The difference between Jim's bank and other banks is that other banks are banks.
Jim's bank is made by Jim Kaplan, the Quahog conman. It is rundown, is in a bad neighberhood, and accepts people as collateral. Peter goes here to get a loan.
It is connected to Jim's Tattoo Parlor.