Looking into a local credit union a while ago and the biggest downside was that it seemed like most ATM's wouldn't play nice with them.

Could keep most of your cash savings and things like certificates of deposit (had way better rates than non Credit Union options) in the Credit Union and have a small checking account you keep fed from the Credit Union account so that you can have a cash card that works in more places.