Although I'm a New Yorker, will add in two places that I particularly loved in Baltimore.

First is Faidley's, a seafood shop located in Lexington Market downtown. Tremendous fresh crabcakes. There are multiple types, but it's worth it to "splurge" and get the lump type (which I believe is a higher percentage of crab versus other things). It's won numerous awards and although I'm not a crabcake expert, it was wonderful.
Since it's in the middle of a market, it's extremely casual (sort of like at a mall, where you get the food, then find a bench to sit in), so not advised for first dates or anything requiring anything formal.
Their website (as of time of this writeup) is at http://www.lexingtonmarket.com/ShopPages/Faidley/

Next is Attman's Delicatessen on 1019 East Lombard Street. Comparable to any "Jewish" New York deli. Good food, big sandwiches, and "old-time deli" atmosphere.
Note of warning here: Attman's is in a bit of a rundown area of town, so be careful.

Happy eating.