Scholar's Inn used to be really good, but am not sure if they still have one after the remodel.

If you go North, Woody's in Carmel is awesome, great bloody mary's!

If you go South, Augustino's at Stop 11 and Emerson, really great food and they open at 9a.m.

I can't say enough good things about Cafe Patachou. Their Spring Omelette (ham, brie, terragon, and a ranch-like "Green Goddess" dressing) and cinnamon toast is to die for. Although, I haven't been to the one Downtown, so it might not have quite as much charm as the one at 49th and Penn.

Taste Cafe at 52nd and College has really good brunch items as well. I know that's not exactly Downtown though.

The only other place that comes to mind is Le Peep. Most places only have Brunch on the weekend.