I Need Your Sightseeing Advice!

My husband and I are seriously considering our first ever trip to New Orleans.  Unfortunately, it probably won't be a very long visit.  We would most likely drive there (we despise flying unless absolutely necessary) and arrive mid to late Sunday afternoon, and start heading back home on Wednesday morning.  That gives us just under three days to experience New Orleans. 

If you've been there, what sights should be at the top of our list?  Which restaurants do you love?  Is it worth renting bicycles to explore the area?  Is three days enough to get a good "dose" of New Orleans, or should we consider staying one more day?  Please email me any suggestions you have, and thanks in advance for being my de facto travel agent!  😉