You really do. A lot of the most interesting, most charming, most eccentric, and most beautiful parts of the city are kinda hidden away, or off the well-beaten tourist track. I learned a long time ago that when friends come to visit and want to see the city, I’d better know exactly where I’m going, because random cruising won’t take you anywhere particularly interesting unless you know exactly where to go.
There’s a whole lot of great stuff to see, but the sprawl and the strip malls hinder accidental discovery unless you invest a lot of time and effort.