There’s absolutely nothing wrong with finding breasts or the female body attractive, of course. You are definitely not alone in that. :) But look at the way people who are attracted to men look at the male chest. We might look and admire it, but it isn’t considered lewd and something that must be covered, nor does it imply sexual invitation. That’s the difference, for me. That’s the kind of treatment the female body deserves. Sure, look and admire (without making a scene), and that’s that. Just the way you are describing in your own experience.
Thanks, Ken!