I've never personally cared what other people thought about what I was reading. I read everything from books in Latin (very, VERY slowly mind you) to A Day In The Life of Mugsy. Dr. Suess, heck I've even gone so far as to check out a Stephen King and a scooby-doo mystery at the same time.
I do understand about the stares though, I get a lot of them when I walk around reading Dr. Suess aloud while wearing a big black and white hat with a red bow. The kids love me, the parents, as far as I can tell, are afraid of me. Hehehe Yes it's eccentric but I have friends going to Rocky Horror in full drag, Trekkies who walk around in cadet uniforms just because they can, there's even a few guys I know who dress themselves up as different incarnations of Death for a period of time each day just for fun. At the Ren. Fest we all put on elaborate costumes walking around scraping and bowing, taking pictures, having a riot all the way around.
So I have to say putting on a funny hat and reading silly stories to kids just to make them laugh is pretty tame in comparison. I wish I were brave enough to do some of the more interesting things my friends do. D.