We've all seen the eye-rolls, the mocking smiles and heard the patronizing comments from Fantasy Haters out there, but I've never had some hoser on the train, bus or subway snatch my book like that when I'm PTR (Public Transit Reading) Personally, I feel sorry for folk like that. In the end, they just don't know what they are missing.
I agree that if that jackass read MoI, he'd be a fan and would be apologizing to you toot-sweet. BTW, MoI will make you laugh, wet your pants and cry all at once

And that's the whole way through it! Now, while I am blessed (Probably by Oponn) to be surrounded by some great fantasy lovers; my girl and best friend are big nerds like me:), I have still dealt with the ignorant masses that just don't get fantasy nor sci-fi. And while I agree, that there were alot of DnD novels out there that were crap (But still hold a special place for me, since they got me into fantasy) I think that for the most part, the stigma comes instead from a lack of experience with the genres.
For example; My sister has always been notorious for her dislike of Sci-Fi and Fantasy. She thinks LotR is stupid and held Star Wars in the same regard, but don't fret fellow nerds, there is hope. When Revenge of the Sith came out, I was shocked, SHOCKED! when my sister asked me if I'd go with her to the theaters to see it. Of course, I was more then happy too. Since then, she has even seen the new Star Trek movie (trust me, Star Trek got the most heat from her) and its one of her favourite movies now. But, that probably has a lot to do with my tastes rubbing off on her, maybe not though.
We are seeing Fantasy and Sci-Fi becoming more of a staple then either genre has ever been in the past. Movies like LotR and Star Trek are loved be fans of both series' and genres and by those who aren't.
But, there will always be ignorant folk out there, who feel an overwhelming need to redirect their feelings of inadequacy towards people that are fans of something that they are not. Is it society? Maybe. But I think this is a case of...douchebag is as douchebag does.
Pity him my friend, because he is missing out on some works that would probably change his life for the better