Certain habits that seem normal to readers tend to come across as weird, and even downright creepy to folk who don't read, or aren't as crazy about it as the avowed bibliophiles.
It's no news that book snobbery exists along the fiction vs nonfiction lines. One party is assumed dreamy and unrealistic, while the other is seen as hypocritical.