I say do everything in moderation.
of course not including vices or anything.
i really get annoyed at conservative chrisitian schools i know (back in the philippines) saying that pokemon, D&D are devils work. I get really angry when people say that brainwashing stupid beliefs.
its the same as arcades if you ask me. like you said.. its a pasttime, and a hobby. its not like we are woshiping it like a cult or anything.