Bah! One man's hobby is another man's complete waste of time. If you have fun doing it and you aren't hurting anyone, I say why should anyone object?
I mean look at the typical person's hobby of sitting in front of the TV watching American Idol. At least at the completion of your hobby you'll be able to speak Elvish. What do they have? A headache and a irrational anger triggered by British accents because they liked the last guy Simon Cowell made cry.
Really one of my hobbies involves gluing and painting small plastic and pewter dwarves for the express purpose of setting them up on minature terrian and simulating battles with them (that is Warhammer Fantasy for those who don't know.) I know many a person who think that is a waste of time. However, I have fun so why should someone else's opinon bother me?