Interesting thoughts on this topic! I just read the corresponding chapter in Hammond and Scull's LotR Reader's Companion to prepare for the chapter discussion (which will be posted today) on the Chapter-by-Chapter sub-forum. The real life source of the TB character was indeed a "colourful Dutch doll owned by the Tolkien children, dressed exactly as Tom is described". The name may have been chosen by one of the children, they speculate; the character existed long before he found his way into Middle-earth and LotR. The story began as an oral tale, then Tolkien wrote a long poem which can be read in The Adventures of Tom Bombadil.
I agree that he (along with the Old Forest and Barrow-downs) is an essential part of the story, even if he can be removed from it when it is adapted and abbreviated. As the Hobbits go on their journey, they build "adventure muscles", so to speak, starting with smaller and less immediate dangers, being rescued (and building up their own courage to defend themselves!) while still close to home, and finding safe havens even while in the Shire or close to its borders. Without those, I think the large-scale adventures and dangerous foes that come later would have been too difficult for them to handle. There is a progression throughout the journey, and removing one step leaves stumbling blocks along the way.
__________________
'Mercy!' cried Gandalf. 'If the giving of information is to be the cure of your inquisitiveness, I shall spend all the rest of my days in answering you. What more do you want to know?' 'The whole history of Middle-earth.. .'
|