Is it Bilbo and the rabbits Gollum catches? The trolls and eagles certainly think he is one...
I feel like the 'speculation' is likely quite insulting, and possibly relating to an animal. Sort of like Treebeard saying that he thought Merry and Pip were little Orcs, but again he doesn't get specific.
hS