[The Saucepan Man]

And then I couldn't think of any other question with him sitting beside me,

That sounds like Bilbo talking about the Riddle Game with Gollum, at the Council of Elrond I would guess.