If we are to believe the Tale of years:
Quote:
2953
Being jealous and afraid of Gandalf [Saruman] sets spies to watch all his movements; and notes his interest in the Shire. He soon begins to keep agents in Bree and the Southfarthing.
|
Apparently, 2953 is the year when his interest in the Shire began.