It was changing its size as it's bearers changed. I mean, hobbits fingers must be smaller, right? But it fitted Bilbo, and it fitted Isildur
It would not have shrinked itself away if Sauron never got it. But it's influence was not pwerful when Sauron was weak. I mean, Gollum had it for 5 centuries and was not completely bad
