I like the idea of making the locations of the palantiri only known to a few, but I suggest a slight change to make it sound better to my ears:
... That was guarded by the Elves, and though NKD-SL-04d{we never}[very few] knew it, it remained there, until Círdan put it aboard Elrond’s ship when he left. ...
|