Well, in the Silm it is told there were originally seven Dwarven cities: two in the Blue Mountains, called Belegost and Nogrod, Moria in the Misty Mountains and four more further East.
As you may remember from the Hobbit, Thorin c.s. came from his mines in the leftovers of the Blue Mountains (though Belegost and Nogrod were destroyed at the end of the First Age). Also, there lived Dwarves to the East of Erebor, in the Iron Mountains, who came to help Thorin in the Battle of the Five Armies.
More can be read in one of the HoME volumes; can't recall at the moment which volume, though. You can also have a look at
The Encyclopedia of Arda, lemma 'dwarves' in the Alphabetical Index.