Once driven out, the Longbeard clan of dwarves took refuge in The Blue Mountains. Hence the reason the song is called "Far Over the Misty Mountains Cold". In order to reclaim their home and treasure back from Smaug, the dwarves would need to travel *far over* the Misty Mountains.