Why did God want these places destroyed? Because He wanted there to be no temptation to idolatry; no joining together of the way the people of the land worshipped their god with the way God wanted His people to worship Him. He did not want His way to be diluted by anything that was foreign to His purpose, to His plan. So He specifically designates that there is to be only one place.