William himself headed north, securing further rebel lands and building castles at Nottingham and York. On his way back south, he did the same at Lincoln, Cambridge and Huntingdon. Slowly but surely, the castle was becoming the symbol of Norman lordship – and the key to controlling the new colony. For castles could be held by a handful of trained men, enabling the small Norman elite to dominate a much larger English population with relative ease.