Powderham Castle, eight miles south of Exeter and overlooking the River Exe, has belonged to his ancestors since Hugh de Courteney married Margaret de Bohun, a granddaughter of King Edward I, in 1325. The land upon which the castle is built was a part of her dowry, and the castle was built a generation later by their son, Philip.