There may have been a fortified house on the site of the present building from around 1300. The House of Neville held the manor of Raby from the 13th century. Around the second half of the 14th century the Neville’s began rebuilding several of their properties in the north of England, including Raby Castle between 1367 and 1390. Raby Castle has an irregular plan, with nine towers along its perimeter wall.
