The brick built castle was constructed between 1434 to 1445 by Ralph Cromwell, Lord Treasurer to Henry VI and replaced an earlier 13th century castle. After the death of Lord Cromwell the property passed to the Crown and then to the Earls of Lincoln. In 1911 it was. bought by Lord Curzon who restored the tower and who, in 1926, bequeathed the castle to the National Trust.