The Cloisters and the Chapel at Horsley Towers were added by the Earl of Lovelace, to his own designs and have attracted much criticism from the architectural fraternity, no doubt peeved by not being appointed to the work themselves. The arches and supporting pillars are polychrome painted to look like brick.