Observatory Tower, Lincoln Castle in Spring. The Observatory Tower almost certainly started as a wooden structure being replaced with stonework in the 12th century. It was extended during the 14th century to square it off and during the early part of the 19th century it was capped with a Victorian turret.