Bury Mount Motte is the remains of an earthwork motte and bailey fortification or ancient castle, and has been designated a Scheduled Ancient Monument. The Motte probably dates back to the 11th Century when it was a Norman fortification but over time was subject to neglect.