St Mary's Church is the civic church of Bury St Edmunds and is one of the largest parish churches in England. It claims to have the second longest aisle, and the largest West Window of any parish church in the country It was part of the abbey complex and originally was one of three large churches in the town .