The Old Rectory is on the south side of Broad Street opposite the Golden Lion, as you walk towards All Saints' church,  whose tower is visible through the gate.

The top floor of the rectory was removed  at the end of the second world war. 

When the house was later sold it was replaced as rectory by the Victorian villa  half way up High Street, which has been the Rectory 
ever since.