Joseph Martin was born about 1740 and married Elizabeth Winder in October 1763.  Described as a gentleman from Downe they moved to Hayes Grove in 1773.  Their son Joseph William was born 9 August 1776 and baptised in Hayes Church.

Joseph was keen to extend the grounds of his new house and he was granted permission to enclose about one acre of Hayes Common which bordered his shrubbery and garden.  Charles Kadwell said that here he planted the avenue of lime trees, some of which survive today. 

He died at the young age of 36 on 8 April 1777 leaving his widow his estate which in addition to Hayes Grove included three crofts and annuities worth £5700. His widow Elizabeth remarried first  William Pickard and then Edward Robinson.  His son Joseph William Martin was ordained in 1800 and became Rector of Keston where he died 12 November 1858.