On the death of Scott’s son Walter in 1847, Abbotsford passed to Scott’s granddaughter, Charlotte.

The daughter of Sophia and John Gibson Lockhart, Charlotte married the barrister James Hope. On inheriting Abbotsford they adopted the surname Hope Scott.

James Hope Scott was an important figure in the Oxford Movement and a close friend of John Henry (later Cardinal) Newman. He and his wife converted to Catholicism in 1851 and built both the Chapel and a new private wing for the family.

James and Charlotte had only one child who survived to adulthood, Mary Monica Hope Scott. Charlotte died in childbirth in 1858 and James died in 1873, having married for a second time in 1861 to Lady Victoria Fitzalan-Howard, daughter of the Duke of Norfolk.