In 1796 the bishop married, secondly, Mary Vyse, daughter of William Vyse of Lichfield and sister of William Vyse (17411816), archdeacon of Coventry.