's-Graveland, Rebuilding Westerveld House, H.J. Vermey