Cavendish inherited two fortunes that were so large that Jean Baptiste Biot called him "the richest of all the savants and the most knowledgeable of the rich". At his death, Cavendish was the largest depositor in the Bank of England. He was a shy man who was uncomfortable in society and avoided it when he could. He could speak to only one person at a time, and only if the person were known to him and male.[31] He conversed little, always dressed in an old-fashioned suit, and developed no known deep personal attachments outside his family. Cavendish was taciturn and solitary and regarded by many as eccentric. He communicated with his female servants only by notes. By one account, Cavendish had a back staircase added to his house to avoid encountering his housekeeper, because he was especially shy of women. The contemporary accounts of his personality have led some modern commentators, such as Oliver Sacks, to speculate that he had Asperger syndrome,[32] a form of autism.