I didn't mean to contest the actual meaning behind the term for you have clearly researched the historical aspect of the word itself, I'm only saying that despite the likely reference Himaruya might have made to this old aristocratic family, it seems a bit forced in my opinion.

However, like I said, Himaruya is the type to get information from the most disparate sources and use them for his works, so it's very much probable.