I don't think that they judged Mr. Darcy harshly, according to the dictates of society at the time he was very rude...however, the expectation that "a single man in possession of good fortune must be in want of a wife"(1), led the family to believe that his attitude was based on a dislike of themselves. This led them to keep a form a long lasting grudge against Mr. Darcy.