A Law Firm You Can Trust

Lawyer Ranking and Rating Sites: Why They Are Problematic

With 228 million adult internet users in the United States, it is no surprise that people are using the internet to find lawyers when they need them.  And entrepreneurs did not miss a beat; lawyer ranking/rating sites (to be referred to as “lawyer evaluation sites”) have become not only common, but trusted by consumers and legal professionals.  However, these sites misrepresent themselves as being driven by the desire to educate consumers when in fact they are driven by profits.

Upon investigating lawyer evaluation websites, their flawed and self-interested processes for calculating their rankings/ratings becomes abundantly clear; however, where they explain the methodology behind their evaluations is not on pages consumers would generally look.  Three lawyer evaluation websites held in high esteem in the law community that are particularly guilty of this are Avvo, Super Lawyers, and U.S. News & World Report’s Best Law Firms.

Avvo
Avvo creates and hosts profiles for lawyers.  Lawyer profiles contain background information about lawyers gathered by Avvo, and possibly given to Avvo by the lawyers themselves.  Lawyer information is entered into Avvo’s secret algorithm to produce the Avvo rating.  Avvo refuses to release how the information is weighted in their algorithm and freely admits that the way in which information is weighted is based solely on Avvo’s opinion.

Additionally, the way for lawyers to fully utilize the marketing capabilities of Avvo is for them to pay a monthly fee, and buy “Display Ads” and “Sponsored Listings.”  Profiles of whose who pay for these options are seen substantially more often by consumers than those who do not.

The problem with Avvo:

Super Lawyers
Super Lawyers is a lawyer rating publisher that determines the best lawyers in a given state.  According to their website, lawyers deemed “Super Lawyers” and “Rising Star” are highly regarded by the law community for their perfessional achievement.  Super Lawyers publishes Super Lawyers and Rising Stars lists, as well as ads lawyers pay for, in their magazines and special sections in other magazines throughout the country.

Super Lawyers lists are the top 5 percent of lawyers in each state and Rising Stars lists are the top 2.5 percent of lawyers in each state; both are based on the criteria established by Super Lawyers.  Super Lawyers’ lists are determined by 4 steps.  Their first step is to determine who will be in their pool of candidates; this is based on any one of the following: formal nominations by peers, research conducted by attorneys employed by Super Lawyers, and informal nominations. Though Super Lawyers claims to implement “safe guards” to prevent “back scratching,” what lengths they go to in order to protect the integrity of votes is not publicized.  The second step is to assess candidates in the pool based on 12 Super Lawyers’ determined criteria; their criteria is simply stated and not expanded beyond that.  The third step, which is skipped in the Rising Star determination, is for those candidates rated highest in their area of practice to evaluate candidates that are rated lower than them.  In the fourth step, those candidates that rated the highest when compared to others who belong to a firm of the same size are selected to be Super Lawyers or Rising Stars.  Information to be published and lawyer backgrounds are supposedly further researched to ensure accuracy.

The problem with Super Lawyers:

U.S. News and World Report’s “Best Law Firms”
Joined with Best Lawyers, U.S. News and World Report (USNWR) annually releases a ranked list of the top law firms in the United States.  Rankings are determined by surveying various law-related groups in the U.S.; the methodology behind their surveys is listed on their website. Their surveys were developed by sending a primary set of surveys to various groups in the law community to determine what factors are relevant in evaluating a law firm’s quality.  The surveys they developed are sent to selected groups in the law community annually to determine law firms’ rank.  The following are the details of the surveys according to their website, as well as questions relevant to evaluating the “Best Law Firms” lists:

  1. Client surveys are sent to 52,480 clients.
  2. Lawyer surveys are sent to 43,900 lawyers, including every U.S. lawyer listed in Best Lawyers.
  1. Surveys are sent to 2,314 marketing officers and 2,322 recruiting officers.
  1. Surveys are sent to 8,597 firms without marketing- or recruiting-office contacts.
  2. Associate surveys are sent to 2,322 firm associates and 1,775 summer associates.

Those chosen represent only a small fraction of the law community; a question relevant to all of the surveys is how and why those surveyed were chosen.

The problem with USNWR:

The Investigation
The American Board Association (ABA) was prompted to investigate lawyer evaluation services by the House of Delegates in 2010.  The investigation’s purpose was to determine if the questionable methods said services use to determine a lawyer’s or law firms rating/ranking are causing harm to people who use their services.  The ABA’s Commission on Ethics 20/20 (ABACE) concluded the investigation in August of 2011; it claimed that it found no evidence of an obvious problem.  The ABA admitted that evidence of lawyer evaluation sites affecting the public or law community was absent altogether.  The absence of evidence is due to lawyer evaluation services being relatively new.  As a result, no research has been done to understand how they affect the public.  The ABA also stated that it was not willing to hire the experts such research would require.

The bottom line:  Ultimately, the investigation was pointless.  Its purpose was to determine if harm is being done but no research has been conducted, so no evidence exists.  And the ABA is not willing to change that.

An experienced car accident lawyer will be able to assist you if you’ve been a victim of a car accident.

Call for a
FREE consultation
800-969-7022

FREE CONSULTATION

Complete the form below and your case
will be reviewed for FREE within 15 MINS!





 

As Seen On