Is Facebook's Facial Recognition Software Racist?

Loki Morgan

My first experience with Facebook's facial recognition software was an odd one. I was uploading pictures of my son's kindergarten graduation when Facebook grouped several faces together and offered suggestions. Facebook's facial recognition program is meant to help you tag friends by automatically analyzing pictures when they are uploaded and suggesting who those people might be, allowing for easier tagging. If you find this creepy and want no part of it, you must opt out by changing your account settings.

My son goes to a very diverse school which is one of the reasons I love it so much. I cannot say whether Facebook's facial recognition software messed up so badly because most of the people in the pictures were graduating from kindergarten and therefore likely did not have Facebook profiles, or whether the facial recognition program has a technical problem. What I can tell you is that the results I was given after uploading my photos were strange.

The first odd thing I noticed was that Facebook suggested to me that my son was actually my husband. At first I was shocked to see my husband's name suggested next to my son's isolated face. If I didn't think the facial recognition system was creepy before, this cemented it in my mind. It does technically make sense though when you know that there have been many times I have tagged my husband on pictures of my son in order for the pictures to display on my husband's wall. One mystery solved.

The second odd occurrence is what prompted me to ask whether Facebook's facial recognition software is racist. The majority of the Asian faces were lumped together even though they were different kids. Chinese and Korean children were identified as being the same person. Likewise, there were a few Latino children that were suggested by Facebook as being the same person. Even stranger, the same child was listed as being more than one person. Interestingly enough, the children who were the most Caucasian seemed to be picked up correctly. Black children also were identified correctly. Gender did not seem to matter to Facebook, as both girls and boys were impacted.

Is Facebook's facial recognition software saying that all Asian kids look alike? Perhaps the facial recognition software was not developed to identify the faces of children. Could it have been the distance to the stage, or the celebratory lighting that caused this anomaly? I cannot say for certain. Facebook's facial recognition software is so new that at this point it is hard to tell. I am interested in reading about whether other Facebook users are finding the same results.

What have your experiences been with Facebook's facial recognition software?

More from Loki Morgan:

Facebook Privacy and Friend Fails

Guidelines for Creating Your Child's First Email Address

FBI Hacks Infected Computers to Stop Coreflood Botnet

Published by Loki Morgan - Featured Contributor in Technology

Loki Morgan is a Microsoft Certified Professional with over ten years experience in the Information Technology field including technical writing. Morgan has published online content with a focus on compute...  View profile

6 Comments

Post a Comment
  • Sarah McEleney8/16/2011

    Wow, this is creepy...

  • Adam Justice6/25/2011

    I do know that facial recognition software relies more on the distances between features such as eyes, mouth and ears than it does shape or depth. It's also likely the very first filter used to narrow possible matches is color. You can eliminate large swaths of possibilities easily by filtering by color, so I would say it most definately uses race in it's matching algorithms.

  • Harriet Steinberg6/24/2011

    I'm not familiar with this, but I'm sure it is a glitch.

  • Bill Hanks6/24/2011

    :)

  • rmharrington6/24/2011

    I too am not familiar with this software, but you can bet I will avoid it. Scary. Scary. Scary.

  • Michele Starkey6/24/2011

    I am not familiar with FB's recognition software but I have had similar findings with other recognition software programs so it may be a global glitch! cheers ;)

Displaying Comments

To comment, please sign in to your Yahoo! account, or sign up for a new account.