Artificial intelligence is already being used for facial recognition, but how good is it?
In lab conditions, it’s extraordinarily precise, correctly identifying people 99 percent of the time. In the real world, however, things get a little tougher. Bad lighting, sunglasses, clothing, and more can either flummox AI facial recognition systems or lead to false positives. Of course, we already have human forensic facial specialists, and a better understanding of their expertise could help train their computer counterparts.
Read more: “Get Ready to Be Identified by Your Ear”
To investigate, a team of cognitive and AI researchers from the National Institute of Standards and Technology recruited 27 forensic facial experts employed by the federal government. The specialists were given images of two similar faces and one hidden face. The goal was to match the obscured face to one of the other faces by individually removing the coverings from nine different features: cheeks, chin, ears, eyes, eyebrows, forehead, neck, nose, and mouth. A points system incentivized the experts to uncover the fewest possible features and another version of the experiment individually uncovered the features at random.
So how did they do?
According to the study published in PLOS One, they were incredibly accurate, correctly identifying the hidden face 90 percent of the time after uncovering only one or two features. “What surprised me most was that specialists could accurately judge identity from a single facial feature most of the time,” study author Carina Hahn said in a statement. “It’s remarkable how much identity information they can extract from so little.”
Ears, the team found, were the experts’ favorite feature to uncover (and proved to be extremely useful for identification), but they strategically selected other features next as they adapted. Interestingly, along with ears, the seldom-selected foreheads were associated with the highest accuracy (chins and necks were the least helpful). Taken together, the findings are consistent with other research results, which suggest that certain aspects of our faces contain more identifying information than others.
But the adaptability is what stood out to the team. “Specialists have a striking ability to adapt their strategy depending on the face in front of them, rather than applying one fixed rule,” Hahn explained. “The combination of relying on features known to be useful, like ears, with adjusting when needed, hasn’t been documented before.”
Importantly, the team cautions that this experiment doesn’t mimic real-word conditions, nor is it meant to. Instead the findings may be useful for training both human and AI facial specialists in the future. So if you’d like to avoid AI identification going forward, remember to pack your earmuffs.
Enjoying Nautilus? Subscribe to our free newsletter.
Lead Image: Hahn et al., 2026
