This light-powered AI can spot deepfakes with nearly 98% accuracy

Researchers at the University of California, Los Angeles (UCLA) have created a new optical-neural processor that uses light to help identify deepfake videos quickly and accurately. Unlike conventional systems that typically examine videos one after another using digital hardware, the UCLA technology can analyze 15 or more video streams at the same time.

The key difference is that part of the detection process takes place through the physical propagation of light. This allows many videos to be evaluated simultaneously during a single optical pass rather than requiring each one to move separately through a conventional digital processing pipeline.

The technology is detailed in the study "Scalable, Energy-Efficient Optical-Neural Architecture for Multiplexed Deepfake Video Detection," published in eLight. The researchers designed the optical AI system to serve as a high-throughput, attack-resilient first layer of defense for screening large amounts of manipulated and AI-generated video.

Rapid improvements in generative AI have made synthetic videos increasingly realistic, increasing the need for detection systems that are both accurate and capable of operating at large scale.

Many advanced deepfake detectors depend on enormous amounts of digital computation. A single analysis can require hundreds of billions of floating-point operations, and videos are often processed sequentially. As more content must be checked, both the processing time and energy requirements can rise proportionally.

Digital detection systems face another problem. Attackers can deliberately alter fake videos in subtle ways designed to confuse a detector and make manipulated footage appear authentic.

Professor Aydogan Ozcan and his UCLA team developed a hybrid digital-optical system intended to address both challenges.

A lightweight digital encoder first collects compact information about each video, including spatial, spectral, and temporal features. That information is transformed into a phase pattern and displayed on a programmable spatial light modulator.

The resulting optical wavefront then travels through a free-space-based, passive optical decoder. At the other end, paired optical detectors directly produce an authenticity score for each video.

In effect, the system replaces a computationally demanding digital decoding network with a physical process that can handle many streams in parallel.

In experiments using visible light, the processor examined 15 Celeb-DF videos simultaneously during each optical pass.

It achieved an average detection accuracy of 97.79%, along with a sensitivity of 99.86% and a specificity of 95.72%. Sensitivity measures how successfully the system identifies manipulated videos, making the particularly high sensitivity important for a screening tool designed to keep fake content from slipping through.