Johns Hopkins APL Develops Mixed Reality-Based Gesture Detector

Johns Hopkins University Applied Physics Laboratory has created a mixed reality system designed to amplify a person’s facial movement to detect social gestures, emotional signals and other forms of nonverbal communication.

The Mixed Reality Social Prosthesis technology works by overlaying facial imagery with psychophysiological data through the use of Microsoft’s HoloLens holographic platform, APL said Thursday.

The system uses sensors to gather the needed signal data that HoloLens then overlays on a subject’s face.

“The result is dramatic accentuation of subtle changes in the face, including changes that people are not usually aware of, like pupil dilation or nostril flare,” said Ariel Greenberg, APL research scientist.

“The Mixed Reality Social Prosthesis could help train officers to recognize and overcome the impact of stress on perception of emotion,” Greenberg added.

APL noted the technology has potential applications in the law enforcement, intelligence and healthcare areas.

Check Also

Dave Young SVP of Public Sector Lumen Technologies

Executive Spotlight: David Young, SVP of Lumen’s Public Sector, Discusses Rebranding from CenturyLink to Lumen

David Young, senior vice president of Lumen’s Public Sector and global hyperscaler business and a two-time Wash100 Award recipient, recently spoke with ExecutiveBiz regarding CenturyLink’s recent rebranding to Lumen Technologies. He discussed Lumen’s new initiatives, advanced platform for managing data and applications, and work across government agencies to support real-time decision making. 

Persistent Aquatic Living Sensors

DARPA, Three Research Teams Move Into Phase 2 of Marine Bio Sensor Project

Northrop Grumman, Raytheon Technologies and Florida Atlantic University have received contracts to undertake the second phase of a Defense Advanced Research Projects Agency program designed to advance biological sensing concept for underwater vehicle detection and monitoring purposes.


SAS, RTI to Combine Analytics Tech, Research Service for Gov’t Clients

SAS and RTI International have partnered to integrate analytics software products and research services into an comprehensive offering designed to help government customers extract insights from data to perform complex missions.