2018 CCN Workshop: Multidisciplinary Approaches to Understanding Face Perception
ALEIX MARTINEZ, THE OHIO STATE UNIVERSITY
The face of emotion: From faces and emotion to the visual recognition of intent
Abstract:
We now have computer vision algorithms that can successfully segment regions of interest in images and video, recognize faces, objects and scenes, and even create accurate 3D models of them. But how about people’s intent? The recognition of non-verbal behavior, including emotions, is fundamental to humans. Without it, we would constantly misinterpret one another and human societies would be impossible. Yet, computers are unable to read people’s emotion and intent. In this talk, we will address this problem. First, we will identify the mechanisms human’s use to communicate emotion and intent. Second, we will show how to design computer vision and machine learning algorithms that can visually interpret these signals quickly and accurately. A typical mechanism people use to express emotion is the movement of their facial muscles. Thus, we will design algorithms that can identify muscle articulations in face images and videos filmed “in the wild.” Specifically, we will derive algorithms that can recognize more than 8,000 facial configurations and dozens of emotion categories. We will also show an algorithm that can edit a single image of a face to make it express any of these facial configurations and see that these images are indistinguishable from real pictures of facial expressions. We will then note that facial muscle articulations is not the sole mechanism by which people express emotion. When one experiences an emotion, the central nervous system releases hormones. These hormones change the flow and composition of one’s blood. And, these changes, are visible as small variations in facial color, thanks to the closeness of a large number of facial blood vessels to the surface of the skin. We will thus show algorithms that can read emotion using these color variations, even in the absence of any facial muscle movement, e.g., when people attempt to suppress an expression. Finally, we will summarize ongoing work of other behavioral signals that communicate emotion and intent to others, including body pose and kinematics.
Ещё видео!