Reinherit header image

ReInHerit Digital Hub

Facial expression recognition

Referenced webinar(s)

Referenced app(s)

ReInHerit Project

Publication date
April 17, 2023

Terms of reuse
MIT - CC BY 4.0

Share your experience in the ReInHerit chat!

Face landmark recognition is the task of detecting and identifying specific points on a human face, such as the corners of the eyes, the tip of the nose, and the corners of the mouth. MediaPipe is a framework for building multimodal machine learning pipelines, which includes a neural network for face landmark recognition.

The MediaPipe face landmark recognition neural network uses a combination of convolutional neural network (CNN) and regression layers to predict the coordinates of facial landmarks. The network takes as input an image or video frame of a human face and outputs a list of coordinates for each facial landmark.

The ReInHerit toolkit Face-fit app uses the MediaPipe network to understand the pose and expression of users and evaluate how similar they are w.r.t. those depicted in an artwork.

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101004545.

EU commission logo