Reinherit header image

ReInHerit Digital Hub

Face-Fit - Description

Referenced webinar(s)

Author(s)
ReInHerit Project

Publication date
February 07, 2023

Terms of reuse
MIT - CC BY 4.0

Share your experience in the ReInHerit chat!

Face-Fit

Face-fit asks the user to replicate an artwork, concentrating on facial expressions that require a much more refined matching. The application invites the users to replicate the pose of the head and the expression of some portraits by famous painters and transfer the face of the user on the artworks, generating a new image.

The goal of this application is to challenge the user to analyze and replicate artworks with their own face a obtaining information on the artworks that are replicated and personalized artwork representations that can be shared on social networks.

Face -Fit

Example:  Face-Fit

Example: Matching the expression with artworks and generation of the image merging the user face in the artwork. The image is emailed with info on artwork to the user. 

Face-Fit

The innovative application promotes a user-centred and gamification approach, a process of exploiting game strategies and dynamics in non-game scenarios. It has already been proved to be useful to enhance skills and competences in a variety of domains such as marketing, industry training and entertainment. Also cultural heritage can benefit from a gamification approach which represents an opportunity to engage visitors to museums contents through the design of more entertaining, social and challenging digital learning scenarios, to help museums to move from the traditional “look and do not touch” toward a “play and interact” approach.

Face-Fit - User Interaction during a test at ACM Multimedia 2022

Face-Fit - User Interaction during a test at ACM Multimedia 2022

This app won a Best Demo Honorable Mention award at ACM Multimedia 2022, the foremost conference on multimedia.

Best Demo Honorable Mention award at ACM Multimedia 2022

Face-Fit is an application developed in JavaScript and Python which provides gamification and personalization on painting, in particular portraits, adapting their visual content. The application designed both for mobile devices and in installations allows to replicate the pose of the head and the expression of some portraits by famous painters and transfer the face of the user on the artworks, generating a new image.

Discover and test

Gallery images are part of WikiArt -Visual Art Encyclopedia. DEMO version also includes limited selection of artworks provided by museums participating in the ReinHerit project (GrazMuseum, Museum of Cycladic Art, Bank of Cyprus Cultural Foundation). In addition, through collaboration with curators of small and medium-sized museums, the gallery has been populated with images of artworks and additional contents provided by Fondazione Musei Senesi IT, Giara Gipsoteca di Arte Antica e Antiquarium University of Pisa IT, Musei Civici di Reggio Emilia IT, Museo Capitolare Diocesano Foligno IT.

Demo is available at this link (using Chrome or Firefox browser):
https://reinherit-facefit.hero​kuapp.com 

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101004545.

EU commission logo