Reinherit header image

ReInHerit Digital Hub

Chatbot and Cultural Heritage – DEMO at ACM Multimedia Systems Conference 2024

ReInHerit Project

Publication date
April 18, 2024

Terms of reuse
MIT - CC BY 4.0

Share your experience in the ReInHerit chat!

MMSys 2024

MICC researchers participated in the 15th ACM Multimedia Systems Conference held from 15-18 April, 2024 in Bari, Italy. MMSys 2024 provides a forum to leading researchers from academia and industry to present and share their latest findings in multimedia systems.  

MMSys 2024

MICC presented a DEMO, titled "Context-aware Chatbot using MLLMs for Cultural Heritage, focusing on Multi-modal Large Language Models (MLLMs) that are revolutionizing the way we understand and interact with multimedia content, including in the field of cultural heritage and museums. Existing models face difficulties in accurately answering contextually relevant questions about visual content, limiting their usefulness in applications such as art learning support. Based on work conducted as part of the ReInHerit Toolkit's VIOLA Multimedia Chatbot, the demo presented an innovative approach that integrates contextual descriptions of artworks to improve the answering of visual questions, addressing a crucial need in cultural heritage interpretation. It highlights the need for chatbots that function with scientific accuracy, free of hallucinations, to provide reliable information in the cultural domain.

A great opportunity to present the results achieved to the scientific community, introducing the system architecture, the chatbot dataset, design considerations, discussing possible developments and challenges, following the chatbot test carried out with the community of prominent researchers from around the world attending the Conference.

MMSys 2024

MMSys 2024 Program

MMSys 2024

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101004545.

EU commission logo