MICC researchers participated in the 15th ACM Multimedia Systems Conference held from 15-18 April, 2024 in Bari, Italy. MMSys 2024 provides a forum to leading researchers from academia and industry to present and share their latest findings in multimedia systems.
MICC presented a DEMO, titled "Context-aware Chatbot using MLLMs for Cultural Heritage, focusing on Multi-modal Large Language Models (MLLMs) that are revolutionizing the way we understand and interact with multimedia content, including in the field of cultural heritage and museums. Existing models face difficulties in accurately answering contextually relevant questions about visual content, limiting their usefulness in applications such as art learning support. Based on work conducted as part of the ReInHerit Toolkit's VIOLA Multimedia Chatbot, the demo presented an innovative approach that integrates contextual descriptions of artworks to improve the answering of visual questions, addressing a crucial need in cultural heritage interpretation. It highlights the need for chatbots that function with scientific accuracy, free of hallucinations, to provide reliable information in the cultural domain.
A great opportunity to present the results achieved to the scientific community, introducing the system architecture, the chatbot dataset, design considerations, discussing possible developments and challenges, following the chatbot test carried out with the community of prominent researchers from around the world attending the Conference.
MMSys 2024 Program https://2024.acmmmsys.org/program/detailed-program/
