The SUN project collaborated with the XReco and ViRMA projects to deliver an engaging tutorial, “Multimedia Information Retrieval in XR,” at ACM Multimedia 2024 in Melbourne. This session, held at one of the most prestigious conferences in the multimedia field, offered a look into how immersive technologies are reshaping multimedia search, introducing participants to innovative ways to access and explore multimedia content within Extended Reality (XR).
The tutorial included an overview of advanced retrieval techniques and challenges unique to XR environments, such as new paradigms to query and interact with data. The session also highlighted how XR can enhance collection exploration, allowing users to navigate and analyze multimedia collections in interactive ways, and covered evaluating XR search and exploration by discussing the methods and metrics best suited to assess XR-based retrieval systems.
Live demonstrations offered attendees hands-on experience with systems such as vitrivr-VR, a VR platform for multimedia retrieval; ViRMA, a tool for exploring large media collections in XR; and (MR)2, which enables intuitive, real-world object interactions for initiating queries in Mixed Reality.
This tutorial emphasized how XR is broadening the scope of multimedia retrieval, with SUN at the forefront of creating more connected and interactive ways for users to create and engage with digital content in virtual and physical spaces.
A Special Thanks to Our Organizing Team
The success of this tutorial was made possible by the dedication and expertise of the organizing team: Lucia Vadicamo from the SUN partner CNR-ISTI, along with Rahel Arnold, Ralph Gasser, Heiko Schuldt, Florian Spiess from the University of Basel, Björn Þór Jónsson and Omar Khan from Reykjavik University, and Werner Bailer from Joanneum Research.
