Merging art and technology: an innovative concept for new worlds of experience
© IWS GmbH, generated with AI
The ‘Immersive MTI’ project aims to create new opportunities for creative and cultural experiences. The aim is to create a flexible framework that makes it easier to design interactive spaces and content. The focus is on innovative projection technologies and the connection between people and technology. The MIREVI (Mixed Reality and Visualisation) team at Düsseldorf University of Applied Sciences is working on this project together with the companies SkySpirit GmbH, tennagels Medientechnik GmbH and Capture-Media-Beteiligungs-GmbH. The project is being funded with around 866,000 euros by the Central Innovation Programme for SMEs (ZIM).
Challenges with immersive installations
Immersive technologies offer many opportunities to combine virtual and real worlds and create interactive experiences. Such installations, e.g. in museums or at art exhibitions, often attract a large audience. However, their planning is complex as they cannot simply be transferred to other spaces.
It becomes particularly challenging when drones are part of the installations. They have to react dynamically to the audience and display content precisely. The aim of the ‘Immersive MTI’ project is to develop a flexible solution that overcomes these challenges and simplifies the realisation of such installations.
Joint implementation of innovative drone and projection technology
The particular challenge of the project lies in the approach of realising highly dynamic, interactive and immersive projections on moving drones in real time and planning and testing these precisely in advance in the modular framework. The project not only involves the technical challenge of precise projection onto curved and moving surfaces, but also the integration of these projections into an interactive environment that reacts to the visitors’ interactions. The combination of real-time data fusion, predictive algorithms and adaptive projection technology clearly sets this project apart from existing solutions.
SkySpirit GmbH is responsible for the development of the autonomous drone swarm. The aim is to project content onto the drones and into the room without delay or distortion. To this end, tennagels Medientechnik GmbH is developing predictive algorithms and adaptive projection methods. In addition, Capture-Media-Beteiligungs-GmbH is using an innovative pipeline to ensure that the projected content is interactive and dynamic through the use of generative AI.
A scalable, camera-based people tracking system is needed to ensure that all components work together seamlessly. The MIREVI (Mixed Reality and Visualisation) team at Düsseldorf University of Applied Sciences is developing a hybrid approach that combines marker-based and markerless full-body tracking in order to involve the audience.
The idea for the ‘Immersive MTI’ project was developed as part of the innovation network AIMECA – Artificial Intelligence in Medical Care. The network is funded by the Central Innovation Programme for SMEs (ZIM). As a member of the network, the partners are actively supported in the implementation and financing of R&D projects. AIMECA is managed by IWS GmbH, which also handles the application management of the cooperation projects and provides intensive support to members in the development of new technologies.
Further information can be found at www.aimeca.net