Research

Together with our partners, we uncover new capabilities in the VR space by integrating haptics, AI-based speech functionalities, and human-robot-interactions.

VIRTOSHA

The aim of the VIRTOSHA project is to create a virtual reality training environment with haptic feedback for surgical operations on hard and soft tissues.

Together with the Universitätsklinikum Bonn (UKB), TH Cologne, and Haption, MindPort is developing an authoring solution which allows creating surgical VR training simulations that provide realistic haptic feedback to train fine motor skills of aspiring surgeons.

VIRTOSHA is part of the Gesünder.in.NRW EFRE program and funded by the IN.NRW Innovationsförderagentur, the MKW NRW, and the EU with a total budget of €1.5M.

More about VIRTOSHA
A surgeon experimenting with a haptic arm
Artistic visualization of an artificial brain.
Source: Wikimedia
Image license: public domain

Gen-AIvatar

The Rheinische Friedrich-Wilhelms University Bonn and TH Köln – University of Applied Sciences, join forces to drive AI empowered synthesize of animations to a new level. Their ambitious goal: Create a generative AI system capable of creating and editing complex animations on a broad variety of avatars with native inputs such as text prompts and video recordings.

MindPort, consortial leader of this project, is responsible for developing the intuitive user interface which lets users access these powerful capabilities with ease. With our background in VR training, we see this as a key technology to make VR softskill training valuable and affordable, supported by VR Builder.

More about Gen-AIvatar

REACH

REACH provides a holistic authoring system for easy creation of multi-user VR/MR applications, which foster collaboration between real robots and their digital twins.

The REACH consortium of industrial and academic XR experts creates and provides a holistic authoring system for the easy creation of multi-user VR/MR applications, which foster collaboration between real robots and their digital twins. We integrate multimodal interaction like gaze, voice, sound, and visuals for smooth communication with robotic systems and support diverse user roles.

More about REACH
REACH symbol image
A human and a robot meet in VR in an industrial environment

AIXTRA

The aim of AIXTRA is to overcome language barriers in VR and to provide AI-based virtual training partners.

To achieve this goal, we will make VOXReality's AI models for translating and intent recognition available within VR Builder.

Our partner LEFX will create a demo application leveraging those new capabilities to provide interested people with real-world scenarios in VR.

More about AIXTRA

Want to push the limits of VR with us?

Get in Touch!