Biomedicine: Digital OP - Digital Scrubs at the Research Center

Biomedicine: Digital OP - Digital Scrubs

project

Interpersonal and multimodal attention assistance system for context-sensitive, neuroergonomic human-machine interaction in networked operating theatres

background

Networked operating theatres in which artificial intelligence is used will be able to provide more and more information in the future. However, in order for surgical teams to be able to use this flood of information profitably, they must always resort to a limited resource, that is their attention.

research

The consortium of the DIGITAL SCRUBS project is therefore researching, developing and evaluating for the first time an attention assistance system for neuroergonomic human-technology interaction in networked operating theatres. AI-supported attention assistance with a generic interface to surgical technology is intended to reduce the cognitive load and fatigue of surgical teams. In this way, it is intended to demonstrably improve the quality of medical interventions. The interpersonal AI assistant presents information in particular through an augmented reality (AR) system for the senses of seeing, hearing and feeling. This information is adapted to the work to be performed and the receptiveness of the surgical team. The researchers communicate transparently with the target group of the system and involve them in the development at an early stage.

task

The tasks of the ZeMA focus on the creation of a microservice-based representation of the digital operating room. For this purpose, a modular design of the system is developed for flexible use that can be adapted to different surgical scenarios. Microservice architectures and multi-layer communication technologies are used to network devices and assistance systems.
The field of human-machine/human-robot interaction plays an important role in the OR, as well as the integration of IoT devices and sensors in the demonstrator setup for the safe and real-time handling of heterogeneous data in the decentralized networked OR.

Photo gallery - Digital OP - Digital Scrubs