How does the MR-GLi interface work?
MR-GLi is an innovative teleoperation system that uses mixed reality to transmit visual information directly at the gripper level. underwater robot.. Instead of displaying data on a separate screen, the interface assigns the reaction torque indicator and image from the wrist camera to the physical position of the gripper in space. This allows the operator to see how the gripper reacts to forces acting in the underwater environment, exactly where its end is located. This solution eliminates the need to constantly shift attention between the screen and the actual work area.
The system was designed to reduce the operator's cognitive load, especially in situations requiring precise control. The study confirmed that such an assignment of information to the gripper does not negatively affect the quality of torque regulation - the system's performance was comparable to a traditional 2D monitor.
The experiment confirmed its effectiveness and comfort.
Enlarged imageClose zoomPrevious imageA study conducted on twenty participants showed that the MR-GLi interface works as effectively as a classic 2D monitor when performing tasks such as lifting and moving objects - both hard and soft. All tests were carried out within an intergroup experiment with balanced order, which eliminated the influence of the learning effect. Identical visual information content and four-channel bilateral control were used, which ensured a clear comparison.
In subjective assessment, participants noted that MR-GLi reduces the need to shift attention between the work area and the screen. This means that the operator can focus on the task without having to constantly switch between different points of view - crucial in underwater conditions, where precision and speed are critical.
Why might this be important for the future of underwater robotics?
The application of mixed reality in teleoperation is not limited to facilitating access to information - it represents a new concept of interaction between the operator and the machine. When data is directly assigned to a physical element of the robot, a more intuitive and natural form of collaboration is created. This can lead to faster skill acquisition by operators and a reduction in errors under difficult conditions.
The study did, however, find that MR-GLi is not superior in terms of technical performance - its advantage lies in comfort and reduced cognitive load. This means that the system may be particularly useful in long-term missions or in situations requiring high concentration, where operator fatigue is a significant factor.
Limitations and future development directions
The study was conducted under laboratory conditions, which means that its results cannot be automatically generalized to real-world underwater applications. The lack of data on performance in real-world conditions - such as strong currents, limited visibility, or changing lighting conditions - leaves open questions.
In addition, the MR-GLi system requires specialized equipment - mixed reality goggles and precise calibration. This may limit its availability in some applications, especially where access to advanced equipment is not possible. Future research should focus on testing the system in real-world conditions and evaluating its performance with different types of objects and environments.
In the future, the development of MR-GLi-type systems may lead to the creation of more integrated and autonomous teleoperation solutions that not only facilitate operator interaction but also support their decision-making in real time. For example, combining data from underwater sensors and AI analysis could enable automatic warnings of potential gripper damage or difficulties in manipulating objects with unpredictable behavior. Such extensions could significantly increase the safety and efficiency of underwater missions, especially in complex environments such as shipwrecks or offshore installations.
It is also worth noting that although the system currently requires specialized equipment, the development of cheap and lightweight mixed reality goggles may make such solutions accessible to a wider range of users in the future. Therefore, MR-GLi is not just a new interface - it is a step towards a new generation of underwater robotics, where humans and machines collaborate at an intuitive and natural level.
It is worth emphasizing that although the MR-GLi system does not provide higher technical performance compared to a 2D monitor, its real value lies in increasing operator comfort and operational efficiency. In underwater conditions, where every momentary lapse of attention can lead to errors or equipment damage, reducing cognitive load is crucial. Future research should focus on testing the system in complex real-world scenarios - for example, during offshore installation repairs or exploration of shipwrecks - where changing lighting conditions, turbulence, and limited visibility pose additional challenges.