Augmented Reality in Oculus (2013)
After we got our first Oculus DK1, we attached two cameras to it and built ourselvs an augmented reality HMD. On the software side we connected it to our own raycasting renderer and fed preprocessed medical data from our multimodal stitching software. Presented below, are the results from stitching CT and segmented vascular structures from MRI data:
Multi-kinect pose tracking and fusion (2012-2013)
We did research on fusion of uncertain data from multiple Kinect devices. Data from different cameras, connected to individual computers, was gathered using local network to the central machine, that did the stiching. Our system was tested in configuration of 2 up to 5 cameras and it worked in multiuser settings. This setup allowed widening the work area and was much more immune to overlap situations than individual Kinect cameras, while being much cheaper then motion capture system and didn’t need special markers. It was easy to setup since it had autocalibration function. System was also resiliant to removing or adding cameras while the system was running.
Some of our findings were published in:
Rutkowski Andrzej, Michał Meina, and Michał Chlebiej. “Human pose fusion for scalable kinetic interfaces.” 2013 6th International Conference on Human System Interactions (HSI). IEEE, 2013.
Experiments with natural user interfaces in medical data exploration (2012)
We played with natural interaction using Kinect device connected to stereo-projection system . At the time Kinect was lacking hand-grab gesture detection, so the the whole interaction was based on hover-clicking and gesture detection.
Interactive projection mapping for Bella Skyway 2019
This work was done in cooperation with Tomasz Wlaźlak (who was responsible for the game idea and artwork). It was an interactive projection mapping, presented on the walls of Collegium Maximum in Toruń, Poland. The game, written on top of Unity Game Engine, was running on a single PC that rendered two video streams, pushed to two huge projectors mounted on the tower. Game was controller by passerbys and attendees of Bella Skyway Festival.
