ICT Projects
Sentors AR Application
During my internship in the third year of my study I had the pleasure of working with cutting edge technology in the 5G Hub. This The 5G Hub is a cooperation between Brainport Eindhoven, Vodafone Ziggo and Ericcson to explore usecases and possibilities of new 5G technology and present this to customers, business partners, shareholders and other interessted parties.
Within the 5G Hub I worked on a project to show the possibilities of “Edge Computing” with fellow Avans student Levi Vlasblom. Together with a company named Sentors, who specialize in computer vision, we aimed to make an Augmented Reality app using their container ID recognition software. The computer vision calculations needed for recognizing container ID’s would be impractical to include on a mobile phone, especially since latency is a consideration in AR. Therefor, using 5G, it allowed us to stream real time frames from a pair of Nreal AR glasses to a powerfull computer on the edge, and return the results for us to show on these glasses.
The main constraint during this process was that we needed to send frames from the glasses to the computer in realtime from a Unity application (during this time Unity was the only platform supported by Nreal). All other solutions to stream video like this required the feed to buffer. However, in our usecase, buffering frames would result in more latency between looking at an object and seeing the result of the Sentors software. We ended up writing our own bare-bones streaming protocol to accommodate for our required specifications.