Envisioning waterway operations with immersive Apple Vision Pro data visualisation
De Vlaamse Waterweg nv is responsible for sustainable, dynamic and commercial management of the waterways in Flanders. Considering their vast amounts of operational data and fragmented information across multiple platforms and systems, the operators struggled to use the data effectively and keep it well-organised. Through an innovative Apple Vision Pro proof-of-concept, we showcased an immersive and intuitive solution to how operators might interact with the data in a more actionable way.
De Vlaamse Waterweg nv generates vast amount of data, but it’s fragmented and difficult to manage.
An immersive Apple Vision Pro experience consolidating multiple data streams into a 3D environment.
User-centred design process combining spatial computing capabilities with operational needs.
Proof-of-concept as an inspiration on how AR/VR technology can make operations be more data-driven.
01 — CHALLENGE
Managing complex operations in a fragmented data environment
De Vlaamse Waterweg nv gathers vast amounts of data across their operations, but much of it is still siloed, underutilised or inaccessible. In this specific use case an operator monitors and manages extensive the waterway networks, handling everything from ship traffic to infrastructure maintenance.
The existing setup required an operator to:
- Monitor multiple screens showing different data streams
- Mentally piece together information from separate systems
- Switch between various interfaces to understand the full picture
- Make quick decisions without complete situational awareness
This fragmented approach could limit their ability to grasp the bigger picture in real-time, decreasing situational awareness and the access to the relevant data.
02 — SOLUTION
Visualising the value of data
In this proof-of-concept, co-funded by the EU, we developed an Apple Vision Pro application that would showcase a more immersive and multi-layered approach on how an operator could interact with waterway data. We chose the Apple Vision Pro over other devices because of its advanced eye tracking and high-quality displays, which enhance the overall user experience and interaction. Instead of static dashboards or 2D monitors, an operator would explore data in 3D, with the flexibility to move between scenes, zoom in for details, and interact with the environment using intuitive gestures.
The Apple Vision Pro could help the operator transition from data overload to data immersion by providing:
- Consolidated view: Multiple data streams merged into one immersive 3D
- EnvironmentIntuitive navigation: Natural gestures for moving between macro and micro views
- Contextual information: Real-time data overlaid directly onto relevant locations
- Flexible visualisation: Easy switching between different data layers and perspectives
03 — APPROACH
Merging data streams into one environment and workflow
Our proof-of-concept development process focused on three key areas:
Data research:
- Identifying data that is currently present within the organisation and could prove useful for operators
Interface design:
- Developing intuitive gesture controls
- Creating clear visual hierarchy for data layers
- Bringing accurate rendering of the surrounding areas
Technical implementation:
- Building scalable data architecture
- Implementing eye-tracking and gesture controls
- Creating framework for future API integration
A major advantage of using immersive technology is its ability to consolidate multiple screens into one. This feature would help De Vlaamse Waterweg nv operators shift easily between separate systems to monitor traffic, weather, and infrastructure, or, potentially, have the available data in a single 3D interface. The bird’s-eye view perfectly provides an overarching perspective, while zooming in offers granular insights. By merging these data streams into one environment and workflow, users would be able to more quickly get a grasp of the situation on the ground.
04 — OUTCOME
Translating complex data into action points with Apple Vision Pro
In this interactive and immersive AR/VR proof-of-concept, users are presented with a top-down view of Belgium’s waterways, with visual highlights of key cities and operational zones managed by De Vlaamse Waterweg nv. This map offers a macro view of how waterways and infrastructure are connected, enabling users to identify potential issues immediately. Zooming into the specific areas, the app shifts from a broad view to a detailed environment. Here, they can view layers of data, from live webcam feeds and ship movements to environmental data and infrastructure details. This 3D approach allows operators to easily switch between different data points, offering more context and clarity than a traditional 2D interface.
Users can examine ship routes, traffic density, bridge heights, and even hydro-meteorological conditions, all from a single, intuitive interface. The ability to interact with real-time and historical data in such a fluid manner demonstrates how Apple Vision Pro could help translate complex data into action points.
In developing this proof-of-concept, we learned valuable lessons about how AR/VR technologies have a tremendous potential to help organisations reimagine the way they work:
- Intuitive interaction: The use of eye-tracking and pinch-to-zoom gestures allows users to navigate the application effortlessly. This natural interaction reduces the learning curve and makes the application immediately accessible to a wide range of users.
- Future-proofing with APIs: While the proof-of-concept uses hardcoded data, it is designed with the future in mind. By maintaining a consistent data structure, it can easily integrate with live APIs, allowing real-time data streaming into the AVP interface.
