Shader Development and User Interface Design for 3D Scientific Visualization in VR Headset
College:
The Dorothy and George Hennings College of Science, Mathematics, and Technology
Major:
Computational Science & Engineering
Faculty Research Advisor(s):
David Joiner
Abstract:
This research introduces an innovative user interface tailored specifically for the visualization of three-dimensional (3D) hyper stack images obtained through confocal microscopy. Focused on specimens like pollen grains and fruit fly stem cells, the interface uses virtual reality (VR) technology to deliver volumetric renditions of hyper stack images, employing transparency to enrich the viewing experience within VR headset environments. Core functionalities include seamless manipulation of x, y, and z cut-planes for navigation through image layers while upholding data integrity. Leveraging advanced shader techniques, users can dynamically adjust transparency, rotation, and color enhancements directly through VR headset controllers. Moreover, an interactive menu facilitates further customization through sliders, checkboxes, and the exploration of data through other types of manipulation using different shapes and functions. This visualization tool not only aids in validating object detection algorithms for cell counting but also contributes to building a comprehensive database of 3D pollen grain images. The operation has been tested on Oculus Quest 2, 3 and pro headsets.