Michael Krone

Interactive Visualization of Molecular Surface Dynamics

Molecular dynamics simulations of proteins play a growing role in various fields such as pharmaceutical, biochemical and medical research. Accordingly, the need for high quality visualization of these protein systems raises. Highly interactive visualization techniques are especially needed for the analysis of time-dependent molecular simulations. Beside various other molecular representations the surface representations are of high importance for these applications. So far, users had to accept a trade-off between rendering quality and performance - particularly when visualizing trajectories of time-dependent protein data. We present a new approach for visualizing the solvent excluded surface of proteins using a GPU ray casting technique and thus achieving interactive frame rates even for long protein trajectories where conventional methods based on precomputation are not applicable. Furthermore, we propose a semantic simplification of the raw protein data to reduce the visual complexity of the surface and thereby accelerate the rendering without impeding perception of the proteins basic shape. We also demonstrate the application of our solvent excluded surface method to visualize the spatial probability density for the protein atoms over the whole period of the trajectory in one frame, providing a qualitative analysis of the protein flexibility.

Fast Visualization of Gaussian Density Surfaces for Molecular Dynamics and Particle System Trajectories

We present an efficient algorithm for computation of surface representations enabling interactive visualization of large dynamic particle data sets. Our method is based on a GPU-accelerated data-parallel algorithm for computing a volumetric density map from Gaussian weighted particles. The algorithm extracts an isovalue surface from the computed density map, using fast GPU-accelerated Marching Cubes. This approach enables interactive frame rates for molecular dynamics simulations consisting of millions of atoms. The user can interactively adjust the display of structural detail on a continuous scale, ranging from atomic detail for in-depth analysis, to reduced detail visual representations suitable for viewing the overall architecture of molecular complexes. The extracted surface is useful for interactive visualization, and provides a basis for structure analysis methods.

MegaMol—A Prototyping Framework for Particle-Based Visualization

Visualization applications nowadays not only face increasingly larger datasets, but have to solve increasingly complex research questions. They often require more than a single algorithm and consequently a software solution will exceed the possibilities of simple research prototypes. Well-established systems intended for such complex visual analysis purposes have usually been designed for classical, mesh-based graphics approaches. For particle-based data, however, existing visualization frameworks are too generic - e.g. lacking possibilities for consistent low-level GPU optimization for high-performance graphics - and at the same time are too limited - e.g. by enforcing the use of structures suboptimal for some computations. Thus, we developed the system softwareMegaMol for visualization research on particle-based data. On the one hand, flexible data structures and functional module design allow for easy adaption to changing research questions, e.g. studying vapors in thermodynamics, solid material in physics, or complex functional macromolecules like proteins in biochemistry. Therefore, MegaMol is designed as a development framework. On the other hand, common functionality for data handling and advanced rendering implementations are available and beneficial for all applications. We present several case studies of work implemented using our system as well as a comparison to other freely available or open source systems.

Interactive exploration of protein cavities

We present a novel application for the interactive exploration of cavities within proteins in dynamic data sets. Inside a protein, cavities can often be found close to the active center. Therefore, when analyzing a molecular dynamics simulation trajectory it is of great interest to find these cavities and determine if such a cavity opens up to the environment, making the binding site accessible to the surrounding substrate. Our user‐driven approach enables expert users to select a certain cavity and track its evolution over time. The user is supported by different visualizations of the extracted cavity to facilitate the analysis. The boundary of the protein and its cavities is obtained by means of volume ray casting, where the volume is computed in real‐time for each frame, therefore allowing the examination of time‐dependent data sets. A fast, partial segmentation of the volume is applied to obtain the selected cavity and trace it over time. Domain experts found our method useful when they applied it exemplarily on two trajectories of lipases from Rhizomucor miehei and Candida antarctica. In both data sets cavities near the active center were easily identified and tracked over time until they reached the surface and formed an open substrate channel.

GPU-powered tools boost molecular visualization

Recent advances in experimental structure determination provide a wealth of structural data on huge macromolecular assemblies such as the ribosome or viral capsids, available in public databases. Further structural models arise from reconstructions using symmetry orders or fitting crystal structures into low-resolution maps obtained by electron-microscopy or small angle X-ray scattering experiments. Visual inspection of these huge structures remains an important way of unravelling some of their secrets. However, such visualization cannot conveniently be carried out using conventional rendering approaches, either due to performance limitations or due to lack of realism. Recent developments, in particular drawing benefit from the capabilities of Graphics Processing Units (GPUs), herald the next generation of molecular visualization solutions addressing these issues. In this article, we present advances in computer science and visualization that help biologists visualize, understand and manipulate large and complex molecular systems, introducing concepts that remain little-known in the bioinformatics field. Furthermore, we compile currently available software and methods enhancing the shape perception of such macromolecular assemblies, for example based on surface simplification or lighting ameliorations.

Atomistic Visualization of Mesoscopic Whole‐Cell Simulations Using Ray‐Casted Instancing

Molecular visualization is an important tool for analysing the results of biochemical simulations. With modern GPU ray casting approaches, it is only possible to render several million of atoms interactively unless advanced acceleration methods are employed. Whole‐cell simulations consist of at least several billion atoms even for simplified cell models. However, many instances of only a few different proteins occur in the intracellular environment, which can be exploited to fit the data into the graphics memory. For each protein species, one model is stored and rendered once per instance. The proposed method exploits recent algorithmic advances for particle rendering and the repetitive nature of intracellular proteins to visualize dynamic results from mesoscopic simulations of cellular transport processes. We present two out‐of‐core optimizations for the interactive visualization of data sets composed of billions of atoms as well as details on the data preparation and the employed rendering techniques. Furthermore, we apply advanced shading methods to improve the image quality including methods to enhance depth and shape perception besides non‐photorealistic rendering methods. We also show that the method can be used to render scenes that are composed of triangulated instances, not only implicit surfaces.

Object-space ambient occlusion for molecular dynamics

In many different application fields particle-based simulation, like molecular dynamics, are used to study material properties and behavior. Nowadays, simulation data sets consist of millions of particles and thousands of time steps challenging interactive visualization. Direct glyph-based representations of the particle data are important for the visual analysis process and these rendering methods can be optimized to be able to work sufficiently fast with huge data sets. However, the perception of the implicit spatial structures formed by such data is often hindered by aliasing and visual clutter. Especially the depth of these structures can be grasped better if visual cues are applied, even in interactive representations. We hence present a method to apply object-space ambient occlusion, based on local neighborhood information, to large timedependent particle-based data sets without the need for any precomputations. Based on density information collected in real-time, glyph-based representations of the data sets can be visually enhanced without significant impact on the rendering performance allowing to visualize multi-million particle data sets interactively on commodity workstations.

Visualization of Biomolecular Structures: State of the Art

Structural properties of molecules are of primary concern in many fields. This report provides a comprehensive overview on techniques that have been developed in the fields of molecular graphics and visualization with a focus on applications in structural biology. The field heavily relies on computerized geometric and visual representations of three-dimensional, complex, large, and time-varying molecular structures. The report presents a taxonomy that demonstrates which areas of molecular visualization have already been extensively investigated and where the field is currently heading. It discusses visualizations for molecular structures, strategies for efficient display regarding image quality and frame rate, covers different aspects of level of detail, and reviews visualizations illustrating the dynamic aspects of molecular simulation data. The report concludes with an outlook on promising and important research topics to enable further success in advancing the knowledge about interaction of molecular structures.

Parallel Contour-Buildup algorithm for the molecular surface

Molecular Dynamics simulations are an essential tool for many applications. The simulation of large molecules — like proteins — over long trajectories is of high importance e. g. for pharmaceutical, biochemical and medical research. For analyzing these data sets interactive visualization plays a crucial role as details of the interactions of molecules are often affected by the spatial relations between these molecules. From the large range of visual representations for such data, molecule surface representations are of high importance as they clearly depict geometric interactions, such as docking or substrate channel accessibility. However, these surface visualizations are computationally demanding and thus pose a challenge for interactive visualization of time-dependent data sets. We propose an optimization of the Contour-Buildup algorithm for the Solvent Excluded Surface (SES) to remedy this issue. An optimized subdivision of calculation tasks of the original algorithm allows for full utilization of massive parallel processing hardware. Our approach is especially well suited for modern graphics hardware employing the CUDA programming language. As we do not rely on any pre-computations our method is intrinsically applicable to time-dependent data with arbitrarily long trajectories. We are able to visualize the SES for molecules with up to ten thousand atoms interactively on standard consumer graphics cards.

Interactive extraction and tracking of biomolecular surface features

We present a coordinated‐view application for the analysis of molecular surface features like cavities, channels and pockets. Our tool employs object‐space ambient occlusion for the detection of such features and tracks them over time. It offers time‐dependent graphs of metrics concerning those features and allows analyzing the temporal relationship of the features, i.e. when they (dis)appear, split or merge and which features participate in each of these events. The automated analysis process is performed in real time while the user interactively explores a dynamic data set. The system supports linking and brushing to allow for a user‐guided visual analysis based on different aspects of the data. We demonstrate the effectiveness of our approach by applying it to data sets from biochemistry and report the insights that can be gained. We also evaluate the benefits of our method with respect to recent advancements in the field. The algorithmic pipeline leverages the computing power of modern GPUs, thus achieving interactive frame rates without any precomputation for fully dynamic data sets.