Won Hwa Kim

Tracking moving object using Snake’s jump based on image flow

Abstract An active contour model, Snake, was developed as a useful segmenting and tracking tool for rigid or non-rigid (i.e. deformable) objects by Kass in 1987. Snake is designed on the basis of Snake energies. Segmenting and tracking can be executed successfully by the process of energy minimization. The ability to contract is an important process for segmenting objects from images, but the contraction forces of Kass’ Snake are dependent on the object’s form. In this research, new contraction energy, independent of the object’s form, is proposed for the better segmentation of objects. Kass’ Snake can be applied to the case of small changes between images because its solutions can be achieved on the basis of variational approach. If a somewhat fast moving object exists in successive images, Kass’ Snake will not operate well because the moving object may have large differences in its position or form, between successive images. Snake’s nodes may fall into the local minima in their motion to the new positions of the target object in next image. When the motion is too large to apply image flow energy to tracking, a jump mode is proposed for solving the problem. The vector used to make Snake’s nodes jump to the new location can be obtained by processing the image flow. The effectiveness of the proposed Snake is confirmed by some simulations.

Multi-resolution Shape Analysis via Non-Euclidean Wavelets: Applications to Mesh Segmentation and Surface Alignment Problems

The analysis of 3-D shape meshes is a fundamental problem in computer vision, graphics, and medical imaging. Frequently, the needs of the application require that our analysis take a multi-resolution view of the shapes local and global topology, and that the solution is consistent across multiple scales. Unfortunately, the preferred mathematical construct which offers this behavior in classical image/signal processing, Wavelets, is no longer applicable in this general setting (data with non-uniform topology). In particular, the traditional definition does not allow writing out an expansion for graphs that do not correspond to the uniformly sampled lattice (e.g., images). In this paper, we adapt recent results in harmonic analysis, to derive Non-Euclidean Wavelets based algorithms for a range of shape analysis problems in vision and medical imaging. We show how descriptors derived from the dual domain representation offer native multi-resolution behavior for characterizing local/global topology around vertices. With only minor modifications, the framework yields a method for extracting interest/key points from shapes, a surprisingly simple algorithm for 3-D shape segmentation (competitive with state of the art), and a method for surface alignment (without landmarks). We give an extensive set of comparison results on a large shape segmentation benchmark and derive a uniqueness theorem for the surface alignment problem.

Lifelike facial expression of mascot-type robot based on emotional boundaries

Nowadays, many robots have evolved to imitate human social skills such that sociable interaction with humans is possible. Socially interactive robots require abilities different from that of conventional robots. For instance, human-robot interactions are accompanied by emotion similar to human-human interactions, Robot emotional expression is thus very important for humans. This is particularly true for facial expressions, which play an important role in communication amongst other non-verbal forms. In this paper, we introduce a method of creating lifelike facial expressions in robots using variation of affect values which consist of the robots emotions based on emotional boundaries. The proposed method was examined by experiments of two facial robot simulators.

Association of longitudinal white matter degeneration and cerebrospinal fluid biomarkers of neurodegeneration, inflammation and Alzheimer’s disease in late-middle-aged adults

Alzheimer’s disease (AD) is characterized by substantial neurodegeneration, including both cortical atrophy and loss of underlying white matter fiber tracts. Understanding longitudinal alterations to white matter may provide new insights into trajectories of brain change in both healthy aging and AD, and fluid biomarkers may be particularly useful in this effort. To examine this, 151 late-middle-aged participants enriched with risk for AD with at least one lumbar puncture and two diffusion tensor imaging (DTI) scans were selected for analysis from two large observational and longitudinally followed cohorts. Cerebrospinal fluid (CSF) was assayed for biomarkers of AD-specific pathology (phosphorylated-tau/Aβ42 ratio), axonal degeneration (neurofilament light chain protein, NFL), dendritic degeneration (neurogranin), and inflammation (chitinase-3-like protein 1, YKL-40). Linear mixed effects models were performed to test the hypothesis that biomarkers for AD, neurodegeneration, and inflammation, or two-year change in those biomarkers, would be associated with worse white matter health overall and/or progressively worsening white matter health over time. At baseline in the cingulum, phosphorylated-tau/Aβ42 was associated with higher mean diffusivity (MD) overall (intercept) and YKL-40 was associated with increases in MD over time. Two-year change in neurogranin was associated with higher mean diffusivity and lower fractional anisotropy overall (intercepts) across white matter in the entire brain and in the cingulum. These findings suggest that biomarkers for AD, neurodegeneration, and inflammation are potentially important indicators of declining white matter health in a cognitively healthy, late-middle-aged cohort.

Stochastic approach on a simplified OCC model for uncertainty and believability

As robots step into the humans daily lives, interaction and communication between human and robot is becoming essential. For this social interaction with humans, we propose an emotion generation model considering simplicity, believability and uncertainty. First, OCC model is simplified and then stochastic approach on emotion decision algorithm for believability and uncertainty is applied. The proposed model is implemented on a 3D robot expression simulator that can express emotions through its facial expression, gesture, led and so on. A demo of the model is provided as a result.

Synchronized multimodal expression generation using editing toolkit for a human-friendly robot

Attempts to put robots to practical use have been increased, as robots become more human-friendly. In the human-robot interaction field, main issues are how variously the robot can express its emotion and how much the expression is socially acceptable. This paper proposed the editing toolkit which allows us to simulate a 3D model robot in order to express robots emotions and intentions for human-robot interaction and robot services. Using the editing toolkit, we have generated multimodal expressions and formulated the method to combine a few of the primitive expressions. The robot, which we used for simulation, has three modalities such as a facial expression, a neck motion and a gesture with two arms. The expressions of each modality were used for generating multimodal expressions, synchronizing with the time information obtained from a professional actor. Consequently, for three emotions and thirteen intentions of the robot, we have generated primitive expression database set and synchronized multimodal expression using editing toolkit.

Statistical inference models for image datasets with systematic variations

Statistical analysis of longitudinal or cross sectional brain imaging data to identify effects of neurodegenerative diseases is a fundamental task in various studies in neuroscience. However, when there are systematic variations in the images due to parameter changes such as changes in the scanner protocol, hardware changes, or when combining data from multi-site studies, the statistical analysis becomes problematic. Motivated by this scenario, the goal of this paper is to develop a unified statistical solution to the problem of systematic variations in statistical image analysis. Based in part on recent literature in harmonic analysis on diffusion maps, we propose an algorithm which compares operators that are resilient to the systematic variations. These operators are derived from the empirical measurements of the image data and provide an efficient surrogate to capturing the actual changes across images. We also establish a connection between our method to the design of wavelets in non-Euclidean space. To evaluate the proposed ideas, we present various experimental results on detecting changes in simulations as well as show how the method offers improved statistical power in the analysis of real longitudinal PIB-PET imaging data acquired from participants at risk for Alzheimers disease (AD).

Shape tracking based on the modular active shape model

The active contour model was proposed by M. Kass et al. in 1988 for segmentation and tracking of target objects in image space. In their theory some kinds of energies was designed to extract the boundaries of targets by giving higher or lower values of snake energy to them. In ACMs, some basic problems such as weakness to strong surrounding edges, the drift of snaxels due to the changes of illumination conditions and sensitivity to cluttered environments, are still not easy to be overcome in the applications of ACM to real environments. In this paper there are three main contributions. Firstly, the combination of the ACM and the ASM is tried to implement a model-based visual tracking system. Secondly, a systematical approach is proposed to construct a few individual PDMs generated on the basis of the projection relation. Finally, the modular active shape model(MASM) is designed to integrate the results of the PCA on the individually generated PDMs.

The 4D Hyperspherical Diffusion Wavelet: A New Method for the Detection of Localized Anatomical Variation

Recently, the HyperSPHARM algorithm was proposed to parameterize multiple disjoint objects in a holistic manner using the 4D hyperspherical harmonics. The HyperSPHARM coefficients are global; they cannot be used to directly infer localized variations in signal. In this paper, we present a unified wavelet framework that links Hyper-SPHARM to the diffusion wavelet transform. Specifically, we will show that the HyperSPHARM basis forms a subset of a wavelet-based multiscale representation of surface-based signals. This wavelet, termed the hyperspherical diffusion wavelet, is a consequence of the equivalence of isotropic heat diffusion smoothing and the diffusion wavelet transform on the hypersphere. Our framework allows for the statistical inference of highly localized anatomical changes, which we demonstrate in the first-ever developmental study on the hyoid bone investigating gender and age effects. We also show that the hyperspherical wavelet successfully picks up group-wise differences that are barely detectable using SPHARM.

Cerebrospinal fluid biomarkers of neurofibrillary tangles and synaptic dysfunction are associated with longitudinal decline in white matter connectivity: A multi-resolution graph analysis

In addition to the development of beta amyloid plaques and neurofibrillary tangles, Alzheimers disease (AD) involves the loss of connecting structures including degeneration of myelinated axons and synaptic connections. However, the extent to which white matter tracts change longitudinally, particularly in the asymptomatic, preclinical stage of AD, remains poorly characterized. In this study we used a novel graph wavelet algorithm to determine the extent to which microstructural brain changes evolve in concert with the development of AD neuropathology as observed using CSF biomarkers. A total of 118 participants with at least two diffusion tensor imaging (DTI) scans and one lumbar puncture for CSF were selected from two observational and longitudinally followed cohorts. CSF was assayed for pathology specific to AD (Aβ42 and phosphorylated-tau), neurodegeneration (total-tau), axonal degeneration (neurofilament light chain protein; NFL), and synaptic degeneration (neurogranin). Tractography was performed on DTI scans to obtain structural connectivity networks with 160 nodes where the nodes correspond to specific brain regions of interest (ROIs) and their connections were defined by DTI metrics (i.e., fractional anisotropy (FA) and mean diffusivity (MD)). For the analysis, we adopted a multi-resolution graph wavelet technique called Wavelet Connectivity Signature (WaCS) which derives higher order representations from DTI metrics at each brain connection. Our statistical analysis showed interactions between the CSF measures and the MRI time interval, such that elevated CSF biomarkers and longer time were associated with greater longitudinal changes in white matter microstructure (decreasing FA and increasing MD). Specifically, we detected a total of 17 fiber tracts whose WaCS representations showed an association between longitudinal decline in white matter microstructure and both CSF p-tau and neurogranin. While development of neurofibrillary tangles and synaptic degeneration are cortical phenomena, the results show that they are also associated with degeneration of underlying white matter tracts, a process which may eventually play a role in the development of cognitive decline and dementia.