Hongyu Miao

On Identifiability of Nonlinear ODE Models and Applications in Viral Dynamics

Ordinary differential equations (ODE) are a powerful tool for modeling dynamic processes with wide applications in a variety of scientific fields. Over the last 2 decades, ODEs have also emerged as a prevailing tool in various biomedical research fields, especially in infectious disease modeling. In practice, it is important and necessary to determine unknown parameters in ODE models based on experimental data. Identifiability analysis is the first step in determing unknown parameters in ODE models and such analysis techniques for nonlinear ODE models are still under development. In this article, we review identifiability analysis methodologies for nonlinear ODE models developed in the past one to two decades, including structural identifiability analysis, practical identifiability analysis and sensitivity-based identifiability analysis. Some advanced topics and ongoing research are also briefly reviewed. Finally, some examples from modeling viral dynamics of HIV, influenza and hepatitis viruses are given to illustrate how to apply these identifiability analysis methods in practice.

Quantifying the Early Immune Response and Adaptive Immune Response Kinetics in Mice Infected with Influenza A Virus

ABSTRACT Seasonal and pandemic influenza A virus (IAV) continues to be a public health threat. However, we lack a detailed and quantitative understanding of the immune response kinetics to IAV infection and which biological parameters most strongly influence infection outcomes. To address these issues, we use modeling approaches combined with experimental data to quantitatively investigate the innate and adaptive immune responses to primary IAV infection. Mathematical models were developed to describe the dynamic interactions between target (epithelial) cells, influenza virus, cytotoxic T lymphocytes (CTLs), and virus-specific IgG and IgM. IAV and immune kinetic parameters were estimated by fitting models to a large data set obtained from primary H3N2 IAV infection of 340 mice. Prior to a detectable virus-specific immune response (before day 5), the estimated half-life of infected epithelial cells is ∼1.2 days, and the half-life of free infectious IAV is ∼4 h. During the adaptive immune response (after day 5), the average half-life of infected epithelial cells is ∼0.5 days, and the average half-life of free infectious virus is ∼1.8 min. During the adaptive phase, model fitting confirms that CD8+ CTLs are crucial for limiting infected cells, while virus-specific IgM regulates free IAV levels. This may imply that CD4 T cells and class-switched IgG antibodies are more relevant for generating IAV-specific memory and preventing future infection via a more rapid secondary immune response. Also, simulation studies were performed to understand the relative contributions of biological parameters to IAV clearance. This study provides a basis to better understand and predict influenza virus immunity.

Simulation and Prediction of the Adaptive Immune Response to Influenza A Virus Infection

ABSTRACT The cellular immune response to primary influenza virus infection is complex, involving multiple cell types and anatomical compartments, and is difficult to measure directly. Here we develop a two-compartment model that quantifies the interplay between viral replication and adaptive immunity. The fidelity of the model is demonstrated by accurately confirming the role of CD4 help for antibody persistence and the consequences of immune depletion experiments. The model predicts that drugs to limit viral infection and/or production must be administered within 2 days of infection, with a benefit of combination therapy when administered early, and cytotoxic CD8 T cells in the lung are as effective for viral clearance as neutralizing antibodies when present at the time of challenge. The model can be used to investigate explicit biological scenarios and generate experimentally testable hypotheses. For example, when the adaptive response depends on cellular immune cell priming, regulation of antigen presentation has greater influence on the kinetics of viral clearance than the efficiency of virus neutralization or cellular cytotoxicity. These findings suggest that the modulation of antigen presentation or the number of lung resident cytotoxic cells and the combination drug intervention are strategies to combat highly virulent influenza viruses. We further compared alternative model structures, for example, B-cell activation directly by the virus versus that through professional antigen-presenting cells or dendritic cell licensing of CD8 T cells.

Parameter identifiability and estimation of HIV/AIDS dynamic models.

Abstract We use a technique from engineering (Xia and Moog, in IEEE Trans. Autom. Contr. 48(2):330–336, 2003; Jeffrey and Xia, in Tan, W.Y., Wu, H. (Eds.), Deterministic and Stochastic Models of AIDS Epidemics and HIV Infections with Intervention, 2005) to investigate the algebraic identifiability of a popular three-dimensional HIV/AIDS dynamic model containing six unknown parameters. We find that not all six parameters in the model can be identified if only the viral load is measured, instead only four parameters and the product of two parameters (N and λ) are identifiable. We introduce the concepts of an identification function and an identification equation and propose the multiple time point (MTP) method to form the identification function which is an alternative to the previously developed higher-order derivative (HOD) method (Xia and Moog, in IEEE Trans. Autom. Contr. 48(2):330–336, 2003; Jeffrey and Xia, in Tan, W.Y., Wu, H. (Eds.), Deterministic and Stochastic Models of AIDS Epidemics and HIV Infections with Intervention, 2005). We show that the newly proposed MTP method has advantages over the HOD method in the practical implementation. We also discuss the effect of the initial values of state variables on the identifiability of unknown parameters. We conclude that the initial values of output (observable) variables are part of the data that can be used to estimate the unknown parameters, but the identifiability of unknown parameters is not affected by these initial values if the exact initial values are measured with error. These noisy initial values only increase the estimation error of the unknown parameters. However, having the initial values of the latent (unobservable) state variables exactly known may help to identify more parameters. In order to validate the identifiability results, simulation studies are performed to estimate the unknown parameters and initial values from simulated noisy data. We also apply the proposed methods to a clinical data set to estimate HIV dynamic parameters. Although we have developed the identifiability methods based on an HIV dynamic model, the proposed methodologies are generally applicable to any ordinary differential equation systems.

Sieve Estimation of Constant and Time-Varying Coefficients in Nonlinear Ordinary Differential Equation Models by Considering Both Numerical Error and Measurement Error.

This article considers estimation of constant and time-varying coefficients in nonlinear ordinary differential equation (ODE) models where analytic closed-form solutions are not available. The numerical solution-based nonlinear least squares (NLS) estimator is investigated in this study. A numerical algorithm such as the Runge-Kutta method is used to approximate the ODE solution. The asymptotic properties are established for the proposed estimators considering both numerical error and measurement error. The B-spline is used to approximate the time-varying coefficients, and the corresponding asymptotic theories in this case are investigated under the framework of the sieve approach. Our results show that if the maximum step size of the p-order numerical algorithm goes to zero at a rate faster than n(-1/(p∧4)), the numerical error is negligible compared to the measurement error. This result provides a theoretical guidance in selection of the step size for numerical evaluations of ODEs. Moreover, we have shown that the numerical solution-based NLS estimator and the sieve NLS estimator are strongly consistent. The sieve estimator of constant parameters is asymptotically normal with the same asymptotic co-variance as that of the case where the true ODE solution is exactly known, while the estimator of the time-varying parameter has the optimal convergence rate under some regularity conditions. The theoretical results are also developed for the case when the step size of the ODE numerical solver does not go to zero fast enough or the numerical error is comparable to the measurement error. We illustrate our approach with both simulation studies and clinical data on HIV viral dynamics.

Ultrasonic excitation of a bubble inside a deformable tube: Implications for ultrasonically induced hemorrhage

Various independent investigations indicate that the presence of microbubbles within blood vessels may increase the likelihood of ultrasound-induced hemorrhage. To explore potential damage mechanisms, an axisymmetric coupled finite element and boundary element code was developed and employed to simulate the response of an acoustically excited bubble centered within a deformable tube. As expected, the tube mitigates the expansion of the bubble. The maximum tube dilation and maximum hoop stress were found to occur well before the bubble reached its maximum radius. Therefore, it is not likely that the expanding low pressure bubble pushes the tube wall outward. Instead, simulation results indicate that the tensile portion of the acoustic excitation plays a major role in tube dilation and thus tube rupture. The effects of tube dimensions (tube wall thickness 1-5 microm), material properties (Youngs modulus 1-10 MPa), ultrasound frequency (1-10 MHz), and pressure amplitude (0.2-1.0 MPa) on bubble response and tube dilation were investigated. As the tube thickness, tube radius, and acoustic frequency decreased, the maximum hoop stress increased, indicating a higher potential for tube rupture and hemorrhage.

Differential Equation Modeling of HIV Viral Fitness Experiments : Model Identification, Model Selection, and Multimodel Inference

Many biological processes and systems can be described by a set of differential equation (DE) models. However, literature in statistical inference for DE models is very sparse. We propose statistical estimation, model selection, and multimodel averaging methods for HIV viral fitness experiments in vitro that can be described by a set of nonlinear ordinary differential equations (ODE). The parameter identifiability of the ODE models is also addressed. We apply the proposed methods and techniques to experimental data of viral fitness for HIV-1 mutant 103N. We expect that the proposed modeling and inference approaches for the DE models can be widely used for a variety of biomedical studies.

RegNetwork: an integrated database of transcriptional and post-transcriptional regulatory networks in human and mouse

Transcriptional and post-transcriptional regulation of gene expression is of fundamental importance to numerous biological processes. Nowadays, an increasing amount of gene regulatory relationships have been documented in various databases and literature. However, to more efficiently exploit such knowledge for biomedical research and applications, it is necessary to construct a genome-wide regulatory network database to integrate the information on gene regulatory relationships that are widely scattered in many different places. Therefore, in this work, we build a knowledge-based database, named ‘RegNetwork’, of gene regulatory networks for human and mouse by collecting and integrating the documented regulatory interactions among transcription factors (TFs), microRNAs (miRNAs) and target genes from 25 selected databases. Moreover, we also inferred and incorporated potential regulatory relationships based on transcription factor binding site (TFBS) motifs into RegNetwork. As a result, RegNetwork contains a comprehensive set of experimentally observed or predicted transcriptional and post-transcriptional regulatory relationships, and the database framework is flexibly designed for potential extensions to include gene regulatory networks for other organisms in the future. Based on RegNetwork, we characterized the statistical and topological properties of genome-wide regulatory networks for human and mouse, we also extracted and interpreted simple yet important network motifs that involve the interplays between TF-miRNA and their targets. In summary, RegNetwork provides an integrated resource on the prior information for gene regulatory relationships, and it enables us to further investigate context-specific transcriptional and post-transcriptional regulatory interactions based on domain-specific experimental data. Database URL: http://www.regnetworkweb.org

Modeling antiretroviral drug responses for HIV-1 infected patients using differential equation models

We review mathematical modeling and related statistical issues of HIV dynamics primarily in response to antiretroviral drug therapy in this article. We start from a basic model of virus infection and then review a number of more advanced models with consideration of pharmacokinetic factors, adherence and drug resistance. Specifically, we illustrate how mathematical models can be developed and parameterized to understand the effects of long-term treatment and different treatment strategies on disease progression. In addition, we discuss a variety of parameter estimation methods for differential equation models that are applicable to either within- or between-host viral dynamics.

Estimation of constant and time-varying dynamic parameters of HIV infection in a nonlinear differential equation model

Modeling viral dynamics in HIV/AIDS studies has resulted in deep understanding of pathogenesis of HIV infection from which novel antiviral treatment guidance and strategies have been derived. Viral dynamics models based on nonlinear differential equations have been proposed and well developed over the past few decades. However, it is quite challenging to use experimental or clinical data to estimate the unknown parameters (both constant and time-varying parameters) in complex nonlinear differential equation models. Therefore, investigators usually fix some parameter values, from the literature or by experience, to obtain only parameter estimates of interest from clinical or experimental data. However, when such prior information is not available, it is desirable to determine all the parameter estimates from data. In this paper, we intend to combine the newly developed approaches, a multi-stage smoothing-based (MSSB) method and the spline-enhanced nonlinear least squares (SNLS) approach, to estimate all HIV viral dynamic parameters in a nonlinear differential equation model. In particular, to the best of our knowledge, this is the first attempt to propose a comparatively thorough procedure, accounting for both efficiency and accuracy, to rigorously estimate all key kinetic parameters in a nonlinear differential equation model of HIV dynamics from clinical data. These parameters include the proliferation rate and death rate of uninfected HIV-targeted cells, the average number of virions produced by an infected cell, and the infection rate which is related to the antiviral treatment effect and is time-varying. To validate the estimation methods, we verified the identifiability of the HIV viral dynamic model and performed simulation studies. We applied the proposed techniques to estimate the key HIV viral dynamic parameters for two individual AIDS patients treated with antiretroviral therapies. We demonstrate that HIV viral dynamics can be well characterized and quantified for individual patients. As a result, personalized treatment decision based on viral dynamic models is possible.