Shelley N. Facente

Independent assessment of candidate HIV incidence assays on specimens in the CEPHIA repository

Objective:Cross-sectional HIV incidence surveillance, using assays that distinguish ‘recent’ from ‘nonrecent’ infections, has been hampered by inadequate performance and characterization of incidence assays. In this study, the Consortium for the Evaluation and Performance of HIV Incidence Assays presents results of the first independent evaluation of five incidence assays (BED, Limiting Antigen Avidity, Less-sensitive Vitros, Vitros Avidity and BioRad Avidity). Design:A large repository of diverse specimens from HIV-positive patients was established, multiple assays were run on 2500 selected specimens, and data were analyzed to estimate assay characteristics relevant for incidence surveillance. Methods:The mean duration of recent infection (MDRI, average time ‘recent’ while infected for less than some time cut-off T) was estimated from longitudinal data on seroconverters by regression. The false-recent rate (FRR, probability of testing ‘recent’ when infected for longer than T) was explored by measuring the proportions of ‘recent’ results in various subsets of patients. Results:Assays continue to fail to attain the simultaneously large MDRI and small FRR demanded by existing performance guidelines. All assays produce high FRRs amongst virally suppressed patients (>40%), including elite controllers and treated patients. Conclusions:Results from this first independent evaluation provide valuable information about the current performance of assays, and suggest the need for further optimization. Variation of ‘recent’/‘nonrecent’ thresholds and the use of multiple antibody-maturation assays, as well as other biomarkers, can now be explored, using the rich data generated by the Consortium for the Evaluation and Performance of HIV Incidence Assays. Consistently high FRRs amongst those virally suppressed suggest that viral load will be a particularly valuable supplementary marker. Video abstract:http://links.lww.com/QAD/A569

Post-marketing surveillance of OraQuick whole blood and oral fluid rapid HIV testing.

Objective:Post-marketing surveillance was conducted to monitor the performance of the OraQuick Advance rapid HIV-1/2 antibody test (OraQuick) on whole blood and oral fluid. Design:Surveillance of routinely collected data on clients tested with OraQuick in 368 testing sites affiliated with 17 state and city health departments between 11 August 2004 and 30 June 2005. Methods:For whole blood and oral fluid, we report the median (range) health department OraQuick specificity and positive predictive value (PPV), and the number of clients with discordant results (e.g. who had a reactive rapid test not confirmed positive by Western blot or indirect immunofluorescence). At one site with lower than expected oral-fluid specificity, we evaluated whether device expiration, manufacturing lot, operator practices, or device-storage or testing-area temperatures were associated with false-positive tests. Results:During the surveillance period, 135 724 whole blood and 26 066 oral fluid rapid tests were conducted. The median health department whole blood OraQuick specificity was 99.98% (range: 99.73–100%) and PPV was 99.24% (range: 66.67–100%); the median oral fluid specificity was 99.89% (range: 99.44–100%) and PPV was 90.00% (range: 50.00–100%). A total of 124 discordant results were reported from 68 (0.05%) whole blood and 56 (0.22%) oral fluid rapid tests. The oral fluid specificity at the site with excess oral fluid false-positive tests was 98.7% (95% confidence interval: 98.18–99.11%). The increase in false-positive tests at that site was not associated with any specific device characteristic, operator procedure or temperature condition. Conclusion:The specificity of OraQuick performed on whole blood and oral fluid during post-marketing surveillance was compatible with the manufacturers claim within the package insert. However, one site experienced lower than expected oral fluid specificity. Sites that observe that the specificity of OraQuick is lower than the range indicated in the package insert should notify the manufacturer and evaluate quality assurance procedures.

Performance of rapid point-of-care and laboratory tests for acute and established HIV infection in San Francisco

Background Current laboratory and point-of-care tests for HIV detect different analytes and use different sample types. Some have fast turnaround times (<1 hour). We investigated how HIV test choice could impact case finding by testing programs. Methods We analyzed 21,234 consecutive HIV tests with venous blood obtained by San Francisco HIV testing programs from 2003 to 2008. For a subset, oral fluid (n = 6446) or fingerstick blood (n = 8127) samples were also obtained for rapid testing. In all cases, HIV status was determined using an HIV antibody-plus-RNA test algorithm. We assessed how the screening antibody tests performed individually versus the gold standard of the full algorithm. We then evaluated the potential ability of other tests (including new tests) to detect more cases, by re-testing all specimens that had negative/discrepant antibody results on initial screening. Findings The antibody-RNA algorithm identified 58 acute and 703 established HIV infection cases. 1st-generation (Vironostika) and 3rd-generation (Genetic Systems) immunoassays had 92 and 96 percent sensitivity, respectively. The Oraquick rapid test had clinical sensitivity of only 86 percent on oral fluid samples, but 92 percent on finger-stick blood. Newer 4th-generation, antigen-antibody combo rapid immunoassay (ARCHITECT) detected HIV in 87 percent of all the acute cases that had been missed by one of the previous screening assays. A point-of-care 4th generation antigen-antibody combo rapid test (Determine) detected about 54 percent of such acute cases. Conclusions Our study suggests that some rapid antibody blood tests will give similar case detection to laboratory antibody tests, but that oral fluid testing greatly reduces ability to detect HIV. New 4th-generation combo tests can detect the majority of acute infections detectable by HIV RNA but with rapid results. Using these tests as a primary screening assay in high-risk HIV testing programs could reduce or eliminate the need for HIV RNA testing.

Performance of Risk-Based Criteria for Targeting Acute HIV Screening in San Francisco

Background Federal guidelines now recommend supplemental HIV RNA testing for persons at high risk for acute HIV infection. However, many rapid HIV testing sites do not include HIV RNA or p24 antigen testing due to concerns about cost, the need for results follow-up, and the impact of expanded venipuncture on clinic flow. We developed criteria to identify patients in a municipal STD clinic in San Francisco who are asymptomatic but may still be likely to have acute infection. Methods Data were from patients tested with serial HIV antibody and HIV RNA tests to identify acute HIV infection. BED-CEIA results were used to classify non-acute cases as recent or longstanding. Demographics and self-reported risk behaviors were collected at time of testing. Multivariate models were developed and preliminarily evaluated using predictors associated with recent infection in bivariate analyses as a proxy for acute HIV infection. Multivariate models demonstrating ≥70% sensitivity for recent infection while testing ≤60% of patients in this development dataset were then validated by determining their performance in identifying acute infections. Results From 2004–2007, 137 of 12,622 testers had recent and 36 had acute infections. A model limiting acute HIV screening to MSM plus any one of a series of other predictors resulted in a sensitivity of 83.3% and only 47.6% of patients requiring testing. A single-factor model testing only patients reporting any receptive anal intercourse resulted in 88.9% sensitivity with only 55.2% of patients requiring testing. Conclusions In similar high risk HIV testing sites, acute screening using “supplemental” HIV p24 antigen or RNA tests can be rationally targeted to testers who report particular HIV risk behaviors. By improving the efficiency of acute HIV testing, such criteria could facilitate expanded acute case identification.

Viral load criteria and threshold optimization to improve HIV incidence assay characteristics

Objective:Assays for classifying HIV infections as ‘recent’ or ‘nonrecent’ for incidence surveillance fail to simultaneously achieve large mean durations of ‘recent’ infection (MDRIs) and low ‘false-recent’ rates (FRRs), particularly in virally suppressed persons. The potential for optimizing recent infection testing algorithms (RITAs), by introducing viral load criteria and tuning thresholds used to dichotomize quantitative measures, is explored. Design:The Consortium for the Evaluation and Performance of HIV Incidence Assays characterized over 2000 possible RITAs constructed from seven assays (Limiting Antigen, BED, Less-sensitive Vitros, Vitros Avidity, BioRad Avidity, Architect Avidity, and Geenius) applied to 2500 diverse specimens. Methods:MDRIs were estimated using regression, and FRRs as observed ‘recent’ proportions, in various specimen sets. Context-specific FRRs were estimated for hypothetical scenarios. FRRs were made directly comparable by constructing RITAs with the same MDRI through the tuning of thresholds. RITA utility was summarized by the precision of incidence estimation. Results:All assays produce high FRRs among treated patients and elite controllers (10–80%). Viral load testing reduces FRRs, but diminishes MDRIs. Context-specific FRRs vary substantially by scenario – BioRad Avidity and Limiting Antigen provided the lowest FRRs and highest incidence precision in scenarios considered. Conclusion:The introduction of a low viral load threshold provides crucial improvements in RITAs. However, it does not eliminate nonzero FRRs, and MDRIs must be consistently estimated. The tuning of thresholds is essential for comparing and optimizing the use of assays. The translation of directly measured FRRs into context-specific FRRs critically affects their magnitudes and our understanding of the utility of assays.

False Positive Rate of Rapid Oral Fluid HIV Tests Increases as Kits Near Expiration Date

Background Because a recent cluster of false positive results on the OraQuick ADVANCE® Rapid HIV-1/2 Antibody Test occurred in San Francisco on test kits close to their expiration date, we decided to assess the relationship between time to expiration and rate of false positive results from tests used with oral fluid. Methodology/Principal Findings We analyzed results of 20,904 tests with either an initial HIV-negative result (n = 20,828) or a preliminary positive result that was then negative on confirmatory tests (n = 76). We computed specificity for kits with time to expiration from ≤1 to ≥6 months, with exact binomial confidence intervals, then used logistic regression to estimate the independent association of time to expiration with false positive results, adjusting for site and technician effects. For 1,108 kits used in the last month before expiration, specificity was 98.83% (95% exact binomial confidence interval (CI) 98.00%–99.37%); the upper bound is below the claimed specificity of 99.60%. After adjustment using regression standardization for the effects of site, test lot, and technician factors, adjusted specificity in the last month before expiration was 99.18% (95% bootstrap confidence interval 98.60–99.57%). Conclusions/Significance We found that specificity of the OraQuick ADVANCE® with oral fluid declined significantly with ≤1 month remaining to expiration, leaving little margin for error from other sources.

Performance of the Bio-Rad Geenius HIV1/2 Supplemental Assay in Detecting "Recent" HIV Infection and Calculating Population Incidence.

Objective:HIV seroconversion biomarkers are being used in cross-sectional studies for HIV incidence estimation. Bio-Rad Geenius HIV-1/2 Supplemental Assay is an immunochromatographic single-use assay that measures antibodies (Ab) against multiple HIV-1/2 antigens. The objective of this study was to determine whether the Geenius assay could additionally be used for recency estimation. Design:This assay was developed for HIV-1/2 confirmation; however, quantitative data acquired give information on increasing concentration and diversity of antibody responses over time during seroconversion. A quantitative threshold of recent HIV infection was proposed to determine “recent” or “nonrecent” HIV infection; performance using this cutoff was evaluated. Methods:We tested 2500 highly characterized specimens from research subjects in the United States, Brazil, and Africa with well-defined durations of HIV infection. Regression and frequency estimation were used to estimate assay properties relevant to HIV incidence measurement: mean duration of recent infection (MDRI), false-recent rate, and assay reproducibility and robustness. Results:Using the manufacturers proposed cutoff index of 1.5 to identify “recent” infection, the assay has an estimated false-recent rate of 4.1% (95% CI: 2.2 to 7.0) and MDRI of 179 days (155 to 201) in specimens from treatment-naive subjects, presenting performance challenges similar to other incidence assays. Lower index cutoffs associated with lower MDRI gave a lower rate of false-recent results. Conclusions:These data suggest that with additional interpretive analysis of the band intensities using an algorithm and cutoff, the Geenius HIV-1/2 Supplemental Assay can be used to identify recent HIV infection in addition to confirming the presence of HIV-1 and HIV-2 antibodies.

HIV Antibody Level as a Marker of HIV Persistence and Low-Level Viral Replication

Background Human immunodeficiency virus (HIV) antibodies are generated and maintained by ongoing systemic expression of HIV antigen. We investigated whether HIV antibody responses as measured by high-throughput quantitative and qualitative assays could be used to indirectly measure persistent HIV replication in individuals receiving antiretroviral therapy (ART). Methods HIV antibody responses were measured over time in the presence or absence of suppressive ART and were compared to the HIV reservoir size and expression of antiviral restriction factors. Results Among untreated individuals, including both elite controllers (ie, persons with a viral load of ≤40 copies/mL) and noncontrollers, antibody parameters were stable over time and correlated with the individual viral load. Viral suppression with ART led to a progressive decline in antibody responses after treatment induction that persisted for 5-7 years. Higher levels of HIV antibodies during suppressive therapy were associated with later initiation of ART after infection, with higher DNA and cell-associated RNA levels, and with lower expression of multiple anti-HIV host restriction factors. Discussion These findings suggest that declining antibody levels during ART reflect lower levels of antigen production and/or viral replication in the persistent HIV reservoir. Results of relatively inexpensive and quantitative HIV antibody assays may be useful indirect markers that enable efficient monitoring of the viral reservoir and suppression during functional-cure interventions.

Comparison of cross-sectional HIV incidence assay results from dried blood spots and plasma

Background Assays have been developed for cross-sectional HIV incidence estimation using plasma samples. Large scale surveillance programs are planned using dried blood spot (DBS) specimens for incidence assessment. However, limited information exists on the performance of HIV cross-sectional incidence assays using DBS. Methods The assays evaluated were: Maxim HIV-1 Limiting Antigen Avidity EIA (LAg-Avidity), Sedia HIV-1 BED-Capture EIA (BED-CEIA), and CDC modified BioRad HIV-1/2 Plus O Avidity-based Assay (CDC-BioRad Avidity) using pre-determined cutoff values. 100 matched HIV-1 positive plasma and DBS samples, with known duration of infection, from the Consortium for the Evaluation and Performance of HIV Incidence Assays repository were tested. All assays were run in duplicate. To examine the degree of variability within and between results for each sample type, both categorical and continuous results were analyzed. Associations were assessed with Bland Altman, R2 values and Cohen’s kappa coefficient (ĸ). Results Intra-assay variability using the same sample type was similar for all assays (R2 0.96 to 1.00). The R2 values comparing DBS and plasma results for LAg-Avidity, BED-CEIA, and CDC-BioRad Avidity were 0.96, 0.94, and 0.84, respectively. The concordance and ĸ values between DBS and plasma for all three assays were >87% and >0.64, respectively. The Bland-Altman analysis showed significant differences between plasma and DBS samples. For all three assays, a higher number of samples were classified as recent infections using DBS samples. Conclusions DBS and plasma sample results were highly correlated. However, when compared to plasma, each assay performed somewhat differently in DBS at the lower and higher ends of the dynamic range. DBS samples were more likely to be classified as recently infected by all three assays, which may lead to overestimation of incidence in surveys using performance criteria derived for plasma samples.

Computational analysis of antibody dynamics identifies recent HIV-1 infection.

Accurate HIV-1 incidence estimation is critical to the success of HIV-1 prevention strategies. Current assays are limited by high false recent rates (FRRs) in certain populations and a short mean duration of recent infection (MDRI). Dynamic early HIV-1 antibody response kinetics were harnessed to identify biomarkers for improved incidence assays. We conducted retrospective analyses on circulating antibodies from known recent and longstanding infections and evaluated binding and avidity measurements of Env and non-Env antigens and multiple antibody forms (i.e., IgG, IgA, IgG3, IgG4, dIgA, and IgM) in a diverse panel of 164 HIV-1-infected participants (clades A, B, C). Discriminant function analysis identified an optimal set of measurements that were subsequently evaluated in a 324-specimen blinded biomarker validation panel. These biomarkers included clade C gp140 IgG3, transmitted/founder clade C gp140 IgG4 avidity, clade B gp140 IgG4 avidity, and gp41 immunodominant region IgG avidity. MDRI was estimated at 215 day or alternatively, 267 days. FRRs in untreated and treated subjects were 5.0% and 3.6%, respectively. Thus, computational analysis of dynamic HIV-1 antibody isotype and antigen interactions during infection enabled design of a promising HIV-1 recency assay for improved cross-sectional incidence estimation.