Ann Strydom

Implementing rapid, robust, cost-effective, patient-centred, routine genetic testing in ovarian cancer patients

Advances in DNA sequencing have made genetic testing fast and affordable, but limitations of testing processes are impeding realisation of patient benefits. Ovarian cancer exemplifies the potential value of genetic testing and the shortcomings of current pathways to access testing. Approximately 15% of ovarian cancer patients have a germline BRCA1 or BRCA2 mutation which has substantial implications for their personal management and that of their relatives. Unfortunately, in most countries, routine implementation of BRCA testing for ovarian cancer patients has been inconsistent and largely unsuccessful. We developed a rapid, robust, mainstream genetic testing pathway in which testing is undertaken by the trained cancer team with cascade testing to relatives performed by the genetics team. 207 women with ovarian cancer were offered testing through the mainstream pathway. All accepted. 33 (16%) had a BRCA mutation. The result informed management of 79% (121/154) women with active disease. Patient and clinician feedback was very positive. The pathway offers a 4-fold reduction in time and 13-fold reduction in resource requirement compared to the conventional testing pathway. The mainstream genetic testing pathway we present is effective, efficient and patient-centred. It can deliver rapid, robust, large-scale, cost-effective genetic testing of BRCA1 and BRCA2 and may serve as an exemplar for other genes and other diseases.

CSN and CAVA: variant annotation tools for rapid, robust next-generation sequencing analysis in the clinical setting

BackgroundNext-generation sequencing (NGS) offers unprecedented opportunities to expand clinical genomics. It also presents challenges with respect to integration with data from other sequencing methods and historical data. Provision of consistent, clinically applicable variant annotation of NGS data has proved difficult, particularly of indels, an important variant class in clinical genomics. Annotation in relation to a reference genome sequence, the DNA strand of coding transcripts and potential alternative variant representations has not been well addressed. Here we present tools that address these challenges to provide rapid, standardized, clinically appropriate annotation of NGS data in line with existing clinical standards.MethodsWe developed a clinical sequencing nomenclature (CSN), a fixed variant annotation consistent with the principles of the Human Genome Variation Society (HGVS) guidelines, optimized for automated variant annotation of NGS data. To deliver high-throughput CSN annotation we created CAVA (Clinical Annotation of VAriants), a fast, lightweight tool designed for easy incorporation into NGS pipelines. CAVA allows transcript specification, appropriately accommodates the strand of a gene transcript and flags variants with alternative annotations to facilitate clinical interpretation and comparison with other datasets. We evaluated CAVA in exome data and a clinical BRCA1/BRCA2 gene testing pipeline.ResultsCAVA generated CSN calls for 10,313,034 variants in the ExAC database in 13.44 hours, and annotated the ICR1000 exome series in 6.5 hours. Evaluation of 731 different indels from a single individual revealed 92 % had alternative representations in left aligned and right aligned data. Annotation of left aligned data, as performed by many annotation tools, would thus give clinically discrepant annotation for the 339 (46 %) indels in genes transcribed from the forward DNA strand. By contrast, CAVA provides the correct clinical annotation for all indels. CAVA also flagged the 370 indels with alternative representations of a different functional class, which may profoundly influence clinical interpretation. CAVA annotation of 50 BRCA1/BRCA2 gene mutations from a clinical pipeline gave 100 % concordance with Sanger data; only 8/25 BRCA2 mutations were correctly clinically annotated by other tools.ConclusionsCAVA is a freely available tool that provides rapid, robust, high-throughput clinical annotation of NGS data, using a standardized clinical sequencing nomenclature.

The ICR1000 UK exome series: a resource of gene variation in an outbred population.

To enhance knowledge of gene variation in outbred populations, and to provide a dataset with utility in research and clinical genomics, we performed exome sequencing of 1,000 UK individuals from the general population and applied a high-quality analysis pipeline that includes high sensitivity and specificity for indel detection. Each UK individual has, on average, 21,978 gene variants including 160 rare (0.1%) variants not present in any other individual in the series. These data provide a baseline expectation for gene variation in an outbred population. Summary data of all 295,391 variants we detected are included here and the individual exome sequences are available from the European Genome-phenome Archive as the ICR1000 UK exome series. Furthermore, samples and other phenotype and experimental data for these individuals are obtainable through application to the 1958 Birth Cohort committee.

Accurate clinical detection of exon copy number variants in a targeted NGS panel using DECoN.

Background: Targeted next generation sequencing (NGS) panels are increasingly being used in clinical genomics to increase capacity, throughput and affordability of gene testing. Identifying whole exon deletions or duplications (termed exon copy number variants, ‘exon CNVs’) in exon-targeted NGS panels has proved challenging, particularly for single exon CNVs. Methods: We developed a tool for the Detection of Exon Copy Number variants (DECoN), which is optimised for analysis of exon-targeted NGS panels in the clinical setting. We evaluated DECoN performance using 96 samples with independently validated exon CNV data. We performed simulations to evaluate DECoN detection performance of single exon CNVs and to evaluate performance using different coverage levels and sample numbers. Finally, we implemented DECoN in a clinical laboratory that tests BRCA1 and BRCA2 with the TruSight Cancer Panel (TSCP). We used DECoN to analyse 1,919 samples, validating exon CNV detections by multiplex ligation-dependent probe amplification (MLPA). Results: In the evaluation set, DECoN achieved 100% sensitivity and 99% specificity for BRCA exon CNVs, including identification of 8 single exon CNVs. DECoN also identified 14/15 exon CNVs in 8 other genes. Simulations of all possible BRCA single exon CNVs gave a mean sensitivity of 98% for deletions and 95% for duplications. DECoN performance remained excellent with different levels of coverage and sample numbers; sensitivity and specificity was >98% with the typical NGS run parameters. In the clinical pipeline, DECoN automatically analyses pools of 48 samples at a time, taking 24 minutes per pool, on average. DECoN detected 24 BRCA exon CNVs, of which 23 were confirmed by MLPA, giving a false discovery rate of 4%. Specificity was 99.7%. Conclusions: DECoN is a fast, accurate, exon CNV detection tool readily implementable in research and clinical NGS pipelines. It has high sensitivity and specificity and acceptable false discovery rate. DECoN is freely available at www.icr.ac.uk/decon.

A Cost-Effectiveness Evaluation of Germline BRCA1 and BRCA2 Testing in UK Women with Ovarian Cancer

Objectives To evaluate the long-term cost-effectiveness of germline BRCA1 and BRCA2 (collectively termed “BRCA”) testing in women with epithelial ovarian cancer, and testing for the relevant mutation in first- and second-degree relatives of BRCA mutation–positive individuals, compared with no testing. Female BRCA mutation–positive relatives of patients with ovarian cancer could undergo risk-reducing mastectomy and/or bilateral salpingo-oophorectomy. Methods A cost-effectiveness model was developed that included the risks of breast and ovarian cancer; the costs, utilities, and effects of risk-reducing surgery on cancer rates; and the costs, utilities, and mortality rates associated with cancer. Results BRCA testing of all women with epithelial ovarian cancer each year is cost-effective at a UK willingness-to-pay threshold of £20,000/quality-adjusted life-year (QALY) compared with no testing, with an incremental cost-effectiveness ratio of £4,339/QALY. The result was primarily driven by fewer cases of breast cancer (142) and ovarian cancer (141) and associated reductions in mortality (77 fewer deaths) in relatives over the subsequent 50 years. Sensitivity analyses showed that the results were robust to variations in the input parameters. Probabilistic sensitivity analysis showed that the probability of germline BRCA mutation testing being cost-effective at a threshold of £20,000/QALY was 99.9%. Conclusions Implementing germline BRCA testing in all patients with ovarian cancer would be cost-effective in the United Kingdom. The consequent reduction in future cases of breast and ovarian cancer in relatives of mutation–positive individuals would ease the burden of cancer treatments in subsequent years and result in significantly better outcomes and reduced mortality rates for these individuals.

The ICR142 NGS validation series: a resource for orthogonal assessment of NGS analysis

To provide a useful community resource for orthogonal assessment of NGS analysis software, we present the ICR142 NGS validation series. The dataset includes high-quality exome sequence data from 142 samples together with Sanger sequence data at 730 sites; 409 sites with variants and 321 sites at which variants were called by an NGS analysis tool, but no variant is present in the corresponding Sanger sequence. The dataset includes 286 indel variants and 275 negative indel sites, and thus the ICR142 validation dataset is of particular utility in evaluating indel calling performance. The FASTQ files and Sanger sequence results can be accessed in the European Genome-phenome Archive under the accession number EGAS00001001332.

CoverView: a sequence quality evaluation tool for next generation sequencing data

Quality assurance and quality control are essential for robust next generation sequencing (NGS). Here we present CoverView, a fast, flexible, user-friendly quality evaluation tool for NGS data. CoverView processes mapped sequencing reads and user-specified regions to report depth of coverage, base and mapping quality metrics with increasing levels of detail from a chromosome-level summary to per-base profiles. CoverView can flag regions that do not fulfil user-specified quality requirements, allowing suboptimal data to be systematically and automatically presented for review. It also provides an interactive graphical user interface (GUI) that can be opened in a web browser and allows intuitive exploration of results. We have integrated CoverView into our accredited clinical cancer predisposition gene testing laboratory that uses the TruSight Cancer Panel (TSCP). CoverView has been invaluable for optimisation and quality control of our testing pipeline, providing transparent, consistent quality metric information and automatic flagging of regions that fall below quality thresholds. We demonstrate this utility with TSCP data from the Genome in a Bottle reference sample, which CoverView analysed in 13 seconds. CoverView uses data routinely generated by NGS pipelines, reads standard input formats, and rapidly creates easy-to-parse output text (.txt) files that are customised by a simple configuration file. CoverView can therefore be easily integrated into any NGS pipeline. CoverView and detailed documentation for its use are freely available at github.com/RahmanTeamDevelopment/CoverView/releases and www.icr.ac.uk/CoverView

The ICR96 exon CNV validation series: a resource for orthogonal assessment of exon CNV calling in NGS data.

Detection of deletions and duplications of whole exons (exon CNVs) is a key requirement of genetic testing. Accurate detection of this variant type has proved very challenging in targeted next-generation sequencing (NGS) data, particularly if only a single exon is involved. Many different NGS exon CNV calling methods have been developed over the last five years. Such methods are usually evaluated using simulated and/or in-house data due to a lack of publicly-available datasets with orthogonally generated results. This hinders tool comparisons, transparency and reproducibility. To provide a community resource for assessment of exon CNV calling methods in targeted NGS data, we here present the ICR96 exon CNV validation series. The dataset includes high-quality sequencing data from a targeted NGS assay (the TruSight Cancer Panel) together with Multiplex Ligation-dependent Probe Amplification (MLPA) results for 96 independent samples. 66 samples contain at least one validated exon CNV and 30 samples have validated negative results for exon CNVs in 26 genes. The dataset includes 46 exon CNVs in BRCA1, BRCA2, TP53, MLH1, MSH2, MSH6, PMS2, EPCAM or PTEN, giving excellent representation of the cancer predisposition genes most frequently tested in clinical practice. Moreover, the validated exon CNVs include 25 single exon CNVs, the most difficult type of exon CNV to detect. The FASTQ files for the ICR96 exon CNV validation series can be accessed through the European-Genome phenome Archive (EGA) under the accession number EGAS00001002428.

The Quality Sequencing Minimum (QSM): providing comprehensive, consistent, transparent next generation sequencing data quality assurance

Next generation sequencing (NGS) is routinely used in clinical genetic testing. Quality management of NGS testing is essential to ensure performance is consistently and rigorously evaluated. Three primary metrics are used in NGS quality evaluation: depth of coverage, base quality and mapping quality. To provide consistency and transparency in the utilisation of these metrics we present the Quality Sequencing Minimum (QSM). The QSM defines the minimum quality requirement a laboratory has selected for depth of coverage (C), base quality (B) and mapping quality (M) and can be applied per base, exon, gene or other genomic region, as appropriate. The QSM format is CX_BY(P Y)_MZ(P Z). X is the parameter threshold for C, Y the parameter threshold for B, P Y the percentage of reads that must reach Y, Z the parameter threshold for M, P Z the percentage of reads that must reach Z. The data underlying the QSM is in the BAM file, so a QSM can be easily and automatically calculated in any NGS pipeline. We used the QSM to optimise cancer predisposition gene testing using the TruSight Cancer Panel (TSCP). We set the QSM as C50_B10(85)_M20(95). Test regions falling below the QSM were automatically flagged for review, with 100/1471 test regions QSM-flagged in multiple individuals. Supplementing these regions with 132 additional probes improved performance in 85/100. We also used the QSM to optimise testing of genes with pseudogenes such as PTEN and PMS2. In TSCP data from 960 individuals the median number of regions that passed QSM per sample was 1429 (97%). Importantly, the QSM can be used at an individual report level to provide succinct, comprehensive quality assurance information about individual test performance. We believe many laboratories would find the QSM useful. Furthermore, widespread adoption of the QSM would facilitate consistent, transparent reporting of genetic test performance by different laboratories.

A discrete event simulation to evaluate the cost effectiveness of germline BRCA1 and BRCA2 testing in UK women with ovarian cancer

Objectives The objective of this study was to evaluate the long-term cost-effectiveness of germline BRCA1 and BRCA2 (collectively termed ‘BRCA’) testing in women with epithelial ovarian cancer, and testing for the relevant mutation in first and second degree relatives of BRCA mutation-positive individuals, compared with no testing. Female BRCA mutation-positive relatives of ovarian cancer patients could undergo risk-reducing mastectomy and/or bilateral salpingo-oophorectomy. Methods A discrete event simulation model was developed that included the risks of breast and ovarian cancer, the costs, utilities and effects of risk-reducing surgery on cancer rates, and the costs, utilities and mortality rates associated with cancer. Results BRCA testing all women with epithelial ovarian cancer each year is cost-effective at a UK willingness-to-pay threshold of £20,000/QALY compared with no testing, with an ICER of £4,339/QALY. The result was primarily driven by fewer cases of breast (142) and ovarian (141) cancer and associated reductions in mortality (77 fewer deaths) in relatives over the subsequent 50 years. Sensitivity analyses showed that the results were robust to variations in the input parameters. Probabilistic sensitivity analysis showed that the probability of germline BRCA mutation testing being cost-effective at a threshold of £20,000/QALY was 99.9%. Conclusions Implementing germline BRCA testing in all ovarian cancer patients would be cost-effective in the UK. The consequent reduction of future cases of breast and ovarian cancer in relatives of mutation-positive individuals would ease the burden of cancer treatments in subsequent years and result in significantly better outcomes and reduced mortality rates for these individuals.