Anna Carobene

A checklist for critical appraisal of studies of biological variation

Abstract Data on biological variation are used for many purposes in laboratory medicine but concern exists over the validity of the data reported in some studies. A critical appraisal checklist has been produced by a working group established by the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) to enable standardised assessment of existing and future publications of biological variation data. The checklist identifies key elements to be reported in studies to enable safe accurate and effective transport of biological variation data sets across healthcare systems. The checklist is mapped to the domains of a minimum data set required to enable this process.

A systematic review of data on biological variation for alanine aminotransferase, aspartate aminotransferase and γ-glutamyl transferase

Abstract Background: Alanine aminotransferase (ALT), aspartate aminotransferase (AST) and γ-glutamyl transferase (GGT) are enzymes measured in serum or plasma to investigate liver disease. The aim of this work is to assess the validity of published biological variation (BV) data currently available for these enzymes. Methods: Publications containing BV data for ALT, AST and GGT were identified by searching PubMed using the following keywords: biological varia*, RCV, CVw, CVi, CVb, and CVg. The 95% confidence intervals for the within- and between-subject coefficients of variation were calculated using the analytical imprecision, the number of subjects, samples and replicates. Results: The searches identified 10 publications with ALT, 14 with AST and nine with GGT data. The protocols presented in those publications as used were varied. The ranges of within-subject variation reported were: ALT: 11.1%–58.1%, AST: 3.0%–32.3% and for GGT: 3.9%–14.5%. The median values (ALT: 18.0%, AST: 11.9% and GGT: 13.8%) were similar to those listed in a BV database commonly used as a reference source. Conclusions: Published BV data for ALT, AST and GGT demonstrate a wide range of values derived from inconsistent protocols. The quality of the presentations of the data is variable. These findings raise concerns around the utility of the data currently available and highlight the need for critical appraisal of such publications. The working group on BV of the European Federation of Clinical Chemistry and Laboratory Medicine is undertaking work to develop a critical appraisal checklist for the production and publication of reliable BV data.

Reliability of biological variation data available in an online database: need for improvement

Abstract Background: Biological variation (BV) data enable assessment of the significance of changes in serial measurements observed within a subject and are used to set analytical quality specifications. This data is available in a database held in Westgard website (http://www.westgard.com/biodatabase1.htm). Some limitations of this data, however, have been identified in recent published reviews. The aim of this paper is to show the reliability of the published BV data and to identify ongoing works to address some of its limitations. Methods: The BV data currently hosted on the Westgard website was examined. Distribution of measurands stratified by the number of cited references upon which the database entry is based and the distribution of papers stratified by publication year, are shown. Moreover, BV data available in literature for glycated hemoglobin, C-reactive protein, glycated albumin, alanine aminotransferase, aspartate aminotransferase and γ-glutamyl transferase are evaluated. Results: The results obtained show that most BV data come just from a few papers or only one paper and that a lot of publications are dated, therefore this data is too obsolete to be used. Furthermore critical review of the BV database highlights a number of factors that might impact on the reliability of the BV data entries and translation into current practice. Conclusions: A number of issues clearly undermine the value of the current database. These issues are being considered by the European Federation of Clinical Chemistry and Laboratory Medicine, biological variation working group, in collaboration with a Spanish group responsible for the database updating.

Sample collections from healthy volunteers for biological variation estimates' update: a new project undertaken by the Working Group on Biological Variation established by the European Federation of Clinical Chemistry and Laboratory Medicine.

Abstract Background: Biological variation (BV) data have many fundamental applications in laboratory medicine. At the 1st Strategic Conference of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) the reliability and limitations of current BV data were discussed. The EFLM Working Group on Biological Variation is working to increase the quality of BV data by developing a European project to establish a biobank of samples from healthy subjects to be used to produce high quality BV data. Methods: The project involved six European laboratories (Milan, Italy; Bergen, Norway; Madrid, Spain; Padua, Italy; Istanbul, Turkey; Assen, The Netherlands). Blood samples were collected from 97 volunteers (44 men, aged 20–60 years; 43 women, aged 20–50 years; 10 women, aged 55–69 years). Initial subject inclusion required that participants completed an enrolment questionnaire to verify their health status. The volunteers provided blood specimens once per week for 10 weeks. A short questionnaire was completed and some laboratory tests were performed at each sampling consisting of blood collected under controlled conditions to provide serum, K2EDTA-plasma and citrated-plasma samples. Results: Samples from six out of the 97 enroled subjects were discarded as a consequence of abnormal laboratory measurements. A biobank of 18,000 aliquots was established consisting of 120 aliquots of serum, 40 of EDTA-plasma, and 40 of citrated-plasma from each subject. The samples were stored at –80 °C. Conclusions: A biobank of well-characterised samples collected under controlled conditions has been established delivering a European resource to enable production of contemporary BV data.

Biological Variation Estimates Obtained from 91 Healthy Study Participants for 9 Enzymes in Serum

BACKGROUND We sought to develop estimates of biological variation (BV) for 9 enzymes in blood serum as part of the European Biological Variation Study. METHODS Ninety-one healthy study participants (38 male and 53 female, 21-69 years old) were phlebotomized in each of 10 consecutive weeks at 6 European laboratories. The same preanalytical sample-handling protocol was followed at each center before transport to San Raffaele Hospital, Milan, Italy, for analysis. Sera were stored at -80 °C before analysis in duplicate within a single run on an ADVIA 2400 Clinical Chemistry System (Siemens Healthcare) following a protocol designed to minimize analytical imprecision. Assay traceability was established using frozen sera with target values assigned by reference methods. The results were subjected to outlier analysis before CV-ANOVA to deliver valid BV estimates. Results for 9 enzymes were subsequently partitioned for graphical display allowing visual assessment of the effects of country of origin, sex, and age on BV estimates. RESULTS We found no effect of country upon the observed variation, but overall sex-related differences were evident for alanine amino transferase (ALT), γ-glutamyl transferase (GGT), and creatine kinase (CK). The following estimates for within-subject BV (CVI) and between-subject BV (CVG), respectively, were obtained: ALT: 9.3%, 28.2%; aspartate aminotransferase: 9.5%, 20.3%; GGT: 8.9%, 41.7%; alkaline phosphatase : 5.3%, 24.9%; lactate dehydrogenase: 5.2%, 12.6%; CK: 14.5%, 31.5%; amylase: 6.8%, 30.4%; pancreatic α-amylase: 6.3%, 24.9%; and lipase (LIP): 7.7%, 23.8%. CONCLUSIONS All CVI and some CVG estimates were lower than those reported in the online BV 2014 updated database. Analytical performance specifications derived from BV can be applied internationally.

The EuBIVAS Project: Within–and Between-Subject Biological Variation Data for Serum Creatinine Using Enzymatic and Alkaline Picrate Methods and Implications for Monitoring

BACKGROUND The European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) European Biological Variation Study (EuBIVAS) has been established to deliver rigorously determined biological variation (BV) indices. EuBIVAS determined BV for serum creatinine using the enzymatic and alkaline picrate measurement methods. METHOD In total, 91 healthy individuals (38 males, 53 females; age range, 21-69 years) were bled for 10 consecutive weeks at 6 European laboratories. An equivalent protocol was followed at each center. Sera were stored at -80 °C before analysis. Analyses for each patient were performed in duplicate within a single run on an ADVIA 2400 system (San Raffaele Hospital, Milan). The data were subjected to outlier and homogeneity analysis before performing CV-ANOVA to determine BV and analytical variation (CVA) estimates with confidence intervals (CI). RESULTS The within-subject BV estimates [CVI (95% CI)] were similar for enzymatic [4.4% (4.2-4.7)] and alkaline picrate [4.7% (4.4-4.9)] methods and lower than the estimate presently available online (CVI = 5.9%). No significant male/female BV differences were found. Significant differences were observed in mean creatinine values between men and women and between Turkish individuals and those of other nationalities. Between-subject BV (CVG) estimates, stratified accordingly, produced CVG values similar to historical BV data. CVA was 1.1% for the enzymatic and 4.4% for alkaline picrate methods, indicating that alkaline picrate methods fail to fulfill analytical performance specifications for imprecision (CVAPS). CONCLUSIONS The serum creatinine CVI obtained by EuBIVAS specifies a more stringent CVAPS than previously identified. The alkaline picrate method failed to meet this CVAPS, raising questions regarding its future use.

The Biological Variation Data Critical Appraisal Checklist: A Standard for Evaluating Studies on Biological Variation

BACKGROUND Concern has been raised about the quality of available biological variation (BV) estimates and the effect of their application in clinical practice. A European Federation of Clinical Chemistry and Laboratory Medicine Task and Finish Group has addressed this issue. The aim of this report is to (a) describe the Biological Variation Data Critical Appraisal Checklist (BIVAC), which verifies whether publications have included all essential elements that may impact the veracity of associated BV estimates, (b) use the BIVAC to critically appraise existing BV publications on enzymes, lipids, kidney, and diabetes-related measurands, and (c) apply metaanalysis to deliver a global within-subject BV (CVI) estimate for alanine aminotransferase (ALT). METHODS In the BIVAC, publications were rated as A, B, C, or D, indicating descending compliance for 14 BIVAC quality items, focusing on study design, methodology, and statistical handling. A D grade indicated that associated BV estimates should not be applied in clinical practice. Systematic searches were applied to identify BV studies for 28 different measurands. RESULTS In total, 128 publications were identified, providing 935 different BV estimates. Nine percent achieved D scores. Outlier analysis and variance homogeneity testing were scored as C in >60% of 847 cases. Metaanalysis delivered a CVI estimate for ALT of 15.4%. CONCLUSIONS Application of BIVAC to BV publications identified deficiencies in required study detail and delivery, especially for statistical analysis. Those deficiencies impact the veracity of BV estimates. BV data from BIVAC-compliant studies can be combined to deliver robust global estimates for safe clinical application.

Performance of glycated hemoglobin (HbA1c) methods evaluated with EQAS studies using fresh blood samples: Still space for improvements

BACKGROUND The determination of glycated hemoglobin is a key indicator for the management of diabetic patients. A reference measurement system for its determination is available and IVD manufacturers should have aligned their assay to this system. METHODS Two fresh blood samples were distributed by courier to 206 Italian laboratories asking for the determination of their HbA1c concentration. Target HbA1c values were assigned by the IFCC reference measurement procedure. RESULTS From 193 laboratories using analytical systems from five manufacturers (Bio-Rad Laboratories, A. Menarini Diagnostics, Roche Diagnostics, Sebia and Tosoh), we obtained a global variability of 5.3% (in terms of CV) and of 3.8% at an HbA1c value of 37.4 mmol/mol (sample 1) and 62.0 mmol/mol (sample 2), respectively. With a goal for the allowable total error (TE) of 6.0%, 70% and 77% of the participants met this criterion for samples 1 and 2, respectively. Inter-laboratory CVs, were between 3.3 and 5.0% and between 2.2 and 3.7% for samples 1 and 2, respectively. Tosoh users registered the smallest inter-laboratory CV in sample 1, and Sebias in sample 2. With regard to trueness, all methods had a mean bias of ≤ 2.8% with respect to the target values, with the exception of Tosoh (bias of + 6.1 and + 5.8%, for samples 1 and 2, respectively). CONCLUSION These results are in good agreement with those obtained by the CAP 2014 GH2-A survey, suggesting then that still there is an urgent need for improving a significant part of the methods currently used to measure HbA1c.

Biological variation of platelet parameters determined by the Sysmex XN hematology analyzer

BACKGROUND This study was aimed to define the short- and medium-term biological variation (BV) estimates, the index of individuality and the reference change value (RCV) of platelet count, platelet distribution width, mean platelet volume, platelet larger cell ratio, plateletcrit and immature platelet fraction. METHODS The study population consisted of 43 health subjects, who participated to the assessment of medium-term (21 subjects; blood sampling once a week for 5 consecutive weeks) and short-term (22 subjects; blood sampling once a day for 5 consecutive days) BV study, using Sysmex XN-module. Eight subjects were also scheduled to participate to both phases. The data were subject to outlier analysis prior to CV-ANOVA, to determine the BV estimates with the relative confidence intervals. RESULTS The medium-term and short-term within-subject BV (CVI) was comprised between 2.3 and 7.0% and 1.1-8.6%, whereas the medium-term and short-term between-subjects BV (CVG) was comprised between 7.1 and 20.7% and 6.8-48.6%. The index of individuality and index of heterogeneity were always respectively <0.6 and >0.63 for all the parameters, in both arms of the study. The RCVs were similar for all parameters, in both arms of the study. CONCLUSION This study allowed to define the BV estimates of many platelet parameters, some of them unavailable in literature. The kinetics of platelet turnover suggests the use of short-term BV data for calculating analytical goals and RCV. The correct clinical interpretation of platelet parameters also necessitates that each laboratory estimates local RCV values.

Age dependence of within-subject biological variation of nine common clinical chemistry analytes.

Abstract Background: The knowledge of biological variation (BV) data is important for clinical decisions and as a basis for defining analytical quality specifications. However, in gene\xadrating reliable data of biological variation there are still some unsolved problems, such as age dependence. The aim of our work is to verify this aspect. Methods: Twenty-six subjects divided into three groups by age were studied. Blood samples were collected in lithium heparin tubes for four weeks at one week intervals, on the same day of the week (Tuesday) and at the same time of day (8–9 a.m.) by the same phlebotomist. They were analysed in duplicate for creatinine, urate, calcium, albumin, total cholesterol, high density lipoprotein (HDL) and low density lipoprotein (LDL)-cholesterol, triglycerides and iron. After outlier exclusion by Cochran\u2019s test, components of biological variation were calculated by ANOVA. The significance of the differences between results of the classes was also calculated with the Student\u2019s test (t-test) and the Fisher\u2019s test (F-test). Results: Excluding albumin, the group 3 results (age range from 78 to 98 years) showed significantly lower CV within subjects (CVW) than the other two groups. Conclusions: Our data seem to highlight the relevance of the age when choosing the reference subjects for biological variation studies. The level of within-subject biological variation of the elderly group may have been further reduced by the homogeneity of the group constituted by individuals living together in the same nursing home.