P. Arnaud

A reference data base for multilead electrocardiographic computer measurement programs

In an effort to standardize and evaluate the performance of electrocardiographic computer measurement programs, a 15 lead reference library has been developed based on simultaneously recorded standard 12 lead and orthogonal XYZ lead data. A set of 250 electrocardiograms (ECGs) with selected abnormalities was analyzed by a group of five referee cardiologists and 11 different 12 lead and 6 XYZ computer programs. Attention was focused on the exact determination of the onsets and offsets of P, QRS and T waves. The referees performed their task on highly amplified, selected complexes from the library in a two round process. Median results of the referees coincided best with the median derived from all programs. An analysis of stability proved that the combined program median was a robust reference. However, some individual program results were widely divergent. Paired t tests demonstrated earlier onset for P and QRS (p less than 0.001), as well as later offset for P and T waves in the median 12 lead than in the XYZ results. Significant differences also existed among results obtained by programs analyzing all standard ECG leads at one time, the so-called multilead programs, and those obtained by the conventional standard three lead analysis programs. As a consequence, the derived P, PR, QRS and QT interval measurements varied quite widely among the various programs. Significant differences were also observed among measurements of Q, R and S duration. Some programs showed Q waves that were on the average 6 ms (p less than 0.001) longer than those of others. This may significantly influence diagnostic performance.(ABSTRACT TRUNCATED AT 250 WORDS)

Assessment of the performance of electrocardiographic computer programs with the use of a reference data base.

To allow an exchange of measurements and criteria between different electrocardiographic (ECG) computer programs, an international cooperative project has been initiated aimed at standardization of computer-derived ECG measurements. To this end an ECG reference library of 250 ECGs with selected abnormalities was established and a comprehensive reviewing scheme was devised for the visual determination of the onsets and offsets of P, QRS, and T waves. This task was performed by a group of cardiologists on highly amplified, selected complexes from the library of ECGs. With use of a modified Delphi approach, individual outlying point estimates were eliminated in four successive rounds. In this way final referee estimates were obtained that proved to be highly reproducible and precise. This reference data base was used to study measurement results obtained with nine vectorcardiographic and 10 standard 12-lead ECG analysis programs. The medians of program determinations of P, QRS, and T wave onsets and offsets were close to the final referee estimates. However, an important variability could be demonstrated between measurements from individual programs and mean differences from the referee estimates amounted to 10 msec for QRS for certain programs. In addition, the variances of all programs with respect to the referee point estimates were variable. Some programs proved to be more accurate and stable when the data from high- vs low-noise recordings were analyzed. Average Q wave durations calculated from ECGs for which programs agreed on the presence of a Q or QS wave differed by more than 8 msec in several program-to-program comparisons. Such differences may have important consequences with respect to diagnostic performance. Various factors that might explain these differences have been determined. The present study demonstrates that to allow an exchange of results and diagnostic criteria between different ECG computer programs, definitions, minimum wave requirements, and measurement procedures urgently need to be standardized.

Influence of noise on wave boundary recognition by ECG measurement programs

In the international cooperative project entitled Common Standards for Quantitative Electrocardiography (CSE) systematic noise tests have been performed in order to compare measurement results of electrocardiographic computer programs under degraded operational conditions and to develop recommendations for preprocessing and measurement strategies. The influence of seven different high- and low-frequency noise types on the recognition of P, QRS, and T wave onsets and offsets was investigated. The analysis was performed on 160 electrocardiograms derived from two sets of 10 cases each, by eight electrocardiographic and six vectorcardiographic computer programs. The stability and precision of these programs were tested with respect to the results obtained (1) in the noise-free recordings and (2) by a group of five cardiologists who have analyzed the recordings previously in a Delphi reviewing process. Increasing levels of high-frequency noise shifted the onsets and offsets of most programs outward. Programs analyzing an averaged beat showed significantly less variability than programs which measure every complex or a selected beat. On the basis of the findings of the present study, a measurement strategy based on selective averaging is recommended for diagnostic ECG computer programs. However, averaging should be performed only if proper alignment and precise waveform comparison have been performed beforehand in order to exclude dissimilar complexes.

Establishment of a reference library for evaluating computer ECG measurement programs

As a result of an international cooperative project entitled Common Standards for Quantitative Electrocardiography (CSE), an ECG reference data base has been established with the aim of standardizing computer-derived ECG measurements. The objective of the project is to reduce the wide variation in wave measurements currently obtained by ECG analysis programs. A library of 250 ECGs with selective ECG abnormalities was established and a comprehensive reviewing scheme was devised for the visual determination of the onsets and offsets of P, QRS, and T. This task was performed by a board of cardiologists on highly amplified, selected complexes from the library. A subset was examined in order to study beat-to-beat and intraobserver variability. By using a modified Delphi approach, individual outlying point estimates were eliminated in four successive rounds. In this way final referee estimates were obtained which proved to be highly reproducible and precise. A reference library has thereby been developed which allows testing of the performance of ECG measurement programs and is a useful instrument in establishing recommendations for more precise measurement rules and definitions.

Stability of computer ECG amplitude measurements in the presence of noise

An important feature of an ECG analysis program is its ability to provide reliable measurements under various operating conditions, e.g., on noise-free and noisy ECGs. Therefore, within the European cooperative project Common Standards For Quantitative Electrocardiography (CSE), the accuracy and stability of ECG measurements obtained by several computer programs has been compared. To investigate the stability of measurements two sets of 10 ECGs with and without seven different high- and low-frequency types of noise--altogether 160 electrocardiograms and 160 vectorcardiograms--have been analyzed by eight electrocardiographic and five vectorcardiographic computer programs. The stability of measurement was tested with respect to results obtained for the noise-free recordings. In a previous paper, the influence of noise on wave boundary recognition has been reported. In the present paper, the effect of noise on amplitude measurements and on problems of waveform definitions within the QRS complex are described. The results indicate that programs analyzing an averaged beat exhibit less variability than programs which measure every complex or a selected beat. Comparability and stability of measurements could be improved if a standardized procedure for amplitude references were to be introduced. In addition, the stability of QRS waveform labelling could be improved if waveforms minimum amplitude and duration were to be validated against the noise level which itself should be determined by a standardized procedure.

Comparison of diagnostic results of ECG computer programs and cardiologists

In the European concerted action Common Standards for Quantitative Electrocardiography (CSE) results of nine electrocardiography (ECG) and 6 vector cardiography (VCG) computer programs have been compared with a true diagnosis based on ECG-independent evidence, as well as to the results obtained by eight cardiologists who read the ECGs and five who read the VCGs. Results obtained in 1220 cases are presented. Assessment of the diagnostic performance of computer programs and of cardiologists against ECG-independent validated data was the primary objective. However, also testing against the readings of a group of cardiologists was performed to assess the clinical acceptability of the computer program results. The study shows that programs with the best performance reached almost equal levels to the best cardiologists. The study also shows that all can still be improved for one or more diagnostic categories, whereas some require general improvement.<<ETX>>

Common Standards for Quantitative Electrocardiography : The CSE Pilot Study

A four year concerted action project has been started in the European Communities (EC) with the aim of “Common Standards for Quantitative Electrocardiography” (CSE Project). Standards for computer derived ECG measurements are urgently required because more and more quantitative diagnostic ECG criteria are now being derived by ECG computer programs and in view of the existing differences, first of all with respect to time measurements of present computer programs.