Marieke C. Vissers

The VATAM guidelines

Evaluation and assessment of the impact of information and communication technology in medicine is gaining interest. Unfortunately, till now there were no agreed upon approaches. The objective of the VATAM project is to develop guidelines that will assist assessors to set-up and execute studies. This paper describes the background of the VATAM project and provides an account of the current state of the guidelines. It concludes with an indication of the developments that will take place in the short term to further elaborate the guidelines and some considerations for consolidation of VATAMs results.

Impact of a protocol processing system (protoview) on clinical behaviour of residents and treatment.

A protocol processing system (ProtoVIEW), containing therapeutic trauma protocols, was used in the Accident and Emergency (A and E) department for a period of 7 months to investigate the impact of automated protocols on firstly, medical decision making of physicians and secondly, on quality of treatments eventually received by the patients. A randomized controlled trial showed that mandatory use of the system led to a more uniform working strategy while fracture treatment only seemed to improve in a subgroup of patient for whom residents established a correct diagnosis.

Effects of a supportive protocol processing system (ProtoVIEW) on clinical behaviour of residents in the Accident and Emergency department

A randomized two period crossover trial was performed at the Accident and Emergency (A & E) department of the University Hospital in Nijmegen (The Netherlands). We assessed what the impact was of (mandatory) consultation of a protocol for the management of isolated traumas on treatment decisions of residents. All eight surgical residents who regularly worked in the A & E department participated in the trial. All patients who entered the A & E department between October 13, 1992 and June 9, 1993, of age 16 years or older with an isolated fracture without concomitant lesions were admitted to the study. During the experimental periods, the management protocol was available on computer (using ProtoVIEW) and during the control periods on paper. Main measurements were treatment adjustments made by residents (after consulting different information sources), and their opinion about ProtoVIEW as an information source assessed by means of a questionnaire. When protocol consultation was mandatory, residents changed their treatments almost four times more often towards the protocol than during the control periods (P = 0.01 Chi-square test). Most residents found ProtoVIEW easy to use, liked it as a useful training source while half of them said they would use the system in daily clinical practice. We conclude that mandatory protocol consultation using ProtoVIEW influenced protocol adherence positively.

Protocol processing system (Proto VIEW) to support residents at the emergency ward

This paper describes the design, implementation and evaluation of a prototype protocol processing system (ProtoVIEW). ProtoVIEW provides protocol information for diagnostic and therapeutic purposes. The developed system described here is used as a research instrument to investigate the impact of automated protocols on the medical decision making of physicians. A first evaluation indicates that residents like to use the system and that usage of the system leads to a more uniform working strategy.

Combining a scientific approach and prototyping in the design of EHCR systems

In this paper, it is emphasized that electronic medical record systems cannot totally be developed in the traditional way. The underlying process of how physicians or nurses are searching for information is not fully understood. Therefore, a method that combines a scientific approach and prototyping is advocated. With the help of this advocated approach, these questions could be answered in a way that was also scientifically sound. In this contribution, two examples of the use of this method are presented. One concerns the determination of the optimum granularity of the narrative parts of the electronic healthcare record (EHCR) and the other concerns the use and impact of stand-alone protocol systems.

Consultation behaviour of residents supported with a protocol processing system (ProtoVIEW) at the emergency ward

We evaluated the consultation behaviour of residents using a protocol processing system in routine clinical practice. A total of 125 consecutive patients, of age 16 years or older with an isolated fracture without concomitant lesions, were treated with computer support between 13 October 1992 and 9 June 1993. All eight surgical residents who worked at the emergency ward of the University Hospital in Nijmegen, The Netherlands participated. The mean consultancy time, method of information retrieval, number of correct protocols found, number of windows retrieved and attitude towards ProtoVIEW as a useful information source were estimated. Main results are: a mean consultancy time of 1.5 min per case, residents browsed through the protocol information more often than using keyword search. The correct protocols were found in 98% of the cases while on average a minimum number of text-browse windows was retrieved. Residents were positive about the way protocols were presented and about the information supplied by ProtoVIEW. From this study we may conclude that ProtoVIEW consultation is hardly time consuming, and easy to use. Since keyword search was hardly used, expanding the number of synonyms may stimulate searching by keyword more often.

Building a flexible protocol information system with ready for use' web-technology.

This paper describes how web technology, currently available, can be used to build a fast and easy flexible protocol information system. The interface design and functionalities of the system were based on experiences with a previous version of a protocol information system (ProtoVIEW). A wide range of diagnostic or therapeutic protocols could be retrieved and viewed with ProtoVIEW. The Web-based version contains all functionalities of the non web-based version plus several new functionalities. The web version contains an X-ray viewer and a great deal of interactivity such as validation of electronic patient data forms. The most important additional function is the context sensitive protocol support that may lead to improved protocol adherence. Finally, the web-based version can be accessed from any working place since patient data and protocols are stored centrally.

Inventory of validation approaches in selected health telematics projects

This paper presents the results from an inventory of validation approaches and methodologies which have been used in selected health telematics projects. The inventory was performed in the VATAM Validation of Telematic Applications in Medicine project, HC1115HC. The purpose of the inventory was to analyse the methodologies and their application assumptions in order to identify possibilities for harmonization and consolidation. The inventory was performed using five validation dimensions: IT-development; quality; user; technology assessment and marketing. The inventory results show that possibilities exist to synthesise methodologies and to provide practical guidance and support for projects that are developing health telematics applications. All stakeholders in health telematics projects, i.e. users, health care decision-makers, developers, suppliers and IT-industries, can benefit from practical validation guidelines and support for validation when guidelines are represented in a usable, easy to access and informative way.