Nerida Creswick

A comparison of self-reported and observational work sampling techniques for measuring time in nursing tasks

Objectives: To compare self-reported and observational work sampling techniques when applied to ward-based nurses. Methods: A self-reported work sampling study was undertaken with nine registered nurses in an Australian teaching hospital over 8.5 weeks, followed by an observational work sampling study conducted over 4.5 weeks. Both studies used a random reminder method and a multidimensional work task classification. Field notes were also recorded and analysed. Results: 3910 data points were collected, 667 during the self-report study and 3243 in the observational study. The two techniques yielded significant differences in work patterns of registered nurses. The observational study showed that compared with the self-reported study, patient care (40% versus 33%, P <0.000) and ward-related activities (7% versus 3%; P <0.001) were recorded significantly more frequently, and documentation less frequently (8% versus 19%; P <0.000). Both the techniques generated similar proportions of time spent in breaks (12%), medication tasks (13%) and clinical discussion (15%). The self-report technique was poorly accepted by nursing staff. The observational technique was well accepted and data collection was more effcient. Conclusions: The self-report work sampling technique is not a reliable method for obtaining an accurate reflection of the work tasks of ward-based nurses. The observational technique was preferred by nurses, and despite concern regarding a potential Hawthorne effect, this was not substantiated.

Understanding communication networks in the emergency department.

BackgroundEmergency departments (EDs) are high pressure health care settings involving complex interactions between staff members in providing and organising patient care. Without good communication and cooperation amongst members of the ED team, quality of care is at risk. This study examined the problem-solving, medication advice-seeking and socialising networks of staff working in an Australian hospital ED.MethodsA social network survey (Response Rate = 94%) was administered to all ED staff (n = 109) including doctors, nurses, allied health professionals, administrative staff and ward assistants. Analysis of the network characteristics was carried out by applying measures of density (the extent participants are concentrated), connectedness (how related they are), isolates (how segregated), degree centrality (who has most connections measured in two ways, in-degree, the number of ties directed to an individual and out-degree, the number of ties directed from an individual), betweenness centrality (who is important or powerful), degree of separation (how many ties lie between people) and reciprocity (how bi-directional are interactions).ResultsIn all three networks, individuals were more closely connected to colleagues from within their respective professional groups. The problem-solving network was the most densely connected network, followed by the medication advice network, and the loosely connected socialising network. ED staff relied on each other for help to solve work-related problems, but some senior doctors, some junior doctors and a senior nurse were important sources of medication advice for their ED colleagues.ConclusionsNetwork analyses provide useful ways to assess social structures in clinical settings by allowing us to understand how ED staff relate within their social and professional structures. This can provide insights of potential benefit to ED staff, their leaders, policymakers and researchers.

Social network analysis of medication advice-seeking interactions among staff in an Australian hospital.

PURPOSE To examine the medication advice-seeking network of staff in a hospital ward. METHODS Social network analysis was carried out in a renal ward of an Australian metropolitan teaching hospital. The medication advice-seeking interactions of doctors, nurses, allied health professionals (including a pharmacist) and a ward clerk were examined using data from questionnaires administered to staff. The questionnaire listed all staff who worked in the ward and sought information from respondents regarding their interactions with each staff member. Data were analysed using social network software, UCINET. Analyses performed included geodesic distance, network density, strength of ties, reciprocation of relations, and centrality of individuals. NetDraw was used to produce social network diagrams. RESULTS A very high response rate of 96% was achieved with 45 of 47 staff returning the questionnaire. On average, there is little interaction between each of the staff members in the medication advice-seeking network, with even less interaction between staff from different professional groups. Nurses are mainly located on one side of the network and doctors on the other. However, the pharmacist is quite central in the medication advice-seeking network as are some senior nurses and a junior doctor. CONCLUSIONS When hospital clinical staff seek medication advice from other members of a ward it tends to be sought from those in their profession. However key individuals in the ward are relied upon for the provision of medication advice by staff from all professions. Social network analysis can be used to examine the complex medication advice-seeking interactions amongst staff in a hospital ward, providing useful quantitative baseline data against which to compare the effect of interventions, such as an electronic medication system, on interactions.

Mobile and Fixed Computer Use by Doctors and Nurses on Hospital Wards: Multi-method Study on the Relationships Between Clinician Role, Clinical Task, and Device Choice

Background Selecting the right mix of stationary and mobile computing devices is a significant challenge for system planners and implementers. There is very limited research evidence upon which to base such decisions. Objective We aimed to investigate the relationships between clinician role, clinical task, and selection of a computer hardware device in hospital wards. Methods Twenty-seven nurses and eight doctors were observed for a total of 80 hours as they used a range of computing devices to access a computerized provider order entry system on two wards at a major Sydney teaching hospital. Observers used a checklist to record the clinical tasks completed, devices used, and location of the activities. Field notes were also documented during observations. Semi-structured interviews were conducted after observation sessions. Assessment of the physical attributes of three devices—stationary PCs, computers on wheels (COWs) and tablet PCs—was made. Two types of COWs were available on the wards: generic COWs (laptops mounted on trolleys) and ergonomic COWs (an integrated computer and cart device). Heuristic evaluation of the user interfaces was also carried out. Results The majority (93.1%) of observed nursing tasks were conducted using generic COWs. Most nursing tasks were performed in patients’ rooms (57%) or in the corridors (36%), with a small percentage at a patient’s bedside (5%). Most nursing tasks related to the preparation and administration of drugs. Doctors on ward rounds conducted 57.3% of observed clinical tasks on generic COWs and 35.9% on tablet PCs. On rounds, 56% of doctors’ tasks were performed in the corridors, 29% in patients’ rooms, and 3% at the bedside. Doctors not on a ward round conducted 93.6% of tasks using stationary PCs, most often within the doctors’ office. Nurses and doctors were observed performing workarounds, such as transcribing medication orders from the computer to paper. Conclusions The choice of device was related to clinical role, nature of the clinical task, degree of mobility required, including where task completion occurs, and device design. Nurses’ work, and clinical tasks performed by doctors during ward rounds, require highly mobile computer devices. Nurses and doctors on ward rounds showed a strong preference for generic COWs over all other devices. Tablet PCs were selected by doctors for only a small proportion of clinical tasks. Even when using mobile devices clinicians completed a very low proportion of observed tasks at the bedside. The design of the devices and ward space configurations place limitations on how and where devices are used and on the mobility of clinical work. In such circumstances, clinicians will initiate workarounds to compensate. In selecting hardware devices, consideration should be given to who will be using the devices, the nature of their work, and the physical layout of the ward.

The Effect of Computerized Provider Order Entry Systems on Clinical Care and Work Processes in Emergency Departments: A Systematic Review of the Quantitative Literature

STUDY OBJECTIVE We undertake a systematic review of the quantitative literature related to the effect of computerized provider order entry systems in the emergency department (ED). METHODS We searched MEDLINE, EMBASE, Inspec, CINAHL, and CPOE.org for English-language studies published between January 1990 and May 2011. RESULTS We identified 1,063 articles, of which 22 met our inclusion criteria. Sixteen used a pre/post design; 2 were randomized controlled trials. Twelve studies reported outcomes related to patient flow/clinical work, 7 examined decision support systems, and 6 reported effects on patient safety. There were no studies that measured decision support systems and its effect on patient flow/clinical work. Computerized provider order entry was associated with an increase in time spent on computers (up to 16.2% for nurses and 11.3% for physicians), with no significant change in time spent on patient care. Computerized provider order entry with decision support systems was related to significant decreases in prescribing errors (ranging from 17 to 201 errors per 100 orders), potential adverse drug events (0.9 per 100 orders), and prescribing of excessive dosages (31% decrease for a targeted set of renal disease medications). CONCLUSION There are tangible benefits associated with computerized provider order entry/decision support systems in the ED environment. Nevertheless, when considered as part of a framework of technical, clinical, and organizational components of the ED, the evidence base is neither consistent nor comprehensive. Multimethod research approaches (including qualitative research) can contribute to understanding of the multiple dimensions of ED care delivery, not as separate entities but as essential components of a highly integrated system of care.

Computerized Provider Order Entry—What are health professionals concerned about? A qualitative study in an Australian hospital

PURPOSE To identify the main concerns of a broad range of hospital staff about the implementation of a new Computerized Provider Order Entry (CPOE) system for medication management. METHODS The study was conducted in a large Australian teaching hospital using semi-structured interviews (n=20) and focus groups (six focus groups involving a total of 30 participants) from a broad section of health professionals including doctors, nurses, managers, pharmacists and senior health executives. Systematic concurrent analysis of the data was undertaken by a team of researchers. RESULTS We identified 20 recurrent themes related to nine areas of shared concern including work practices, software/hardware, relationships/communication, education and training, inexperienced staff and de-skilling. A higher level of analysis identified four interrelated constructs that highlight what people are concerned about: (1) Will it help? (2) Will it work? (3) Will we cope? (4) Will it impair existing interaction? LIMITATIONS The research provides a snapshot overview of perceptions from a range of hospital personnel in the lead up to CPOE implementation. Generalizability is limited by the size of the sample and the contextual circumstances of the hospital being studied. DISCUSSION This work contributes valuable evidence about an often-neglected dimension in the evaluation of computer systems in hospitals, namely the pre-implementation concerns of staff. These pre-conceptions can have a significant effect on how technology is implemented and utilised. Acknowledging and addressing peoples concerns can contribute to the establishment of durable channels of negotiation and communication. Further research informed by the findings of this study will help advance this process.

The development, design, testing, refinement, simulation and application of an evaluation framework for communities of practice and social-professional networks

BackgroundCommunities of practice and social-professional networks are generally considered to enhance workplace experience and enable organizational success. However, despite the remarkable growth in interest in the role of collaborating structures in a range of industries, there is a paucity of empirical research to support this view. Nor is there a convincing model for their systematic evaluation, despite the significant potential benefits in answering the core question: how well do groups of professionals work together and how could they be organised to work together more effectively? This research project will produce a rigorous evaluation methodology and deliver supporting tools for the benefit of researchers, policymakers, practitioners and consumers within the health system and other sectors. Given the prevalence and importance of communities of practice and social networks, and the extent of investments in them, this project represents a scientific innovation of national and international significance.Methods and designWorking in four conceptual phases the project will employ a combination of qualitative and quantitative methods to develop, design, field-test, refine and finalise an evaluation framework. Once available the framework will be used to evaluate simulated, and then later existing, health care communities of practice and social-professional networks to assess their effectiveness in achieving desired outcomes. Peak stakeholder groups have agreed to involve a wide range of members and participant organisations, and will facilitate access to various policy, managerial and clinical networks.DiscussionGiven its scope and size, the project represents a valuable opportunity to achieve breakthroughs at two levels; firstly, by introducing novel and innovative aims and methods into the social research process and, secondly, through the resulting evaluation framework and tools. We anticipate valuable outcomes in the improved understanding of organisational performance and delivery of care. The projects wider appeal lies in transferring this understanding to other health jurisdictions and to other industries and sectors, both nationally and internationally. This means not merely publishing the results, but contextually interpreting them, and translating them to advance the knowledge base and enable widespread institutional and organisational application.

Who Do Hospital Physicians and Nurses Go to for Advice About Medications? A Social Network Analysis and Examination of Prescribing Error Rates.

ObjectivesTo measure the weekly medication advice-seeking networks of hospital staff, to compare patterns across professional groups, and to examine these in the context of prescribing error rates. MethodA social network analysis was conducted. All 101 staff in 2 wards in a large, academic teaching hospital in Sydney, Australia, were surveyed (response rate, 90%) using a detailed social network questionnaire. The extent of weekly medication advice seeking was measured by density of connections, proportion of reciprocal relationships by reciprocity, number of colleagues to whom each person provided advice by in-degree, and perceptions of amount and impact of advice seeking between physicians and nurses. Data on prescribing error rates from the 2 wards were compared. ResultsWeekly medication advice-seeking networks were sparse (density: 7% ward A and 12% ward B). Information sharing across professional groups was modest, and rates of reciprocation of advice were low (9% ward A, 14% ward B). Pharmacists provided advice to most people, and junior physicians also played central roles. Senior physicians provided medication advice to few people. Many staff perceived that physicians rarely sought advice from nurses when prescribing, but almost all believed that an increase in communication between physicians and nurses about medications would improve patient safety. The medication networks in ward B had higher measures for density, reciprocation, and fewer senior physicians who were isolates. Ward B had a significantly lower rate of both procedural and clinical prescribing errors than ward A (0.63 clinical prescribing errors per admission [95%CI, 0.47–0.79] versus 1.81/ admission [95%CI, 1.49–2.13]). ConclusionsMedication advice-seeking networks among staff on hospital wards are limited. Hubs of advice provision include pharmacists, junior physicians, and senior nurses. Senior physicians are poorly integrated into medication advice networks. Strategies to improve the advice-giving networks between senior and junior physicians may be a fruitful area for intervention to improve medication safety. We found that one ward with stronger networks also had a significantly lower prescribing error rate, suggesting a promising area for further investigation.