Nathalie Wellens

The effectiveness of inpatient geriatric evaluation and management units: a systematic review and meta-analysis.

OBJECTIVES: To examine how geriatric evaluation and management units (GEMUs) are organized and to examine the effectiveness of admission on a GEMU.

Profiles of older patients in the emergency department: findings from the interRAI Multinational Emergency Department Study.

STUDY OBJECTIVE We examine functional profiles and presence of geriatric syndromes among older patients attending 13 emergency departments (EDs) in 7 nations. METHODS This was a prospective observational study of a convenience sample of patients, aged 75 years and older, recruited sequentially and mainly during normal working hours. Clinical observations were drawn from the interRAI Emergency Department Screener, with assessments performed by trained nurses. RESULTS A sample of 2,282 patients (range 98 to 549 patients across nations) was recruited. Before becoming unwell, 46% were dependent on others in one or more aspects of personal activities of daily living. This proportion increased to 67% at presentation to the ED. In the ED, 26% exhibited evidence of cognitive impairment, and 49% could not walk without supervision. Recent falls were common (37%). Overall, at least 48% had a geriatric syndrome before becoming unwell, increasing to 78% at presentation to the ED. This pattern was consistent across nations. CONCLUSION Functional problems and geriatric syndromes affect the majority of older patients attending the ED, which may have important implications for clinical protocols and design of EDs.

Content validity and internal consistency of the Dutch translation of the Safety Attitudes Questionnaire: An observational study

BACKGROUND Patient safety is fundamental to healthcare quality. Attention has recently focused on the patient safety culture of an organisation and its impact on patient outcomes. A strong safety climate appears to be an essential condition for safe patient care in the hospital. A number of instruments are used to measure this patient safety climate or culture. The Safety Attitudes Questionnaire is a validated, widely used instrument to investigate multiple dimensions of safety climate at the clinical level in a variety of inpatient and outpatient settings. OBJECTIVES The purpose of this study is to explore the face- and content validity and the internal consistency of the Safety Attitudes Questionnaire in a large Belgian academic medical center. METHOD The translation into Dutch was done by three researchers. A panel of fifteen Dutch speaking experts evaluated the translation and its content validity. Content validity was quantified by the content validity index (CVI) and a modified kappa index. Face validity was evaluated by two nurses and two physicians who assessed the Dutch version of the SAQ. A cross-sectional design was used to test internal consistency of the SAQ items by calculating Cronbachs alpha and corrected item-total correlations. RESULTS Twenty-three of the 33 SAQ items showed excellent and seven items showed good content validity. One item had a fair kappa value (item 20) and two items had a low content validity index (items 15 and 16). The average CVI of the total scale was 0.83 and ranged from 0.55 to 0.97 for the six subscales. The face-validity was good with no fundamental remarks given. The SAQs overall Cronbachs alpha was 0.9 and changed minimally when removing items. The item-total correlations ranged from 0.10 to 0.63, no single items were strongly correlated with the sum of the other items. CONCLUSION We conclude that in this study the Dutch version of the Safety Attitudes Questionnaire showed acceptable to good psychometric properties. In line with previous evidence, this instrument seems to be an acceptable to adequate tool to evaluate the safety climate.

Prediction of functional decline in older hospitalized patients: a comparative multicenter study of three screening tools.

Background and aims: Older hospitalized patients are at risk of functional decline, which is associated with several negative outcomes. The aim of this study was to compare the predictive accuracy of the Identification of Seniors At Risk (ISAR), Variable Indicative for Placement risk (VIP) and the Flemish version of the Triage Risk Screening Tool (TRST) in predicting functional decline. Methods: A prospective cohort study with 30 days follow-up in geriatric, medical and surgical wards in 25 hospitals was conducted. 752 participants aged 75 years or older were eligible for inclusion. Baseline data were gathered within 72 hours of admission. Functional decline was defined as an increase of one point or more from the premorbid Katz score to the score 30 days post-discharge. Positive predictive value (PPV) and negative predictive value (NPV) were calculated on 2×2 tables as well as by Bayes’ theorem. Results: Functional decline at 30 days postdischarge was observed in 279 participants (39%). ISAR and Flemish TRST showed high sensitivity (88%–78%) and fair NPV (62%–67%), but low specificity (19%–30%) and low PPV (47%–48%) using the original cut-off of ≥2. The sensitivity of VIP with cut-off ≥2 was too low (62%), but could be optimized with cut-off ≥1, showing sensitivity, specificity, PPV and NPV of 88%, 21%, 48% and 68%, respectively. Accuracy varied between 40% and 61% for all instruments on all calculated cut-offs. Conclusions: All three instruments performed similarly well, showing good sensitivity and fair NPV, the two major characteristics for good screening tools. False positives could be filtered out according to the clinical expert opinion of a care team.

Convergent Validity of the Cognitive Performance Scale of the interRAI Acute Care and the Mini-Mental State Examination

OBJECTIVE The Cognitive Performance Scale (CPS) is generated from five items of the interRAI/ Minimum Data Set instruments, a comprehensive geriatric assessment method. CPS was initially designed to assess cognition in residential care, where it has shown good psychometric performance. We evaluated the performance of the interRAI Acute Care in identifying cognitive impairment among patients hospitalized on acute geriatric wards. METHODS An observational study was conducted on two geriatric wards. Trained raters independently completed the interRAI Acute Care and the Mini-Mental State Examination (MMSE) in 97 inpatients (85 ± 5 years; 67% female). The level of agreement between CPS and MMSE was explored using comparisons of means, agreement coefficients, and diagnostic accuracy. RESULTS Cognitive impairment was present in 61% of the participants. Average MMSE scores were significantly different between groups with low CPS scores compared with those with high CPS scores (p <0.05). CPS explained only 48.8% of the variability in MMSE. Agreement in defining cognitively impaired subjects was moderate (percentage observed agreement, 68%; κ = 0.41). With MMSE score less than 24 as a gold standard, diagnostic accuracy of CPS was moderate (area under curve = 0.73), with low sensitivity, but excellent specificity. When lowering the MMSE cutoff to less than 18 and focusing on patients with severe cognitive impairment, CPS agreement coefficients and sensitivity increased but specificity decreased. Using education-adjusted MMSE cutoffs did not substantially affect the results. CONCLUSION CPS can be used for coarse triage between intact and severe cognitive impairment. Although promising results have been obtained in residential and community settings, our results suggest that CPS fails to differentiate across different levels of cognitive impairment in hospitalized geriatric patients.

Geriatric syndromes predict postdischarge outcomes among older emergency department patients: findings from the interRAI Multinational Emergency Department Study.

OBJECTIVES Identifying older emergency department (ED) patients with clinical features associated with adverse postdischarge outcomes may lead to improved clinical reasoning and better targeting for preventative interventions. Previous studies have used single-country samples to identify limited sets of determinants for a limited number of proxy outcomes. The objective of this study was to identify and compare geriatric syndromes that influence the probability of postdischarge outcomes among older ED patients from a multinational context. METHODS A multinational prospective cohort study of ED patients aged 75 years or older was conducted. A total of 13 ED sites from Australia, Belgium, Canada, Germany, Iceland, India, and Sweden participated. Patients who were expected to die within 24 hours or did not speak the native language were excluded. Of the 2,475 patients approached for inclusion, 2,282 (92.2%) were enrolled. Patients were assessed at ED admission with the interRAI ED Contact Assessment, a geriatric ED assessment. Outcomes were examined for patients admitted to a hospital ward (62.9%, n=1,436) or discharged to a community setting (34.0%, n=775) after an ED visit. Overall, 3% of patients were lost to follow-up. Hospital length of stay (LOS) and discharge to higher level of care was recorded for patients admitted to a hospital ward. Any ED or hospital use within 28 days of discharge was recorded for patients discharged to a community setting. Unadjusted and adjusted odds ratios (ORs) were used to describe determinants using standard and multilevel logistic regression. RESULTS A multi-country model including living alone (OR=1.78, p≤0.01), informal caregiver distress (OR=1.69, p=0.02), deficits in ambulation (OR=1.94, p≤0.01), poor self-report (OR = 1.84, p≤0.01), and traumatic injury (OR=2.18, p≤0.01) best described older patients at risk of longer hospital lengths of stay. A model including recent ED visits (OR=2.10, p≤0.01), baseline functional impairment (OR=1.68, p≤0.01), and anhedonia (OR=1.73, p≤0.01) best described older patients at risk of proximate repeat hospital use. A sufficiently accurate and generalizable model to describe the risk of discharge to higher levels of care among admitted patients was not achieved. CONCLUSIONS Despite markedly different health care systems, the probability of long hospital lengths of stay and repeat hospital use among older ED patients is detectable at the multinational level with moderate accuracy. This study demonstrates the potential utility of incorporating common geriatric clinical features in routine clinical examination and disposition planning for older patients in EDs.

Interrater reliability of the interRAI Acute Care (interRAI AC)

We examined the interrater reliability of the interRAI AC. An observational study was conducted on 3 geriatric wards. Two trained raters completed independently the interRAI AC between 24 and 48 h after admission. A sample of 100 patients (age 84.5 ± 5.6 years; 45% female) was analyzed. Interrater reliability was tested using observed agreement, kappa coefficients, and intraclass correlation coefficients. The overall kappa median value for nominal items was 0.82 (almost perfect). For items on ordinal level, both the overall weighted kappa median and the intraclass correlation coefficient median were 0.86 (almost perfect). According to conventional cut-offs for interpreting kappa statistics, reliability was almost perfect (K ≥ 0.81) for 60% of all items, substantial (0.60 < K ≤ 0.80) for 26%, moderate (0.41 < K ≤ 0.60) for 10%, and poor (K ≤ 0.40) for 4% of the items. The median observed agreement was 0.89. For 83% of the items, the observed agreement was greater than 0.80. This study showed substantial or almost perfect interrater reliability for 86% of the items. In addition to previous evidence, the current results suggest that the estimates of the interrater reliability of the interRAI AC are acceptable and provide preliminary evidence that the current version is appropriate for clinical application.

The interRAI Acute Care instrument incorporated in an eHealth system for standardized and web-based geriatric assessment: strengths, weaknesses, opportunities and threats in the acute hospital setting

BackgroundThe interRAI Acute Care instrument is a multidimensional geriatric assessment system intended to determine a hospitalized older persons’ medical, psychosocial and functional capacity and needs. Its objective is to develop an overall plan for treatment and long-term follow-up based on a common set of standardized items that can be used in various care settings. A Belgian web-based software system (BelRAI-software) was developed to enable clinicians to interpret the output and to communicate the patients’ data across wards and care organizations. The purpose of the study is to evaluate the (dis)advantages of the implementation of the interRAI Acute Care instrument as a comprehensive geriatric assessment instrument in an acute hospital context.MethodsIn a cross-sectional multicenter study on four geriatric wards in three acute hospitals, trained clinical staff (nurses, occupational therapists, social workers, and geriatricians) assessed 410 inpatients in routine clinical practice. The BelRAI-system was evaluated by focus groups, observations, and questionnaires. The Strengths, Weaknesses, Opportunities and Threats were mapped (SWOT-analysis) and validated by the participants.ResultsThe primary strengths of the BelRAI-system were a structured overview of the patients’ condition early after admission and the promotion of multidisciplinary assessment. Our study was a first attempt to transfer standardized data between home care organizations, nursing homes and hospitals and a way to centralize medical, allied health professionals and nursing data. With the BelRAI-software, privacy of data is guaranteed. Weaknesses are the time-consuming character of the process and the overlap with other assessment instruments or (electronic) registration forms. There is room for improving the user-friendliness and the efficiency of the software, which needs hospital-specific adaptations. Opportunities are a timely and systematic problem detection and continuity of care. An actual shortage of funding of personnel to coordinate the assessment process is the most important threat.ConclusionThe BelRAI-software allows standardized transmural information transfer and the centralization of medical, allied health professionals and nursing data. It is strictly secured and follows strict privacy regulations, allowing hospitals to optimize (transmural) communication and interaction. However, weaknesses and threats exist and must be tackled in order to promote large scale implementation.

Validity of the interRAI Acute Care based on test content: A multi-center study

Background and aims: The MDS inter-RAI Acute Care is a comprehensive geriatric assessment tool for hospitalized older persons. The aim was to examine its validity based on test content by use in daily clinical practice. Methods: Clinical staff of multiple disciplines assessed 256 older persons (83.2±5.2 years; 60% female) in a cross-sectional multicenter study in nine acute hospitals. Test content was empirically tested by frequency distribution of clinical deficits, missing, and invalid data. Item relevance was quantified by the content validity index (CVI) and modified kappa statistics (κ*) based on assessors’ judgment. Results: Clinical deficits exceeded 30% in the majority of items (67%) across all assessment periods. Mean missing data for premorbid, admission, day-14 and discharge assessments were 9.7%, 5.3%, 29.3% and 13.7%, respectively. Invalid scores ranged from 3.9% to 26.7%. Of the 98 items, 82 had excellent CVI (≥0.78). Item relevance was excellent for 82 (κ*≥0.75), good for 9 (0.60≤κ*=0.74) and fair for 3 items (0.40=≤κ*<0.60). Item revision may optimize clinical relevance: removing 4 items with poor relevance would increase the overall CVI from 0.89 to 0.91, meeting the standard of excellent content validity (CVIaverage≥0.90). Conclusions: Although the frequency distribution provides evidence that item selection of the interRAI Acute Care is appropriate for the targeted population, its use in a clinical context reveals a substantial number of missing and invalid data. To improve validity, training should pay specific attention to items with low compliance and invalid records. Software applications should also be designed to improve data quality.

Methods to assess the reliability of the interRAI Acute Care: a framework to guide clinimetric testing. Part II

The interRAI Acute Care is a comprehensive geriatric assessment tool that provides a holistic picture of complex and frail hospitalized older persons. It is designed to support holistic care planning and to transfer patient data across settings. Its usefulness in clinical decision making depends on the extent to which clinicians can rely on the patient data as accurate and meaningful indicators of patients functioning. But its multidimensional character implies challenges for clinimetric testing as some of the traditional analyses techniques cannot be unconditionally applied. The objective was to present an overview of methods to examine the reliability of the interRAI Acute Care. For each line of evidence, examples of hypotheses and research questions are listed.