Reliability, validity and relevance of needs assessment instruments for informal dementia caregivers: a psychometric systematic review.

Abstract

OBJECTIVE\nThe objective of this review is to identify reliable and/or valid needs assessment instruments for informal dementia caregivers which are relevant for clinical practice, research and informal caregivers.\n\n\nINTRODUCTION\nInformal dementia caregivers report important unmet needs at all stages of the disease. In addition, they often indicate that health care providers insufficiently attend and adapt to their multiple needs. A systematic and patient-centered assessment is needed to address this lack of knowledge and understanding. However, existing quantitative needs assessment questionnaires are limited in terms of psychometric testing. Qualitative measures are time intensive and difficult to conduct on a large scale, with growing economic pressure. Information about the methodological quality and the characteristics of needs assessment instruments are crucial for clinicians and researcher to make informed decisions about the most reliable and valid tool for their specific purpose.\n\n\nINCLUSION CRITERIA\nThis review considered studies on multidimensional needs assessment instruments for assessing the needs of informal dementia caregivers, living at home. Psychometric studies or other type of studies with sufficient data to evaluate methodological quality were included if they considered at least one outcome for reliability or validity.\n\n\nMETHODS\nStudies in English, French or German and published until February 2019 were searched in four databases: Embase, MEDLINE, CINAHL and PsycINFO. After screening the titles, abstracts or full-texts for eligibility, the provisional included studies were assessed for methodological quality with a standardized tool for systematic reviews of measurement properties. After data extraction using a standardized tool, the quality of the measurement properties was rated and compared using predefined quality criteria.\n\n\nRESULTS\nEighteen articles covering 14 different needs assessment instruments were included in the review. Eleven publications focused on the development or the evaluation of an instrument. In addition, a development report, a manual and five studies, not aimed primarily at validation but containing sufficient information about the development or the evaluation of the used instruments, were included. The systematic evaluation of the instruments revealed that half of them had excellent content validity. In contrast, structural validity was rarely examined, and mostly with an insufficient sample size or a questionable analysis. None of the instruments had an optimally tested and good internal consistency. Regarding reliability, test-retest agreement was rarely tested and inter-rater agreement was evaluated using controversial procedures. Comparing the different instruments reviewed, the Partnering for better health - living with chronic illness: dementia had the best psychometric evidence, and the Questionnaire of consultation expectations was also partly supported, while most other instruments presently had limited psychometric soundness.\n\n\nCONCLUSIONS\nDespite the good evidence for some psychometric properties, further developments in the field of needs assessment for informal dementia caregivers are needed, particularly regarding structural and construct validity, as well as test-retest reliability and sensitivity to change. To enhance conceptual clarity, the development of an underlying theoretical model of needs should be prioritized.