Disability and Rehabilitation · 2008 · 35 citations · 10 references
EducationRehabilitation MedicineDisability InsuranceFunctional AssessmentPhysical DisabilitiesDisability AssessmentDisability EvaluationMedical Aspects Of DisabilityPatient AssessmentTest ReliabilityAssessmentsInter-rater AgreementInter-rater ReliabilityInter-rater Reliability AssessmentInterrater ReliabilityNurse PractitionersPatient-reported Functional StatusWork Limitations Questionnaire
PURPOSE: To investigate whether physicians are able to perform a disability assessment based on a written report and to assess the inter-rater reliability between physicians in the assessment of work limitations. METHOD: In total, 12 insurance physicians used written reports to assess work limitations in 12 patients. The reports involved a semi-structured interview executed by a nurse practitioner. The insurance physicians were asked whether they could make reliable assessments based on these reports. In addition, inter-rater reliability was measured by computing their percentage agreement with respect to the mental and physical items of two Dutch disability lists (the Functional Information System and the Mental Ability List). RESULTS: The quality of the reports was evaluated as reasonable to good. Half the physicians found the assessment based on the reports to be reasonably reliable, 25% found the opposite and 25% was indecisive. The overall agreement between the insurance physicians was reasonable to good, with a mean agreement of 76% (range 64 - 88%). Agreement between the physicians concerning the number of hours a patient could function daily was low. CONCLUSIONS: Half the physicians thought that a reliable assessment based on the written information was possible. The quality of written patient reports made by nurse practitioners trained in conducting a semi-structured interview was considered reasonable to good by insurance physicians. The inter-rater reliability between insurance physicians of physical-disability and mental-disability assessment based on the written reports was reasonable to good. The assessment of the number hours patients could function daily had low inter-rater reliability.
10
The Measurement of Observer Agreement for Categorical Data
J. Richard Landis, Gary G. Koch · Biometrics · 1977 · 78.9K citations · Full text
Validity of work-related assessments
Ev Innes, Leon Straker · Work · 1999 · 165 citations
Reliability of work-related assessments
Ev Innes, Leon Straker · Work · 1999 · 161 citations
Social Sciences, Occupational Health Nursing, Functional Assessment +8
Sandra Brouwer, PU Dijkstra, JW Groothoff et al. · Disability and Rehabilitation · 2005 · 77 citations