Skip to main content

Validity and reliability of the Johns Hopkins Adapted Cognitive Exam for critically ill patients

Introduction

Assessment of cognition in ICU patients is a critical component of evaluating cerebral dysfunction. Several cognitive tools also exist for assessment of delirium in the ICU. However, few are simple to use and none has been specifically designed to focus on cognition in ICU patients. The Johns Hopkins Adapted Cognitive Exam (ACE) is an examination tool on a 100-point scale specifically designed for the assessment and quantification of cognition in critically ill patients.

Methods

A prospective cohort study to establish the criterion, construct, and face validity, as well as inter-rater reliability and inter-item reliability of the ACE.

Results

A total of 106 patients were assessed, 46 intubated and 60 non-intubated, resulting in 424 ACE measurements and 240 MMSE measurements. ACE and MMSE were performed by 76 different raters over the study period. For criterion validity we compared ACE with a neurointensivist's assessment of cognitive status (rs = 0.83, P < 0.001). In addition we utilized an ordinal logistic regression model to establish optimal predicted cut-off points for cognitive status classification (< 28 = severely impaired, 29 to 55 = moderately impaired, >56 = mildly impaired or normal). Utilizing these cut-off points, the ACE appropriately classified cognitive status 90% of the time as compared with the neurointensivist assessment. Construct validity was established by comparing ACE with MMSE in non-intubated patients (rs = 0.81, P < 0.001). Face validity was assessed by surveying raters who used both the ACE and MMSE during the study, and indicated the ACE was an accurate reflection of the patient's cognitive status, was more sensitive a marker of cognition than the MMSE, and was easy to use. The ACE demonstrated excellent inter-rater reliability (ICC = 0.997, 95% CI = 0.997 to 0.998). In addition, inter-item reliability of each of the five subscales of the ACE and MMSE was also assessed (Cronbach's alpha: range for ACE = 0.83 to 0.88; range for MMSE = 0.72 to 0.81), demonstrating a higher degree of internal consistency across subscales for the ACE.

Conclusions

The ACE is the first valid and reliable examination for the assessment and quantification of cognition in critically ill patients. It provides a useful, objective tool that can be utilized by any member of the interdisciplinary critical care team to support clinical assessment and research efforts.

References

  1. 1.

    Mirski MA, Lewin JJ, Ledroux S, et al.: Cognitive improvement during continuous sedation in critically ill, awake and responsive patients: the Acute Neurological ICU Sedation Trial (ANIST). Intensive Care Med 2010, 36: 1505-1513. 10.1007/s00134-010-1874-9

    Article  PubMed  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to MM Mirski.

Rights and permissions

This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Cite this article

Mirski, M., Lewin, J., Ledroux, S. et al. Validity and reliability of the Johns Hopkins Adapted Cognitive Exam for critically ill patients. Crit Care 15, P362 (2011). https://doi.org/10.1186/cc9782

Download citation

Keywords

  • Cognitive Status
  • Face Validity
  • Ordinal Logistic Regression
  • Accurate Reflection
  • Cognitive Tool