TY - JOUR
T1 - Psychometric evaluation of a comprehensive medication management service experience instrument
AU - Campbell, Patrick J.
AU - Axon, David R.
AU - Anderson, Elizabeth J.
AU - Ekstrand, Molly J.
AU - Brummel, Amanda
AU - Warholak, Terri
N1 - Funding Information:
Disclosures: Patrick J. Campbell reports grants from Community Pharmacy Foundation (grant number 220), outside the submitted work, and is an employee of Merck and Co, Inc, Kenilworth, NJ. At the time of the study, Patrick J. Campbell was an employee of the University of Arizona College of Pharmacy. David R. Axon reports grants from Pharmacy Quality Alliance, grants from Merck and Co, grants from Tabula Rasa HealthCare Group, grants from Arizona Department of Health Services (grant number CTR041521), and grants from American Association of Colleges of Pharmacy, outside of the submitted work. Amanda Brummel reports personal fees from Merck, during the conduct of the study; personal fees from Pfizer; personal fees from Lilly; personal fees from Boehringer Ingelheim; and personal fees from UCB, outside the submitted work. Terri Warholak reports grants from Pharmacy Quality Alliance, grants from Merck and Co, grants from Tabula Rasa HealthCare Group, grants from Arizona Department of Health Services, and grants from Novartis (grant number BYL719-2017-01), outside of the submitted work. The authors declare no other relevant conflicts of interest or financial relationships.
Publisher Copyright:
© 2022 American Pharmacists Association®
PY - 2022/1/1
Y1 - 2022/1/1
N2 - Background: The Health-Systems Alliance for Integrated Medication Management (HAIMM) instrument was developed to estimate patient experience following pharmacist-delivered comprehensive medication management (CMM). Objectives: The objective of this paper was to assess the psychometric properties and factor structure of the HAIMM instrument. Methods: Data were collected from 5 members of the HAIMM collaborative. A one-factor confirmatory factor analysis (CFA) model was used to assess instrument dimensionality. A partial-credit item response theory model was used to assess the psychometric properties of the ten-item HAIMM patient experience instrument, consisting of tests for rating scale functioning, person and item fit, and content validity. Results: Among 516 respondents, there was a strong skew toward high satisfaction, including a strong ceiling effect. CFA results suggest a unidimensional construct. Item difficulty was spread across a low range and content redundancies were identified. The mean-square values for both infit and outfit all fell within the recommended range, whereas the z-standard fit was within the recommended range for most items. The 5-point Likert scale used in the HAIMM instrument did not distinguish between participants’ level of experience following the pharmacist-delivered CMM service. Conclusion: The psychometric analysis showed the HAIMM survey tool does not cover all of the content that should be assessed to fully evaluate CMM experiences. In its current form, the HAIMM instrument should not be used to make comparisons about the quality of CMM services provided, although it may be useful to monitor patient satisfaction for quality improvement purposes. Further research is required to develop an improved instrument that contains expanded content coverage, response options, and aspects of CMM to be useful by health care providers, health systems, and other decision makers.
AB - Background: The Health-Systems Alliance for Integrated Medication Management (HAIMM) instrument was developed to estimate patient experience following pharmacist-delivered comprehensive medication management (CMM). Objectives: The objective of this paper was to assess the psychometric properties and factor structure of the HAIMM instrument. Methods: Data were collected from 5 members of the HAIMM collaborative. A one-factor confirmatory factor analysis (CFA) model was used to assess instrument dimensionality. A partial-credit item response theory model was used to assess the psychometric properties of the ten-item HAIMM patient experience instrument, consisting of tests for rating scale functioning, person and item fit, and content validity. Results: Among 516 respondents, there was a strong skew toward high satisfaction, including a strong ceiling effect. CFA results suggest a unidimensional construct. Item difficulty was spread across a low range and content redundancies were identified. The mean-square values for both infit and outfit all fell within the recommended range, whereas the z-standard fit was within the recommended range for most items. The 5-point Likert scale used in the HAIMM instrument did not distinguish between participants’ level of experience following the pharmacist-delivered CMM service. Conclusion: The psychometric analysis showed the HAIMM survey tool does not cover all of the content that should be assessed to fully evaluate CMM experiences. In its current form, the HAIMM instrument should not be used to make comparisons about the quality of CMM services provided, although it may be useful to monitor patient satisfaction for quality improvement purposes. Further research is required to develop an improved instrument that contains expanded content coverage, response options, and aspects of CMM to be useful by health care providers, health systems, and other decision makers.
UR - http://www.scopus.com/inward/record.url?scp=85114288129&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85114288129&partnerID=8YFLogxK
U2 - 10.1016/j.japh.2021.08.024
DO - 10.1016/j.japh.2021.08.024
M3 - Article
C2 - 34493457
AN - SCOPUS:85114288129
SN - 1544-3191
VL - 62
SP - 218
EP - 223
JO - Journal of the American Pharmacists Association
JF - Journal of the American Pharmacists Association
IS - 1
ER -