HOMERuN Hospital Medicine Collaborative Research Group

Research Collaboration Proposals

Improving Patient Centered Outcomes through Accountable Care Units: A Comparative Effectiveness Trial of Traditional Care Model to Accountable Care Unit Model

Proposal Status: 

PI name and affiliations: Marisha A. Burden, MD, Denver Health and Hospital Authority, University of Colorado School of Medicine; Angela Keniston, MSPH, Denver Health and Hospital Authority

Site PI name and affiliations: Flora Kisuule, MD, MPH, Johns Hopkins School of Medicine; David Paje, MD, MPH, University of Michigan; Keri Holmes-Maybank, MD, Medical University of South Carolina; Hemali Patel, MD, University of Colorado Hospital, University of Colorado School of Medicine; Jeremy Schwartz, MD, Yale School of Medicine

Potential co-investigators: Jason Stein, MD, 1Unit; Katarzyna Mastalerz, MD, Presbyterian St. Luke's Hospital, University of Colorado School of Medicine; Jon Manheim, MD, Presbyterian St. Luke's Hospital, University of Colorado School of Medicine; Ed Havranek, MD, Denver Health and Hospital Authority, University of Colorado School of Medicine; John Rice, PhD, ACCORDS, University of Colorado School of Medicine

Patient partner: Michelle Archuleta

 

Program overview/introduction:

The purpose of this proposal is to evaluate a continuum of existing inpatient hospital care models ranging from the traditional care model to the accountable care unit model (ACU) by conducting a pragmatic observational, comparative effectiveness study.

Key clinical questions or evidence gaps:

Fragmented hospital care is common and leads to medical errors, increased utilization of health care and affects many stakeholders including patients, front line staff, and hospital leadership and administration. Currently, the optimal model of care on inpatient medical units is not known. One proposed model of care is the accountable care unit model (ACU) which consists of geographically based teams, structured interdisciplinary bedside rounding, nurse physician leadership dyad, and unit level data (1). Single center observational studies of components of this framework have suggested improved patient-centered outcomes such as patient and family experience of care (2), team communication and collaboration (3), and clinical outcomes (4).  However, there have been no head to head multisite comparisons published on accountable care unit models compared to traditional care.

The proposed study is designed to test the extent to which and for whom the ACU model will be more effective at engaging patients, improving communication across care teams and with patients, and improving clinical outcomes compared to traditional care model. Clinical stakeholders, administrative leaders and healthcare systems need to know which model (and which parts of the models) improves patient centered outcomes and the outcomes of interest to the key stakeholders. We propose a multi-hospital, pragmatic, observational, comparative effectiveness study in which we first assess the fidelity to the ACU care model on a particular unit or by a particular team, followed by observational data collection for the comparative effectiveness study of traditional care models versus accountable care unit models (high versus low fidelity to the components of the ACU).

Aims and Hypotheses:

Specific Aim 1. To assess fidelity to the accountable care unit model with differing levels of ACU model implementation to further refine protocol and prepare for the comparative effectiveness trial.

Aim 1a. Engage patients, families, and caregivers, clinical staff (nursing, providers, other clinical staff), health system administrators and clinical leaders to refine characterization of low and high fidelity ACU units and plan data utilization, collection procedures, and reporting.

Aim 1b. Assess the fidelity of participating sites to the ACU model by measuring through direct observation and at regular intervals, the specific structure and processes and elements present in both the ACU and traditional care model units/teams.

Specific Aim 2. To conduct a pragmatic, observational, comparative effectiveness study on a continuum of existing care models from the traditional care model (with 2 or less of ACU criterion) to the accountable care unit model (with all four criteria)

Aim 2a. Compare patient-centered outcomes such as shared decision-making and patient-reported anxiety and depression levels

Aim 2b. Compare clinical staff outcomes, including interprofessional collaboration amongst care teams and staff assessment of patient safety and quality of care

Aim 2c. Evaluate unit/team level quality outcomes important to patients, clinical care teams, and institutional leadershiputilizing data available through CDRN's and EHRs

Aim 2d. Compare engagement of patients, families, and caregivers, clinical staff, and hospital administrators through qualitative interview process and focus groups about their experiences with traditional care model and ACU model.

Hypotheses (Quantitative): Patients hospitalized in units with high fidelity to ACUs will experience better patient centered outcomes, interprofessional team outcomes, and clinical outcomes compared to traditional care models.

Any preliminary data:

As a part of our current and past work, we have engaged our patient stakeholders, patient partners, clinical staff stakeholders (including nursing, providers, social workers, physical therapists and occupational therapists, and pharmacists), and administrative and clinical leaders. We have conducted multiple focus groups with patients and families, clinical staff, and administrative leaders to better understand what patients want and need in their care and similarly how care teams perceive and experience the way patients are cared for. We have also engaged our local Patient and Family Advisory Council and members of the Colorado Patient Partners in Research network (CoPPiR) along with national experts in ACU model to help us choose the outcome metrics and develop the study methodology. We have also submitted a comparative effectiveness study to PCORI to study mentored implementation of accountable care units compared to traditional care, which is under review and will be complementary to this proposed study.

Study design, including study subjects (patients and/or providers) and setting, comparator groups, data sources, outcomes, analysis plan, power and sample size, limitations, and timeline:

Study design. This is a multi-hospital, within-hospital, pragmatic observational comparative effectiveness trial. A mixed-methods evaluation will include quantitative (patient and frontline clinical staff surveys, data collection via electronic health records, and participation and intervention fidelity tracking data) and qualitative (individual interviews and focus groups of patients, families, and care providers, staff, and leadership).

Study Population and Setting: Adult Spanish and English-speaking patients admitted to a Medicine service and being cared for in participating hospital inpatient units. All CRG sites would be invited to submit applications to participate. Hospitals will be selected to ensure sufficient variability between low and high fidelity units across selected sites.

Comparators: Because of the evolving nature of the care of patients who are hospitalized, our research team and stakeholders felt that in most cases some components of the ACU model are already employed in many hospitals thus we chose as the comparator to have two or less of the ACU components.

1. Traditional care model. For the existing care model to be considered traditional, no more than two ACU characteristics can be in place in the participating hospital inpatient unit.

2. Accountable care unit model. For an existing model to be considered an ACU, the four key characteristics must be in place including geographically located teams, standardized interdisciplinary bedside rounding, nurse-physician dyad leadership model, and unit level reporting.

Outcomes: The primary outcomes, as selected in conjunction with our stakeholders, are patient-reported experience of shared decision-making, clinician-reported perception of interprofessional collaboration, and hospital length of stay. Secondary outcomes include patient-reported symptoms of anxiety and depression, clinician assessment of patient safety and quality, ICU length of stay, rapid response calls, patient falls, inpatient mortality, time of discharge, unexpected returns to the hospital within 30 days of discharge, and HCAHPS survey results (including the nurse and physician communication composites and pain control composite).

Data Sources: Data will come in a variety of formats including patient surveys, care team member surveys. Additional data sources will be from the electronic health record and CDRN databases including PCORnet. Data will include but will not be limited to: hospital length of stay, intensive care unit length of stay, rapid response calls, patient falls, inpatient mortality, time of discharge, and unexpected return to the hospital within 30 days of discharge. All clinical effectiveness outcomes data will be obtained from hospital EHRs and CDRN databases and thus availability of data will not be dependent on patient participation, allowing for estimates of effectiveness among all patients who received care in specific types of care models as well as sub-analyses among those patients who were willing and able to complete patient-centered outcomes surveys with the research assistant. EHR extracts will include patient demographics, patient clinical history data, quality outcomes, and HCAPHS survey results.

In addition to better understanding quantitatively the types of existing care models, we hope to also utilize a qualitative approach as well. By utilizing purposive sampling techniques to recruit perspectives from a variety of stakeholders we hope to hold several focus groups and individual interviews to better understand how a wide variety of stakeholders experience the care model being utilized by their hospital.

Analytic Plan: We will compare our primary outcomes among models of care across all hospital units using linear mixed models, assuming these scores are approximately Gaussian distributed. We will include a parameter to represent the random effect of hospital unit, as patients in the same hospital unit will likely have correlated outcomes. We will include a fixed binary effect for model type and other patient- and hospital-level factors that we presume will be associated with the outcomes, such as age, gender, race, primary language and discharge diagnoses. All analyses will be performed in a statistical software program, such as R or SAS.

Sample Size and Power Calculations. N (total) = 15 hospitals, 7,500 patients (1 unit per hospital and 500 patients per unit), allowing for 30% attrition (leaving approximately 5,250 patients or 350 patients per unit per hospital).

Limitations: We will be studying an array of care models with the foundation for the comparison being whether the model utilized is high versus low fidelity to the ACU model harnessing the power of a natural experiment. Sites that have adopted the ACU model of care may be more progressive or more focused on improvement and thus results may be biased by those inherent traits. If funded, we plan on having a robust process to solicit applications for participation and will prospectively assess both current and past improvement efforts as well as models of care previously utilized. We hope to select a wide array of institutions that are diverse including hospital settings such as community hospitals, academic medical centers and centers that care for underserved populations like safety net institutions. This research is also observational in nature and thus there could be unmeasured and unknown causes of variance because the study does not include randomization. Healthcare systems are dynamic and continually working on improvement efforts, which could also affect findings.

Timeline: 3-5 years

Characteristics of sites who might participate: We have developed a rich network of research partners across the country, including six sites with who we previously submitted an Improving Healthcare Systems PCORI grant together. We anticipate that these sites, along with additional hospitals with whom we have partnered for other projects, will participate in this study. We would also have a larger call to other healthcare systems across the country to recruit sites that are as diverse as possible and also having implemented the ACU model to varying degrees.

Potential funders with RFA/RFP and due dates:

1. Pragmatic Clinical Studies to Evaluate Patient-Centered Outcomes - Cycle 2 2017 – letter of intent due 7/25/2017

2. AHRQ Health Services Research Projects (R01) (PA-14-291) – expiration date July 6, 2018

References:

1. Stein J, Payne C, Methvin A, et al. Reorganizing a hospital ward as an accountable care unit. J Hosp Med 2015;10:36-40.

2. Landry MA, Lafrenaye S, Roy MC, Cyr C. A randomized, controlled trial of bedside versus conference-room case presentation in a pediatric intensive care unit. Pediatrics 2007;120:275-80.

3. Gonzalo JD, Kuperman E, Lehman E, Haidet P. Bedside interprofessional rounds: perceptions of benefits and barriers by internal medicine nursing staff, attending physicians, and housestaff physicians. J Hosp Med 2014;9:646-51.

4. Kara A, Johnson CS, Nicley A, Niemeier MR, Hui SL. Redesigning inpatient care: Testing the effectiveness of an accountable care team model. J Hosp Med 2015;10:773-9.

Comments

Hi Marisha, Thanks for submitting this proposal. It is great to see how you have engaged patients and other stakeholders to inform the development and design of this study. How do plan to engage patients and other stakeholders throughout implementation and dissemination? 

Hi James,

Thank you for your comment and question.  We have identified key stakeholders for this study, which include patients and caregivers, clinical staff (doctors, nurses, and other clinical care team members), and administrative and clinical leadership with important experiential knowledge of hospital care. We have developed a model for an Advisory Stakeholder Panel, which will include representatives from each of the study sites in each of the key stakeholder groups (nurse, physician, patient partner, or administrative partner) who will also engage in stakeholder feedback at their respective institutions.  We have already utilized surveys and in-person focus groups to select our current outcome metrics. We will continue to utilize these stakeholders throughout our study and will track the continued contributions to this study.

Patient and clinician stakeholder partners will also be involved in the interpretation of results and dissemination of these results.  Their opinions and input will be invited throughout the study process.  Our stakeholders will help us to plan dissemination efforts and select novel and insightful ways to share information.  We will also utilize our patient and stakeholder partners to identify key partner organizations for dissemination.  Lastly, every study participant we consent for the study will be offered the opportunity to have the results made available to them in a way that is most preferable to them (electronically or mailed). They will also be invited to further share these results in their respective communities. 

We anticipate that once we secure funding for this project that patient partners and stakeholders not listed on the grant as investigators will be compensated for their time as their input is vital to this project.  Please let us know if you need any further specific details or have additional questions.

Sincerely,
Marisha Burden and Angela Keniston

Thanks Marisha and Angela for your response. It is great to see how many different ways, and at different stages of the project, you will engage patients and family members. In addition, HOMERuN is in the process of creating a Patient & Family Advisory Council - this could also be another opportunity to get patient stakeholder input. 

that will be a great resource!  thank you for letting us know about the HOMERuN Patient and Family Advisory Council

Great topic and proposed study. Will any of the implementation involve the use of Lean management and operating principles and tools - such as value stream mapping, A3 thin king, work standardization, visual management displays etc.?  If so, our Center at Berkeley may be able to contribute - particyulalry in regard to qualitative part of the study. Additional hypothesis or proposition to consider is that those hopsital ACUs using Lean will have better outcomes than those not using Lean.

 

Our websit is www.clear.berkeley.edu.

 

Best

Steve Shortell

 

 

Steve,

Thank you for your comment.  LEAN is utilized very heavily at Denver Health.  For the purposes of this study, we hadn’t planned on utilizing LEAN as we are hoping to study the current state of institutions with variable implementation of the components of the ACU model.  We have submitted a different PCORI grant on a similar topic where we will be implementing ACU’s.  In that study, we do plan to standardize data reporting to the ACU teams and will be utilizing tools such as visual management boards.  Thank you for providing the website, we will certainly explore it!
Sincerely,
Marisha and Angela

This is a great proposal concept. I think the ACU model is at a good stage for a multisite replication study like this with additional attention to fidelity of implementation. One suggestion is to incorporate caregivers in some way -- perhaps survey their perception about being involved in the patient's care and decision-making in the hospital, and whether the ACU model helps them be more engaged after discharge in assisting with the patient's recovery.

Hi Sunil,

Thank you for your comment.  For Aim 2a, we plan to assess two patient centered outcomes: (1)  We plan to assess communication and shared decision making via the validated CollaboRATE survey (Elwyn et al.) and assess patient-reported anxiety and depression utilizing the validated Hospital Anxiety and Depression Scale (HADS) (Zigmond and Snaith).  CollaboRATE does have a survey for individuals acting on behalf of patients though not validated.  http://www.collaboratescore.org/patient-representatives.html.  In addition, we plan to conduct qualitative interviews with patients and family members/caregivers in the hospital about their experiences with a focus on how patients experience components of the ACU (i.e. structured interdisciplinary bedside rounding). 

I agree that caregiver perspective is very important.  Do you have experience with any particular surveys for caregivers that might work for the purposes of this study?  I will do some more exploration as well.  Thank you for this suggestion!

Marisha and Angela

We have implemented an ACU model at our hospital with great success on our non-resident hospitalist units but less robust application on our teaching units and surgical units. It could be interesting to compare impact based on units with learners with hour restrictions/turnover of workforce each month as well as interventional units where teams are largely in the OR during the day. Would love to see solutions on how to do this better on those types of units--at least at our hospital, that would be valuable information.

Thank you Ann for your comment!   I agree completely.  We hope to include both teaching and non-teaching settings.  We are now possibly looking at having more sites based on the concept discussion on 7/27 which I think will add to the feasibility of understanding those differences.

Hi Marisha - I think it would be interesting to expand some of the descriptive work you propose in Aim 1 to: a) look at which components of ACU are more commonly implemented, and if there are particular combinations that are more prevalent. This might suggest that those elements are either easier implement and/or perceived as higher value by hospitals and health systems. b) assess what the perceived barriers are to implementing certain components of ACU. For example, at our institution, we've intermittently been able to do geographic rounding; one of the reasons it's never really 'stuck' is because it apparently increases ED boarding times. Another issue is that even though people love the IDEA of bedside interdisciplinary rounds, they have also never really caught on because of the logistical challenges in coordinating everyone's schedules to round at the same time. It would be valuable to know if these (and other challenges) are common issues facing 'low fidelity' sites, and how some sites have been able to overcome them.

For Aim 2, I'm not sure if you'd have the numbers to do it (or if this is even feasible) but I wonder if you could do nested/sequential models to figure out which components of ACU have the most influence on your outcomes of interest (i.e., rather than using number of ACU components as an ordinal measure of fidelity).

Hi Oanh,

Thank you for your comments.  You make some great points.  Because we will be tracking which components are utilized on each of the units/teams, we should be able to understand which components are the most commonly implemented though this will be biased to some degree since we will be screening potential sites to ensure we have both high and low fidelity models.  I think overall this will be very feasible to do.  Because we also plan to conduct qualitative interviews, I believe we will be able to capture the common challenges as well.   Re: Aim 2, we do hope to be able to distinguish which components (and for which populations) impact the outcomes of interest.

Thank you again!
Marisha 

Our patient engagement team discussed your project earlier today and I have been asked to summarize this discussion. The patient advisors on this team had some specific comments/questions:
  • They were encouraged to see your openness and willingness for patient, family member and caregiver engagement. Based on their experiences in multi-center studies they felt that having access to at least 2 advisors at each site would be important to ensure that locally the patient/family/caregiver perspective is incorporated. Given the potential for local issues impacting on implementation of the ACU the patient perspective would be very important. The reason for 2 advisors is so that they can support one another and provide cover for each other when one is unavailable. These local advisors should then interact with the central project steering committee. 
  • For Aim 2 activities ensuring all questions are vetted by patient stakeholders is essential– this would ensure they resonate and were relevant for these groups. Similarly ensuring that ANY patient facing study materials, communications should be checked by patient advisors on the project to ensure clarity and patient centeredness. 
  • It would be important to see specifically what patient reported outcomes are available and see which of these would resonate and be important to patients and families and then include. They felt that responses to press ganey/HCHAPS questions would likely be too generic and some other patient reported outcomes may be more relevant. 

Thank you so much for this feedback.  We will incorporate this feedback into our current grant application.

Marisha and Angela

Commenting is closed.