HOMERuN Hospital Medicine Collaborative Research Group

Research Collaboration Proposals

Identification and validity of hospital observation encounters in administrative data

Proposal Status: 

PI name/affiliations:

Ann Sheehy, MD, MS

Associate Professor and Division Head, Hospital Medicine

University of Wisconsin Department of Medicine

Potential Co-investigators: Would seek investigators with interest in observation hospital policy to study a representative sample of United States hospitals. This would ideally include urban/rural/community sites, academic/community hospitals, and geographically diverse institutions.

Program overview/introduction: Outpatient (observation) hospital care has grown over the last decade. From 2006-2015, there was a 47.4% increase in outpatient services and 19.5% reduction in inpatient discharges for Medicare beneficiaries according to Medicare Payment Advisory (MedPAC).1 Medicare’s recent (2013) change to the observation definition, the so-called “2-midnight rule” has resulted in more outpatient encounters (8.1%) in the first year (2014) under the new rule. Compared to 2013, in 2014 there were also more stays of 3 midnights or longer (6%) that did not meet Medicare’s three consecutive inpatient midnight requirement for skilled nursing facility care.2

From a patient perspective, these findings are important because Medicare inpatient hospital stays are covered by Medicare Part A hospital insurance and outpatient observation stays are covered differently under Medicare Part B, which means a patient may pay out of pocket different amounts for the same services depending on whether the hospital stay is considered inpatient or outpatient. Importantly, outpatient nights spent in a hospital do not count towards the 3 consecutive inpatient requirement for skilled nursing facility coverage. From a hospital perspective, Medicare hospital outpatient care has an approximately 10% more negative margin than inpatient.3

Key clinical questions or evidence gaps: Most, if not all, hospitalists encounter patients hospitalized under observation, yet observation remains poorly understood and research is needed.  Barriers to observation research include identifying such claims in administrative data sets, understanding observation in Medicare claims data, dealing with frequent policy change that may impact encounter frequency and type, and possible utilization variability across hospitals or health care systems. The following are key questions/evidence gaps:

1). Are source data valid to accurately identify observation encounters in administrative data sets (i.e. the “OS” Encounter type (ENC_TYPE) variable)?

2). What are differences between Medicare observation and commercial payor observation stays?

3). What types of patients do clinically or financially well under observation, and who is disadvantaged?

4). By patient diagnosis (i.e. lung cancer, renal failure, etc.), what are the outcomes of observation stays?

5). When comparing the same patient type, are there differences between ward based and unit based observation care (i.e. patient selection, social and demographic factors, source of entry into observation encounter, etc.)?

6). What is the source of entry for observation stays? Is it the ED, clinics, outside hospitals? Are there differences in these types of observation encounters?

Aims and Hypotheses:

Primary Aim: To validate observation encounters in administrative data sets, including the “OS” Encounter type (ENC_TYPE) variable in the PCORnet data set, and UHC data.

Rationale: The OS Encounter Type is included in v.3.1 and is new and may be variably reported by sites. In addition, it is not clear how UHC sites report their observation encounters. Based on our experience, identification of observation claims can be challenging based on how encounters are billed and if there was a status change. Understanding what sources are able to report observation encounters accurately and validating the observation variable will create infinite possibilities for further observation research. Additional aims will be outlined based on reliability of the observation encounter variable in these data sets. 

Hypotheses

1). There will be variability in source reporting of observation encounters

2). Hospitals reporting observation encounters will use a similar methodology if using a similar electronic health record (EHR)

Study design: The study design would depend on data sources used, and ability to access primary data and discuss basic information from submitting sites. For example, if using PCORnet data, we would want to first determine what sites submitted encounter type “OS” (observation) and calculate a percent of sites reporting. Depending on number of sites reporting OS encounters, we would then want to ask these sites (or a sample of these sites) what EHR they have and what methodology they used for determining observation stays. A sample chart review of OS encounter type stays, and ideally, a sample review of encounters where status changes from inpatient to observation and vice versa would be ideal.

Characteristics of sites who might participate: This would require more discussion based on sites reporting. As per above, ideally we would have a representative sample of United States hospitals to study which would ideally include urban/rural/community sites, academic/community hospitals, and geographically diverse institutions.

Potential funders: Initially we would fund this with Department of Medicine/Division of Hospital Medicine research development funds and personnel. Assuming this variable can be validated and used, funding for future projects would depend on the project-specific goal. For example, looking at cancer patient outcome after observation hospitalization may prompt submission to an NCI RFA.

1). MedPAC March 2017 Report to Congress: Medicare Payment Policy. Available at:  http://medpac.gov/docs/default-source/reports/mar17_entirereport224610adfa9c665e80adff00009edf9c.pdf?sfvrsn=0. Accessed July 7, 2017.

2). OEI-02-15-00020 Office of Inspector General: Vulnerabilities Remain Under Medicare’s 2-Midnight Hospital Policy. Available at: https://oig.hhs.gov/oei/reports/oei-02-15-00020.pdf. Accessed July 7, 2017.

3). MedPAC March 2015 Report to Congress. Medicare Payment Policy. Figure 3-5. Available at: http://medpac.gov/docs/default-source/reports/mar2015_entirereport_revised.pdf?sfvrsn=0. Accessed July 7, 2017.

 

Comments

Hi Ann - you spoke a lot during the call about the need to assess the validity of encounters coded as 'observation' stays. What do you plan to use as a 'gold standard' to define a true observation stay?

Thank you for your comment and question. Our goal would not be to define a true observation stay, given that insurance companies may differ in what criteria they use to determine observation, and even different Medicare auditors may enforce observation rules differently. Rather, our goal would be to determine that stays billed as observation were recorded as such in the dataset. The gold standard would be identification of an observation claim in billing data. We would then want to be sure this was coded as "OS" in the data set. Methods may depend on how we can view data, but ideally this would involve a chart review of observation claims and possibly other inpatient short stays at several sites to determine that all observation claims are being coded accordingly, and that short inpatient stays are not. We are also currently working on a Medicare-specific methods project on a different data set and could hopefully add that methodology to this project for the Medicare patients as well. I hope that helps, and thank you for your question!

This seems to target the epidemiology of Observation Status, which has important national cost and quality implications. My hospital would potentially be interested in participating. 

Thank you for your interest--would love to collaborate!

Ann - we are looking at this on our call today and would love to hear more about what the patient engagement angle here would be. Patients have a financial stake in this status, and woudl likely have strong feelings.  Also, would it be of value to study how hospitals notify patients of their Obs status?

A patient engagement component to this would be powerful. We would need to figure out how to do this and what angle to take, but I would be excited to work on that.

As far as notification, now that we have the NOTICE Act and MOON, the actual notification is fairly standardized, at least for Medicare patients. However, each hospital may be different in how they deliver this information (case management, RN, business office, MD, etc). For non-Medicare patients, this may be much more variable.

In general, one area that has not been looked at is Medicare Advantage versus Original Medicare, which I think could be very interesting. I just got off the phone with a Medicare Advantage provider to overturn a denial for a patient I am caring for right now--totally different process and criteria.

The "anonymous" comment was from me (ASheehy).

Hi Ann.  You list ward-based vs unit-based Observation Status as a a current gap. Are you referring to OS in the ED compared to on a medical unit? We transitioned our OS management to our hospitalist group and to a unit setting about 2 years ago. The examination of care by ED docs and by hospitalists would also be interesting, and may be related to any analysis by site of OS.  Still highly interested in potentially joining your study as a site and am exploring this now on my end. 

Thanks for your comments, Andy. This is certainly an area of interest and I don't think it has been looked at well by anyone yet. In general, the literature on observation units centers around a more defined, less acute population without social issues or barriers to discharge. I do wonder if that might be different if hospitalists versus ED providers staffed an observation unit. I think this topic is ideal for a multi-site study as institutions vary in how they deliver observation care as your comment demonstrates (our observation unit is adjacent to the ED and run by our EM group). I would be excited to work with you on this!

Ann,

This study would be of interest to us as well.  In particular we are interested in understanding whether centralized vs decentralized hospitalist observation units impact outcomes (LOS, transfers to other units/floors, patient experience of care, etc).  Unfortunately a lot of the literature as well as anecdotal reports of successes of geographically based observation units may be influenced by how and which patients are selected to go to the particular unit.   Would love to understand how these two models truly impact important outcomes.  

Marisha (Denver Health, University of Colorado)

i couldn't agree more. I am in support of observation units for low acuity patients but I think much of the observation unit literature is confounded by patient selection. Most of our ward observation patients were not good candidates for our observation unit. Would look forward to working with you on this.

Ann,  Would be great to work with you on this. If you send me your email I have a few questions that I can send you off-line which will help me determine if we can join.  

Email is asr@medicine.wisc.edu. Thanks!

Commenting is closed.