Skip to content

Description of CHNG as-of estimation problems #732

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Oct 11, 2021
Merged

Description of CHNG as-of estimation problems #732

Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
e9383f5
Description of CHNG as-of estimation problems
rumackaaron Oct 4, 2021
66b31a6
Include pipeline pause in limitations update for CHNG
krivard Oct 8, 2021
b5f0112
Apply suggestions from review
krivard Oct 8, 2021
87eeae7
Spelling changes from code review
krivard Oct 11, 2021
1270f12
chng docs: issue link
krivard Oct 11, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions docs/api/covidcast-signals/chng.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,8 @@ grand_parent: COVIDcast Epidata API

## Overview

**Notice: This data source was paused on 2021-10-04 so that we can resolve some problems with the data pipeline. [Additional details on this pause are available below](#pipeline-pause).**

This data source is based on Change Healthcare claims data that has been
de-identified in accordance with HIPAA privacy regulations. Change Healthcare is
a healthcare technology company that aggregates data from many healthcare providers.
Expand Down Expand Up @@ -185,6 +187,26 @@ Note that due to local differences in health record-keeping practices, estimates
are not always comparable across locations. We are currently working on
adjustments to correct this spatial bias.

Indicator values for issue dates before 2021-02-21 are merely estimates, as
these indicators were not yet available in real time. Backfill behavior of
these estimates is erratic and not indicative of current backfill behavior. For more
information on this effect and to track updates as we develop a fix, please see
[covidcast-indicators issue #1289: CHNG historical issues are wrong before 2021-02-21](https://github.com/cmu-delphi/covidcast-indicators/issues/1289).

### Pipeline Pause

Starting on October 4, 2021, a problem with the `chng` pipeline began causing it
to mark some days of data as deleted in their most recent version. These
spurious deletions affected all regions and `chng` signals from July 31 to
August 3, 2021, and the affected date range would continue to grow by one day
each day if we allowed the pipeline to continue running.

On October 8, 2021, we paused the `chng` pipeline, and it will remain inactive
until we can identify and implement a fix. In the meantime, the versions with
the deletion markings have been removed, so that default (latest) queries and
queries with as-of set to 2021-10-04 or later will return the
next-most-recently-updated value for these dates.

## Qualifying Conditions

We receive data on the following six categories of counts:
Expand Down