Skip site navigation

Last week, for the first time since the pandemic began, the number of tests fell week over week. This week, it happened again. This week, in fact, every major metric we track fell, including a slight drop in weekly deaths, the first time deaths have dropped since the end of June.

The falls in cases, hospitalizations, and deaths should be good news, and in reality, they likely do reflect an improving reality on the ground. But tests are also dropping, nearly as much as cases are. In an ideal world where the Sunbelt surge is genuinely easing, we’d see increased testing combined with falling case counts. That happened in state after state in the Northeast as the spring turned to summer. 

In the South, that’s not what’s happening. Tests have precipitously declined over the last two weeks. While complicated situations in Florida and Texas have led the way in that drop, just about every state in the region shows a decline in testing in the first half of the month. 

The different regions differ widely in population size, and the South is by far the most populous. When we look at the per million testing rates, you can see that the Northeast is now testing at higher rates than the South, despite vastly fewer cases. In fact, every region is. 

Add it up to the national statistics and these dynamics produce a chart where tests and cases are uncomfortably correlated in recent weeks.

Data disruption

The data that we compile from states can look complete and polished in the charts and data tables that we produce. But as we’ve noted time and time again, our data is a patchwork of data put out by 56 jurisdictions and multiple entities within each. The Federal government influences the data states report through guidelines and control of reporting systems, but the states themselves have not received guidance on what they should publish themselves. That is to say, we are acutely aware of the data production processes that must all work to bring reliable numbers to our users. 

And some weeks, these data systems break down, marring individual state numbers and skewing the national statistics. Just this week, we’ve seen major data problems from California, Florida, North Carolina, Texas, and Washington

Some of these issues are easy to understand. Florida’s Department of Health is dealing with both storm-related backlogs and an individual lab that had not reported 4,000 cases in the Miami area. Other times, the technical issues are difficult, but the system at fault is clear; in California and North Carolina, specific technical systems broke down, leading California to add missed tests and North Carolina to pull out 220,000 misfiled results

And then there is whatever is happening in Texas.

It is not at all clear why the state would suddenly do a fraction of the tests it completed a few weeks ago. And the most likely answer is that the state is not doing fewer tests, but that something strange has happened within the reporting system. Some Texas data sleuths have pointed to a category of test that had not been assigned to a particular county. As these tests have gotten a county designation, the number of tests the state reports having completed overall is falling. Why? That’s what nobody can figure out. Is it counties finding duplicate tests? Is it antigen tests being shaken out of the state data? Or something more mysterious? The state has launched an investigation, and we look forward to the publication of its results. Our researchers are also looking into the mystery, as are journalists throughout Texas. 

In the meantime, we continue to compile the data and to annotate the problems we find as part of our ongoing mission to contextualize all these deceptively tidy-looking data points in a way that brings them closer to the reality on the ground.

To keep up to date on our work, follow us on Twitter and join our low-frequency email list.


original.png

Alexis C. Madrigal is a staff writer at The Atlantic and the author of Powering the Dream: The History and Promise of Green Technology.

@alexismadrigal
peter_walker.jpg

Peter Walker is Head of Marketing & Growth at PublicRelay and Data Viz Co-Lead at The COVID Tracking Project.

@PeterJ_Walker

More “Weekly Update” posts

Testing In Limbo, Hospitalizations and Deaths Still Dropping: This Week in COVID-19 Data, Sep 10

A long holiday weekend makes ambiguous testing data even harder to understand, but hospitalizations are dropping, which is good.

By Erin Kissane & Peter WalkerSeptember 10, 2020

Holiday Reporting Lags Interrupt Positive Trends: This Week in COVID-19 Data, Sep 17

Though cases are rising in parts of the Midwest, hospitalizations in the West and South continued trending downward. The Labor Day holiday impacted data reporting lag times both this week and last, obscuring what had been positive trends in September.

By Joanna Pearlstein & Peter WalkerSeptember 17, 2020

Cases Stop Dropping and the Midwest Heats Up: This Week in COVID-19 Data, Sep 3

After five straight weeks of sharp declines in new cases of COVID-19 in the United States, we’ve leveled off again. Reported tests are up about 5 percent, but are actually dropping in the Midwest, where three states—Iowa, North Dakota, and South Dakota—are driving an uptick in new cases. This week we also launched a new dataset that looks closely at the toll of COVID-19 in nursing homes and other long-term care facilities.