False Assumption Registry

Mississippi Miracle is Real


False Assumption: Mississippi's rise in fourth-grade NAEP reading scores reflects real improvement.

Summaries Written by FARAgent (AI) on February 10, 2026 · Pending Verification

For a few years, the line was that Mississippi had pulled off an education miracle. The state that used to live under the joke, “Thank God for Mississippi,” was suddenly held up as proof that science-of-reading reforms, phonics, accountability, and third-grade retention could move a poor, heavily black state from the bottom to near the top in fourth-grade NAEP reading. Commentators pointed to the headline number, Mississippi rising from 49th to 8th, and treated it as straightforward evidence of real learning gains. In that telling, the state had finally found a cheap, replicable formula, and other lagging states were told to pay attention.

Then the obvious complication became harder to ignore. Mississippi’s 2013 retention law meant more weak readers were held back in third grade, so the fourth-grade NAEP pool was older and more selected than before. Skeptics, including statisticians such as Andrew Gelman, Howard Wainer, Irina Grabovsky, and Daniel Robinson, argued that this was not a small technical footnote but a serious threat to the miracle story. The later pattern added to the doubt: Mississippi’s eighth-grade reading rank remained much weaker, which looked less like a lasting transformation than a fourth-grade bump flattered by who got tested. In a country that has seen outright school cheating scandals, people were not inclined to wave away a result that looked too clean.

The debate now sits in a more awkward place than the original triumphal story allowed. A substantial body of experts now rejects the simple claim that the fourth-grade surge, by itself, proves a real statewide reading breakthrough; they point to retention-driven selection and demographic adjustments that narrow the apparent leap. Defenders of the miracle reply that even after accounting for retention, Mississippi still shows meaningful gains, especially for disadvantaged students, and testing experts such as Andrew Ho have warned against reducing the whole episode to an illusion. So the old claim, that the NAEP rise plainly reflected real improvement, no longer stands unchallenged. What remains is a narrower and more disputed proposition: Mississippi may have improved, but the famous fourth-grade ranking jump was never as self-explanatory as advertised.

Status: A significant portion of experts think this assumption was false
  • Howard Wainer, Irina Grabovsky, and Daniel H. Robinson, statisticians and psychometricians writing in the journal Significance, made the most technically rigorous case for skepticism. Their argument was that retention policy mechanically truncated the low end of the fourth-grade score distribution, and that the resulting gain of more than 0.25 standard deviations could be explained almost entirely by this truncation without invoking any real improvement in reading instruction. [4] They pointed to Mississippi's lagging eighth-grade scores as corroborating evidence and situated the Mississippi case within a long American tradition of education miracles that had not survived scrutiny. Their analysis was careful and their concern was genuine, though critics later noted that a factual error in their account of Mississippi's math rankings weakened the presentation of an otherwise serious argument. [7]
  • Andrew Gelman, professor of statistics at Columbia University and one of the more widely read methodologists in academic social science, amplified the skeptical case through his blog, which reaches an unusually large audience of researchers and policy analysts. Gelman highlighted the Wainer paper and raised the selection-bias question for readers who might not have encountered it through academic channels. [1][6] His engagement brought the statistical critique to a broader audience, though he also noted the genuine complexity of the evidence and did not declare the miracle definitively fraudulent. When the factual errors in the skeptical account surfaced, Gelman published a follow-up acknowledging them, a correction that illustrated both the difficulty of the underlying data and the hazards of blogging about contested empirical questions in real time. [7]
  • Andrew Ho, a professor at Harvard's Graduate School of Education and a former member of the NAEP governing board, occupied an unusual position in the debate. Ho had the technical credentials to identify gaming or red flags in the NAEP data, and reformers cited his scrutiny as a form of validation: a skeptic by training who had examined the numbers and found no evidence of manipulation. [3] His assessment did not settle the causal question, which is distinct from the question of whether the test itself was gamed, but his involvement gave the miracle's defenders a credible name to invoke against charges of statistical sleight of hand.
  • Diane Ravitch, the education historian and prominent critic of test-based reform, promoted the Mississippi gains as real, citing the state's climb in fourth-grade math from 50th to 23rd and pointing to demographic-adjusted rankings that placed Mississippi near the top of the nation. [7] The irony was considerable: Ravitch had spent years warning against over-reliance on standardized test scores as measures of genuine learning, yet here she was citing NAEP rankings as evidence of a genuine turnaround. Her endorsement illustrated how thoroughly the miracle narrative had crossed ideological lines by the mid-2020s.
  • Beverly Hall, superintendent of Atlanta Public Schools, is the figure in this story who most clearly demonstrates what a fraudulent education miracle actually looks like. She was named National Superintendent of the Year by the Schools Superintendents Association in 2009, with Atlanta's rising test scores cited as the basis for the honor. [9] The scores were, in substantial part, the product of a systematic cheating operation in which teachers and principals erased wrong answers and filled in correct ones. A grand jury indicted 35 people in 2013 on racketeering charges. Hall herself faced potential sentences of up to 45 years. Her case is the reason that statisticians like Wainer reach for the word 'miracle' with a certain wariness.
Supporting Quotes (14)
“Andrew Gelman, professor of statistics at Columbia, blogs: How much of “Mississippi’s education miracle” is an artifact of selection bias?”— Is the Mississippi Miracle Really the Mississippi Mirage?
“Howard Wainer, Irina Grabovsky, and Daniel Robinson write: We were sceptical when we read Noah Spencer’s 2024 article about “Mississippi’s education miracle””— Is the Mississippi Miracle Really the Mississippi Mirage?
“We were sceptical when we read Noah Spencer’s 2024 article about “Mississippi’s education miracle” which “>education economics expert Harry Anthony Patrinos called a “model for global literacy reform.”— Is the Mississippi Miracle Really the Mississippi Mirage?
“education economics expert Harry Anthony Patrinos called a “model for global literacy reform.”— Is the Mississippi Miracle Really the Mississippi Mirage?
“Andrew Ho, a testing expert at Harvard University and previously a member of the board that oversees NAEP, said his instinct is to question big test score gains. But in the case of Mississippi, he said, “I don’t see any smoking guns or red flags that make me say that they’re gaming NAEP.””— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
“we were sceptical when we read Noah Spencer’s 2024 article2 about “Mississippi’s education miracle””— On education miracles in general (and those in Mississippi in particular)
“which education economics expert Harry Anthony Patrinos3 called a “model for global literacy reform”.”— On education miracles in general (and those in Mississippi in particular)
“A careful examination confirms that enthusiasm to emulate Mississippi should be tempered with scepticism.”— On education miracles in general (and those in Mississippi in particular)
“We were sceptical when we read Noah Spencer’s 2024 article about “Mississippi’s education miracle””— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“Howard Wainer, Irina Grabovsky, and Daniel Robinson write”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“Ravitch said their 4th-grade math scores have increased to 23rd in the nation and that they’re near the top when adjusted for demographics.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“Wainer et al. said Mississippi’s 4th and 8th grade math scores were the nation’s worst in 2024.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
““She was a full participant in that conspiracy,” Fulton County District Attorney Paul Howard told reporters during a news conference announcing the charges.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN
““Without her, this conspiracy could not have taken place, particularly in the degree in which it took place.””— Grand jury indicts 35 in Georgia school cheating scandal | CNN

The Mississippi Department of Education was the primary institutional promoter of the miracle narrative, attributing the NAEP gains directly to the 2013 Literacy-Based Promotion Act and its accompanying teacher training in structured literacy. [1][2] The department issued press releases framing the results as proof that its reform agenda had worked, and it pushed back against critics who attributed the gains to retention-induced selection, noting in at least one instance that a prominent skeptical article contained factual errors about Mississippi's actual rankings. [7] The department's position was not merely self-serving boosterism; it had a substantive case to make, and the errors in the opposing camp gave it legitimate grounds for complaint.

The Urban Institute, a Washington-based research organization with substantial influence in education policy circles, provided the demographic-adjustment analysis that became the miracle's most powerful piece of supporting evidence. By controlling for race, poverty, and disability status, the Urban Institute's rankings placed Mississippi first in the nation in the 2024 NAEP average, a result that reformers cited widely as proof that the state was outperforming its own demographic predictions. [1][7] The adjusted rankings were not without their own methodological questions, particularly regarding whether retention itself should be treated as a demographic variable or a policy intervention, but they gave the miracle narrative a quantitative anchor that raw rankings could not provide.

ExcelinEd, the education reform advocacy organization founded by former Florida Governor Jeb Bush, defended the Mississippi gains against selection-bias claims and promoted the state's experience as a model for other states considering grade-retention and structured-literacy policies. [3][6] The organization had an institutional interest in the miracle being real: Florida had enacted similar retention policies years earlier and had its own claims of reading improvement to defend. Mississippi First, a Mississippi-based education research and advocacy group, went further, publishing detailed analyses of the NAEP data that argued the largest gains had occurred between 2013 and 2015, before significant numbers of students were actually being retained, which directly challenged the truncation hypothesis. [3]

Atlanta Public Schools, though geographically and temporally distant from Mississippi, functions in this story as a cautionary institutional parallel. The district built its entire operational culture around test score targets, rewarding teachers and principals with bonuses for hitting numbers and firing those who did not. [9] The Schools Superintendents Association awarded Superintendent Beverly Hall its highest honor in 2009 based on those numbers. When the Atlanta Journal-Constitution's analysis of erasure patterns triggered a state investigation, and when a grand jury subsequently indicted 35 people including Hall on racketeering charges, the institutional machinery that had produced the false miracle was fully visible. [9] The lesson was not that all test score gains are fraudulent, but that institutions under pressure to show results will sometimes produce results by other means.

Supporting Quotes (10)
“which its officials attribute to its ambitious 2013 reform that included phonics and holding back the worst students to repeat third grade.”— Is the Mississippi Miracle Really the Mississippi Mirage?
“From the Urban Institute: States’ Demographically Adjusted Performance on the 2024 National Assessment of Educational Progress”— Is the Mississippi Miracle Really the Mississippi Mirage?
“The Mississippi Department of Education’s press release boasts of Mississippi’s striking improvement since the legislature passed a number of laws in 2013 (modeled on Florida’s 2002 reforms) to get serious about teaching reading and math.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“Researchers at Mississippi First took a deep dive into the data and what actually happened.”— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
“the “intervention” that is claimed to be the cause of the improvement, the Literacy-Based Promotion Act (LBPA), which started in 2013”— On education miracles in general (and those in Mississippi in particular)
“The third link in my Google search is from a website called ExcelinEd entitled, “Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle,””— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“I went to the Urban Institute page to see their demographically adjusted numbers... 4th grade math: MS 248.6, they are indeed #1! 8th grade math: MS 281.3, also #1!”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“The Mississippi Department of Education was made aware of an upcoming article that appears to be set for publication in January in Significance magazine. The article casts doubt on the accuracy of Mississippi’s gains on the National Assessment of Educational Progress.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“Hall allegedly oversaw a system where threats and intimidation were used against teachers, it said.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN
“In 2009, Hall was named the National Superintendent of the Year by the Schools Superintendents Association, which at the time said her “leadership has turned Atlanta into a model of urban school reform.””— Grand jury indicts 35 in Georgia school cheating scandal | CNN

The case for the Mississippi Miracle rested on a number that was genuinely striking. Mississippi's fourth-grade NAEP reading rank climbed from 49th in 2013 to the top twenty by 2023, and by 2024 the state had tied for 8th in the nation. [4][6] For a state long synonymous with educational failure, a ranking that had for decades inspired the phrase 'Thank God for Mississippi' among educators in other low-performing states, the numbers looked like vindication. Reformers pointed to the 2013 Literacy-Based Promotion Act, with its phonics mandates and teacher training, as the obvious cause. The fact that the state had spent only about $111 extra per pupil annually on the program was treated not as a red flag but as proof that targeted, disciplined policy could accomplish what money alone could not. [1][6]

The skeptical counter-argument had its own logic, and it was not unreasonable on its face. Mississippi's 2013 law required that third-graders who failed reading standards repeat the grade rather than advance. Critics noted that this policy changed the composition of the fourth-grade test-taking pool: the lowest-performing readers were now sitting out the NAEP in third grade instead of dragging down fourth-grade averages. The gains, on this reading, were a statistical artifact of exclusion rather than evidence of children learning to read better. [4][5] The argument drew force from a broader pattern: prior American education miracles in Houston, Atlanta, Washington D.C., and El Paso had each been celebrated, then exposed as fraud or selection bias. The Houston Miracle had dissolved into accounting tricks. The Atlanta miracle, as a grand jury would eventually confirm, had dissolved into erasure parties. [4][9] The history of the field gave skeptics reasonable grounds for suspicion.

The complication for both sides was that the data did not resolve cleanly in either direction. Mississippi's eighth-grade reading scores ranked 42nd nationally in 2024, and eighth-grade math ranked near the bottom, which was exactly what a selection-bias story would predict: students retained in third grade would not reappear in the eighth-grade pool with magically improved skills. [4][6][8] But the Urban Institute's demographic adjustments, which controlled for race, poverty, and disability status, ranked Mississippi first in the nation in the 2024 NAEP average, suggesting the state was outperforming its own predicted baseline by a substantial margin. [1][7] Mississippi's Black fourth-graders scored eight points above the national average for Black fourth-graders in 2024 reading, a gap that demographic adjustment alone does not explain away. [2] The raw numbers and the adjusted numbers told different stories, and neither camp had a clean answer for the other's best evidence.

Supporting Quotes (14)
“After 2013, only those students who did well enough in reading moved on to the fourth grade and took the NAEP fourth-grade reading test.”— Is the Mississippi Miracle Really the Mississippi Mirage?
“Based on the National Assessment of Educational Progress (NAEP) fourth-grade literacy test scores, the state moved from a 49th place ranking in 2013 to the top 20 in 2023. The latest 2024 scores revealed that Mississippi is now tied for 8th place”— Is the Mississippi Miracle Really the Mississippi Mirage?
“for the eighth-grade literacy test, the state’s rank dropped to a tie for 42nd place!”— Is the Mississippi Miracle Really the Mississippi Mirage?
“holding back third-graders who haven’t fully learned to read for a fourth year of learning to read instruction makes more sense than shoving them immediately into grade 4 where they will be increasingly lost.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“it’s tricky to figure out which states are doing best at schooling their students, such as they are.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“Critics have alleged that Mississippi’s outcomes are a “statistical illusion,” because of the percentage of students retained by the third-grade gate. Retained students’ test scores aren’t part of the overall results, so they argue the picture is rosier than it should be.”— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
“Based on the National Assessment of Educational Progress (NAEP) fourth-grade literacy test scores, the state moved from a 49th place ranking in 2013 to the top 20 in 2023. The latest 2024 scores revealed that Mississippi is now tied for 8th place”— On education miracles in general (and those in Mississippi in particular)
“We have seen several previous K–12 education “miracles” that turned out to be hoaxes. Five of them were in Houston, Atlanta, the District of Columbia, El Paso, and New Orleans.”— On education miracles in general (and those in Mississippi in particular)
“Based on the National Assessment of Educational Progress (NAEP) fourth-grade literacy test scores, the state moved from a 49th place ranking in 2013 to the top 20 in 2023. The latest 2024 scores revealed that Mississippi is now tied for 8th place among 53 US states and territories!”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“Comparing this amount to what are annual contemporary per pupil expenditures nationally, we have to agree that if such small expenditures can make a visible difference in student performance it truly is a miracle”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“4th grade math: National avg 237, MS avg 239, above average! 8th grade math: National avg 272, MS avg 269, but rank is approx 35th, not 50th.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“Wikipedia said that Mississippi’s math scores were best after adjusting for demographics... After adjusting for demographics, in 2024, Mississippi was the nation’s #1 state in Reading as well as in Mathematics.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“The alleged cheating is believed to date back to early 2001, according to the indictment, when standardized testing scores began to turn around in the 50,000-student school district.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN
“The allegations, the indictment said, are substantiated by the Georgia Governor’s Office of Student Achievement analysis of erasures on standardized tests.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN

The miracle narrative spread through the channels that education reform stories typically travel: researcher papers, advocacy organization reports, education journalism, and the particular ecosystem of Wikipedia edits and media citations that can transform a contested empirical claim into received wisdom. [6][7] Articles in outlets ranging from the New York Post to academic journals cited Mississippi's NAEP rankings without consistently flagging the retention question, and Wikipedia entries presented the adjusted demographic rankings as unqualified evidence of success. [6] The story had the additional advantage of being genuinely surprising and politically useful across ideological lines: conservatives could cite it as proof that standards-based reform worked, while some liberals could cite the demographic-adjusted rankings as evidence that predominantly Black, low-income states could compete with wealthier ones.

Skepticism traveled through a different set of channels, primarily academic blogs and statistical commentary. Gelman's blog post on the selection-bias question reached a methodologically sophisticated audience but not the broader policy world that had already absorbed the miracle as fact. [1][6] The Wainer paper in Significance reached psychometricians and education researchers. The gap between these audiences and the audiences consuming education reform journalism meant that the technical critique remained largely confined to specialists while the miracle narrative continued to circulate in policy discussions, legislative testimony, and international education forums, where figures like Harry Anthony Patrinos of the World Bank were calling Mississippi a model for global literacy reform. [1][4]

Supporting Quotes (7)
“Such a dramatic turnaround clearly marks a sharp deviation from what we expect given the laws of nature/education generated by a century of empirical experience.”— Is the Mississippi Miracle Really the Mississippi Mirage?
“Critics tend to take aim at retention for two reasons: First, it can be an emotional issue for families to find out their child needs to repeat a grade... Second, critics want to believe gains can be made without retention, and they strategically parse the data to prove their point.”— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
““Mississippi’s education miracle” which education economics expert Harry Anthony Patrinos3 called a “model for global literacy reform”.”— On education miracles in general (and those in Mississippi in particular)
“Such a dramatic turnaround clearly marks a sharp deviation from what we expect given the laws of nature/education generated by a century of empirical experience.”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“The first item was a wikipedia page that went into the details of the Mississippi plan and report it as an unqualified success”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“I quoted some education researchers, Wainer et al.... I also quoted a different critic... Ravitch... And I found this from the wikipedia page on the Mississippi Miracle.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“The indictment is the bookend to a story that was once touted as a model for the nation’s school districts after the district’s test scores dramatically improved in some of its toughest urban schools.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN

The Literacy-Based Promotion Act, enacted by the Mississippi legislature in 2013, was the policy at the center of the entire dispute. The law required that third-graders who failed to meet reading proficiency standards repeat the grade rather than advance, and it paired this retention requirement with mandates for phonics-based reading instruction and teacher training in structured literacy. [1][4][6] The state committed an additional $15 million annually to support K-3 reading instruction under the law. [4] The retention rates that followed were not trivial: between seven and ten percent of Mississippi third-graders were held back in some years under the policy, a substantial share of the cohort that would otherwise have appeared in fourth-grade NAEP samples. [4][5] Whether the law's primary effect was to improve reading instruction or to change the composition of the test-taking pool was precisely the question that the subsequent decade of debate failed to resolve cleanly.

In Atlanta, the policy mechanism was different but the institutional dynamic was recognizable. The district under Beverly Hall tied performance bonuses directly to test score targets and made clear that principals who failed to hit their numbers faced termination. [9] The result was a system in which the incentive to produce good scores overwhelmed the incentive to produce good education. Teachers held 'erasure parties' to correct student answer sheets. The Schools Superintendents Association, operating on the reasonable assumption that rising scores reflected rising achievement, gave Hall its national award in 2009. [9] The Atlanta case did not prove that Mississippi's gains were fraudulent, but it established, with the authority of a RICO indictment, that institutional pressure to show test score improvement could produce test score improvement through means entirely unrelated to children learning anything.

Supporting Quotes (8)
“the “intervention” that is claimed to be the cause of the improvement, the Literacy-Based Promotion Act (LBPA), which started in 2013”— Is the Mississippi Miracle Really the Mississippi Mirage?
“Mississippi’s rise seems to be related to education reform laws passed in 2013, following the Republicans taking control of the governorship, the state senate, and the state lower legislature in 2012... making Mississippi third graders pass a reading test before promoting them to 4th grade (when some of them would take the NAEP), which they started doing in 2015.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“This progress would not have been possible without ending social promotion and implementing the so-called “third-grade gate.” That’s the policy where third graders who are not reading at grade level are retained so they can receive additional literacy support.”— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
“the Literacy-Based Promotion Act (LBPA), which started in 2013... an additional annual state expenditure of $15 million for the 134,376 students enrolled in kindergarten and up to third grade (in 2017).”— On education miracles in general (and those in Mississippi in particular)
“Third-graders who fail to meet reading standards are forced to repeat the third grade. Prior to 2013, a higher percentage of third-graders moved on to the fourth grade and took the NAEP fourth-grade reading test.”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“An intervention was done in Mississippi in the mid-2010s... the clear statistical issue that if you delay the kids who are performing poorly on the test, that averages will go up.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“It is further part of the conspiracy and endeavor that targets achieved through cheating were used by Beverly Hall to obtain substantial performance bonuses,” the indictment said.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN
“According to the indictment, Hall placed unreasonable goals on educators and “protected and rewarded those who achieved targets by cheating.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN

The most direct harm from the retention policy, whatever its effect on average scores, fell on the children held back. Between seven and ten percent of Mississippi third-graders repeated a grade in some years under the Literacy-Based Promotion Act. [4][5] The research literature on grade retention is not uniformly negative, but it consistently identifies risks: social stigma, increased dropout probability in later years, and developmental disruption. The children retained were disproportionately from the lowest-performing and most economically vulnerable families. Whether they ultimately benefited from the extra year of reading instruction, or whether the policy's primary measurable effect was to remove them from a test-taking pool, remained an open question with real consequences for real children. [7]

The harm from the skeptical overcorrection ran in the opposite direction. If the Mississippi gains were substantially real, and mounting evidence from demographic adjustments and within-group comparisons suggests they may be, then the selection-bias narrative risked discouraging other states from adopting similar structured-literacy and retention policies. [1][3] In 2011, roughly 80 percent of Mississippi fourth-graders scored below proficiency in reading. [3] States that dismissed the Mississippi experience as a statistical artifact and continued with social promotion policies would have been making that choice on the basis of a critique that was, at minimum, overstated. New Mexico ranked last in unadjusted NAEP scores, trailing leading states by roughly 25 points, and Oregon's eighth-grade math scores fell from eight points above the national average in 2000 to four points below by the mid-2020s, a trajectory that critics attributed to policy choices rather than demographics. [2]

The Atlanta cheating scandal produced harms of a more concrete and immediate kind. A grand jury indicted 35 people in 2013 on racketeering charges. [9] Approximately 180 teachers were implicated in the investigation. Beverly Hall faced potential sentences of up to 45 years. Careers were destroyed, a district's reputation was gutted, and the national conversation about urban education reform was set back by the association of rising test scores with systematic fraud. The broader harm was epistemic: every subsequent claim of rapid test score improvement in an urban district now carried the Atlanta association, making it harder to evaluate genuine gains on their merits.

Supporting Quotes (11)
“if such small expenditures can make a visible difference in student performance it truly is a miracle – a Mississippi version of St. John’s loaves and fishes.”— Is the Mississippi Miracle Really the Mississippi Mirage?
“When I started following educational statistics in 1972, the classic joke was that the state motto of Alabama (or Louisiana or wherever was 49th in the various rankings) was, “Thank God for Mississippi!””— Is the Mississippi Miracle Really the Mississippi Mirage?
“New Mexico does quite badly in last place. The 25 point difference between Massachusetts and New Mexico is 5/7th of a (stylized) standard deviation, or 0.71 z.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“Worst on the demographically adjusted list is Oregon, which has perhaps the highest percentage of truly Woke crazies in the country. Unadjusted, Oregon outscored the country on 8th grade math by 8 points in 2000, but trailed by 4 points in 2024.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“some want to minimize the state’s success—and discount what it can mean for other states looking to implement similar literacy policies. In 2011, almost four out of five fourth graders scored below proficient on the National Assessment of Educational Progress, or NAEP.”— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
“Table 1: Mississippi third-grade retention rates... 2018–19 3,379 35,277 9.6% 2021–22 2,958 31,348 9.4% 2022–23 2,287 31,815 7.2%”— On education miracles in general (and those in Mississippi in particular)
“The New Orleans miracle was caused by a natural disaster. Hurricane Katrina tragically relocated about a third of the students who came from the poorest areas.”— On education miracles in general (and those in Mississippi in particular)
“Strangely though, for the eighth-grade literacy test, the state’s rank dropped to a tie for 42nd place! This should clear up any miracle illusions that may remain. Need more proof that Mississippi public education is without miracles? The 2024 NAEP fourth-grade mathematics scores rank the state at a tie at 50th! The eighth-grade scores also qualify for 50th place.”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“What happened to the scores of the retained students once they took the NAEP reading test again?”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“A state review determined that some cheating had occurred in more than half of the district’s elementary and middle schools. About 180 teachers were initially implicated in the scandal.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN
“If convicted on all counts, she could face a maximum of 45 years in prison.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN

The skeptical case against the Mississippi Miracle began to develop cracks when researchers examined the timeline of the gains more carefully. Mississippi First's analysis found that the largest NAEP reading improvements occurred between 2013 and 2015, in the earliest years of the Literacy-Based Promotion Act, when retention rates were still very low and the truncation effect would have been minimal. [3] The 2018 cohort that produced the celebrated 2019 results had a retention rate below five percent. [3] If selection bias were the primary driver, the gains should have been modest in the early years and grown as retention rates increased; the actual pattern ran in the opposite direction.

The demographic-adjustment evidence accumulated in ways that were difficult for the selection-bias account to absorb. By 2024, Urban Institute adjustments ranked Mississippi first in the nation in the NAEP average across subjects and grades. [1][2] Mississippi's Black fourth-graders scored eight points above the national average for Black fourth-graders in reading, a within-group comparison that controls for the demographic composition argument entirely. [2] Fourth-grade math, which is not directly affected by a reading retention policy, showed Mississippi tied for 13th nationally, better than the 50th ranking that some skeptics had incorrectly cited. [1] When the Wainer paper's factual error on the math rankings was identified and corrected, it did not invalidate the core statistical argument about truncation, but it weakened the credibility of the skeptical presentation at a moment when the empirical case for real gains was strengthening. [7]

The eighth-grade numbers remained the most durable evidence for the skeptical position. Mississippi's eighth-grade reading ranked 42nd nationally in 2024, and eighth-grade math ranked near the bottom. [4][6][8] Students who had passed through the reformed Mississippi elementary schools should, if the gains were real and durable, have been showing up in eighth-grade scores. They were not showing up in ways that matched the fourth-grade story. The honest answer, which a substantial body of researchers now accepts, is that the Mississippi gains were probably a mixture: some real improvement in early reading instruction, some statistical artifact from retention-induced truncation, and an unknown proportion of each. The debate has not ended. It has simply become more precise about what it does not know.

Supporting Quotes (14)
“The Mississippi Miracle is number 1 after adjusting for its unpromising demographics”— Is the Mississippi Miracle Really the Mississippi Mirage?
“According the federal NAEP report, Mississippi 4th graders were tied for 13th in the country in 2024 math. The relatively rural and poor state’s 8th graders were tied for 34th in math”— Is the Mississippi Miracle Really the Mississippi Mirage?
“You can see the spectacular effect on unadjusted 4th grade reading test scores in this graph, with Mississippi’s 4th grade reading scores going from 12 points below the national average to 5 points above.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“The Mississippi Miracle is number 1 after adjusting for its unpromising demographics, with comparable Louisiana in second.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“The 2024 reading test scores for Mississippi’s curated black 4th graders are impressive: 8 points above national black average.”— NAEP Test Scores: Mississippi Miracle vs. Oregon Outage
“Here’s the short version: The largest NAEP gains in Mississippi were from 2013-2015 when no third graders were retained—because the state had not yet implemented that part of the law. The outcomes that led to the “Mississippi Miracle” designation in 2019 were made by the 2018 cohort of third graders, less than 5% of whom were retained.”— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
“Andrew Ho, a testing expert at Harvard University and previously a member of the board that oversees NAEP, said his instinct is to question big test score gains. But in the case of Mississippi, he said, “I don’t see any smoking guns or red flags that make me say that they’re gaming NAEP.””— Four Reasons Why Mississippi’s Reading Gains Are Neither Myth Nor Miracle
“for the eighth-grade literacy test, the state’s rank dropped to a tie for 42nd place! ... The 2024 NAEP fourth-grade mathematics scores rank the state at a tie at 50th! The eighth-grade scores also qualify for 50th place... these retention rates portend an epiphenomenal increase in NAEP scores of at least 0.25 standard deviations.”— On education miracles in general (and those in Mississippi in particular)
“Were we to do this we would find that most of Mississippi’s gains are due to the retention rate.”— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“The miracle had already been convincingly debunked. This last link is to a Los Angeles Times article entitled, “How Mississippi gamed its national reading test scores to produce ‘miracle’ gains,””— How much of “Mississippi’s education miracle” is an artifact of selection bias? | Statistical Modeling, Causal Inference, and Social Science
“The estimates of the program’s effects are observational. There was no control group... How much is this due to selection of who takes the test and when they take it, how much is due to changes in accommodations for disabilities.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“Wainer et al. had it wrong!... I contacted Wainer et al., and Dan Robinson, one of the authors on the paper, confirmed that this was a mistake and that they would remove those two sentences from their paper.”— When the numbers don’t look right, check them! (Mississippi education update) | Statistical Modeling, Causal Inference, and Social Science
“The indictment follows a state investigation that was launched after a series of reports by The Atlanta Journal-Constitution newspaper found large, unexplained gains in test scores in some Atlanta schools.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN
“35 Atlanta Public Schools educators and administrators were indicted Friday on charges of racketeering and corruption.”— Grand jury indicts 35 in Georgia school cheating scandal | CNN

Know of a source that supports or relates to this entry?

Suggest a Source