They teach using proven methods, like phonics. They actually teach math. They test and use that as real information. They focus on results not on ideology.

They do NOT encurage using Paulo Freire's "methods".

They hold students back if they don't pass a basic reading literacy test in third grade.

The scores are adjusted for some demographic factors, so one explanation could be that they use exactly the same strategies as everybody else but the “demographic factors” adjustment works out for them.

Mississippi's average ACT scores are tied for last (edit: tied for second to last). I’m sure some of their educational outcomes are improving, but the demographic-adjusted stats from elementary school students are misleading. Holding kids back for poor performance can really pump their numbers inadvertently. Even if that’s not a very prevalent practice, performance in high school is more important and far more predictive of life outcomes.

You know what’s crazier? Mississippi’s average ACT was higher before some of their education policy improvements.

That's because the article is really about politics, not education. Education was just a hook for the author to hang a political point on.

The basis is likely to create engagement with all the "blue states won't listen" and "Democrats are AWOL" commentary.

I think it was because the demographic adjustments move scores for black students higher and scores for white students lower. If unadjusted scores for white students and black students are converging over time, that would explain why Mississippi looks so strong compared to states like Maine, Vermont, and Oregon in the time series.

Yea, the information here is really limited and from only a single source.

And in the same sense the entire article was still damning to US education. Yes, Mississippi got better, but is still not at Maine 2019 levels.

Also 2020 was covid which we all know had huge upsets in education, so I'd like to see a much broader view among different states to know if this is just the Texas Sharpshooter fallacy.

I think it is sprinkled throughout the article:

e.g., the section "Edu-Snobbery Hurts Us All", "Mississippi, Louisiana and Alabama climbed the charts because they focused on core academic instruction when much of the country used ESSA as an excuse to focus on anything and everything else. It paid off."

Yeah I think the phenomenon is interesting and important to be aware of, but the berating political take isn't really that helpful or productive in my opinion — even though it ostensibly attempts to be unbiased in its criticisms. It would have been more productive to dive into what is working and what might be irrelevant, and how it might or might not generalize to other places.

There is a kind of implicit spin to it. I think it's worth a read, but it's also worth reading and thinking a bit about some of the sources it criticizes.

For example, in this piece the author admits that some of the sleight of hand can't account for increases in reading per se:

https://jabberwocking.com/mississippi-revisited-the-mississi...

However, if you think about it, the sleight of hand can still make the scores look better than they are overall. So while the improvements might still be valid, the comparisons to other states might not be — which is part of the primary substance of the essay.

I'm often disappointed in discussions about educational policy or curricula because so much of it has this cargo cult feel to it, masking political leanings with "objective" results. I say this about a lot of it, not just left or right-leaning discussions. It's almost like someone needs to make a fill-in-the-blank checklist critique of educational discussions (testing, admissions) like the old ones about email alternatives: focusing on means and not variances, attributing progress to everything in a basket of changes rather than trying to figure out which one(s) were responsible, ignoring who the students actually are, ignoring the counterfactual questions that are the elephants in the room, focusing on single outcome variables in isolation, etc. I always feel like almost everyone is cherry picking data to make a case.

I'm no longer living in Oregon but remain closely connected. I can't opine to the behavioral challenges, but in terms of the raw score drop I think there's also the one-two punch here of:

1) Schools were closed from Covid for a long time. Not here to debate whether that was good/bad/otherwise, but it is factually accurate to say Oregon schools remained remote longer than almost any others in the country, and we now know the duration of closure had pretty direct influence on learning outcomes.

2) In the past decade the Portland metro area has seen an influx of migration from economically disadvantaged families who are immigrants / first generation citizens / non-native English speakers in the home. Students from these families are lagging significantly behind their peers in terms of post-Covid recovery, which if I recall correctly, follows national trends as well.

I have kids in Oregon public schools. The schools themselves (in the sense of classroom education) are fine, for the most part. But education is very underfunded (especially relative to the tax base). So kids like mine do just fine, but anyone who needs outreach or extra support tends not to get it. That hurts badly on aggregate test scores, but not so much on college acceptance performance. So it's hard to correct, politically.

And no, it's not the lack of discipline. In fact my experience is that the peer culture around my kids is much, much safer and respectful than what I saw growing up. And I went to what at the time was the consensus-best public school system in the country!

Oregon is 2 different states: there's the west coast and big cities (Portland, Eugene), and then there's the East Half, which is rural and underfunded. So you have highly funded schools and then underfunded.

There's definitely a phenomena I've seen especially post-Covid where parents and schools just let a child... not learn. Not attend school, not attend classes. Substitute virtual education which is just a pretend education.

How do they look in terms of raw scores? Those are the rankings that matter.

I can't speak for the cities. At least in rural oregon where some of my family resides there's a few competing factors.

For starters, services in rural oregon are terrible. If you aren't in portland, living in nearly any part of oregon translates into being multiple hours of driving to get to any sort of medicine (for example). This applies to pretty much all sorts of desirable things you might want.

But further, even though rural oregon is isolated, the housing prices there (and everywhere) remain at extremely high levels. Due to some of the geography of oregon (lots of hills and mountains) many of these small communities simply have no location where you could build a house even if you wanted to. Unless a city decided to eminent domain some land/a home to build housing (fat chance) the current supply is the maximum supply.

That makes it really hard to hire competent teachers. In many cases you are asking them to do 1, 2 hours, or longer commutes just to teach (if they aren't an established community member. Which is increasingly rare. Most people looking for an education want out of these rural communities). Often times, these rural communities are less destinations for teachers and more stepping blocks for new teachers to then get hired in more desirable locations. That results in high levels of turnover which kills student/teacher relations.

My guess on why cities suffer is a bit different. In my own city (not oregon), it's because of overcrowding, plain and simple. The kids are packed in like sardines. I'd imagine building new schools in a place like portland would be pretty difficult and expensive. So you end up with a large and growing population and limited school infrastructure to handle the ever growing pop. Decreasing the student:teacher ratio is simply a must if you want better results.

My childhood school (rural) ranked as one of the best in Idaho and even was nationally ranked. How did it get there? A couple of factors. For starters it's well positioned, there's a smaller city nearby with a decent amount of services and a larger city just a 45 minute drive away. That makes it pretty easy to find teachers. The student/teacher ratio was almost absurdly low (10:1 in my class). Finally, all the teachers were themselves long term community members. My highschool math teacher taught everyone in my family and some of their kids. There was a relationship there that's hard to recreate.

The schools we played sports against were almost universally in a worse state. Particularly the most isolated schools which were 3 hours from nearly service.

As an addendum: there is an exception to my theories that I really have no good explanation. There was a native american reservation school which was close to the same city we were. It had more money than god thanks to the casinos and had some of the nicest facilities with long-term teaching staff. Yet their student outcomes were absolutely awful. Very few went on to higher education. My best guess is that while the school was the gold standard in terms of funding, the tribe's families weren't so lucky, having a much lower SES score than my school.

I attended in the late 80s, early 90s and originally thought my education was subpar relative to other states. As I got older, I realized my fundamentals were solid and I'd constantly be surprised by what people people didn't know that I learned in middle school.

That said, I could see the gap when it came to others who participated in Honors or more advanced topics in high school. This is a smaller subset of most school's students, but I walked away with a sense that education in these topics at other schools were more rigorous.

What if the reason is external to the school? Hmm, what has changed between 2004 and 2024?

We have devices and experiences that are medically classified as addictive. It can also be home life stuff, it’s kind of a difficult time for a lot of people.

We could have the best trained and supported teachers in the world, but they are up against completely different challenges.

I’m not saying we can never fire anyone. But you suggesting that if we don’t like an outcome we get rid of someone without understanding the entire problem is plain dumb.

I can tell you why with reasonable certainty. When my mom became a Maine teacher in 1990, the starting pay was $28k, for a part time position. By her first retirement in 2022, she was making $48k, for full time work, in a more expensive school district, with more responsibilities (including creating the entire lesson plan and running the department). What was inflation during that time frame?

So basically, Maine can't afford any teachers. It's been coasting on the same 65 year old teachers it had back then. The few new teachers you DO get in rural Maine are the ones that aren't smart enough to notice that they're getting fucked, or are morons screaming at 12 year olds that the vaccine is poison and masks will kill them, or are literal sociopaths who write 17 page (not exaggeration) manifestos full of spelling mistakes and grammar errors due to a perceived slight. Despite that man being an obvious wacko, the administration we spend so much on left my mom high and dry to fend for herself, and it could have destroyed her career and reputation as one of the best teachers in the area.

A school in the Kennebunkport area convinced her out of retirement with a cool $80k a year and strong agreements towards getting her (state program) retirement fully funded.

Everyone in the US loves to harp that "oh we've spent so much on education" but we have not. We have spent immensely on paying a bunch of MBAs to "administrate". Superintendents are politicians, and do not do anything useful for schools. That superintendent spent tens of thousands of dollars on "smartboards" while the teachers used VHS tapes bought in the 80s to teach things. Teachers want supplies, not gimmicks.

But don't worry, that Superintendent will use his political connections to assure everyone that the millions a dirt poor community has handed to him totally isn't a waste, and that buying a heated turf soccer field in fucking northern maine wasn't a waste, and the local numbnuts will continue to blame "woke liberals". It definitely has nothing to do with talented teachers who worked their asses off for 40 years getting jack and shit while their bosses drive Mercedes and buy their third house.

Wow this is an excellent point and really undermines the article conclusions. We should always be looking at unadjusted scores as well as a whole series of adjusted scores with a variety of methods.

Just grabbing one highly adjusted score and drawing conclusions solely off of that is not enough. It's really only giving you one piece of a very complex puzzle in the case of something like education scores.

Observational stats in social sciences turns out to be a lot like epidemiology and strongly held conclusions are hard won.

Can you clarify what exactly you mean by the idea that adjusting for gender, age, race, and ethnicity makes this less impressive?

Generally speaking in order to evaluate the success of a school system you really do want to adjust for the demographics that that school has to deal with, so you don't attribute the effects of, say, private tutors to the public school system. It would be really unfair to judge teachers in the Bronx for their inability to compete on raw scores with teachers in upper Manhattan.

What is a fair way to compare then? If rich Asians kids from the "best" school perform the same as the rich Asians from the "worst" school and poor Native American kids from the "best" school perform same and poor Native American kids form the "worst" school, and the only differences between the best at the worst school is the proportion of each demographic, what does that say about the quality of the shcool?

It's not impressive if you don't understand statistics I guess.

You want to measure the impact of educational policies on students. So you control for other factors that influence educational outcomes, and you try to eliminate those effects.

Girls do better than boys on most testing. Asians do better than other races. Free & reduced lunch kids do worse. Special education and ESL students obviously do worse. So of course you're going to adjust for these populations.

The only reason you look at the raw scores of a rural district outside Biloxi that is 70% black and compare that to the raw scores of a suburban San Francisco district that is 50% asian and 35% white is that you either don't understand math or you're more interested in making a political argument than an educational policy one.

So the schools are doing their job properly, instead of relying on upper-middle-class native English speaking parents to do all the work. It is impressive.

I think it's partly because political conservatives are more often right when it comes to education, because they don't listen to the experts and just demand boring conservative things like phonics, learning the times tables, learning facts, and other stuff that "doesn't really teach you how to think".

Just have a look at what the Harvard Education Review thinks is important - https://meridian.allenpress.com/her - no that's not a parody site by someone who uses the word "woke" without scare quotes.

Progressives listen to experts, and the experts in education are often a bit ... scientifically lightweight. Teachers are not all brilliant at scientific research (nor do they need to be, and expecting every teacher to be a scientific researcher would drastically limit the talent pool, or require a very significant salary bump to get more candidates), so universities need to cater to the lowest common denominator, which makes teaching degrees mostly a course in using education jargon to write persuasive essays.

If you have scientifically lightweight uni courses, you tend to get a lot of scientifically lightweight researchers, who are far better at writing a persuasive essay than actually looking at evidence. And with a critical mass of lightweights, they don't really want education to move into a more scientific or evidence based footing, because then their own influence and maybe even careers will be harmed. Yes, there's good education researchers, but most of them work in Psychology departments, not Education departments. Or special education, which is a bastion of sound evidence based practice, for some reason, probably because like teachers in red states they actually need to do their jobs properly, and can't just rely on demographics to do all the hard work.

Those are the only grade levels at which the NAEP is administered.

https://nces.ed.gov/nationsreportcard/guides/scores_achv.asp...

I’d be more worried if the author stepped beyond their scope, and went from observing results to speculating without evidence about what drove the changes.

It seems like enough to say “here’s a big signal that goes counter to the stories we’ve been telling ourselves, it’s worth doing some work to figure out what’s going on.”

The metric of “random social media commenter” is too narrow to have impact. But you put it out there.

The smart people doing it again…ignoring their own statistical irrelevance while challenging other’s statistics as somehow inconsequential.

Certain grade levels are considered milestones and national tests are associated.