Say what you will about the Union of Soviet Socialist Republics, its 1936 constitution was a banger. It guaranteed freedom of speech, the press, assembly, and protest. It extended equal rights to all citizens, regardless of race or gender. It shortened the working day to seven hours, affirmed âthe right to rest and leisureâ, and offered free education and free health care to all, including a âwide network of health resorts for the working people.â You gotta admit this is a lot better than certain other constitutions that, say, count slaves as three-fifths of a person. In the two years after the constitution was adopted, however, Stalin purged something like a million people. Eighteen million Soviet citizens would be forced into gulag camps and colonies over the next three decades. This was all clearly in violation of Articles 103, 111, and 127, and many others besides. How could one of the greatest tragedies in human history happen when it was very explicitly not allowed? The uncomfortable answer is that a critical mass of people found prisons and purges palatable. We say that âStalinâ did all these things as if held the gun himself1, but obviously you canât run a gulag without guards, secretaries, accountants, engineers, architects, doctors, drivers, quartermasters, mid-level managers, kangaroo court judges, and all manner of flunkies, patsies, and stool pigeons. Apparently, hundreds of thousands of regular people were willing to commit their own personal portion of an atrocity. The lesson here is obvious: rules donât matter unless people act like they matter. Writing down laws does not endow them with physical force or psychic potency. We all know this. We all believe this. So why donât we act like it? Ever since the replication crisis began over a decade ago, most folks have agreed that the problem is the laxness of our rules, and that the solution is to tighten them. We should mandate replication, preregistration, public data, bigger studies and tinier p-values. The more we can reduce researcher degrees of freedom, the thinking goes, the better our science will be. Vindicating this theory, a big group of researchers published a paper in 2023 showing that itâs possible to achieve high rates of replicability as long as you follow a set of ârigor-enhancing practices: confirmatory tests, large sample sizes, preregistration and methodological transparency.â One year later, the paper was retracted because it...failed to follow those rigor-enhancing practices. The journal editors claim the authors were not transparent about their methods, did not abide by their own preregistration, and cherry-picked their results.2 Clearly, weâre not missing the right regulations. Weâre missing the right motivations. If you want to discover true things about the world, youâll be interested in the guidelines that help you do that, and youâll be thankful to the people who develop them. Thatâs how the replication crisis could have played out: someone demonstrates that our sample sizes are too small, and we all go, âoh wow we should make our sample sizes bigger because want to know whatâs real and whatâs notâ. But if youâre not actually seeking the truth, no amount of ârigor-enhancing practicesâ will ever cause you to find it. Thatâs why our revolution in scientific regulation has mostly failed. We require researchers who conduct clinical trials to post the results on a public website, but only 45% of them do. We tell people to specify their primary outcomes beforehand, but if their studies donât work as planned, they just sneak in different analysesâone study on anesthesiology experiments found that 92%(!) of them did this. We make researchers end their papers by saying âdata available on requestâ and then only 17% of them actually make their data available on request.3 You canât turn a cheat into a scientist by making a rule against cheating. The most important ârigor-enhancing practiceâ is caring about getting things right, and without that, nothing else matters. Every couple will eventually have some version of the âLetâs Make a Ruleâ fight, where they try to solve some interpersonal issue through legislation. âYou think I donât take enough interest in your life, so letâs make a rule: I have to ask you three things about your day before I start telling you about mine.â The theory behind the Letâs Make a Rule fight is that we could live in harmony with one another if we could just compile all of our expectations into one big Google Doc. The Letâs Make a Rule fight never leads to a satisfying conclusion because nobody actually wants their partner to follow the rules. They want their partner to care. Being asked âHow was your day, dear?â through gritted teeth because thatâs what our Relationship Handbook says to do is probably worse than not being asked at all. You want your partner to realize that your preferences are not silly affectations that can be belittled, ignored, or disputed until they go away, that they are, in fact, load-bearing parts of your personality, and to reject them is to reject you. In return, you have to realize that some of your preferences are more malleable than you thought, that maybe they donât all have to be foundational to your sense of self, and that some of them can be bent or jettisoned in the interests of coexistence. This is the work of love, and it takes a lifetime. You canât speedrun it by filling out a spreadsheet or signing a contract. The frictions of a lifelong relationship can be made intelligibleâthat is, understandable to the people involved, but they cannot be made legibleâthat is, understandable to everyone else. The best couples I know have all sorts of arrangements and accommodations that make zero sense to me but perfect sense to them, and thatâs exactly why they work well together. A successful relationship is nothing more than a package of haphazard remedies and rickety fixes that people would only ever devise and maintain when they really, really want to be together. Sometimes police officers break the rules, and the solution is obvious: we just need to police the police. If you strap a camera to every officerâs chest and record everything they do, then they wonât misbehave in the first place. And even if they do, we can discipline or fire them. This is the most foolproof plan of all time, supported by an unheard-of 89% of Americans. Police departments all over the country agreedânow every single large precinct has body cameras, and a majority of smaller precincts do too. The technology is out there and the data is in; how is our foolproof plan working out? Not well. According to a 2022 Department of Justice report, body cams might not have any meaningful effect on police behavior. One meta-analysis found a moderate drop in citizen complaints, but didnât find any difference on any other outcomes: use of force, assaults against police officers, number of incident reports, etc. Another meta-analysis finds no evidence of downstream outcomes like conviction rates. The DoJ warns that we need more research, but this is enough to rule out gigantic effects. If body cams do anything at all, they probably donât do much. Maybe our plan just didnât go far enough. Bad cops can simply turn their cameras off or cause the footage to mysteriously go missing. Even if the video exists, itâs only one version of events, and itâs from the officerâs point of view. Maybe what we really need is a swarm of drones to follow every police officer, recording every action from every angle, and they never shut off and their footage automatically gets uploaded to a public database. Or maybe we misdiagnosed the problem in the first place. We assumed that the justice system was eager to hold bad cops accountable and that all it was missing was the necessary evidence. It turns out the justice system is actually rather ambivalent about holding bad cops accountable, and so it handles additional evidence as halfheartedly as it handled all of the evidence it aâŠ
Send this story to anyone â or drop the embed into a blog post, Substack, Notion page. Every play sends rev-share back to Experimental History.
70% goes to the publisher · 20% to whoever forwarded this to you · 10% keeps Storyflo running. Sent in USDC on Base â gas-free for you.