“Should I put this in the junk drawer?” “I dunno. Do you think you could figure out where it goes?” That exchange is short enough to miss, and it is the entire subject of today’s post. The first post in this series introduced the junk drawer as a load-bearing component of any well-designed classification system, … Read more
A new paper by Alexandre Morozov and Alexander Feigel in PNAS offers a genuinely interesting evolutionary result. If each player in a population of Prisoner’s Dilemma agents carries an opponent-indexed cooperation probability — \(p_{c,i\to j}\), one entry per partner identity — then selection and mutation routinely produce cooperative configurations. The press release framed this as … Read more
NANCY — A few days ago I promised a dispatch on the keynote, and here it is. The eighth International Conference in Philosophy and Economics met this week in Nancy, and the keynote was given by my closest collaborator, who is also my wife, Maggie Penn. Her title was “Three Paradoxes of Optimal Evaluation.” I … Read more
Six posts since the last Dispatch, four of them a single arc on AI as a classification system. The arc started with a Vice President who could not evaluate her engineers, passed through a benchmark that turned out to be measuring string length, paused on a paper about elite athletes that was Berkson’s paradox in … Read more
Earlier today, while I was working with an LLM on something, it asked me a question. Here is the question. Three options. They differ from each other in ways the menu makes plain — inherit the body’s numbers and flag, correct everywhere, or correct the appendix and flag the body as wrong. The point of … Read more
A new paper in Science — Gullich et al., “Recent discoveries on the acquisition of the highest levels of human performance” — looked at top performers in athletics, science, math, and music. The headline finding is one most parents would like to hear: among the highest adult achievers, peak performance is negatively associated with early … Read more
While similarly post-apocalyptic and “numbers-driven,” this post is not actually about a new NetFlix series. Rather, the main character of the story is HaluEval, a new “standard benchmark” for measuring whether a large language model is hallucinating — producing fluent, plausible-sounding text where it ought to be reporting a fact. The benchmark contains around 35,000 … Read more
A Vice President at a large technology company sits down at the end of the quarter to evaluate her engineering team. She has twelve direct reports. They have spent the quarter using AI tools heavily, as the company’s leadership has insisted they do. She must now write performance reviews. She has to say, in writing, … Read more
Friday’s post argued that what the Court did in Louisiana v. Callais is best described as breaking a structural link — a load-bearing connection that was holding up many actions at once, not just the Louisiana map. That post was about what. This post is about why now. Why this case, why this term, why … Read more
Justice Kagan opens her Callais dissent with a hypothetical. She knows it’s stylized, and she says so. Imagine a state shaped like a rectangle, with one of its six congressional districts a near-perfect circle in the middle. The circle is ninety percent Black. The other five districts, surrounding it, are ninety percent white. Voting is … Read more