Manual Systems Overcome Consensus Bias in Predictive Modeling
The "Psychotic" Process: Why Subjective Systems Beat Consensus Rankings
In this conversation, Bill Simmons and Mina Kimes explain a counterintuitive truth about predictive modeling: the most accurate forecasts often come from idiosyncratic, manual processes rather than aggregate data. By forcing a systematic, position-by-position evaluation, Simmons avoids the consensus trap that plagues professional analysts. This episode shows that when you remove the comfort of groupthink and replace it with a rigid, self-imposed framework, you uncover team valuations that betting markets often miss. For the reader, this offers a competitive advantage: in a world of automated insights, the manual labor of mapping individual components rather than relying on external rankings is the only way to build a durable edge.
The Hidden Cost of Consensus
Most analysts rely on external metrics or expert consensus to build their rankings. Simmons argues this is a failure of systems thinking. By manually typing out the schedule and assigning point values to player positions, he forces himself to engage with the specific mechanics of a team success. This is not just about efficiency; it is about cognitive forcing functions.
"I have a whole, it is really kind of psychotic but it is like a seven-week process. I went to Hawaii with my wife and like for three hours that I was going through I like to type in the schedule, actually type it in cause it makes me think about the games and the matchups as I do it."
-- Bill Simmons
The downstream effect of this labor is a decoupling from public perception. When you build the system yourself, you stop caring about the vibes or the popular narrative. You start seeing the team as a collection of modular assets, such as offensive lines, defensive coordinators, and injury-prone stars, rather than a singular, monolithic entity.
The Feedback Loop of Solved Problems
Systems thinking requires looking at how a team responds to its own success or failure. Simmons notes that teams often dine out on past achievements, like a single Super Bowl run, long after the structural reality of the team has changed. This creates a lag in market perception.
The most critical insight here is the Ewing Theory dynamic: the idea that a team might perform better after losing a star player because the system is forced to redistribute its resources. Simmons suggests that the Cleveland Browns defense might benefit from this, whereas the public perception remains anchored to the presence of a departed star. The immediate pain of losing a blue-chip player creates a hidden opportunity for systemic recalibration, a phenomenon most observers miss because they are too focused on the loss itself.
Where Conventional Wisdom Fails
The conversation exposes the fragility of top-down analysis. When evaluating teams like the Buffalo Bills or the Cincinnati Bengals, the consensus often points to star quarterbacks as an equalizer. Simmons rejects this, arguing that if the underlying system, such as the offensive line or the run defense, is broken, the quarterback cannot compensate indefinitely.
"The Bengals are eight, nine or nine and eight like always. Joe Barrow has been really dining on that one Super Bowl appearance and that one she is playing when Mahomes... Mahomes definitely got concussed in the second quarter and there is no way the Chiefs lose otherwise."
-- Bill Simmons
This reveals a systems-level truth: relying on a single hero variable in a complex system is a high-risk strategy that fails when the system support structures degrade. The payoff for the analyst who recognizes this is the ability to fade teams that the market has over-indexed on due to past heroics.
Key Action Items
- Implement a Manual Forcing Function: Stop relying on pre-aggregated data. Spend 2-3 hours manually mapping the components of your own projects or investments to identify dependencies you previously overlooked. (Immediate)
- Identify Your Consensus Trap: List three areas where you agree with the majority opinion. Research the counter-argument specifically focused on the systemic reasons why that consensus might be wrong. (Over the next quarter)
- Audit Your Star Dependencies: For your current projects, ask: "If our top performer left, would our system actually improve?" Look for areas where reliance on a single individual is masking structural weaknesses. (12-18 months)
- Prioritize Structural Continuity: When evaluating performance, ignore the vibes of a new hire or a new strategy. Focus on whether the team has maintained 90% of its core functional components, which is a stronger predictor of stability than excitement. (Ongoing)
- Embrace the Psychotic Prep: If you want to outperform, do the work that others find psychotic or tedious. The competitive advantage lies in the labor that others are unwilling to perform. (Ongoing)