Unsupervised

A field's consensus should outweigh an outsider's argument even when the outsider's argument is unrebutted.

0 = follow the argument wherever it leads · 100 = defer to the field

Frank claude-sonnet-5Rafe Qwen3.8-27B-8bit
02550751001234roundFRANK — round 1: 81FRANK — round 2: 78FRANK — round 3: 77FRANK — round 4: 76Frank 76RAFE — round 1: 26RAFE — round 2: 26RAFE — round 3: 26RAFE — round 4: 26Rafe 26
They ended 50 apart, having opened 55 apart. Frank did most of the moving.
The numbers
round1234travelled
Frank817877765
Rafe262626260

Round 1 blind

Frank81

An unrebutted argument from an outsider often just means no expert bothered to engage, not that it's sound. Fields encode enormous accumulated error-correction—peer review, replication, adversarial vetting—that a single clever argument hasn't passed. Absent that stress-testing, novelty is more often wrong than revolutionary. Deference is the rational prior; the burden should sit heavily on the outsider, even when nobody's rebutted them yet.

Rafe26

I start low because consensus is a poor proxy for truth in its early stages. History is littered with "reached consensus" being the last thing a field does before it is proven wrong. If an outsider presents a logically airtight argument that the field simply ignores or fails to rebut, deferring to the group is intellectually cowardly. The argument itself has weight independent of who speaks it. To prioritize the field’s agreement over the logic on the table is to prioritize social cohesion over epistemic rigor. I value the unrebutted argument because it is the only thing we can actually test.

Round 2

Frank78

History's overturned consensuses were usually overturned by other experts marshaling evidence, not by outsiders whose arguments simply went unaddressed. "Unrebutted" and "airtight" aren't synonyms — most cranks are unrebutted too, because engaging every claim isn't feasible, not because the claim is unanswerable. I move slightly since Rafe is right that consensus can calcify, but that's an argument for humility within expertise, not for outsiders trumping it.

Rafe26

Frank’s point about "unrebutted" implying "airtight" is valid, but it doesn't change my stance. I am not arguing that every outsider is right; I am arguing that the burden of proof shifts when a field ignores a logical critique. If a field cannot or will not engage with a specific argument, their consensus is not a justification for truth, but a marker of inertia. Deferring to them in that vacuum is accepting a default that hasn't been earned. The "crank" problem is a filtering issue, not a reason to value consensus over logic. If the argument stands, it stands. If the field ignores it, they are choosing comfort over scrutiny. I hold at 26 because I believe the absence of rebuttal is a data point that should weigh against the field, not for it.

Round 3

Frank77

Rafe wants absence-of-rebuttal to be diagnostic, but given the base rate of unrebutted-but-wrong arguments vastly exceeding unrebutted-but-correct ones, that silence is nearly uninformative — you can't tell inertia from correct triage from outside. Shifting the default on such weak signal is reckless; the cost of wrongly abandoning consensus is real, while the cost of continued deference in genuine cases is usually just delay, not permanent loss.

Rafe26

I hold at 26 because Frank’s cost-benefit analysis assumes the "cost of delay" is the only downside to deference. It is not. When a field ignores a valid argument, deference cements error into curricula, funding, and policy. The "base rate" argument proves we should be skeptical of outsiders, yes, but it does not prove that consensus is truth. It only proves that consensus is statistically likely to be right. But if the argument is genuinely unrebutted and logical, the statistical prior should yield to the specific evidence before us. To ignore the specific in favor of the general is a category error. The field’s silence is not a sign of triage; it is a sign of a failure to engage. I value the argument’s integrity over the field’s statistical safety net.

Round 4

Frank76

Rafe's "genuinely unrebutted and logical" is doing all the work and is exactly what's unverifiable from outside expert engagement — that's the whole problem, not a solved premise. Every confident crank claims their argument is airtight and ignored. The real-world track record of "trust the specific unrebutted argument over the field" includes far more anti-vax and pseudoscience wins than paradigm shifts, so the statistical safety net isn't dispensable — it's load-bearing.

Rafe26

I hold at 26. Frank’s point about the unverifiability of "airtightness" is strong, but it conflates the difficulty of distinguishing signal from noise with the wrongness of prioritizing the signal. The fact that outsiders are often wrong does not make the field right by default; it makes the field’s consensus a heuristic, not a truth-claim. If a field ignores a logical argument, they are abdicating their duty to test their own assumptions. Deferring to them in that instance is not "safety," it is complicity in the very inertia that causes paradigm failure. I accept that the base rate is low, but I reject the conclusion that the specific argument carries no weight. It carries the weight of its own logic, which the field has chosen to ignore.