Biology Atlas

Map / Open register

question · intermediate · partly written

What happens to a stored claim in an agent system when a later experiment contradicts it?

What happens to a stored claim in an agent system when a later experiment contradicts it?

What is known

Kosmos updates its world model with summaries of task outputs. The co-scientist appends Meta-review text to later prompts. The AI Scientist-v2 adds debugging children to failed nodes. Kitano's 2021 paper asked for belief revision. 1234

Reported, not yet replicated

What is not known more

Whether any of them revises, retracts or forks a claim, and how. Supplements, code and the Sakana and Science versions were not opened. 1234

Our inference

Observation

In the texts read, no agentic science system states a rule for revising a stored claim after a contradicting result. 1234

Reported, not yet replicated

What is known

Kosmos updates its world model with summaries of task outputs. The co-scientist appends Meta-review text to later prompts. The AI Scientist-v2 adds debugging children to failed nodes. Kitano's 2021 paper asked for belief revision. 1234

Reported, not yet replicated

What is not

Whether any of them revises, retracts or forks a claim, and how. Supplements, code and the Sakana and Science versions were not opened. 1234

Our inference

What would settle it

A published update rule or a code release that shows a claim changing after a contradicting experiment, with a test on a seeded contradiction. 1234

Our inference

Still open here

Not yet written: Hypotheses, What is missing, Who works on it.

Linked from

Sources

  1. Edison Scientific and collaborators (37 authors). Kosmos: an AI scientist for autonomous discovery. arXiv 2511.02824 (2025). preprint, not peer reviewed; opened 2026-11-18 all records citing this
  2. Gottweis J, et al.. Towards an AI co-scientist (Nature version). Nature 655:487-496 (2026). paper; opened 2026-11-18 all records citing this
  3. Sakana AI and collaborators. The AI Scientist-v2: workshop-level automated scientific discovery via agentic tree search. arXiv 2504.08066 (2025). preprint, not peer reviewed; opened 2026-11-18 all records citing this
  4. Kitano H. Nobel Turing Challenge: creating the engine for scientific discovery. npj Systems Biology and Applications (2021). paper; opened 2026-11-18 all records citing this
Where it sits on the map
History of this record (5)

This record has been changed 5 times, on the dates below. The note kept against each change is written for the people who maintain the atlas, in their own shorthand, so it is not shown here; it is in the record itself.

Kind
big-open
Register
open-question
Status
partly written
Last updated
2026-11-19
Record
content/questions/agent-world-model-after-contradicting-experiment.json