question · intermediate · partly written
How do we know a pathway is a bona fide pathway?
Short answer
A curated pathway is a chain of reactions, each tied to a paper that showed that step in humans by direct experiment, reviewed by a second curator and outside experts. A screen-derived interaction is not a reaction. A large share of what a pathway database stores is inferred, not observed. 12
Reported, not yet replicated
What Reactome requires as evidence more
References must provide direct experimental evidence for the reaction in human. High-throughput-only events (microarray, proteomics) are excluded unless an expert vouches or a meta-analysis combines independent studies. The top confidence tier is two experimental papers from independent groups showing the same mechanism; one paper plus an expert, or one paper using more than one method, is includable unless a reviewer doubts it. A "black box" reaction records that a step happens when the mechanism is unknown but the endpoint has direct evidence. Weaker reactions may fill a gap only with the evidence type flagged and the reason written; if publications refute the evidence the event is controversial and left out. The guide does not list assays that qualify or a minimum number of papers for the base case, and is internally inconsistent about one field. 1
Reported, not yet replicated
Scale, and how much is inference more
Release 86 (September 2023): 14,803 reactions from 37,156 references (about 2.5 references per reaction, arithmetic), 2,647 pathways, 11,148 human proteins. Human reactions are projected to other species by homology, with success from 80.8 percent (mouse) to 8.8 percent (Plasmodium falciparum); Reactome calls these inferences hypotheses. In a different kind of resource, 63 percent of statements assembled by a text-mining system rested on a single piece of evidence. 345
Reported, not yet replicated
Is a pathway a set of one-at-a-time experiments? deep
Largely yes. Each Reactome reaction is built from small-scale papers, with a reference for each, written by expert authors, checked by a second curator and externally peer reviewed. Genome-scale interaction maps are not used as stand-alone evidence for a reaction, because an interaction edge has no verb, no direction and no step-level paper. This reading is ours from the two Reactome sources. 12
Our inference
What genetic screens add and do not add more
Double-mutant (epistasis) screens find genes with related function. In yeast, only 30 of 4,039 genetically interacting pairs encoded proteins that interact physically. So genetic interaction supports membership of a pathway but says nothing about contact or direction. 6
Reported, not yet replicated
How one would test that a new pathway exists deep
Our reasoning from the sources above; no source opened gives a procedure for establishing a wholly new pathway end to end. The evidence types a reviewer would look for are: genetic ordering (does the double mutant behave as an ordered chain), perturbation (remove A; does B's state change), reconstitution (do purified parts reproduce the step), structure (does the interface exist), and temporal ordering (does A change before B). A cheap first pass is to ask which map reports the pair and what kind of edge it is. 16
Our inference
Observation
Pathway databases state a pathway as a chain of reactions, each with references; how a wholly new pathway is shown to exist was not found in any opened source. 1
Reported, not yet replicated
What is known
What is not
How a wholly new pathway is established end to end; KEGG and WikiPathways evidence standards were not found; no pair-level comparison of Reactome with interaction maps was done. 1
Our inference
What would settle it
A source describing how a curated pathway moved from a new finding into a database, plus a pair-level comparison of reaction objects with the interaction maps. 1
Our inference
Still open here
- How is a wholly new pathway shown to exist, end to end? Only our own reasoning is written so far.
- What evidence standards do KEGG and WikiPathways apply? This atlas found none.
- What share of Reactome binding reactions appear in HuRI, BioPlex or CORUM? See questions/reactome-versus-interaction-map-overlap.
- Why does the Reactome guide describe the evidenceType field two ways?
Not yet written: Hypotheses, What is missing, Who works on it.
Linked from
Sources
- Reactome Curator Guide, version 93 (June 2025). Zenodo. organisation-page, not peer reviewed; opened 2026-11-17 all records citing this
- Joshi-Tope, G., et al.. Reactome: a knowledgebase of biological pathways. Nucleic Acids Research (2005). paper; opened 2026-11-17 all records citing this
- Reactome authors. The Reactome Knowledgebase 2024. Nucleic Acids Research (2024). paper; opened 2026-11-17 all records citing this
- Reactome documentation: inferred events. Reactome. organisation-page, not peer reviewed; opened 2026-11-17 all records citing this
- INDRA paper on automated assembly of mechanistic knowledge from text and databases (PMC10167483). PubMed Central (2023). paper; opened 2026-11-17 all records citing this
- Tong, A. H. Y., et al.. Global mapping of the yeast genetic interaction network. Science (2004). paper; opened 2026-11-17 all records citing this
- Amit's dictation of 2026-11-17: what the atlas must contain. Kept in the atlas repository; not published.
Where it sits on the map
History of this record (9)
This record has been changed 9 times, on the dates below. The note kept against each change is written for the people who maintain the atlas, in their own shorthand, so it is not shown here; it is in the record itself.
- Kind
- amit
- Register
- open-question
- Status
- partly written
- Last updated
- 2026-11-19
- Record
- content/questions/how-do-we-know-a-pathway-is-bona-fide.json