Biology Atlas

Map / Open register

question · intermediate · partly written

How do we know a pathway is a bona fide pathway?

Short answer

A curated pathway is a chain of reactions, each tied to a paper that showed that step in humans by direct experiment, reviewed by a second curator and outside experts. A screen-derived interaction is not a reaction. A large share of what a pathway database stores is inferred, not observed. 12

Reported, not yet replicated

What Reactome requires as evidence more

References must provide direct experimental evidence for the reaction in human. High-throughput-only events (microarray, proteomics) are excluded unless an expert vouches or a meta-analysis combines independent studies. The top confidence tier is two experimental papers from independent groups showing the same mechanism; one paper plus an expert, or one paper using more than one method, is includable unless a reviewer doubts it. A "black box" reaction records that a step happens when the mechanism is unknown but the endpoint has direct evidence. Weaker reactions may fill a gap only with the evidence type flagged and the reason written; if publications refute the evidence the event is controversial and left out. The guide does not list assays that qualify or a minimum number of papers for the base case, and is internally inconsistent about one field. 1

Reported, not yet replicated

Scale, and how much is inference more

Release 86 (September 2023): 14,803 reactions from 37,156 references (about 2.5 references per reaction, arithmetic), 2,647 pathways, 11,148 human proteins. Human reactions are projected to other species by homology, with success from 80.8 percent (mouse) to 8.8 percent (Plasmodium falciparum); Reactome calls these inferences hypotheses. In a different kind of resource, 63 percent of statements assembled by a text-mining system rested on a single piece of evidence. 345

Reported, not yet replicated

Is a pathway a set of one-at-a-time experiments? deep

Largely yes. Each Reactome reaction is built from small-scale papers, with a reference for each, written by expert authors, checked by a second curator and externally peer reviewed. Genome-scale interaction maps are not used as stand-alone evidence for a reaction, because an interaction edge has no verb, no direction and no step-level paper. This reading is ours from the two Reactome sources. 12

Our inference

What genetic screens add and do not add more

Double-mutant (epistasis) screens find genes with related function. In yeast, only 30 of 4,039 genetically interacting pairs encoded proteins that interact physically. So genetic interaction supports membership of a pathway but says nothing about contact or direction. 6

Reported, not yet replicated

How one would test that a new pathway exists deep

Our reasoning from the sources above; no source opened gives a procedure for establishing a wholly new pathway end to end. The evidence types a reviewer would look for are: genetic ordering (does the double mutant behave as an ordered chain), perturbation (remove A; does B's state change), reconstitution (do purified parts reproduce the step), structure (does the interface exist), and temporal ordering (does A change before B). A cheap first pass is to ask which map reports the pair and what kind of edge it is. 16

Our inference

Observation

Pathway databases state a pathway as a chain of reactions, each with references; how a wholly new pathway is shown to exist was not found in any opened source. 1

Reported, not yet replicated

What is known

What Reactome accepts as evidence, how much is homology inference, and what genetic interaction does and does not show. 146

Reported, not yet replicated

What is not

How a wholly new pathway is established end to end; KEGG and WikiPathways evidence standards were not found; no pair-level comparison of Reactome with interaction maps was done. 1

Our inference

What would settle it

A source describing how a curated pathway moved from a new finding into a database, plus a pair-level comparison of reaction objects with the interaction maps. 1

Our inference

Still open here

Not yet written: Hypotheses, What is missing, Who works on it.

Linked from

Sources

  1. Reactome Curator Guide, version 93 (June 2025). Zenodo. organisation-page, not peer reviewed; opened 2026-11-17 all records citing this
  2. Joshi-Tope, G., et al.. Reactome: a knowledgebase of biological pathways. Nucleic Acids Research (2005). paper; opened 2026-11-17 all records citing this
  3. Reactome authors. The Reactome Knowledgebase 2024. Nucleic Acids Research (2024). paper; opened 2026-11-17 all records citing this
  4. Reactome documentation: inferred events. Reactome. organisation-page, not peer reviewed; opened 2026-11-17 all records citing this
  5. INDRA paper on automated assembly of mechanistic knowledge from text and databases (PMC10167483). PubMed Central (2023). paper; opened 2026-11-17 all records citing this
  6. Tong, A. H. Y., et al.. Global mapping of the yeast genetic interaction network. Science (2004). paper; opened 2026-11-17 all records citing this
  7. Amit's dictation of 2026-11-17: what the atlas must contain. Kept in the atlas repository; not published.
Where it sits on the map
History of this record (9)

This record has been changed 9 times, on the dates below. The note kept against each change is written for the people who maintain the atlas, in their own shorthand, so it is not shown here; it is in the record itself.

Kind
amit
Register
open-question
Status
partly written
Last updated
2026-11-19
Record
content/questions/how-do-we-know-a-pathway-is-bona-fide.json