North star / What counts as true
Unseen data is spent once
Searching is a screen. Confirmation happens once, on data nobody has searched.
Data we have searched cannot also confirm. Results on it only decide which ideas deserve a real test. The real test is a single run on data nobody has looked at, applied to the whole book, meaning every idea together and how they are combined, not to a favorite.
Because that data can be used only once, we protect it. Going back to it after a disappointing answer is how weak ideas get through.
Families that lean on this