Changes in Round 6

By Charles Twardy

We have big changes to announce!  Read to learn about… simpler definition of replication more markets paying out simpler surveys Simpler Definition of Replication SCORE has adopted a simpler, unified definition of replication: Replication is testing the same claims using data that was not used in the original study. That required some changes from us.…

Surveys, Markets, and Claims

By Louisa Tran

We have heard from our forecasters, and you have questions!  Where’s the prediction market? Short answer: it will open after the surveys close. Why are we taking surveys? Short answer: to be eligible for prize money paid out monthly! …And for science. Read on to learn more… The RM project is structured in Rounds of…

P-Values and Initial Prices

By Michael Gordon

The use of p-values and hypothesis testing is ubiquitous across science. Everyone remembers the rules they learnt in their first statistics courses; 0.05 is the magic cut-off for statistical significance. Statistical evidence with p-values below 0.05 are accepted – models with p-values higher than this threshold are discarded.   However, this statistical practice has come…

On the Topic of Statistical Power

By Michael Gordon

It’s really easy not to find any mind-changing evidence… just don’t go looking for it. Cassie Kozyrkov When testing hypotheses, there are two types of errors one can make: finding a relationship where one does not exist (false positive), and finding no relationship where one does exist (false negative). Statistical power measures how hard you…