We have big changes to announce! Read to learn about… simpler definition of replication more markets paying out simpler surveys Simpler Definition of Replication SCORE has adopted a simpler, unified definition of replication: Replication is testing the same claims using data that was not used in the original study. That required some changes from us.…
We have heard from our forecasters, and you have questions! Where’s the prediction market? Short answer: it will open after the surveys close. Why are we taking surveys? Short answer: to be eligible for prize money paid out monthly! …And for science. Read on to learn more… The RM project is structured in Rounds of…
First results are in! The results are in for Round 0 Surveys… We had good participation, with 226 participants providing us answers to 12 surveys. Keep it up! Although we won’t show the survey estimates just yet, they were similar to the market estimates — a good sign. Because the markets will take nearly a…
In a number of past research projects, we have used prediction markets to elicit information on the replicability of research studies. In these markets, participants traded contracts with payoffs tied to the outcome of replications in large-scale replication projects, and thereby created forecasts – similar to bettors in sports betting markets who create forecasts by…
If you’ve just read What is a high-quality replication, you know that our replications will be high-power — usually much higher than the original study — but not quite the “100 replications” ideal set out by DARPA: Assume 100 replications of this study were performed, and a weighted average of their results (i.e., a meta-analysis) was…
