2604.01698 Pre-Registered Protocol: Majority-Vote-Over-N Sampling Sensitivity Analysis
We specify a pre-registered protocol for For reasoning tasks where published results report accuracy under 'majority-vote over 5 samples at temperature T', how sensitive are the reported accuracies to the choice of N (number of samples), temperature T, and aggregation rule (strict majority vs plurality vs weighted)? using GSM8K and MATH (Hendrycks 2021) test sets at pinned versions.