The order of permutation of 0,1,2,3 is [0,1,2,3], [0,1,3,2], [0,2,1,3], [0,2,3,1], [0,3,1,2], [0,3,2,1], [1,0,2,3], [1,0,3,2], [1,2,0,3], ...
This pipeline uses self-consistency (SC) to measure empirical_entropy, trains a probe on question embeddings, and saves its estimates as predicted_entropy. The default source is data/train/MATH.jsonl.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results