Created by: stephenroller
Patch Description This patch keeps our logit scores in fp32 so they are more accurately reported to the user. Has the nice added benefit of fixing a known bug where using temperature 0.1 causes overflow issues.
Testing steps @tbmihailov running evals on this