Created by: davides
Patch Description I didn't re-run all testing steps from https://github.com/facebookresearch/metaseq/pull/452 and I just caught one case regressed.
Testing steps Multiple eval runs on OPT 125M:
- remote path + consolidated
- remote path + DP>1
- local path + consolidated
- local path + DP>1