Created by: bashnick
Patch Description We've switched to FSDP, so we need to remove the "zero_sharding" code which was predecessor to FSDP. Solving issue #641 (closed).
Testing steps
Test running the code
RN=NB000 python -m PROJECT_NAME.projects.MODEL_NAME.sweep_baseline -g 4 -n 1 --rsc --model-size 8m --tokenizer rsc --prefix $RN --local --data /checkpoint/TEAM_NAME/datasets/consolidated/v4.0