Skip to content
GitLab

Fix verify shards - to fix resuming from checkpoint

Merged Administrator requested to merge fix_verify into opt_instruct

Created by: sriniiyer

Currently, num_gpus is set to the local setting of 8, and not the actual number of global gpus. This causes verify-shards to fail and so, resuming from checkpoint fails.

This fixes that