Merge requests · Administrator / metaseq

fix warning

!353 · created Sep 27, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 27, 2022
[jsonl] Make skipping entries in the dataloader significantly faster 0 of 4 checklist items completed

!337 · created Sep 13, 2022 by Administrator cla signed
- MERGED
- 17
updated Sep 26, 2022
check if we can skip the fused_kernel load, because newer version of …

!348 · created Sep 23, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 23, 2022
Add srctgt truncation

!346 · created Sep 21, 2022 by Administrator opt_instruct cla signed
- MERGED
- 4
updated Sep 21, 2022
Updating from data source rename

!345 · created Sep 21, 2022 by Administrator cla signed
- MERGED
- 3
updated Sep 21, 2022
add sampling specific to pretrain data during finetuning

!340 · created Sep 16, 2022 by Administrator opt_instruct cla signed
- MERGED
- 2
updated Sep 16, 2022
Change deletion of old checkpoints to match new naming

!341 · created Sep 16, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 16, 2022
add control option to turn on validation at step 0

!339 · created Sep 15, 2022 by Administrator opt_instruct cla signed
- MERGED
- 2
updated Sep 15, 2022
multiclass val accuracy during finetuning

!335 · created Sep 09, 2022 by Administrator opt_instruct cla signed
- MERGED
- 22
updated Sep 12, 2022
Make Checkpoint Loading Strict

!143 · created Jun 07, 2022 by Administrator cla signed
- MERGED
- 4
updated Sep 10, 2022
[jsonl] Fix regression in index building.

!312 · created Aug 20, 2022 by Administrator cla signed
- MERGED
- 3
updated Sep 10, 2022
BF16 bug fix:

!330 · created Sep 06, 2022 by Administrator cla signed
- MERGED
- 4
updated Sep 07, 2022
[dist] Force threads=1 when spawning.

!331 · created Sep 06, 2022 by Administrator cla signed
- MERGED
- 3
updated Sep 06, 2022
[QOL] Better error message for megatron softmax failure

!326 · created Aug 31, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 06, 2022
changes for interactive to work with non-fsdp

!170 · created Jun 22, 2022 by Administrator cla signed
- MERGED
- 5
updated Aug 31, 2022
[cleanup] Update some f-strings, change checkpoint naming scheme.

!323 · created Aug 30, 2022 by Administrator cla signed
- MERGED
- 5
updated Aug 30, 2022
[checkpoints] Don't validate/save after epochs.

!322 · created Aug 30, 2022 by Administrator cla signed
- MERGED
- 6
updated Aug 30, 2022
[tboard, QOL] Don't log average train metrics.

!320 · created Aug 30, 2022 by Administrator cla signed
- MERGED
- 2
updated Aug 30, 2022
[logging] Better dataloader logging

!321 · created Aug 30, 2022 by Administrator cla signed
- MERGED
- 4
updated Aug 30, 2022
Validation accuracy during training

!284 · created Aug 02, 2022 by Administrator opt_instruct cla signed
- MERGED
- 6
updated Aug 29, 2022