Merge requests · Administrator / metaseq

Bump protobuf from 3.20.1 to 3.20.2

!354 · created Sep 27, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 29, 2022
fix warning

!353 · created Sep 27, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 27, 2022
Making data loader skipping 5--9x faster

!352 · created Sep 27, 2022 by Administrator cla signed
- MERGED
- 27
updated Sep 29, 2022
restore last checkpoint from the end of the training runs

!350 · created Sep 26, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 29, 2022
Adding tests for hub_utils generator classes 0 of 4 checklist items completed

!349 · created Sep 26, 2022 by Administrator cla signed
- MERGED
- 27
updated Oct 06, 2022
check if we can skip the fused_kernel load, because newer version of …

!348 · created Sep 23, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 23, 2022
Add srctgt truncation

!346 · created Sep 21, 2022 by Administrator opt_instruct cla signed
- MERGED
- 4
updated Sep 21, 2022
Updating from data source rename

!345 · created Sep 21, 2022 by Administrator cla signed
- MERGED
- 3
updated Sep 21, 2022
Add GLU activations

!343 · created Sep 17, 2022 by Administrator cla signed
- CLOSED
- 9
updated Oct 07, 2022
test removing output projection from MHA 0 of 4 checklist items completed

!342 · created Sep 16, 2022 by Administrator cla signed
- CLOSED
- 1
updated Sep 22, 2022
Change deletion of old checkpoints to match new naming

!341 · created Sep 16, 2022 by Administrator cla signed
- MERGED
- 2
updated Sep 16, 2022
add sampling specific to pretrain data during finetuning

!340 · created Sep 16, 2022 by Administrator opt_instruct cla signed
- MERGED
- 2
updated Sep 16, 2022
add control option to turn on validation at step 0

!339 · created Sep 15, 2022 by Administrator opt_instruct cla signed
- MERGED
- 2
updated Sep 15, 2022
Remove no_ and keep_ checkpoint flags

!338 · created Sep 14, 2022 by Administrator cla signed
- MERGED
- 27
updated Oct 07, 2022
[jsonl] Make skipping entries in the dataloader significantly faster 0 of 4 checklist items completed

!337 · created Sep 13, 2022 by Administrator cla signed
- MERGED
- 17
updated Sep 26, 2022
multiclass val accuracy during finetuning

!335 · created Sep 09, 2022 by Administrator opt_instruct cla signed
- MERGED
- 22
updated Sep 12, 2022
Changes to support fairseq_v3 megatron branch

!334 · created Sep 07, 2022 by Administrator cla signed
- CLOSED
- 2
updated Oct 31, 2022
alibi performance fixes

!333 · created Sep 07, 2022 by Administrator cla signed
- CLOSED
- 7
updated Oct 06, 2022
[dist] Force threads=1 when spawning.

!331 · created Sep 06, 2022 by Administrator cla signed
- MERGED
- 3
updated Sep 06, 2022
BF16 bug fix:

!330 · created Sep 06, 2022 by Administrator cla signed
- MERGED
- 4
updated Sep 07, 2022