6c41984d8a
RoPE fixes for 1.5, bfloat16 support in prepare_dataset, gradient_accumulation grad norm undefined fix ( #107 )
...
* rope scaling fixes for cog 1.5
* grad norm log fix
* bf16 prepare dataset fix
* update
* style
2024-12-02 15:12:12 +05:30
0b80dba1de
adaption for CogVideoX1.5 ( #92 )
...
* adaption for CogVideoX1.5
* add patch_size_t in full finetuning of T2V and lora finetuning of I2V
* Update training/args.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-11-23 06:28:20 +05:30
d63a826f37
I2V multiresolution finetuning by removing learned PEs ( #31 )
...
* i2v finetuning without learned pe
* update
* update
* update
* update readme
* refactor
* refactor
2024-11-08 07:59:12 +05:30
d81209bf49
Low-bit memory optimizers, CpuOffloadOptimizer, Memory Reports ( #3 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
2024-10-04 18:18:54 +05:30
512a8a6854
CogVideoX LoRA and full finetuning ( #1 )
...
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
* update
2024-10-01 08:05:10 +05:30
Aryan