6c41984d8a
RoPE fixes for 1.5, bfloat16 support in prepare_dataset, gradient_accumulation grad norm undefined fix ( #107 )
...
* rope scaling fixes for cog 1.5
* grad norm log fix
* bf16 prepare dataset fix
* update
* style
2024-12-02 15:12:12 +05:30
76a9f2b911
Merge pull request #106 from a-r-r-o-w/resume-mochi-1
...
feat: support checkpointing saving and loading
2024-12-01 20:43:25 +05:30
cca97bfd40
readme
2024-12-01 20:35:51 +05:30
79b546b264
feat: support checkpointing.
2024-12-01 20:34:35 +05:30
ec3ec47891
Unbound fix ( #105 )
...
* is some error
```
[rank1]: File "/mnt/ceph/develop/jiawei/cogvideox-distillation/training/cogvideox_image_to_video_lora.py", line 1005, in <module> [rank1]: main(args) [rank1]: File "/mnt/ceph/develop/jiawei/cogvideox-distillation/training/cogvideox_image_to_video_lora.py", line 884, in main [rank1]: "gradient_norm_before_clip": gradient_norm_before_clip, [rank1]: UnboundLocalError: local variable 'gradient_norm_before_clip' referenced before assignment
```
ref1 :https://github.com/a-r-r-o-w/cogvideox-factory/pull/84
ref2: https://github.com/a-r-r-o-w/cogvideox-factory/pull/100
It seems that there is a bug in the accelerator.is_main_process task and accelerator.distributed_type. Is_main_process has scheduling problems during the training initiation and training stages.
* fix
2024-12-01 01:58:27 +05:30
099c9c35c4
Merge pull request #104 from a-r-r-o-w/fix-format-specifier
...
fix format specifier.
2024-11-29 16:29:58 +05:30
c8a118cefd
fix format specifier.
2024-11-29 16:23:14 +05:30
d5cc7c66f1
Merge pull request #100 from a-r-r-o-w/wandb-tracker-fix
...
wandb tracker in scheduling problems during the training initiation and training stages
2024-11-29 15:08:19 +05:30
d10963f707
Merge pull request #90 from a-r-r-o-w/mochi-1-tuner
...
[feat] add Mochi-1 trainer
2024-11-29 14:56:20 +05:30
7090bcb9de
Update README.md
2024-11-29 13:47:26 +05:30
dceded0a94
add a preview table
2024-11-29 13:40:02 +05:30
0011fa1406
better command
2024-11-29 13:34:05 +05:30
95775ba5d1
pyav pining.
2024-11-29 13:27:23 +05:30
8a32b139af
pin moviepy.
2024-11-29 13:22:23 +05:30
38f157c6d0
Apply suggestions from code review
...
Co-authored-by: Aryan <aryan@huggingface.co >
2024-11-29 13:11:08 +05:30
9c86706cbb
fix help message
2024-11-29 13:08:55 +05:30
e1866d844d
better example code.
2024-11-29 13:07:26 +05:30
4e3bb7ab5f
updates
2024-11-29 10:52:12 +05:30
ced8558eb0
updates
2024-11-29 10:48:54 +05:30
2fde026d30
updates
2024-11-28 12:33:25 +05:30
a9cf49ecea
wandb tracker in scheduling problems during the training initiation and training stages.
2024-11-27 17:14:28 +08:00
62a82a8647
Merge pull request #84 from zhipuch/main
...
sft with multigpu gradient_norm_before_clip error update
2024-11-27 17:02:28 +08:00
559ba47993
docs: fix help message in args.py ( #98 )
2024-11-27 08:27:41 +05:30
58a06320ba
updates
2024-11-26 12:28:44 +05:30
0b80dba1de
adaption for CogVideoX1.5 ( #92 )
...
* adaption for CogVideoX1.5
* add patch_size_t in full finetuning of T2V and lora finetuning of I2V
* Update training/args.py
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-11-23 06:28:20 +05:30
2dbddd566e
updates
2024-11-22 23:34:17 +05:30
9a15eaee41
updates
2024-11-20 19:31:13 +05:30
7e203db9aa
updates
2024-11-20 10:39:52 +05:30
9eea656fa0
fixes
2024-11-19 18:38:05 +05:30
5208c59394
fix
2024-11-19 11:36:56 +05:30
cb16cbae5f
dataset_mochi
2024-11-19 11:35:00 +05:30
a01592b25d
betterments.
2024-11-19 11:32:24 +05:30
440dc257c8
better reuse.
2024-11-19 10:51:00 +05:30
4216705510
Merge branch 'main' into mochi-1-tuner
2024-11-19 10:29:48 +05:30
316a705f6a
revert changes to training/dataset.py
2024-11-19 10:29:16 +05:30
c80bd177fd
nearest_frame_bucket.
2024-11-19 10:27:24 +05:30
1409d478d5
updates.
2024-11-19 10:21:28 +05:30
ac83c78a5a
updates
2024-11-18 15:32:04 +05:30
a8dd94ee1c
updates
2024-11-18 15:31:11 +05:30
4c05ea6669
updates
2024-11-18 15:30:23 +05:30
a40ccd2237
updates
2024-11-18 15:28:37 +05:30
9852c3d994
updates.
2024-11-18 15:26:52 +05:30
5ba510e061
updates
2024-11-17 10:18:20 +05:30
a9adf22386
dataprep.
2024-11-17 08:31:21 +05:30
ac5f417555
sft with multigpu
2024-11-12 15:20:41 +08:00
d63a826f37
I2V multiresolution finetuning by removing learned PEs ( #31 )
...
* i2v finetuning without learned pe
* update
* update
* update
* update readme
* refactor
* refactor
2024-11-08 07:59:12 +05:30
cbbac06112
add some script of lora test ( #66 )
...
* multi resolutions support
* full chinese readme
* Update README.md
* Update README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* reformat from pycharm
* dataset.md
* Update README.md
* for merge
* mergeing
* torch update for use
* add test lora script
* Update test_lora_inference.py
* Update requirements.txt
* Update requirements.txt
---------
Co-authored-by: Aryan <aryan@huggingface.co >
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-10-30 16:25:14 +05:30
bd4062760c
Update README.md ( #73 )
2024-10-28 12:51:25 +05:30
0affacb229
Update README.md ( #59 )
...
Install diffusers from source to address https://github.com/a-r-r-o-w/cogvideox-factory/issues/46
2024-10-21 04:01:21 +05:30
7a6dff2d9f
Fixed optimizers parsing error in bash scripts ( #61 )
...
* replaced lambda statements with local functions to work with pickle in dataset.py and moved collate function outside of main and added its own class in cogvideox_image_to_video_lora.py
* fixed merge issue
* fixed row deletion merge
* fixed row deletion merge
* fixed comma-separated param issue in bash
2024-10-21 04:00:51 +05:30
Aryan