Commit Graph

42 Commits

Author SHA1 Message Date
sayakpaul e1866d844d better example code. 2024-11-29 13:07:26 +05:30
sayakpaul 4e3bb7ab5f updates 2024-11-29 10:52:12 +05:30
sayakpaul ced8558eb0 updates 2024-11-29 10:48:54 +05:30
sayakpaul 2fde026d30 updates 2024-11-28 12:33:25 +05:30
sayakpaul 58a06320ba updates 2024-11-26 12:28:44 +05:30
sayakpaul 2dbddd566e updates 2024-11-22 23:34:17 +05:30
sayakpaul 9a15eaee41 updates 2024-11-20 19:31:13 +05:30
sayakpaul 7e203db9aa updates 2024-11-20 10:39:52 +05:30
sayakpaul 9eea656fa0 fixes 2024-11-19 18:38:05 +05:30
sayakpaul 5208c59394 fix 2024-11-19 11:36:56 +05:30
sayakpaul a01592b25d betterments. 2024-11-19 11:32:24 +05:30
sayakpaul 440dc257c8 better reuse. 2024-11-19 10:51:00 +05:30
sayakpaul 4216705510 Merge branch 'main' into mochi-1-tuner 2024-11-19 10:29:48 +05:30
sayakpaul 316a705f6a revert changes to training/dataset.py 2024-11-19 10:29:16 +05:30
sayakpaul c80bd177fd nearest_frame_bucket. 2024-11-19 10:27:24 +05:30
sayakpaul 1409d478d5 updates. 2024-11-19 10:21:28 +05:30
sayakpaul ac83c78a5a updates 2024-11-18 15:32:04 +05:30
sayakpaul a8dd94ee1c updates 2024-11-18 15:31:11 +05:30
sayakpaul 4c05ea6669 updates 2024-11-18 15:30:23 +05:30
sayakpaul a40ccd2237 updates 2024-11-18 15:28:37 +05:30
sayakpaul 9852c3d994 updates. 2024-11-18 15:26:52 +05:30
sayakpaul 5ba510e061 updates 2024-11-17 10:18:20 +05:30
sayakpaul a9adf22386 dataprep. 2024-11-17 08:31:21 +05:30
Aryan d63a826f37 I2V multiresolution finetuning by removing learned PEs (#31)
* i2v finetuning without learned pe

* update

* update

* update

* update readme

* refactor

* refactor
2024-11-08 07:59:12 +05:30
Aryan db9b295408 Windows support for T2V scripts (#48) 2024-10-21 02:40:05 +05:30
Sayak Paul 6c00cf094b fix: resuming from a checkpoint when using deepspeed. (#38)
* fix: resuming from a checkpoint when using deepspeed.

* remove changes to prepare_dataset.py

* propagate to others.

* tackle gradnorm.

---------

Co-authored-by: Aryan <aryan@huggingface.co>
2024-10-20 02:56:32 +05:30
Dhanush f0d9908bbd fix: correct type in .py files (#52) 2024-10-20 01:22:07 +05:30
Aryan 8da9638896 more dataset fixes from stashed changes (#49) 2024-10-19 06:30:26 +05:30
Aryan f2a1626de2 improve dataset preparation (#43)
* update

* update

* update

* update
2024-10-18 02:43:22 +05:30
Aryan feb2e26547 Improve dataset preparation support + multiresolution prep (#39)
* update

* make style

* renormalize correctly

* apply suggestions from review

* apply suggestions from review

* update
2024-10-17 16:48:52 +05:30
Johan Mellin 4f2744ee59 Update for windows compability (#32)
* replaced lambda statements with local functions to work with pickle in dataset.py and moved collate function outside of main and added its own class in cogvideox_image_to_video_lora.py

* Update cogvideox_image_to_video_lora.py

Remove the bug-fix related to image encoding since it's already present in #31

* Update cogvideox_image_to_video_lora.py

Revert to last commit (60c46827404cd4780ee0e7d3c9c56a953e2a04ca)
2024-10-15 19:10:50 +05:30
Aryan ee02219eac readme updates + refactor (#14)
* refactor

* update

* update

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* address review comments part i

* fix adapter name causing peft error

* prompts -> prompt

* update

* add video

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-10-10 18:03:45 +05:30
glide-the 2a70b16d3c add "max_sequence_length": model_config.max_text_seq_length, (#15)
Co-authored-by: --unset <--unset>
2024-10-10 17:08:40 +05:30
glide-the 00f7519f0e add VideoDatasetWithResizeAndRectangleCrop dataset resize crop (#13)
* fix issue 12:  train dataset _preprocess_data crop video

* add_argument  video_reshape_mode input videos are reshaped to this mode

* arg enable_model_cpu_offloading

* Add imageio-ffmpeg and imageio to requirements.txt

* apply changes to i2v lora script

* make style

---------

Co-authored-by: --unset <--unset>
Co-authored-by: Aryan <aryan@huggingface.co>
2024-10-10 01:55:12 +05:30
Aryan b1b72c0e38 CogVideoX I2V; CPU offloading; Model README descriptions (#11)
* update

* update

* update readme

* update

* update

* update model desc

* update

* Update training/prepare_dataset.py
2024-10-09 17:44:59 +05:30
Yuxuan.Zhang cc1d2e759f Multi-GPU parallel encoding support for training videos. (#6)
* Multi-GPU parallel encoding support for training videos.

* revert

* make style

* update

---------

Co-authored-by: Aryan <aryan@huggingface.co>
2024-10-09 04:19:59 +05:30
Aryan 3a519f5443 Full finetuning memory requirements (#9)
* update

* update

* model cpu offloading
2024-10-09 03:11:04 +05:30
Aryan be9d99a1b0 DeepSpeed and DDP Configs (#10)
* add configs

* remove compiled ddp config

* add coauthor

Co-Authored-By: Sayak Paul <spsayakpaul@gmail.com>

* update

* deepspeed numbers  nd fixes

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-10-09 02:54:18 +05:30
Aryan 0937e923e3 update (#7) 2024-10-08 16:04:22 +05:30
Aryan d792cbbb64 update (#5) 2024-10-06 21:53:43 +05:30
Aryan d81209bf49 Low-bit memory optimizers, CpuOffloadOptimizer, Memory Reports (#3)
* update

* update

* update

* update

* update

* update

* update

* update

* update
2024-10-04 18:18:54 +05:30
Aryan 512a8a6854 CogVideoX LoRA and full finetuning (#1)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2024-10-01 08:05:10 +05:30