Commit Graph

33 Commits

Author SHA1 Message Date
Sayak Paul eeb4dd7afa [docs] refactor docs for easier info parsing (#175)
* refactor docs for easier info parsing

* refactor readme

* anonym paths

* updates

* remove notes.

* add a toc.

* minor typos.

* move cog.md -> cogvideox.md

* add a note about the model-specific docs in training readme.

* add memory usage for CogVideoX.

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* change to 5b from 2b for CogVideoX.

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* more appropriate names.

* add headers to the model docs.

* fix adapter name

* minor

* updates

* fix cog training command example

---------

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>
2025-01-05 20:50:30 +05:30
Sayak Paul 191ea8b0cc [optimization] support 8bit optims from bistandbytes (#163)
* support 8bit optims from bnb.

* fix exist_ok

* use_8bit_bnb.

* fix.

* note in readme.
2024-12-30 14:03:56 +05:30
Aryan a19401e84f update README; remove print; make style 2024-12-27 07:19:16 +01:00
sayakpaul 1594c1dade deepspeed note 2024-12-26 08:12:41 +05:30
Aryan 1c8f33967c add note about grad ckpt in readme 2024-12-23 14:59:05 +01:00
Aryan 8c0c28c971 create markdown tables 2024-12-23 14:16:47 +01:00
Aryan 363841ae3f address some reviews; change hunyuan checkpoint repo-id 2024-12-23 12:54:52 +01:00
Aryan 0db7bf28aa update 2024-12-21 15:18:46 +01:00
Aryan 2da8cb5798 update 2024-12-21 12:24:33 +01:00
Aryan 66189c804b update 2024-12-20 10:03:39 +01:00
Aryan 223add1a59 Hunyuan Video LoRA (#126)
* add hunyuan-video lora support

* minor fixes; make style

* update readme

* update

* update

* Update README.md

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* change move train scripts to internal directory

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-20 08:02:08 +05:30
Aryan 9ef58e2f3a LTX Video (#123)
* rename files

* ltx finetuning

* update

* update

* improvements

* make style

* gradient clipping

* update

* fix distributed inference

* update

* update
2024-12-19 04:27:36 +05:30
Sayak Paul aa8612fc06 Update README.md to include mochi-1 trainer 2024-12-05 12:59:13 +05:30
Aryan d63a826f37 I2V multiresolution finetuning by removing learned PEs (#31)
* i2v finetuning without learned pe

* update

* update

* update

* update readme

* refactor

* refactor
2024-11-08 07:59:12 +05:30
Yuxuan.Zhang cbbac06112 add some script of lora test (#66)
* multi resolutions support

* full chinese readme

* Update README.md

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* reformat from pycharm

* dataset.md

* Update README.md

* for merge

* mergeing

* torch update for use

* add test lora script

* Update test_lora_inference.py

* Update requirements.txt

* Update requirements.txt

---------

Co-authored-by: Aryan <aryan@huggingface.co>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-10-30 16:25:14 +05:30
Aryan bd4062760c Update README.md (#73) 2024-10-28 12:51:25 +05:30
Yuancheng Xu 0affacb229 Update README.md (#59)
Install diffusers from source to address https://github.com/a-r-r-o-w/cogvideox-factory/issues/46
2024-10-21 04:01:21 +05:30
Johan Mellin 7a6dff2d9f Fixed optimizers parsing error in bash scripts (#61)
* replaced lambda statements with local functions to work with pickle in dataset.py and moved collate function outside of main and added its own class in cogvideox_image_to_video_lora.py

* fixed merge issue

* fixed row deletion merge

* fixed row deletion merge

* fixed comma-separated param issue in bash
2024-10-21 04:00:51 +05:30
Aryan feb2e26547 Improve dataset preparation support + multiresolution prep (#39)
* update

* make style

* renormalize correctly

* apply suggestions from review

* apply suggestions from review

* update
2024-10-17 16:48:52 +05:30
Farookh Zaheer Siddiqui a6c246c29d [Docs] : Update README.md (#35)
* Update README.md

* Update README.md

---------

Co-authored-by: Aryan <contact.aryanvs@gmail.com>
2024-10-15 19:12:57 +05:30
Yuxuan.Zhang 1323aeb5b1 Update README and Contribution guide (#20)
* multi resolutions support

* full chinese readme

* Update README.md

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* reformat from pycharm

* dataset.md

* Update README.md

---------

Co-authored-by: Aryan <aryan@huggingface.co>
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-10-12 02:37:57 +05:30
Ikko Eltociear Ashimine 09464e2d78 docs: update README.md (#21)
hyperparamters -> hyperparameters
2024-10-11 04:43:27 +05:30
zR 13083b5bbf .github page 2024-10-10 22:14:25 +08:00
Aryan 00a80930a7 Update README.md 2024-10-10 18:06:57 +05:30
Aryan ee02219eac readme updates + refactor (#14)
* refactor

* update

* update

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* address review comments part i

* fix adapter name causing peft error

* prompts -> prompt

* update

* add video

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-10-10 18:03:45 +05:30
Aryan b1b72c0e38 CogVideoX I2V; CPU offloading; Model README descriptions (#11)
* update

* update

* update readme

* update

* update

* update model desc

* update

* Update training/prepare_dataset.py
2024-10-09 17:44:59 +05:30
Yuxuan.Zhang cc1d2e759f Multi-GPU parallel encoding support for training videos. (#6)
* Multi-GPU parallel encoding support for training videos.

* revert

* make style

* update

---------

Co-authored-by: Aryan <aryan@huggingface.co>
2024-10-09 04:19:59 +05:30
Aryan 3a519f5443 Full finetuning memory requirements (#9)
* update

* update

* model cpu offloading
2024-10-09 03:11:04 +05:30
Aryan be9d99a1b0 DeepSpeed and DDP Configs (#10)
* add configs

* remove compiled ddp config

* add coauthor

Co-Authored-By: Sayak Paul <spsayakpaul@gmail.com>

* update

* deepspeed numbers  nd fixes

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-10-09 02:54:18 +05:30
sayakpaul 27af518053 readme i. 2024-10-08 16:55:52 +05:30
Aryan d81209bf49 Low-bit memory optimizers, CpuOffloadOptimizer, Memory Reports (#3)
* update

* update

* update

* update

* update

* update

* update

* update

* update
2024-10-04 18:18:54 +05:30
Aryan 512a8a6854 CogVideoX LoRA and full finetuning (#1)
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
2024-10-01 08:05:10 +05:30
Aryan 95774133eb Initial commit 2024-09-25 13:35:24 +05:30