Commit Graph

138 Commits

Author SHA1 Message Date
ArEnSc 905c22edd8 Fix minor bug with function call that doesn't exist. (#195)
Co-authored-by: Aryan <aryan@huggingface.co>
2025-01-08 05:25:27 +05:30
Aryan f1b02964d7 Update requirements (#189)
* update

* update
2025-01-08 04:14:55 +05:30
Sayak Paul 7b569daf55 simplify docs part ii (#190)
* simplify docs.

* clarify the cog checkpoints supported.

* make the note smaller.

* replace with sub

* Apply suggestions from code review

Co-authored-by: Aryan <aryan@huggingface.co>

---------

Co-authored-by: Aryan <aryan@huggingface.co>
2025-01-07 12:47:01 +05:30
Aryan 38413aa167 Allow images; Remove LLM generated prefixes; Allow JSON/JSONL; Fix bugs (#158)
* update

* update

* fix

* Update finetrainers/dataset.py

* update

* argument for enabling remove of common llm prefixes

* update

* make new generator for validation

* update

* update

* update

* update

* update
2025-01-06 18:52:54 +05:30
Sayak Paul eeb4dd7afa [docs] refactor docs for easier info parsing (#175)
* refactor docs for easier info parsing

* refactor readme

* anonym paths

* updates

* remove notes.

* add a toc.

* minor typos.

* move cog.md -> cogvideox.md

* add a note about the model-specific docs in training readme.

* add memory usage for CogVideoX.

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* change to 5b from 2b for CogVideoX.

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* more appropriate names.

* add headers to the model docs.

* fix adapter name

* minor

* updates

* fix cog training command example

---------

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>
2025-01-05 20:50:30 +05:30
Sayak Paul b3d0ba8e12 support model cards (#176)
* introduce model cards and support passing FPS.

* updates

* fix

* fix

* updates

* revert changes

* revert args.py changes

* fix

* fix

* fix filename
2025-01-05 19:21:17 +05:30
Sayak Paul b5a5124cd5 add a workflow to do quality checks. (#180) 2025-01-05 18:07:49 +05:30
Sayak Paul a709a1cec1 fixes (#178) 2025-01-04 08:57:41 +05:30
Sayak Paul 071c140879 Fix scheduler bugs (#177)
* fix scheduler bugs.

* fix
2025-01-03 18:52:40 +05:30
Sayak Paul b8352abf70 Support CogVideoX T2V (#165)
* support cog t2v.

* generator.

* updates

* style

* fixes

* fix padding frames.

Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn>

* revert changes related to generator.

* refactor a lot of things.

* accept revision and cache_dir.

* remove unused var

* refactoring fixes.

* refactor

* update

* update

---------

Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn>
Co-authored-by: Aryan <aryan@huggingface.co>
2025-01-03 10:53:16 +05:30
Sayak Paul 2a1aa05191 Update README.md to fix graph paths (#171) 2025-01-02 20:11:27 +05:30
Sayak Paul 018953ed86 bulk update styling and formatting (#170) 2025-01-02 13:20:33 +05:30
Sayak Paul 191ea8b0cc [optimization] support 8bit optims from bistandbytes (#163)
* support 8bit optims from bnb.

* fix exist_ok

* use_8bit_bnb.

* fix.

* note in readme.
2024-12-30 14:03:56 +05:30
Sayak Paul e9fba4ab7f Merge pull request #139 from a-r-r-o-w/support-deepspeed
[feat] support DeepSpeed.
2024-12-27 15:21:31 +05:30
sayakpaul 84c17561eb fixes 2024-12-27 15:02:21 +05:30
sayakpaul 4461cdd98f tracker logging 2024-12-27 12:25:11 +05:30
Aryan 739f3d8535 update Makefile 2024-12-27 07:20:34 +01:00
Aryan a19401e84f update README; remove print; make style 2024-12-27 07:19:16 +01:00
sayakpaul 87af1a0113 Merge branch 'main' into support-deepspeed 2024-12-26 08:17:48 +05:30
sayakpaul 1594c1dade deepspeed note 2024-12-26 08:12:41 +05:30
sayakpaul 1d5e0566fb private 2024-12-26 08:01:16 +05:30
Sayak Paul 0309f3bf67 Apply suggestions from code review
Co-authored-by: Aryan <aryan@huggingface.co>
2024-12-26 08:00:04 +05:30
sayakpaul 0c0a0a5e4a scheduler 2024-12-26 07:55:07 +05:30
sayakpaul 28ecfe6b65 torch.is_tensor check 2024-12-26 07:49:51 +05:30
Aryan 2a594ea2db fix validation bug (#149) 2024-12-26 02:54:08 +05:30
Aryan 5757b1b886 fix grad norm related logging 2024-12-25 19:25:22 +01:00
sayakpaul e94c3c71d1 revert configs. 2024-12-25 21:36:22 +05:30
sayakpaul 6b54867c3c fixes 2024-12-25 21:34:56 +05:30
Sayak Paul 5aef4a6c80 Merge pull request #148 from a-r-r-o-w/deepspeed-changes
Grad Norm tracking in DeepSpeed
2024-12-25 20:08:09 +05:30
Aryan 47e4aaac2f track grad norm for deepspeed 2024-12-25 15:04:16 +01:00
Aryan e2178deea0 fix deadlock; make style 2024-12-25 14:16:31 +01:00
sayakpaul d7aa50917f fixes 2024-12-25 12:07:50 +05:30
sayakpaul 69b585a992 fixes 2024-12-25 11:35:09 +05:30
sayakpaul 875cb72f63 address review feedback. 2024-12-24 21:20:37 +05:30
sayakpaul 6329e9ed07 support DeepSpeed. 2024-12-24 10:59:21 +05:30
Sayak Paul cf9be17819 Merge pull request #129 from a-r-r-o-w/condition-precomputation
Precomputation of conditions and latents
2024-12-23 20:00:34 +05:30
Aryan 2858346b27 address review 2024-12-23 15:11:03 +01:00
Aryan 1c8f33967c add note about grad ckpt in readme 2024-12-23 14:59:05 +01:00
Aryan 8c0c28c971 create markdown tables 2024-12-23 14:16:47 +01:00
Aryan 78712f60a5 update comment 2024-12-23 14:01:39 +01:00
Aryan 75a854f9df add coauthor
Co-Authored-By: Sayak Paul <spsayakpaul@gmail.com>
2024-12-23 13:59:45 +01:00
Aryan 5261bed284 remove pipeline hooks 2024-12-23 13:58:37 +01:00
Aryan 86e1d1888a other condtions -> text conditions 2024-12-23 13:48:58 +01:00
Aryan 363841ae3f address some reviews; change hunyuan checkpoint repo-id 2024-12-23 12:54:52 +01:00
Aryan b045037850 make style 2024-12-21 15:19:03 +01:00
Aryan 0db7bf28aa update 2024-12-21 15:18:46 +01:00
Aryan 2da8cb5798 update 2024-12-21 12:24:33 +01:00
Aryan 66189c804b update 2024-12-20 10:03:39 +01:00
Aryan 223add1a59 Hunyuan Video LoRA (#126)
* add hunyuan-video lora support

* minor fixes; make style

* update readme

* update

* update

* Update README.md

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* change move train scripts to internal directory

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-20 08:02:08 +05:30
Aryan 9ef58e2f3a LTX Video (#123)
* rename files

* ltx finetuning

* update

* update

* improvements

* make style

* gradient clipping

* update

* fix distributed inference

* update

* update
2024-12-19 04:27:36 +05:30