Commit Graph

174 Commits

Author SHA1 Message Date
CrossProduct 4354fb3164 LTX uses a default frame rate of 24 FPS
We need to modify the output validation framerate to match that value.
Add Framerate args.
Add Update video output and inference frame rate
2025-01-12 04:39:05 +00:00
Aryan a78fedd108 Merge branch 'main' into feature/full-finetuning 2025-01-11 07:17:29 +05:30
Aryan a3898075d1 Helpful mesages (#210) 2025-01-11 06:35:28 +05:30
Aryan d3b797ee35 Improve argument handling (#209) 2025-01-11 06:18:13 +05:30
Aryan ca957e543c remove unnecessary changes 2025-01-11 01:37:02 +01:00
Aryan 491b35f3dd Merge branch 'main' into feature/full-finetuning 2025-01-11 05:59:08 +05:30
Aryan 1f304b36d4 handle saving of final model weights correctly 2025-01-11 01:28:47 +01:00
Aryan 06dd96c0a3 remove unnecessary changes 2025-01-11 01:11:27 +01:00
Aryan d6821c3da8 refactor 2025-01-11 00:54:03 +01:00
Aryan 81bf590a91 Argument descriptions (#208)
* add argument descriptions

* update

* update

* update
2025-01-11 05:06:02 +05:30
Sayak Paul 014960fd4c Merge branch 'main' into feature/full-finetuning 2025-01-10 19:56:34 +05:30
Boyang Deng b34091362e Fix the checkpoint dir bug in get_intermediate_ckpt_path so that checkpointing_limit can actually work. (#207) 2025-01-10 13:18:32 +05:30
Sayak Paul 34da4c5a6b Merge branch 'main' into feature/full-finetuning 2025-01-10 07:54:05 +05:30
Sayak Paul 4b21d37c9d Update pr_tests.yml to update ruff version (#205) 2025-01-10 07:53:39 +05:30
sayakpaul a422f7f07b updates 2025-01-10 07:53:16 +05:30
Sayak Paul 6d597699b3 Merge branch 'main' into feature/full-finetuning 2025-01-10 07:49:06 +05:30
sayakpaul c0f38892f8 remove __class__. 2025-01-10 07:44:36 +05:30
Sayak Paul 28b3e845d8 Merge branch 'main' into auxiliary-support-ff-2 2025-01-10 07:43:02 +05:30
Sayak Paul 9523a05220 Shell script to minimally test supported models on a real dataset (#204)
* start minimal complete tests

* updates

* fixes

* fixes
2025-01-10 07:22:00 +05:30
sayakpaul 2c6f5497a5 Merge branch 'main' into auxiliary-support-ff-2 2025-01-09 14:26:32 +05:30
Aryan b9a6492ad1 Epoch loss (#201)
* update

* update
2025-01-09 14:22:56 +05:30
sayakpaul 162e6cd50d fix subfolder bug. 2025-01-09 13:25:01 +05:30
sayakpaul 5183405e61 tackle validation. 2025-01-09 13:17:15 +05:30
sayakpaul 8188f8a11e tackle saving and loading hooks. 2025-01-09 13:03:14 +05:30
sayakpaul acffc2d9fc parse subfolder when needed. 2025-01-09 12:54:57 +05:30
Sayak Paul f311f16d98 [core] Fix loading of precomputed conditions and latents (#199)
* support precomputation.

* fixes
2025-01-09 12:43:03 +05:30
Aryan 6716ccf8c2 update (#198)
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2025-01-09 11:06:34 +05:30
CrossProduct 19bba0aed3 Run linter. 2025-01-09 00:39:20 +00:00
CrossProduct d0ee9c3101 Switching to Full FineTuning 2025-01-09 00:27:15 +00:00
Sayak Paul 72ec207708 Merge branch 'main' into feature/full-finetuning 2025-01-08 10:49:13 +05:30
Aryan dbffc80e7c Precomputation folder name based on model name (#196)
* update

* update

* fix

* address review comments
2025-01-08 08:45:44 +05:30
ArEnSc bd02e6d9d2 Merge branch 'main' into feature/full-finetuning 2025-01-07 19:14:25 -05:00
ArEnSc 905c22edd8 Fix minor bug with function call that doesn't exist. (#195)
Co-authored-by: Aryan <aryan@huggingface.co>
2025-01-08 05:25:27 +05:30
CrossProduct cb9381b40e Suggestions Addressed
Renamed to SFT
Added 2 other models.
Testing required.
2025-01-07 22:59:09 +00:00
Aryan f1b02964d7 Update requirements (#189)
* update

* update
2025-01-08 04:14:55 +05:30
CrossProduct 4cd5a8e53b Used disable grad for component on lora fine tuning enabled 2025-01-07 20:41:12 +00:00
CrossProduct f0db0ccb00 Change name of the flag 2025-01-07 20:36:03 +00:00
CrossProduct eeea82ad04 Full Finetuning for LTX possibily extended to other models. 2025-01-07 20:27:19 +00:00
Sayak Paul 7b569daf55 simplify docs part ii (#190)
* simplify docs.

* clarify the cog checkpoints supported.

* make the note smaller.

* replace with sub

* Apply suggestions from code review

Co-authored-by: Aryan <aryan@huggingface.co>

---------

Co-authored-by: Aryan <aryan@huggingface.co>
2025-01-07 12:47:01 +05:30
Aryan 38413aa167 Allow images; Remove LLM generated prefixes; Allow JSON/JSONL; Fix bugs (#158)
* update

* update

* fix

* Update finetrainers/dataset.py

* update

* argument for enabling remove of common llm prefixes

* update

* make new generator for validation

* update

* update

* update

* update

* update
2025-01-06 18:52:54 +05:30
Sayak Paul eeb4dd7afa [docs] refactor docs for easier info parsing (#175)
* refactor docs for easier info parsing

* refactor readme

* anonym paths

* updates

* remove notes.

* add a toc.

* minor typos.

* move cog.md -> cogvideox.md

* add a note about the model-specific docs in training readme.

* add memory usage for CogVideoX.

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* change to 5b from 2b for CogVideoX.

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>

* more appropriate names.

* add headers to the model docs.

* fix adapter name

* minor

* updates

* fix cog training command example

---------

Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com>
2025-01-05 20:50:30 +05:30
Sayak Paul b3d0ba8e12 support model cards (#176)
* introduce model cards and support passing FPS.

* updates

* fix

* fix

* updates

* revert changes

* revert args.py changes

* fix

* fix

* fix filename
2025-01-05 19:21:17 +05:30
Sayak Paul b5a5124cd5 add a workflow to do quality checks. (#180) 2025-01-05 18:07:49 +05:30
Sayak Paul a709a1cec1 fixes (#178) 2025-01-04 08:57:41 +05:30
Sayak Paul 071c140879 Fix scheduler bugs (#177)
* fix scheduler bugs.

* fix
2025-01-03 18:52:40 +05:30
Sayak Paul b8352abf70 Support CogVideoX T2V (#165)
* support cog t2v.

* generator.

* updates

* style

* fixes

* fix padding frames.

Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn>

* revert changes related to generator.

* refactor a lot of things.

* accept revision and cache_dir.

* remove unused var

* refactoring fixes.

* refactor

* update

* update

---------

Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn>
Co-authored-by: Aryan <aryan@huggingface.co>
2025-01-03 10:53:16 +05:30
Sayak Paul 2a1aa05191 Update README.md to fix graph paths (#171) 2025-01-02 20:11:27 +05:30
Sayak Paul 018953ed86 bulk update styling and formatting (#170) 2025-01-02 13:20:33 +05:30
Sayak Paul 191ea8b0cc [optimization] support 8bit optims from bistandbytes (#163)
* support 8bit optims from bnb.

* fix exist_ok

* use_8bit_bnb.

* fix.

* note in readme.
2024-12-30 14:03:56 +05:30
Sayak Paul e9fba4ab7f Merge pull request #139 from a-r-r-o-w/support-deepspeed
[feat] support DeepSpeed.
2024-12-27 15:21:31 +05:30