Commit Graph

27 Commits

Author SHA1 Message Date
CrossProduct 28165e67d0 Adapter weights can be loaded. 2025-02-04 16:46:45 +00:00
CrossProduct ea3cd5c753 Full Finetune should work with this adapter removed the residual_x 2025-01-30 00:14:44 +00:00
CrossProduct e399684065 Make residuals none. 2025-01-30 00:07:39 +00:00
CrossProduct a16285141e Noted place that requires intervention. 2025-01-29 05:30:17 +00:00
CrossProduct 8ec35d58fb trying training again but broke something so going back. 2025-01-28 22:36:09 +00:00
CrossProduct e99d70ff46 Fixed some issues with imports and the original lora.py code. 2025-01-25 02:22:05 +00:00
CrossProduct 06e26ec092 test and trace the changes. 2025-01-24 22:58:44 +00:00
CrossProduct c6490c0d51 Reducing cogload on the framework. 2025-01-24 22:46:32 +00:00
CrossProduct 305a4a994d Need to pass in image ref video. 2025-01-24 05:21:53 +00:00
CrossProduct b7f26bd2e6 removed some code made things clearer to replace the pipeline inference which is needed for validation. 2025-01-23 23:49:24 +00:00
CrossProduct 731f326e86 Added residual 2025-01-22 20:10:01 +00:00
CrossProduct 981767154b modify the forward pass 2025-01-22 06:56:22 +00:00
CrossProduct 07e755c2b3 modifcations to the loading of the weights. 2025-01-22 01:26:49 +00:00
CrossProduct 34996c1eb1 replaced the pipeline functions.
time to test this then test the weight changes.
2025-01-21 02:22:35 +00:00
CrossProduct 2720d24f62 Moved the norm back to prepare latents step.
Now its time to add the adapter layer.
2025-01-18 04:18:25 +00:00
CrossProduct b73d61ae4d saving more changes related to args. 2025-01-17 06:40:06 +00:00
CrossProduct cd66e6e58e fixed the training pipeline to address new changes from upstream 2025-01-17 01:46:35 +00:00
CrossProduct 315431be0a Recommit the conditioning code. 2025-01-16 05:03:44 +00:00
CrossProduct b341b79652 Adding Conditioning Blocks to the Diffusion Transformer. 2025-01-15 22:29:47 +00:00
Aryan 9f0fdb5055 Rename lora files (#214)
* rename files

* update
2025-01-14 01:17:42 +05:30
ArEnSc e5df80cc36 Full Finetuning for LTX possibily extended to other models. (#192)
* Full Finetuning for LTX possibily extended to other models.

* Change name of the flag

* Used disable grad for component on lora fine tuning enabled

* Suggestions Addressed
Renamed to SFT
Added 2 other models.
Testing required.

* Switching to Full FineTuning

* Run linter.

* parse subfolder when needed.

* tackle saving and loading hooks.

* tackle validation.

* fix subfolder bug.

* remove __class__.

* refactor

* remove unnecessary changes

* handle saving of final model weights correctly

* remove unnecessary changes

* LTX uses a default frame rate of 24 FPS
We need to modify the output validation framerate to match that value.
Add Framerate args.
Add Update video output and inference frame rate

* There was a results_args mapping that needed to be modified.

* update

* update README

* Update README.md

* update docs

* add training configuration in cogvideox

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Aryan <aryan@huggingface.co>
Co-authored-by: Aryan <contact.aryanvs@gmail.com>
2025-01-13 23:55:39 +05:30
Sayak Paul b8352abf70 Support CogVideoX T2V (#165)
* support cog t2v.

* generator.

* updates

* style

* fixes

* fix padding frames.

Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn>

* revert changes related to generator.

* refactor a lot of things.

* accept revision and cache_dir.

* remove unused var

* refactoring fixes.

* refactor

* update

* update

---------

Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn>
Co-authored-by: Aryan <aryan@huggingface.co>
2025-01-03 10:53:16 +05:30
Sayak Paul 018953ed86 bulk update styling and formatting (#170) 2025-01-02 13:20:33 +05:30
Aryan 78712f60a5 update comment 2024-12-23 14:01:39 +01:00
Aryan 66189c804b update 2024-12-20 10:03:39 +01:00
Aryan 223add1a59 Hunyuan Video LoRA (#126)
* add hunyuan-video lora support

* minor fixes; make style

* update readme

* update

* update

* Update README.md

* Update README.md

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* update

* update

* change move train scripts to internal directory

* update

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
2024-12-20 08:02:08 +05:30
Aryan 9ef58e2f3a LTX Video (#123)
* rename files

* ltx finetuning

* update

* update

* improvements

* make style

* gradient clipping

* update

* fix distributed inference

* update

* update
2024-12-19 04:27:36 +05:30