Full Finetuning for LTX possibily extended to other models. (#192)

* Full Finetuning for LTX possibily extended to other models.

* Change name of the flag

* Used disable grad for component on lora fine tuning enabled

* Suggestions Addressed
Renamed to SFT
Added 2 other models.
Testing required.

* Switching to Full FineTuning

* Run linter.

* parse subfolder when needed.

* tackle saving and loading hooks.

* tackle validation.

* fix subfolder bug.

* remove __class__.

* refactor

* remove unnecessary changes

* handle saving of final model weights correctly

* remove unnecessary changes

* LTX uses a default frame rate of 24 FPS
We need to modify the output validation framerate to match that value.
Add Framerate args.
Add Update video output and inference frame rate

* There was a results_args mapping that needed to be modified.

* update

* update README

* Update README.md

* update docs

* add training configuration in cogvideox

---------

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Aryan <aryan@huggingface.co>
Co-authored-by: Aryan <contact.aryanvs@gmail.com>
This commit is contained in:
ArEnSc
2025-01-13 13:25:39 -05:00
committed by GitHub
parent a3898075d1
commit e5df80cc36
17 changed files with 365 additions and 131 deletions
+14 -8
View File
@@ -1,8 +1,9 @@
This directory contains the training-related specifications for all the models we support in `finetrainers`. Each model page has:
# FineTrainers training documentation
* an example training command
* inference example
* numbers on memory consumption
This directory contains the training-related specifications for all the models we support in `finetrainers`. Each model page has:
- an example training command
- inference example
- numbers on memory consumption
By default, we don't include any validation-related arguments in the example training commands. To enable validation inference, one can pass:
@@ -12,8 +13,13 @@ By default, we don't include any validation-related arguments in the example tra
+ --validation_steps 100
```
## Model-specific docs
Supported models:
- [CogVideoX](./cogvideox.md)
- [LTX-Video](./ltx_video.md)
- [HunyuanVideo](./hunyuan_video.md)
* [CogVideoX](./cogvideox.md)
* [LTX-Video](./ltx_video.md)
* [HunyuanVideo](./hunyuan_video.md)
Supported training types:
- LoRA (`--training_type lora`)
- Full finetuning (`--training_type full-finetune`)
Arguments for training are well-documented in the code. For more information, please run `python train.py --help`.