5bd5bc4a59
Fix minor bug with function call that doesn't exist.
2025-01-07 23:32:06 +00:00
7b569daf55
simplify docs part ii ( #190 )
...
* simplify docs.
* clarify the cog checkpoints supported.
* make the note smaller.
* replace with sub
* Apply suggestions from code review
Co-authored-by: Aryan <aryan@huggingface.co >
---------
Co-authored-by: Aryan <aryan@huggingface.co >
2025-01-07 12:47:01 +05:30
38413aa167
Allow images; Remove LLM generated prefixes; Allow JSON/JSONL; Fix bugs ( #158 )
...
* update
* update
* fix
* Update finetrainers/dataset.py
* update
* argument for enabling remove of common llm prefixes
* update
* make new generator for validation
* update
* update
* update
* update
* update
2025-01-06 18:52:54 +05:30
eeb4dd7afa
[docs] refactor docs for easier info parsing ( #175 )
...
* refactor docs for easier info parsing
* refactor readme
* anonym paths
* updates
* remove notes.
* add a toc.
* minor typos.
* move cog.md -> cogvideox.md
* add a note about the model-specific docs in training readme.
* add memory usage for CogVideoX.
Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com >
* change to 5b from 2b for CogVideoX.
Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com >
* more appropriate names.
* add headers to the model docs.
* fix adapter name
* minor
* updates
* fix cog training command example
---------
Co-authored-by: a-r-r-o-w <contact.aryanvs@gmail.com >
2025-01-05 20:50:30 +05:30
b3d0ba8e12
support model cards ( #176 )
...
* introduce model cards and support passing FPS.
* updates
* fix
* fix
* updates
* revert changes
* revert args.py changes
* fix
* fix
* fix filename
2025-01-05 19:21:17 +05:30
b5a5124cd5
add a workflow to do quality checks. ( #180 )
2025-01-05 18:07:49 +05:30
a709a1cec1
fixes ( #178 )
2025-01-04 08:57:41 +05:30
071c140879
Fix scheduler bugs ( #177 )
...
* fix scheduler bugs.
* fix
2025-01-03 18:52:40 +05:30
b8352abf70
Support CogVideoX T2V ( #165 )
...
* support cog t2v.
* generator.
* updates
* style
* fixes
* fix padding frames.
Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn >
* revert changes related to generator.
* refactor a lot of things.
* accept revision and cache_dir.
* remove unused var
* refactoring fixes.
* refactor
* update
* update
---------
Co-authored-by: zRzRzRzRzRzRzR <Yuxuan.Zhang2104@student.xjtlu.edu.cn >
Co-authored-by: Aryan <aryan@huggingface.co >
2025-01-03 10:53:16 +05:30
2a1aa05191
Update README.md to fix graph paths ( #171 )
2025-01-02 20:11:27 +05:30
018953ed86
bulk update styling and formatting ( #170 )
2025-01-02 13:20:33 +05:30
191ea8b0cc
[optimization] support 8bit optims from bistandbytes ( #163 )
...
* support 8bit optims from bnb.
* fix exist_ok
* use_8bit_bnb.
* fix.
* note in readme.
2024-12-30 14:03:56 +05:30
e9fba4ab7f
Merge pull request #139 from a-r-r-o-w/support-deepspeed
...
[feat] support DeepSpeed.
2024-12-27 15:21:31 +05:30
84c17561eb
fixes
2024-12-27 15:02:21 +05:30
4461cdd98f
tracker logging
2024-12-27 12:25:11 +05:30
739f3d8535
update Makefile
2024-12-27 07:20:34 +01:00
a19401e84f
update README; remove print; make style
2024-12-27 07:19:16 +01:00
87af1a0113
Merge branch 'main' into support-deepspeed
2024-12-26 08:17:48 +05:30
1594c1dade
deepspeed note
2024-12-26 08:12:41 +05:30
1d5e0566fb
private
2024-12-26 08:01:16 +05:30
0309f3bf67
Apply suggestions from code review
...
Co-authored-by: Aryan <aryan@huggingface.co >
2024-12-26 08:00:04 +05:30
0c0a0a5e4a
scheduler
2024-12-26 07:55:07 +05:30
28ecfe6b65
torch.is_tensor check
2024-12-26 07:49:51 +05:30
2a594ea2db
fix validation bug ( #149 )
2024-12-26 02:54:08 +05:30
5757b1b886
fix grad norm related logging
2024-12-25 19:25:22 +01:00
e94c3c71d1
revert configs.
2024-12-25 21:36:22 +05:30
6b54867c3c
fixes
2024-12-25 21:34:56 +05:30
5aef4a6c80
Merge pull request #148 from a-r-r-o-w/deepspeed-changes
...
Grad Norm tracking in DeepSpeed
2024-12-25 20:08:09 +05:30
47e4aaac2f
track grad norm for deepspeed
2024-12-25 15:04:16 +01:00
e2178deea0
fix deadlock; make style
2024-12-25 14:16:31 +01:00
d7aa50917f
fixes
2024-12-25 12:07:50 +05:30
69b585a992
fixes
2024-12-25 11:35:09 +05:30
875cb72f63
address review feedback.
2024-12-24 21:20:37 +05:30
6329e9ed07
support DeepSpeed.
2024-12-24 10:59:21 +05:30
cf9be17819
Merge pull request #129 from a-r-r-o-w/condition-precomputation
...
Precomputation of conditions and latents
2024-12-23 20:00:34 +05:30
2858346b27
address review
2024-12-23 15:11:03 +01:00
1c8f33967c
add note about grad ckpt in readme
2024-12-23 14:59:05 +01:00
8c0c28c971
create markdown tables
2024-12-23 14:16:47 +01:00
78712f60a5
update comment
2024-12-23 14:01:39 +01:00
75a854f9df
add coauthor
...
Co-Authored-By: Sayak Paul <spsayakpaul@gmail.com >
2024-12-23 13:59:45 +01:00
5261bed284
remove pipeline hooks
2024-12-23 13:58:37 +01:00
86e1d1888a
other condtions -> text conditions
2024-12-23 13:48:58 +01:00
363841ae3f
address some reviews; change hunyuan checkpoint repo-id
2024-12-23 12:54:52 +01:00
b045037850
make style
2024-12-21 15:19:03 +01:00
0db7bf28aa
update
2024-12-21 15:18:46 +01:00
2da8cb5798
update
2024-12-21 12:24:33 +01:00
66189c804b
update
2024-12-20 10:03:39 +01:00
223add1a59
Hunyuan Video LoRA ( #126 )
...
* add hunyuan-video lora support
* minor fixes; make style
* update readme
* update
* update
* Update README.md
* Update README.md
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
* update
* update
* change move train scripts to internal directory
* update
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com >
2024-12-20 08:02:08 +05:30
9ef58e2f3a
LTX Video ( #123 )
...
* rename files
* ltx finetuning
* update
* update
* improvements
* make style
* gradient clipping
* update
* fix distributed inference
* update
* update
2024-12-19 04:27:36 +05:30
80d1150a0e
add I2V sft and fix an error ( #97 )
...
* adaption for CogVideoX1.5
* add patch_size_t in full finetuning of T2V and lora finetuning of I2V
* add I2V sft and add ofs to adapt cogvideox 1.5
2024-12-06 01:59:57 +05:30
CrossProduct