storytold/FineTrainers-Conditioning
2
0
Fork 0
mirror of https://github.com/storytold/FineTrainers-Conditioning.git synced 2026-10-09 00:09:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

update

Browse Source
This commit is contained in:
Aryan
2024-12-20 10:03:39 +01:00
parent 223add1a59
commit 66189c804b
9 changed files with 550 additions and 94 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+51
View File
@@ -143,6 +143,57 @@ video = pipe("<my-awesome-prompt>").frames[0]
export_to_video(video, "output.mp4", fps=8)
```
### Memory Usage
LoRA with rank 128, batch size 1, gradient checkpointing, optimizer adamw, `49x512x768` resolution, **without precomputation**:
```
Memory before training start: {
"memory_allocated": 13.486,
"memory_reserved": 13.879,
"max_memory_allocated": 13.486,
"max_memory_reserved": 13.879
}
Training configuration: {
"trainable parameters": 117440512,
"total samples": 69,
"train epochs": 1,
"train steps": 10,
"batches per device": 1,
"total batches observed per epoch": 69,
"train batch size": 1,
"gradient accumulation steps": 1
}
Memory before validation start: {
"memory_allocated": 14.146,
"memory_reserved": 16.809,
"max_memory_allocated": 15.527,
"max_memory_reserved": 17.623
}
Memory after validation end: {
"memory_allocated": 14.146,
"memory_reserved": 14.627,
"max_memory_allocated": 15.527,
"max_memory_reserved": 17.623
}
Memory after epoch 1: {
"memory_allocated": 14.146,
"memory_reserved": 14.627,
"max_memory_allocated": 15.527,
"max_memory_reserved": 17.623
}
Memory after training end: {
"memory_allocated": 4.461,
"memory_reserved": 5.014,
"max_memory_allocated": 15.527,
"max_memory_reserved": 17.623
}
```
LoRA with rank 128, batch size 1, gradient checkpointing, optimizer adamw, `49x512x768` resolution, **with precomputation**:
TODO
</details>
<details>