mirror of
https://github.com/storytold/storyteller-ml.git
synced 2026-10-25 08:40:31 +00:00
Installs
- Ubuntu 22.04 LTS
- CUDA 12.1
- Python 3.10.12
- hallo v1.0.0
- Torch 2.2.2
- xformers 0.0.25.post1
- Jupyter Lab
- code-server
- runpodctl
- OhMyRunPod
- RunPod File Uploader
- croc
- rclone
Available on RunPod
This image is designed to work on RunPod. You can use my custom RunPod template to launch it on RunPod.
Building the Docker image
Note
You will need to edit the
docker-bake.hclfile and updateREGISTRY_USER, andRELEASE. You can obviously edit the other values too, but these are the most important ones.
# Clone the repo
git clone https://github.com/ashleykleynhans/hallo-docker.git
# Log in to Docker Hub
docker login
# Build the image, tag the image, and push the image to Docker Hub
cd hallo-docker
docker buildx bake -f docker-bake.hcl --push
# Same as above but customize registry/user/release:
REGISTRY=ghcr.io REGISTRY_USER=myuser RELEASE=my-release docker buildx \
bake -f docker-bake.hcl --push
Running Locally
Install Nvidia CUDA Driver
Start the Docker container
docker run -d \
--gpus all \
-v /workspace \
-p 3000:3001 \
-p 7777:7777 \
-p 8888:8888 \
-p 2999:2999 \
-e VENV_PATH=/workspace/venvs/hallo \
ashleykza/hallo:latest
You can obviously substitute the image name and tag with your own.
Ports
| Connect Port | Internal Port | Description |
|---|---|---|
| 3000 | 3001 | hallo |
| 7777 | 7777 | Code Server |
| 8888 | 8888 | Jupyter Lab |
| 2999 | 2999 | RunPod File Uploader |
Environment Variables
| Variable | Description | Default |
|---|---|---|
| JUPYTER_LAB_PASSWORD | Set a password for Jupyter lab | not set - no password |
| DISABLE_AUTOLAUNCH | Disable hallo from launching automatically | (not set) |
| DISABLE_SYNC | Disable syncing if using a RunPod network volume | (not set) |
Logs
hallo creates a log file, and you can tail the log instead of killing the service to view the logs.
| Application | Log file |
|---|---|
| hallo | /workspace/logs/hallo.log |
For example:
tail -f /workspace/logs/hallo.log
Community and Contributing
Pull requests and issues on GitHub are welcome. Bug fixes and new features are encouraged.
