mirror of
https://github.com/storytold/placeholder-artcraft.git
synced 2026-10-28 08:56:48 +00:00
Brandon Thomascandle-quantized-qwen2-instruct
Qwen2 is an upgraded version of Qwen1.5, released by Alibaba Cloud.
Running the example
cargo run --example quantized-qwen2-instruct --release -- --prompt "Write a function to count prime numbers up to N."
0.5b, 1.5b, 7b and 72b models are available via --model argument.