storytold/placeholder-artcraft
2
0
Fork 0
mirror of https://github.com/storytold/placeholder-artcraft.git synced 2026-10-29 09:06:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
main
placeholder-artcraft/crates/vendor/candle/candle-examples/examples/quantized-qwen2-instruct/README.md
T
Brandon Thomas 0daf83dba9 mirror repo (WIP) 
Need to remove secrets before entire repo can be made public.
2025-09-18 22:45:56 -04:00

369 B
Raw Permalink Blame History

candle-quantized-qwen2-instruct

Qwen2 is an upgraded version of Qwen1.5, released by Alibaba Cloud.

Running the example

cargo run --example quantized-qwen2-instruct --release -- --prompt "Write a function to count prime numbers up to N."

0.5b, 1.5b, 7b and 72b models are available via --model argument.

Reference in New Issue View Git Blame Copy Permalink