It's pretty big: 125B tokens, but only 6B active which means it gets a pretty big performance boost.
I've been trying it out on a DGX Spark using these Unsloth quantized models. I'm still exploring the model - so far I've tried the 72.5GB UD-IQ1_S one (producing these pelicans) and the 78.9GB UD-Q2_K_XL (producing these).
My favorite so far was this xhigh reasoning effort one from UD-Q2_K_XL:
Via Hacker News
Tags: ai, generative-ai, llms, qwen, pelican-riding-a-bicycle, ai-in-china, nvidia-spark
For Xanthe Burdett, the boundary between humans and nature is thin, malleable, and always in flux.
When it comes to felines, the artist revels in "the contrast between how ordinary and how weird they are."

The prestigious contest showcases the world's diverse creatures and their habitats.