Got like 2x tok/sec with NVFP4 over UD-Q4_K_XL 🤯
@mauve which model are you running?
@dain Qwen3.6 27B. After a bit of testing, seems the performance degraded significantly with NVFP4 so I reverted back. 2x faster but 20x less useful :P
@mauve shame!
Escape ship from centralized social media run by Mauve.
@mauve shame!