Holy shit the new from microsoft is 3.8B params but performs better than a bunch of 7B models I've tried. Now I just need to find a way to get it to do function calling.

theverge.com/2024/4/23/2413753

Follow

@jazzbox35 Install instructions for what? I usually run models from my own harnesses these days.

Sign in to participate in the conversation
Mauvestodon

Escape ship from centralized social media run by Mauve.