Gonna be presenting a demo of teaching local a #llm to search wikipedia with "Function Calling"
Source for my demo code: https://github.com/RangerMauve/mind-goblin
Video of my talk about making an #OpenSource #LLM perform function calling on my machine.
Follow
@fredy_pferdi Yeah exactly! I'm running #ChimeraOS on it in desktop mode. Lately been thinking of just installing Manjaro on it instead since the steam bits are a bit janky for me.
@mauve I'm using the GPD Win Max 6800u with 32GB RAM 16GB of it allocated to VRAM and im running 13b models with reasonable speeds and 7b quit quickly. Recommend #Fedora and #Ollama in as #Podman container