Follow

IMO Ollama's streaming API is much nicer, but here's an example repo for streaming inference from a request with zero dependencies in .

github.com/RangerMauve/openai-

· · Web · 0 · 2 · 1
Sign in to participate in the conversation
Mauvestodon

Escape ship from centralized social media run by Mauve.