Thinking about how to add memory to an #LLM
Might be good to have two models running in tandem. One is trained to use a memory API. The other is just the personality. Before the personality gets data, memory decides if it wants to do some RAG queries. Then the result is fed to personality to respond with without it needing to understand memory. Then memory asks itself if it needs to remember any of personality's outputs.
@mauve i dont either , but a jewish storyteller friend once told me about them and lots of other neat stuff , alas , good morning !