I think my biggest takeaway from the LLM tinkering I've been doing is that text search and filtering through datasets is key for reasoning about data.
I find it key as a human navigating information systems, but I think it's even more key for LLM driven systems.