Oh no, I think I want a petabyte of storage at home 😵 Like I want to have multiple copies of wikipedia locally to perform various data transformations on, but I'm so limited by space. If abytbing I can let the conpute run for stuff like that over a week if needed but I just don't want to deal with doing this stuff in the cloud. I think I hate subacription services and just prefer upfront stuff I can have forever?
@codinghorror god I love this story.
In programming, it directly translates to “any sufficiently powerful model is inherently incomplete”. And boy howdy have I felt that.
But it’s also clarifying: you can save a helluva lot of time if you design for your model’s imperfections rather than demanding they not exist.
If you’re a fan of Gödel… hopefully you’ve read Gödel Escher Bach?
Note to self: Dolphin models are brainrot to LLMs. No wonder my dolphin-phi was unable to think for more than a few sentences
Seriously though what the hell are some of these outputs they're teaching these things "he was staring at the beautiful mexican girl" as an "answer" to a random rant.
https://huggingface.co/datasets/cognitivecomputations/dolphin?row=30
Maybe this is a side effect of using AI to generate datasets?
@dym I only have 2 braincells so NGL it's pretty low. :P I am becoming less aligned since it's an "uncensored" dataset tho so at least there's that.
CLI coding and smart contract reviewing vibes. Morning meeting seems to be a no show so I got an extra hour of productivity.
@thure Cursed 💀💀💀
Fancy text indexing and RAG is great when you don't know the sort of data you're storing. Human legible questions especially need extra effort. Personally I've been retrieving most of my data via my browser history's fuzzy match and I end up building a sort of shorthand of search terms to bring up exactly what I need
@hank Politicians sadly don't know shit about fuck and they're constantly surrounded by corpo backed lobbyists that are whispering cursed ideas in their ear. It's amazing there's any progress at all.
Occult Enby that's making local-first software with peer to peer protocols, mesh networks, and the web.
Exploring what a local-first cyberspace might look like in my spare time.