Mauve 👁💜 @mauve@mastodon.mauve.moe

I'm considering getting myself a new computer to replace my #SteamDeck.
It seems the GPD Win 4 finally has decent #linux support via #ChimeraOS and I saw someone on Reddit got the GSM module working so I could potentially replace my phone with it. The smaller form factor wouls be great for when I'm walking around witg my head mounted display.

I think my biggest takeaway from the LLM tinkering I've been doing is that text search and filtering through datasets is key for reasoning about data.

I find it key as a human navigating information systems, but I think it's even more key for LLM driven systems.

Language models are both more dumb and less dumb than I expect. 😭

feels kinda satisfying to prolapse this function to return an iterator instead of its heavy for loop.

Hmm, after testing the raw Phi 2 within LM Studio instead of the examples provided by HuggingFace candle, I think it's actually pretty decent after all.

Specifically I got phi 2 Q4_K_S gguf working from TheBloke.

Can't get that model running with candle since it can't seem to load the model weight.

Having tested a bunch of #OpenSource #LLM projects, I gotta say that OpenHermes 2.5 is the most helpful out of the ones I can run locally.

I recently wasted a bunch of time getting Phi-2 to do some summarization work, and it just couldn't stay focused for more than a sentence or two.

Woot, I have finally written enough #rust code to be unable to avoid the lifetime specifications / borrow checker stuff.

K. I swallowed my pride and gave up on trying to run all my build tools as "close to the metal" as possible. I'm now going to pretend I'm in an Ubuntu environment via distrobox :P

Ugh C++ dependencies bring me so much pain. I'd take a hundred weird react-native version mismatches over rustc being unable to find OpenSSL for a library I didn't think would even need rustc in the first place. This is not an invitation to help because my setup is far far away from the happy path of debugging.

I think I'd enjoy living in a wizard tower.

The dowbside with lrimarily interacting with folks I regularly see in meatspace is that they are in my tinezone but aren't night owls

I love it when I get to talk to folks that have more knowledge than me on a subject I am interested in. It's tough because it doesn't happen as often as I'd like due to being the domain expert for the subject in a lot of groups I interact with.