Hmm, after testing the raw Phi 2 within LM Studio instead of the examples provided by HuggingFace candle, I think it's actually pretty decent after all.
Specifically I got phi 2 Q4_K_S gguf working from TheBloke.
Can't get that model running with candle since it can't seem to load the model weight.
Having tested a bunch of #OpenSource #LLM projects, I gotta say that OpenHermes 2.5 is the most helpful out of the ones I can run locally.
I recently wasted a bunch of time getting Phi-2 to do some summarization work, and it just couldn't stay focused for more than a sentence or two.
Woot, I have finally written enough #rust code to be unable to avoid the lifetime specifications / borrow checker stuff.
I love this post-mortem from a former #p2p enthusiast... 🧵
"DHTs were not reliable or performant. We were way too optimistic about device discovery and NAT traversal."
He's absolutely right. If you're using a DHT, you're doing it wrong. It might have been the right primitive in 2003, but not today.
K. I swallowed my pride and gave up on trying to run all my build tools as "close to the metal" as possible. I'm now going to pretend I'm in an Ubuntu environment via distrobox :P
Ugh C++ dependencies bring me so much pain. I'd take a hundred weird react-native version mismatches over rustc being unable to find OpenSSL for a library I didn't think would even need rustc in the first place. This is not an invitation to help because my setup is far far away from the happy path of debugging.
You know, I reckon it might help reverse Firefox's declining marketshare at very little effort for Mozilla to implement a feedreader into Firefox, & run an advertising blitz advocating how much calmer this "new" way of reading the web is!
They'd get some eyerolls, & some may find it suspicious how broadly supported it'd be out of the gate...
But since they're rightly concerned about their declining marketshare, this'd be a cheap & hugely beneficial thing to try!
Hey folks! We have a new round of tutorials and example apps out as well as updated `hyper://` docs. Read more on our blog: https://agregore.mauve.moe/blog/2023/12/demos-and-tutorials-second-round
For my hackathon project I did try to make CFA (Cat Factor Authentication, using your cat's microchip as a second factor) a thing 😆 The project did win a prize, but more for the experimentation then the actual result https://wpengine.com/blog/hackathon-december-2023/
More than ever, we need networking protocols which are resilient, privacy preserving, bandwidth conserving, able to run on low-spec hardware, and not quite as preoccupied with being the global network for everyone ever.
We’re delighted to present Willow, a new family of peer-to-peer protocols that cater to just that niche. https://willowprotocol.org is a guide to those protocols, with full specifications, ~50 hand-drawn diagrams, illustrations, and comics, and much more besides.
Our thanks to @NGIZero for supporting this project!
Occult Enby that's making local-first software with peer to peer protocols, mesh networks, and the web.
Exploring what a local-first cyberspace might look like in my spare time.