Mauve 👁💜 @mauve@mastodon.mauve.moe
- Pronouns
- they/them/it
- mauve+fedi@mauve.moe
- Matrix
- @mauve:mauve.moe
- Github/Gitlab/Discord
- @RangerMauve
Mod
Occult Enby that's making local-first software with peer to peer protocols, mesh networks, and the web.
Yap with me and send me cool links relating to my interests. 👍
Joined Apr 2022
Mauve 👁💜
boosted
So I wrote a blog post on LLM performance. It was focused on SWE-Bench and discussed why performance is topping out.
As part of the post I pulled down gigs of runs from the SWE-Bench S3 bucket and went through several of the harder test cases. I focused on improvements in the last six months. Primarily on Opus.
Regrettably I’m probably not moving forward on that post. Why? Because after going through the data I found that the LLMs are cheating on the tests. And that’s a whole different thing.
Mauve 👁💜
boosted
deprogramming language
@feliks It's neat that math is a domain where you can fact check things automatically without needing to have "out of system" knowledge. I've been looking at software for math proofs and it looks pretty straightforward. Unexpected that language models are that good at using provers already.
Mauve 👁💜
boosted
Imagining if we set aside .1% of all the money being spent to make AIs that write bad software to compensate all the open-source developers who write good software
Hate it when my cyberbody gets amputated. 💀
"Please sir, can you spare some thousands of chat rooms across 7 platforms?" 🥺👉👈
My matrix server is down and so are its bridges. Now I have to access my chats app by app like some sort of peasant. 😿
- Pronouns
- they/them/it
- mauve+fedi@mauve.moe
- Matrix
- @mauve:mauve.moe
- Github/Gitlab/Discord
- @RangerMauve
Mod
Occult Enby that's making local-first software with peer to peer protocols, mesh networks, and the web.
Yap with me and send me cool links relating to my interests. 👍
Joined Apr 2022
