Mauve 👁💜 @mauve@mastodon.mauve.moe

@simon Nice, like a file format for the configs so folks could pass them around and track changes in git?

@simon PR: https://github.com/simonw/llm-gpt4all/pull/17

Gonna need to mess with the parameters more another day though. But my gut feeling is we can up the quality of output significantly by turning down the temperature a bit and reducing the top_p to 1 and top_k to 4 like in the replicate.com demo

@simon Looked into this, I think the top_p and top_k are the main differences. The default in gpt4all is way more "loose".

Would a PR that sets different defaults be welcome? Or would you prefer to just have the flags exposed like your llama-cpp example?

https://github.com/simonw/llm-gpt4all/blob/main/llm_gpt4all.py#L112

https://docs.gpt4all.io/gpt4all_python.html#the-generate-method-api

I'll try hardcoding some values and running a generation again to see if it's "better" in the meantime.

@pauldaoust Hobestly might replace it with the default textbox implementation in QT/GNOME next. Syntax highlighting is too many cycles!

Fug, I think I am a cranky old fart type already because I like to write code closer to the metal instead of using all the fancy new tooling.

Maybe I should swallow my pride and install vscode and try copilot or whatever it is kids these days are using.

Also I'm still using nano for all my text editing so I might be imposing a deeper limitation on myself than most minimalists. :P

Kinda wild that after years of people being stuck in zoom calls we still need to constantly be like "Can you hear me now?" or "Oh, you're muted" or folks leaving their mic on while loudly typing.

I am guilty of all these things, FWIW. >:P

@erlend Are there enough solid users out there that this would be worth the effort? Like, are there a lot of queer furries actively making use of solid that aren't already on mastodon/etc?

Any e-signature services out there that charge per document instead of a subscription per month / year? I don't think I can justify 200 dollars a year for the 5 or so I need and I don't think I can keep making new accounts for the free trials :P

Gonna start pasting the entire bee movie script whenever a marketing chatbot pops up while I'm trying to read a page.

For reference: https://pastebin.com/raw/e90ZUNtD

Hopefully they get billed per word.

@makeworld Oh yeah good point.

For anyone curious here's an article about how bookmarklets work and an example of how to turn that script into one:

https://www.freecodecamp.org/news/what-are-bookmarklets/

```
javascript:(()=>document.body.parentElement.style.filter="invert()")()
```

Low key wish Github would stop adding features. The changes this year have made things way slower and more buggy. Now I have the pleasure of the "submit review" button not working anymore which is a pretty big chunk of my job. :P

It could be related to my ad blocker not letting them log every single action I take to their analytics though.