Follow

Bouta skip the language model and autistically read all the training data into my own brain instead.

· · Web · 2 · 0 · 3

Seriously though what the hell are some of these outputs they're teaching these things "he was staring at the beautiful mexican girl" as an "answer" to a random rant.

huggingface.co/datasets/cognit

Maybe this is a side effect of using AI to generate datasets?

Note to self: Dolphin models are brainrot to LLMs. No wonder my dolphin-phi was unable to think for more than a few sentences

@dym I only have 2 braincells so NGL it's pretty low. :P I am becoming less aligned since it's an "uncensored" dataset tho so at least there's that.

@mauve this looks like parsing out the "Answer the following question:" was the trigger to pick one of "-"-items at the end of the text

@mauve probably a result of getting to the long tail of the probabilities. When there aren't too many occurrences of the previous thread of words..

Sign in to participate in the conversation
Mauvestodon

Escape ship from centralized social media run by Mauve.