SkySyrup

Hi, thanks for replying to this post! I originally had a longer version of this, but I accidentally clicked on "cancel" instead of "reply" because I'm still getting used to this interface.

I understand where you're coming from. I'm in no way familiar with bird biodiversity, specifically in Germany where I live, but I'll try and present (what I think is) a argument against this:

We can't successfully keep the cats out of the garden long-term. We can do it for a few days, but then a neighbour lets them out or they lift up the catflap backwards or something else frees them. It's, unfortunately, a pointless venture.

There's also the issue of shrinking living options for the birds in our city's center ("Altstadt"). Homeowners have started putting up nets and barriers in places where birds have been coming for literal centuries, and because of that, they're becoming increasingly desperate and come to our garden.

We've decided to leave this the way it is for now because

1. Most of the birds still make it. About 80% of the birds that don't fall out of the nest make it. Even the ones that do have a good chance.
2. Helmut's bird amount has remained about the same for the past decade. It's always 1-2 birds a year.
3. The birds simply have no other place to go. We don't let the cats out, they find a way out. We don't let the birds in, 2-4 nests don't get built.

I understand if you don't agree. But we've simply done what we see best, and you are completely in the right to disagree.

I hope this model gets fine-tuned similar to how the original LLaMA got fine-tuned, it really improves it!

I'd recommend the model Wizard-Vicuna-7b-Uncensored (i know it's like a sentence https://huggingface.co/TheBloke/Wizard-Vicuna-7B-Uncensored-GGML) direct download link is here: https://huggingface.co/TheBloke/Wizard-Vicuna-7B-Uncensored-GGML/blob/main/Wizard-Vicuna-7B-Uncensored.ggmlv3.q5_1.bin

Have you put your model in the "models" folder in the "text-generation-webui" folder? If you have, then navigate over to the "Model" section (button for the menu should be at the top of the page) and select your model using the box below the menu.

Huh, that's interesting. If llama.cpp doesn't work, try https://github.com/oobabooga/text-generation-webui which (tries to) provides a user-friendly(-ier) experience.

Hi, I'm happy to see you are willing to give llama a try! If you want to do GPU-Accelerated processing, it depends on your OS and Hardware what you are able to do. If you have a Nvidia card, you will be able to use cuBLAS, instructions here: https://github.com/ggerganov/llama.cpp#cublas . I don't have experience with other cards, but I'll try to help if issues arise!

Also, for more ease-of-use try text-generation-webui (https://github.com/oobabooga/text-generation-webui). Well, ease-of-use, until you can want to use GPU acceleration, because you'll need to look at https://github.com/oobabooga/text-generation-webui/blob/main/docs/llama.cpp-models.md#gpu-acceleration if you want to do that with LLaMA.

33B and 65B models seem to be the best for storytelling and writing.

Hi, sure, thank you so much for helping out! As for LLaMA, I would point you at llama.cpp, (https://github.com/ggerganov/llama.cpp) which is the absolute bleeding edge, but also has pretty useful instructions on the page (https://github.com/ggerganov/llama.cpp#usage). You could also use Kobold.cpp, but I don't have any experience with it, so I can't help you if you have issues.

I've distro-hopped a LOT, but always come back to Fedora, because it's super stable, gives me no issues and doesn't get in my way when I want to screw around.