Equality_for_apples

joined 1 year ago
sorted by: new top controversial old
Discord bot connection? in c/localllama@sh.itjust.works
[–] Equality_for_apples@sh.itjust.works 1 points 1 year ago

I'll give it a whirl, thanks. I saw it a day or two ago, but it doesn't really explain how to get it working. May as well try

Discovering Locally Run Language Models: Share Your Favorites/Not So Favorites! in c/localllama@sh.itjust.works
[–] Equality_for_apples@sh.itjust.works 5 points 1 year ago

I've been doing RP with Wizard-Vicuna 13b Uncensored. it's good, very fast (ggml v3 q5-k-s variant) But sometimes forgets it's roleplaying and spits out a story

5
Discord bot connection? (sh.itjust.works)
 

Hey all, I'm trying to get a discord bot working that connects to my LLM - as in, it spits out the LLM's responses and sends it the messages from Discord. Does anybody know of one that works/have a guide?

llama.cpp for GPU only in c/localllama@sh.itjust.works
[–] Equality_for_apples@sh.itjust.works 1 points 1 year ago

Personally, I have nothing but issues with Oogas ui, so I connect Silly Tavern to it or KoboldCPP. Works great