LocalLLaMA

20 readers

1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago

MODERATORS

SkySyrup@sh.itjust.works

pax@sh.itjust.works

How do I get LLaMA going on a GPU? (sh.itjust.works)

submitted 1 year ago by planish@sh.itjust.works to c/localllama@sh.itjust.works

2 comments fedilink hide all child comments

Everyone is so thrilled with llama.cpp, but I want to do GPU accelerated text generation and interactive writing. What's the state of the art here? Will KoboldAI now download LLaMA for me?

you are viewing a single comment's thread
view the rest of the comments

[–] scrollbars@lemmy.ml 2 points 1 year ago

there's a bit more setup involved but I would look into https://github.com/oobabooga/text-generation-webui

permalink
fedilink
source