None, don't host it yourself.
You will need a ton of ram and a really powerfull PC. Additionally your electricity bill will go up significantly
this post was submitted on 28 Nov 2023
5 points (100.0% liked)
Self-Hosted Main
21 readers
1 users here now
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
For Example
- Service: Dropbox - Alternative: Nextcloud
- Service: Google Reader - Alternative: Tiny Tiny RSS
- Service: Blogger - Alternative: WordPress
We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.
Useful Lists
- Awesome-Selfhosted List of Software
- Awesome-Sysadmin List of Software
founded 1 year ago
MODERATORS
You do know this is selfhosted, right? People tell us that what we do is "not a good idea" all the time.
Im all for selfhosting but LLMs is just stupid. But go for it you do you and evite the ride ♥
Agree people be selfhosting to save money in subscriptions but then spend a 4090 and tons of energy to use an LLM from time to time
Check ollama.
Thanks
Look interesting
its great and has active development. Hit up the discord, lotta helpful folks in there