Rob Zazueta
He’s just this guy, you know?
- 0 Posts
- 7 Comments
Joined 3 years ago
Cake day: March 1st, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Rob Zazueta@toot.robzazueta.comto
Self-hosting@slrpnk.net•Idea: Selfhosted Interface for LLMs
1·7 months ago@mulcahey @not_IO Take a look at: https://openwebui.com/
I’m running the docker container on my home server behind my firewall on an - I think - 6070 GPU (may be a 3070 - it’s one of the cheaper, older ones).
It’s a wee bit slower than one of the cloud based LLMs, but my data stays local. I like the Qwen model.
Rob Zazueta@toot.robzazueta.comto
ActivityPub@community.nodebb.org•Backfilling Conversations: Two Major Approaches
1·7 months ago@julian Ah… that actually may make more sense - thanks.
I’m working on my own AP implementation and hadn’t yet run into this issue, so assumed.
Time to upgrade!
Rob Zazueta@toot.robzazueta.comto
ActivityPub@community.nodebb.org•Backfilling Conversations: Two Major Approaches
1·7 months ago@julian Quick, somewhat unrelated note - I follow you on Mastodon and see your posts with the HTML tags showing. Is NodeBB escaping those tags prior to sending out the AP message?



@mulcahey @not_IO LOL - it’s not even a 3070 - I’m running it on an NVIDIA GeForce GTX 1660.
Not the snappiest thing, but it definitely works well for my needs. Complex queries cause alllll the fans to go off.