Ich würde die Augen offenhalten. Der Lupo steht vielleicht nicht ganz oben auf der Liste, aber es gibt definitiv einen Markt für all-in-one conversion kits.
Man könnt’s wahrscheinlich auch schon mit dem machen, was man jetzt off-the-shelf kriegt, aber das wär halt ein … deutlich größeres Projekt.
Yes. But compared to the number of people who currently use LLMs, not that many have hardware capable of doing that.
What I’m saying is that not all local LLMs are more power efficient, and that we are currently massively over-using the technology for things it isn’t all that useful for.
I suppose, but that’s a very different class of model. I think a more important question might be whether people actually need LLMs at all.
It’s a grift. The athletes that took part where mostly at the end of their careers and wanted a paycheck before retirement. The company behind it now uses the brand to sell medication. I’d be pretty surprised if they’re still around in two years, let alone in ten.
No? If everyone who uses LLMs globally switched over to a local LLM (after buying the necessary hardware), that’d still be a crazy amount of energy usage, just less centralised.
That might be the case. And you might in fact be perfectly well intentioned (though, as you might have found this community isn’t, on average, very into closed source software).
On the project site, this post, your replies, I have read nothing that sounded like genuinely you. It all reads like marketing. Or, more precisely, as if you have a LLM write/rewrite your responses. This, to me, makes them feel incredibly disingenuous. You might just sound like that naturally. In that case, I’m sorry.
If you want to win over this community, a good avenue would probably be open sourcing your application and arranging for some form of donation.
Edit: Also, you didn’t state that it’s closed source in your first sentence?? Well, you did in the first sentence of the reply to the comment that called out there not being source code on the repo, but the cat was out of the bag at that time.
An unkind observer might suspect the goal to be having the aesthetic of an open source or at least source available project without actually being one.
Websites I use regularly:
I suppose such measures might affect retail sites and YouTube, but I can get the stuff I need locally, and being off YouTube, I’ll certainly have the time for it.
That is … good? A downtown people want to be in is not one made for driving.
I don’t think this fully applies to Ferrari in the way it might apply to mass market cars.
Yeah, totally understand that. Had an easy start cause I got a lot of Philips Hue stuff for free from a friend who got fed up with smart tech in general. He now has a Pixel with mostly blank Graphene and a Raspberry Pi as his only computing devices, lol.
I had a lot of fun programming click patterns for smart switches that are incomprehensible for anyone but me XD
Good luck with your transition~
I have been very happy with local stuff. I have home assistant running on a pi, independent of my main server (cause I wanna control the lights easily while changing server hardware).
All my smart devices (lamps, mostly) use Zigbee, and it’s just way easier and more flexible than classical dimmers. There’s local voice recognition support, but for that I’d probably run it on something with more horsepower than a raspi.
I think I’m pretty in touch. I just don’t have a car.
It’s not really renaming. It’s just that the big distros have different naming conventions, and documentation often uses the names used either by Fedora/Redhat or Debian/Ubuntu.
If you look at e.g. Germany, it’s Deutschland in German, but others might call it Allemagne, Tyskland, Germania, Niemcy, Saska, …
I very much don’t want to police what others would like to be called, but feel like having your own local name for a country is mostly normal and fine.
I might also not be the biggest fan of the concept of countries, but that’s neither here nor there.
I use tumbleweed. Mostly just works. Sometimes, you have to go look for packages that are named differently than in other distros.
Nice, cool project.
Ah, right. Never really got using AWS for small/private stuff. If you’re in the ecosystem, that’s one thing, and sure, they have global coverage that’s hard to beat, but if you just need something for a small deployment, they’re so expensive.
Hey, aren’t you that c10y person?
Anyway, I won’t argue it could be used as a server, but 2 Gigs of Ram and a 2011 CPU paired with a TerraScale IGP is probably worse than almost any VPS. I pay 4.50€ for 4vCPUs and 8 GB of Ram, and that’s pretty much the cheapest/smallest option my provider has.
Well, the guy who kinda caused the modern anti vac movement is an UK export, might be that.