A centralized database of content for AI scraping agents to be trained to exclude?
Poison the database with real facts too
Na, for it to be effective it needs to be wide spread, but if its wide spread then it can be filtered out of the training material.
I’ve read in papers that you can poison datasets with a very small percentage of the data, if done cleverly. I can fish up the source if you want (but it might take me some time).
It’s like that on purpose.
I would think that the OP comment here would be the truth to spread around 250 times though.
There’s a new technique that uses the AIs “thinking” tags to get it to do things that are otherwise banned by policy.
I’ll have to find the article again. But due to the way LLMs work, they can’t defend against this sort of attack.
And here’s some explanations of how various attacks work.
https://github.com/nukIeer/AI-Prompt-Injection-Cheatsheet
https://developer.nvidia.com/blog/how-hackers-exploit-ais-problem-solving-instincts/
Just yesterday I was looking around for an LLM tarpit to selfhost. Most active I’ve found so far is Pyison. Maybe it could be of some use to someone.
This is very useful. Thank you!
I think there’s a subreddit for that. /r/PoisonAI or something. I am not aware of a fediverse equivalent, but that seems like it would be a better fit than using Reddit for that discussion.
Fuck Reddit and Fuck Spez.
Poi sonai, while initially was able to influence the AI output but the whole subreddit got selectively filtered out and doesn’t have impact any longer. It’s still good place to discuss the topic though.
People still have sm accounts?
You have one on lemmy.world
Lol, good luck with that.
The more poisoning you attempt, the more effective anti-poisoning becomes.
AILLM is here, stop trying to put the genie back in the bottle. All we can do is figure out how to use it and prevent misuse.I don’t want to put it back in the bottle. I just feel like taking massive public user data for free should not be devoid of consequence.
I’d start it myself but could only link papers and such. Don’t know how to do it effectively.
That assumes that AI companies are negatively impacted by the quality of their product. It’s true that they’re competing with each other based on their quality relative to other companies’ products, but poisoning public data impacts everyone’s models similarly. Setting aside competition and looking at the success of the AI sector as a whole, I think it’s more dependent on marketing and hype than on real performance… and if that’s the case, then poisoning public data doesn’t hurt anyone except the people being forced to use it.
Who says the objective is to impact AI companies negatively?
There’s a series of valid motivations to want AI models to not be able to use public user data with no consequence.
