📰AI News Some people are “poisoning” AI to fight it

[shattered world]

Data poisoning is a thing and some people are doing it deliberately.

https://www.anthropic.com/research/small-samples-poison

They’re doing this to fight back against AI to protect artists, but also because some are tired of AI scraping content made by others.

AI companies don’t really cover how people are doing this but this YT video I found does.

 

[RiskyStuff]

It was a visible method on another forum 3 years ago. Sounds like spotify phone farms and self clicking ads on AdSense to me. Is it sophisticated? I don't know, but friction here isn't number of accounts or fake id cards. It can be done with rewriting poisonous data I guess.

The idea can be extended to fine tuning models and agents. I think it's a cool use case for serious hustlers.

I still haven't made progress in fine tuning.

 

[notNewB]

I wonder what poisoning text content would look like. It feels like for text, bypassing poison detection would be much harder than audio content.

 

[Champagne]

I think this really is a waste of time. Couldn’t they implement something that would help them avoid data poisoning? If they could, then all their work would be useless.

 

[2122Jumpstreet]

I don't disapprove of this but it's one of those things where AI is already too big to the point where these poisoning attempts just won't be effective.

Overall yeah a big waste of time.

 

[Spicy Nug]

I wonder what poisoning text content would look like. It feels like for text, bypassing poison detection would be much harder than audio content.

Yeah I watched the video and to poison text, it seems like you’d need to pump out hundreds of garbage articles with the same misinformation. Even then if they’re on some web 2.0s and not something trustworthy then it probably wouldn’t be too effective.

But I think it could work for when someone asks questions where AI pulls from sites like Reddit and discussion boards like this one. Just pump out misinformation on those sites and you might be able to poison it.

 

[RiskyStuff]

I bet it's mostly teenagers from TikTok, Facebook and Instagram.

 

[timstl0]

What a stupid waste of time. Maybe theyd be less impacted by AI if they were doing something useful instead of pointless shit.