Some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies.

Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

  • YungOnions@sh.itjust.worksEnglish
    4213·
    7 months ago

    It’s about consent. If you have no problem with people jerking off to your pictures, fine, but others do.

    If you don’t want people to jerk off to your photos, don’t upload any. It happens with and without these apps.

    You get that that opinion is pretty much the same as those who say if she didn’t want to be harrassed she shouldn’t have worn such provocative clothing!?

    How about we allow people to upload whatever pictures they want and try to address the weirdos turning them into porn without consent, rather than blaming the victims?

    • CaptainEffort@sh.itjust.worksEnglish
      62·
      7 months ago

      If you have no problem with people jerking off to your pictures, fine, but others do

      Of course, but people have been doing this since the dawn of time. So unless the plan is to incorporate the Thought Police, there’s no way to actually stop it from happening.

      • YungOnions@sh.itjust.worksEnglish
        82·
        6 months ago

        Maybe, but we can certainly help by, amongst many other things, not advertising AI Nude Apps on Instagram. Ultimately what we shouldn’t be doing is blaming the victims by implying they are somehow at fault for having the audacity to upload pictures of themselves to the Internet.

        • CaptainEffort@sh.itjust.worksEnglish
          31·
          6 months ago

          I agree completely with the last part of your comment at least, that other comment unironically saying that it’s the women’s fault for dressing the way they do is bizarre and archaic.

    • MareOfNights@discuss.tchncs.deEnglish
      523·
      7 months ago

      Nah it’s more like: If she didn’t want people to jerk off thinking about her, she shouldn’t have worn such provocative clothing.

      I honestly don’t think we should encourage uploading this many photos as private people, but that’s something else.

      You don’t need consent to jerk off to someone’s photos. You do need consent to tell them about it. Creating images is a bit riskier, but if you make sure no one ever sees them, there is no actual harm done.