Well, this just got darker.

  • Soup@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    2
    ·
    4 hours ago

    Wait… so you meant to tell me that predatory simps are using AI incorrectly? Man…. If only someone could have called this years ago- something could have been done to minimize it!

    Who knew that unchecked growth could lead to negative results?!

  • zlatiah@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    5 hours ago

    A bit off topic… But from my understanding, the US currently doesn’t have a single federal agency that is responsible for AI regulation… However, there is an agency for child abuse protection: the National Center on Child Abuse and Neglect within Department of HHS

    If AI girlfriends generating CSAM is how we get AI regulation in the US, I’d be equally surprised and appalled

  • Todd Bonzalez@lemm.ee
    link
    fedilink
    English
    arrow-up
    131
    arrow-down
    3
    ·
    9 hours ago

    This isn’t surprising, it’s inevitable.

    If you folks knew how common pedophilic fantasies are amongst the general public, you would be shocked. Just look to cultures like Japan and Russia that don’t strongly condemn such things, and you’ll find it’s about 15% of the population. It’s only less in the West because of the near homicidal stigma attached to it that makes people vigorously hide that part of themselves.

    Fortunately, this also shows that the vast majority of those people don’t offend.

    We also tend to define pedophilia as “anything sexual involving a minor”, while reacting to it as if it means “violent rape of a toddler”, so no shit, we sexualize youth all the time, the 18 year mark is a legal and social formality, not a hard limit on human attraction. Adults will find themselves attracted to teens, and they won’t reveal that because who the fuck ever would?

    If anything, the issue isn’t that people have these attractions and fantasies, it is that some portion of those people can’t separate fantasy from reality and are willing to hurt a child to get what they want, or they are sociopaths that consume child porn without feeling disgust for witnessing horrific child abuse.

    • emax_gomax@lemmy.world
      link
      fedilink
      English
      arrow-up
      26
      ·
      7 hours ago

      I think the common incest fantasy in the west isn’t too far removed from this too. Like all the actors are above age minimums but they pretend to be step kids or babysitters like these roles aren’t commonly associated with children and older teens. It’s clearly a form of deflection IMO.

      • Cethin@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        18 minutes ago

        As the other comment implies, that’s just the easiest plot to shove porn into. I don’t think that many people are watching it for the plot, it just happens to be there. Like, people aren’t fantasizing about becoming a plumber to fuck women instead of being paid, for example. It’s just a lazy plot because they need to give some reason for the scene.

      • Melvin_Ferd@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        4 hours ago

        Could also be that those are the only porns with even a half assed attempt at a plot instead of just opening with a ground and pound

  • peanuts4life@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    111
    arrow-down
    8
    ·
    12 hours ago

    I actually don’t think this is shocking or something that needs to be “investigated.” Other than the sketchy website that doesn’t secure user’s data, that is.

    Actual child abuse / grooming happens on social media, chat services, and local churches. Not in a one on one between a user and a llm.

    • GreenKnight23@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      100
      ·
      edit-2
      3 hours ago

      pedophiles are bad, if you think otherwise you’re pedophile enabling scum and are just as guilty as they are.

      edit: I’ll wear the down votes like a badge of honor if it means pedophiles that train their grooming habits against AI are branded as pedophiles.

      Screenshot_20241008-211121_Firefox

      • dalekcaan@lemm.ee
        link
        fedilink
        English
        arrow-up
        20
        arrow-down
        1
        ·
        edit-2
        5 hours ago

        See, imo this is the exact kind of thinking that makes pedophilia dangerous. Most people would agree that being attracted to children is a mental illness. Most people would agree that mental illnesses should be treated by a knowledgeable professional. But pedophilia is so stigmatized that someone even admitting they have a problem, one I very much doubt most of them want to have, has people calling for them to be drawn and quartered, regardless of if they’ve ever actually hurt anyone.

        Do I like that there’s art and writing of people having fantasies about children? No, of course not. But making it impossible for people to have a safe outlet, to even talk about it with a medical professional for fear of imprisonment, death threats, or worse, makes it so these people can’t even get the help they need. It’s like teaching abstinence only sex ed. You’re trying to get people to stop having fantasies by burying them, but it only exacerbates the issue.

        Edit: lol got your downvote less than five minutes in and the whole comment edited to just say “pedophiles bad.” I guess I, as you like to put it, “hit a nerve.”

      • Todd Bonzalez@lemm.ee
        link
        fedilink
        English
        arrow-up
        61
        arrow-down
        1
        ·
        9 hours ago

        If I get to know all that stuff about my neighbors, my neighbors get to know tons of information about me too.

        Hard pass. Wake me when someone commits a crime.

      • surewhynotlem@lemmy.world
        link
        fedilink
        English
        arrow-up
        35
        arrow-down
        1
        ·
        9 hours ago

        There are literally tv shows about how to get away with murder. Very popular ones. Those viewers don’t murder at a higher rate than others.

      • Uriel238 [all pronouns]@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        12
        arrow-down
        2
        ·
        edit-2
        6 hours ago

        As a fiction writer, I do research on espionage, sabotage and even methods of assassination all the time. But I’m not going to make a salted bomb and nuke Jerusalem even though that is an entirely viable evil plot that may even create a net negative death toll.

        True poisoners, as Agatha Christie notes, use thallium, not arsenic nor cyanide (though ricin is good if you can get it.) Thallium assassins are also self-regulating, like demolitions experts, killing off those insufficiently careful when handling the stuff.

        Modern police are lazy until enough of a stink is made to find a culprit for a specific incident, which is why modern assassins targeting VIPs will find a self-radicalized desperado and point them toward the target. This is the sort of thing FBI is looking for in the investigations of Crooks and Routh. They are likely just blue suicides (or green suicides in this case) but finding a operative pointing them towards Trump would indicate an actual plot. But even if those tracks are found, it would unlikely lead to a specific identity.

        I know about this not just to write fiction, but also to understand how things happen, how our fall into one party autocracy and societal collapse plays out. And yes, it means I do a lot of web searches that might excite an onlooking behavioral research agent. Sadly, they’d find I’m yet another boring false positive, though if the nation does succumb to autocracy, I’d certainly write for the resistance. FBI may not care so much about that.

        We often look up creepy things just so see if we can, and we do that a lot more than because we’re eager to build a bomb or fast-track our inheritance.

      • otp@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        10
        arrow-down
        1
        ·
        9 hours ago

        instead of knowing someone in the neighborhood is researching how to get away with murder.

        …how would I know that?

  • circuscritic@lemmy.ca
    link
    fedilink
    English
    arrow-up
    21
    arrow-down
    50
    ·
    edit-2
    12 hours ago

    This is a weird one, because while fantasy is fantasy, and doesn’t necessarily indicate an intention to act on anything, these people were dumb enough to share these specific fantasies with some random AI porn site. That’s got to be an indicator of poor impulse control, right?

    That alone should probably warrant immediate FBI background checks, or whatever relevant agencies have jurisdiction for these types of criminal investigations in each user’s locality.

    Of course, I am saying it’s without actually having read any of the chats. So it’s possible my opinion would change from “this should be investigated”, to summary executions and burn the bodies for good measure… but no way I’m reading those fucking chats.

    • fubo@lemmy.world
      link
      fedilink
      English
      arrow-up
      71
      arrow-down
      9
      ·
      12 hours ago

      Just to be clear, are you saying that people should be investigated by the police for fictional stories that they read?

      • li10@feddit.uk
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        20
        ·
        12 hours ago

        I mean, if those stories were made by their prompts and about having sex with children then maybe 🤷‍♂️

        I know we need to draw a line about what police can do with that sort of info so it’s not abused, but these people are still sick fucks.

        • Iceblade@lemmy.world
          link
          fedilink
          English
          arrow-up
          24
          ·
          9 hours ago

          Now that devices are starting to have built in features with AI automatically combing through all information on them, the idea of this sort of stuff being logged in the first place is concerning.

          For instance, should someone prompting an AI to describe them beating up and torturing their boss be flagged for “potentially violent tendencies”? Who decides the “limit” where “privacy” no longer applies and stuff should be flagged, logged and sent off to authorities?

          As I see it, the real issue is people being hurt, not text or fictive materials, however sickening they might be.

          If the resources invested in spying on people and making databases were instead directed towards funding robust and publicly available psychiatric care I expect that’d be more efficient.

      • circuscritic@lemmy.ca
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        28
        ·
        edit-2
        12 hours ago

        No, I am saying that sharing fantasies about underage children with a shady and poorly designed AI porn site, shows a serious lack of judgement and impulse control.

        For that reason, yeah, they probably deserve having a quick review of their life to make sure that’s the only poor choice they’ve made in regards to that particular fantasy.

        And they weren’t just reading, they were prompting the LLM model to generate these specific fantasies. They didn’t just come across a fucked up website and read a few forum posts.

        • catloaf@lemm.ee
          link
          fedilink
          English
          arrow-up
          34
          arrow-down
          7
          ·
          11 hours ago

          If we investigated everyone with poor impulse control, we’d be investigating 80% of the world.

          • circuscritic@lemmy.ca
            link
            fedilink
            English
            arrow-up
            9
            arrow-down
            25
            ·
            11 hours ago

            80% of the world shares their pedophile fantasies with shoddy AI LLM porn sites…?

        • fubo@lemmy.world
          link
          fedilink
          English
          arrow-up
          22
          arrow-down
          6
          ·
          edit-2
          11 hours ago

          I’m just saying, police investigation of fiction creators and readers for the content of their fiction is way over the line of a lot of social and political norms.

          (Also, I think you’ll find that police abuse children a lot more than pervy fiction fans do; so really, who should be investigating whom? Investigation into crime is supposed to start with evidence that a crime actually occurred — not with your personal disgust towards someone’s reading matter.)

          • circuscritic@lemmy.ca
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            15
            ·
            edit-2
            11 hours ago

            You’re really going to great lengths to ignore what I’ve been saying, and instead responding to whatever strawman you find most convenient.

            Now you’ve moved onto, “why should police investigate pedophiles, when they are the real pedophiles. In fact, the pedophile fantasy users of the site should be investigating the police”.

            I mean, do you even hear yourself?

            • fubo@lemmy.world
              link
              fedilink
              English
              arrow-up
              22
              arrow-down
              7
              ·
              edit-2
              11 hours ago

              I hate torture-porn movies like the Saw series, but a lot of people are fans of them. Should I worry that those people are likely to commit kidnapping, torture, and murder? Should I advocate that the makers or watchers of those movies be investigated for kidnapping, torture, and murder — without any evidence that a crime was committed?

              We don’t send the cops after people for liking murder stories, theft stories, industrial sabotage stories, or treason stories. We shouldn’t send the cops after people for liking stories of Harry Potter getting fucked by Severus Snape either.

              I think you should be more careful to distinguish fantasy from reality. Most fiction readers and writers have no problem doing so.

              • circuscritic@lemmy.ca
                link
                fedilink
                English
                arrow-up
                8
                arrow-down
                16
                ·
                11 hours ago

                Strawman, strawman, strawman.

                Even when I reiterate that we’re not talking about passive consumption of media, but active participation in something else entirely, you can’t help but ignore that, and continue lobbing out fallacy after fallacy.

                Maybe you should reread my original comments, and see why your comments have been so pointless, bordering on disingenuous.

                • fubo@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  12
                  arrow-down
                  6
                  ·
                  10 hours ago

                  So you’re into sending the police after the writers, directors, and producers of the Saw movies, but not the audiences?

                  I dunno man, that’s still too fascist for my tastes, but you can keep fantasizing about it. I promise I won’t try to send the police after you for your perverted fantasies of state power.

    • Mr_Dr_Oink@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      8 hours ago

      Is that an indicator of poor impulse control? Really? Finding some shady back of the internet ai site to put some weird fantasy prompts into to get themselves off? Seems pretty calculated to me. They can’t put it somewhere legitimate where content is moderated and policed. Seems like pretty sound logic to me.

      Dont get me wrong, these people are sick. If thats what they are into then theres something wrong, but instead of targeting real kids like so many people actually do, you know, like hollywood, celebrities, musicians, the catholic church etc they are entering prompts and reading stories. Sounds like impulse controlled to me.

  • DarkThoughts@fedia.io
    link
    fedilink
    arrow-up
    14
    arrow-down
    14
    ·
    12 hours ago

    Paywall. That site frankly does not even look legit and looking at the plethora of other AI sites I don’t know who would use this one. It’s not even displaying correctly and has like 0 information on anything. If I were to stumble upon that site I’d think it is shady as hell.

    • S13Ni@lemmy.studio
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 minutes ago

      It is a independent publication for tech critical journalism, founded by ex motherboard journalists. Only some of their stuff is paywalled, some only requires free account. Agree on their site but their journalism is usually pretty good.

    • glimse@lemmy.world
      link
      fedilink
      English
      arrow-up
      17
      arrow-down
      1
      ·
      11 hours ago

      You are almost definitely getting downvoted because it sounds like you’re saying 404media is not legit. I realize that you’re not, but I’ll admit I interpreted it incorrectly at first.

        • glimse@lemmy.world
          link
          fedilink
          English
          arrow-up
          11
          arrow-down
          1
          ·
          9 hours ago

          No but having misinterpreted your message once myself and then seeing the replies, I was just letting you know.

          I think when people read “this site” in the comments, they assume it refers to the link itself. So while the rest of your comment makes it clear, you try to connect it to the (incorrect) assumption. Like 404media isn’t a very pretty site so I can see why someone might insult the aesthetics?

          I don’t know, I wasn’t picking a fight or anything

    • Zak@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      4
      ·
      12 hours ago

      There are better ways to assess the legitimacy of a media outlet than critiquing its web design. The Wikipedia page might be a good start.

      I don’t like the loginwall, but it doesn’t require payment.

        • otp@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          14
          ·
          9 hours ago

          I also think the issue was with your comment. It could’ve been written a bit more clearly

          • DarkThoughts@fedia.io
            link
            fedilink
            arrow-up
            2
            arrow-down
            8
            ·
            8 hours ago

            I don’t know how my comment is unclear. Unless 404 is an AI site somehow, which I wouldn’t even know about.

    • Kairos@lemmy.today
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      2
      ·
      edit-2
      9 hours ago

      Literally not paywalled.

      And they did this for free posts because there’s lots of sites that scrap and re"publish" articles.

    • ted@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      3
      ·
      12 hours ago

      I know this isn’t necessarily helpful, but 404media has an account wall, not a paywall. You authenticate by email without a password.