• DarkThoughts@fedia.io
      link
      fedilink
      arrow-up
      37
      ·
      3 months ago

      Are we maybe talking about 57% of newly created content? Because I also have a very hard time believing that LLM generated content already surpassed the entire last few decades of accumulated content on the internet.

      • Ephera@lemmy.ml
        link
        fedilink
        arrow-up
        15
        ·
        edit-2
        3 months ago

        I’m too dumb to understand the paper, but it doesn’t feel unlikely that this is a misinterpretation.

        What I’ve figured out:

        • They’re exclusively looking at text.
        • Translations are an important factor. Lots of English content is taken and (badly) machine-translated into other languages to grift ad money.

        What I can’t quite figure out:

        • Do they only look at translated content?
        • Is their dataset actually representative of the whole web?

        The actual quote from the paper is:

        Of the 6.38B sentences in our 2.19B translation tuples, 3.63B (57.1%) are in multi-way parallel (3+ languages) tuples

        And “multi-way parallel” means translated into multiple languages:

        The more languages a sentence has been translated into (“Multi-way Parallelism”)

        But yeah, no idea, what their “translation tuples” actually contain. They seem to do some deduplication of sentences, too. In general, it very much feels like just quoting those 57.1% without any of the context, is just a massive oversimplification.

    • chonglibloodsport@lemmy.world
      link
      fedilink
      arrow-up
      5
      ·
      3 months ago

      I think if you include scraped/plagiarized SEO spam “content” then I totally believe it. The amount of that crap flooding the internet is staggering. Search is just becoming more and more useless every day.

    • datelmd5sum@lemmy.world
      link
      fedilink
      arrow-up
      3
      arrow-down
      13
      ·
      3 months ago

      It can definitely be surprising to realize how much AI contributes to today’s content, but it’s become a powerful tool in many industries. From writing articles and generating art to customer service and personalized recommendations, AI helps create and enhance a lot of what we interact with daily. It’s not just about replacing human effort but often about assisting and enhancing creativity and productivity. The growth of AI is a reflection of how technology is evolving to meet the demands of our fast-paced world.

      • DarkThoughts@fedia.io
        link
        fedilink
        arrow-up
        2
        ·
        3 months ago

        But there’s several decades worth of accumulated texts, images, videos, audio, etc. - there’s no way LLM content already surpassed that within the last few years. They must mean 57% of newly created content or something.

      • andrewth09@lemmy.world
        link
        fedilink
        arrow-up
        2
        arrow-down
        7
        ·
        3 months ago

        Absolutely, you’ve captured the essence of AI’s role perfectly. AI isn’t just about replacing human effort but rather about augmenting our capabilities and expanding creative possibilities. It’s exciting to see how it’s transforming industries and driving innovation, helping us to keep up with the rapid pace of change and enhancing the way we interact with technology and each other.

  • superkret
    link
    fedilink
    arrow-up
    32
    arrow-down
    5
    ·
    edit-2
    3 months ago

    If current copyright law dies at the hand of AI then so be it.
    Cause it desperately needs to die.

    • SkyNTP@lemmy.ml
      link
      fedilink
      arrow-up
      30
      arrow-down
      3
      ·
      edit-2
      3 months ago

      Not like this. Not like this.

      Independent creators need some sort of protection from giant corporations.

      • ayaya@lemdro.id
        link
        fedilink
        English
        arrow-up
        19
        arrow-down
        2
        ·
        3 months ago

        Copyright isn’t meant to help independent creators. At least not small ones. You have to pursue legal action against people to enforce it. Small creators do not have the money for that.

      • Pennomi@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        3
        ·
        3 months ago

        Small creators have far more to gain than lose by loosening copyright regulations. Hell, I know multiple artists whose primary source of income is illegal fanart.

  • FaceDeer@fedia.io
    link
    fedilink
    arrow-up
    14
    ·
    3 months ago

    AI trainers curate the data they use for training. We’ve gone past the phase where people just dump Common Crawl onto a neural net and tell it “figure that out somehow!” That worked back when we had no idea what we were doing or what would produce passable results, nowadays we know what produces better results. “Model collapse” has been known as a potential problem for years. The studies demonstrating it use unrealistic training methodologies to force it to extremes, real training works to avoid it.

    And finally, that “57% of content is AI-generated!” Headline that’s been breathlessly spamming all the feeds? Grossly misleading, of course. The actual study found that 57% of the content in their sample that had been translated into other languages had been translated into three or more languages, which they interpreted as meaning it had been AI-translated.

    People are so eager to click on “AI sucks and is dying!” headlines.

  • TommySoda@lemmy.world
    link
    fedilink
    arrow-up
    6
    arrow-down
    1
    ·
    3 months ago

    Well if plagiarizing the entire internet is required, the least these models could do is provide sources. Hold AI to the same standards as everything else. AI can’t create anything new so it might as well tell me where it’s coming from. That way if an AI model is telling me to eat rocks I can at least see that it’s from a reddit post. And if it creates an image based on a prompt I’d like to know which images it used to generate the “new” image. With AI sucking up and regurgitating more and more of the Internet it’s only going to get more difficult to determine what’s factual information.

    Hopefully this will be resolved before someone that isn’t very tech savvy gets hurt or worse because they decided to trust Google’s AI search. People like your parents or grandparents that barely understand how a smartphone works and are now being fed potentially dangerous information with no sources of where it came from.

  • theRealBassist@lemmy.world
    link
    fedilink
    arrow-up
    5
    ·
    3 months ago

    The headline has literally nothing to do with the paper it is citing.

    The paper is specifically looking at mat machine translation, not generation.

    Nowhere does it state that 57% of content is AI generated.

  • sodalite@slrpnk.net
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    1
    ·
    3 months ago

    if it’s impossible to train AI without abusing copyright why do I see job postings looking for writers to train AI 🤔

    • TommySoda@lemmy.world
      link
      fedilink
      arrow-up
      5
      ·
      3 months ago

      Because these models sucked up everything else and they are still hungry. When they said there would be new jobs, working for AI wasn’t quite what I had imagined. I thought it was supposed to be the other way around.