“Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease,” they added. “We term this condition Model Autophagy Disorder (MAD).”

Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.

  • Melody Fwygon@lemmy.one
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    Muahahahahahahaha.

    Looks like we found a relatively easy way to “poison” an AI dataset silently. Just feed it AI output.

    I could see this mechanic being exploited by websites to provide a bottomless amount of junk text that only a bot doing content scraping would see.