• Turun@feddit.de
    link
    fedilink
    arrow-up
    6
    ·
    4 months ago

    I bet AI detection is going to get a lot better over time.

    I doubt it. ChatGPT 3.5 is good enough to rewrite small snippets of text with better phrasing, ChatGPT 4.0 can write a paragraph if given enough support. Good enough as in "the output is indistinguishable from what a human would have written.

    Of course you can do even more with the currently available tools - and get found out.

    There is a way to make AI generated text detectable: by slightly pushing the output towards a consistent pattern a detector can reliably judge long pieces of text as AI generated.
    Imagine if the AI is biased towards consecutive words starting with consecutive letters of the alphabet (e.g. “a blue car” instead of “a navy vehicle”.). Not strongly biased, but enough so that when there are 1000 words you can look at the probability of consecutive words starting with consecutive letters of the alphabet and get a clear result.

    There are two problems though: this only works with proprietary systems and only with long texts.

    • sunbytes@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      4 months ago

      If something was written by V3 and then published, that text doesn’t get updated every time a new version of chatGPT comes out.

      The text isn’t dynamic.

      • Turun@feddit.de
        link
        fedilink
        arrow-up
        1
        ·
        4 months ago

        Yes, but at some point it doesn’t matter. The AI is trained to replicate human writing. There will be a point where it becomes so good that the result is a perfect replica, where it is indistinguishable from human text. I.e. even a perfect detector will not be able to confidently declare it as AI written, not ever. Because there is no difference.