• intensely_human@lemm.ee
    link
    fedilink
    arrow-up
    7
    ·
    1 year ago

    If there’s an algorithm for detecting deep fakes, there’s an algorithm for creating an AI capable of fooling that algorithm.

      • intensely_human@lemm.ee
        link
        fedilink
        arrow-up
        2
        ·
        1 year ago

        And they’ll train that AI on the first AI’s detection performance. This process is called Generative Adversarial Neural Networks, or GANN. It works really well and allows AI to become superhuman by having superhuman obstacles to overcome.

    • elfpie@beehaw.org
      link
      fedilink
      arrow-up
      0
      ·
      1 year ago

      Does it really work like that? I would say that they are not trying to fool any test, just getting harder to be detected. The goal being looking completely realistic.

      • jarfil@beehaw.org
        link
        fedilink
        arrow-up
        0
        ·
        edit-2
        1 year ago

        This is one of the basic techniques to spot AI fakes:

        • Correct number of body features (limbs, fingers, eyes…)
        • Non-intersecting body features
        • Surface continuity (skin, clothes, walls…)
        • ➡️ Eye reflections
        • Consistent illumination of features
        • Consistent shadows
        • Consistent reflections of illumination and shadows

        The “test” they’re trying to fool, is kind of the Turing test: whether humans can tell them apart.

        • Sina@beehaw.org
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          Consistent illumination and shadows is a rabbit hole we really don’t want to hop into.

          Outside of very obvious anomalies even a trained eye will have a hard time discerning what’s going.

  • Match!!@pawb.social
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    this should work on its face because many machine learning algorithms optimize for low Gini coefficient, e.g. a decision tree classifier makes binary splits based off the greatest reduction in Gini; astronomers use something similar to compress the data sent back from space telescope cameras to a reasonable filesize, so if a picture of a face has weird Gini coefficients then it makes sense that it would’ve been AI generated

    • IHeartBadCode@kbin.run
      link
      fedilink
      arrow-up
      7
      ·
      1 year ago

      To quote the article.

      While the eye-reflection technique offers a potential path for detecting AI-generated images, the method might not work if AI models evolve to incorporate physically accurate eye reflections, perhaps applied as a subsequent step after image generation.

      I’m not discouraging AI detection, we will absolutely need it in the future, but we have to acknowledge that AI detection is a cat and mouse game.

  • AutoTL;DR@lemmings.worldB
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    🤖 I’m a bot that provides automatic summaries for articles:

    Click here to see the summary

    Researchers at the University of Hull recently unveiled a novel method for detecting AI-generated deepfake images by analyzing reflections in human eyes.

    Adejumoke Owolabi, an MSc student at the University of Hull, headed the research under the guidance of Dr. Kevin Pimbblet, professor of astrophysics.

    In some ways, the astronomy angle isn’t always necessary for this kind of deepfake detection because a quick glance at a pair of eyes in a photo can reveal reflection inconsistencies, which is something artists who paint portraits have to keep in mind.

    They used the Gini coefficient, typically employed to measure light distribution in galaxy images, to assess the uniformity of reflections across eye pixels.

    The approach also risks producing false positives, as even authentic photos can sometimes exhibit inconsistent eye reflections due to varied lighting conditions or post-processing techniques.

    But analyzing eye reflections may still be a useful tool in a larger deepfake detection toolset that also considers other factors such as hair texture, anatomy, skin details, and background consistency.


    Saved 70% of original text.