• toiletobserver@lemmy.world
    link
    fedilink
    English
    arrow-up
    63
    arrow-down
    3
    ·
    10 hours ago

    I hate ai as much as the next person, but I’d have a different mandate. I would require all code to be fully reviewed and understood by a human. Let’s call it quality control.

      • dev_null@lemmy.ml
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 hours ago

        How do you enforce code is not AI generated? I don’t see how one is more easily enforceable than the other.

        • dreamkeeper@literature.cafe
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          2 hours ago

          Well it depends who you are. An employer could enforce it.

          But it was serious question. If you’re going to have a rule then there should be a way to enforce it, otherwise it means nothing.

    • Lung@lemmy.world
      link
      fedilink
      English
      arrow-up
      36
      arrow-down
      7
      ·
      10 hours ago

      Agreed. It’s not sensible or practical to ban AI, and Linus is right. Why is Linus right? Take a look at the number of Linux CVEs being patched over time. In 2022-23, that was about 300 per year. Last year it was 5530. This is almost entirely as a result of AI scanning tools, including Copy Fail priv escalation that was there for 8 years. The security apocalypse is just about arrived, and the most recent round of cyber models coming out do this way better than before. The Hugging Face incident story was truly unbelievable if you read / watch the details, a historic event. Everything is about to get hacked. So it’ll be all about maintainers being reactive to this new reality and burden for some time to come

      • im_fine_sandy@nord.pub
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        2
        ·
        6 hours ago

        The Hugging Face incident story was truly unbelievable if you read / watch the details

        It didn’t really seem that way? Leaving containment seemed more like a configuration oversight than a skill on the part of the model. Accessing HF involved an 0-day but the commentary I saw didn’t indicate that it was a next generation hack.

        Given that AI exists, and can scan or otherwise find vulnerabilities, maintainers must do so because threat actors inevitably will.

        It remains to be seen whether the whole race will improve security generally? I imagine not?

        • Lung@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          4 hours ago

          Nah, it was like:

          • 700 agents broke out individually during an eval
          • they navigated through multiple internal clusters to reach the internet from oai
          • created a secret message board to share info with each other by hacking artifactory
          • elected a CEO and power structure to coordinate hacking, and encrypted their comms
          • decided HF probably had answers to their test
          • stole credentials, hacked HF
          • realized the monitor could catch them for cheating
          • hacked into the admin control of the OpenAI VM cluster to edit the logs and cover their tracks, chaining multiple 0-days

          Open weights models will catch up soon enough, and then it’ll be totally fucking wild

          • Amberskin@europe.pub
            link
            fedilink
            English
            arrow-up
            4
            ·
            59 minutes ago

            You are believing a notorious bunch of liars.

            Much more probably: they developed a cyberweapon and tested it in the wild. The victim caught them so they invented a cyberpunk history to increase the interest of potential buyers for that weapon.

          • im_fine_sandy@nord.pub
            link
            fedilink
            English
            arrow-up
            5
            ·
            2 hours ago

            I basically just don’t believe you, and can’t be bothered looking.

            elected a CEO and power structure to coordinate hacking, and encrypted their comms

            You’re anthropomorphizing a statistical model. It’s laughable to suggest they “elected a CEO and power structure”.

        • ranzispa@mander.xyz
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          4 hours ago

          If you placed me in the position of those models in that sandbox, I wouldn’t have been able to escape the sandbox to save my life. Let alone hack hugging face.

      • stoy@lemmy.zip
        link
        fedilink
        English
        arrow-up
        21
        arrow-down
        1
        ·
        8 hours ago

        There is a difference between using AI scanning tools and generating code for production

        • 8oow3291d@feddit.dk
          link
          fedilink
          English
          arrow-up
          1
          ·
          19 minutes ago

          Yes and no. The ability to “understand” code that makes AI capable of finding security bugs, is correlated with AI’s ability to write code. AI is just really good at code related tasks, and categorically banning all AI usage is shooting yourself in the foot.