• Fedditor385@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    3 months ago

    Oh, funny, I also have sentient AI at home that I developed, but choose not to release it. My mom also created one accidentally while baking a cake but it was to powerful and she also decided to best destroy it like it never existed. You know, for everyones safety.

  • I Cast Fist@programming.dev
    link
    fedilink
    English
    arrow-up
    2
    ·
    3 months ago

    Man, I’ll start telling that to my boss whenever I miss a deadline. “Sorry boss, the code I made is too powerful, we can’t release it”

  • Avid Amoeba@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 months ago

    I’m pretty sure Scam Altman tried this line some time ago for one of his supposed models.

  • worhui@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 months ago

    Let me guess, this super ai lives in Canada and we can never meet it, but it’s totally real.

    • 🌞 Alexander Daychilde 🌞@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      3 months ago

      Well, this caused me to learn something today. One of my favorite musicals is Avenue Q, which has an entire song about a girlfriend who supposedly lives in Canada. And I keep seeing this reference - but I keep thinking there is NO WAY that THIS many people know about Avenue Q (which is a pity).

      And sure enough, TIL that this trope dates back to at least the 70s and is references in multiple TV shows and movies and such.

      So Avenue Q was using an existing thing. Ah, well.

      At least I know not to make Avenue Q references since there’s little chance they’ll be gotten. lol

  • theunknownmuncher@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    3 months ago

    The researcher had encouraged Mythos to find a way to send a message if it could escape.

    Engineers at Anthropic with no formal security training have asked Mythos Preview to find remote code execution vulnerabilities overnight, and woken up the following morning to a complete, working exploit

    • girsaysdoom@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 months ago

      I would love to see the exploit. There are vulnerabilities discovered everyday that amount to very little in terms of use in real world implementations.

      • jj4211@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 months ago

        Yes, recently we got a security “finding” from a security researcher.

        His vulnerability required first for someone to remove or comment out calls to sanitize data and then said we had a vulnerability due to lack of sanitation…

        Throughout my career, most security findings are like this, useless or even a bit deceitful. Some are really important, but most are garbage.

        • paraphrand@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          edit-2
          3 months ago

          Well, for now. I’m sure any of those 12 partner companies they called out as new security partners will end up leaking that this is all lies eventually. If it’s just made up bullshit.

          Anthropic announced new partnerships to inform the companies of security issues and to work with them to fix said issues. If it’s bullshit, it’s gonna be wasting their time. And that’ll surface eventually.

          The meme still applies to people asking the AI to tell them what they wanna hear, and delusional people spiraling with sycophantic AI.

          But I believe Anthropic when they say their models are not working as intended and posing security risks.

          Claude Mythos Preview’s large increase in capabilities has led us to decide not to make it generally available," Anthropic wrote in the preview’s system card. “Instead, we are using it as part of a defensive cybersecurity program with a limited set of partners.”

      • theunknownmuncher@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 months ago

        Uh oh, someone clearly didn’t read the article!

        The researcher had encouraged Mythos to find a way to send a message if it could escape.

        Engineers at Anthropic with no formal security training have asked Mythos Preview to find remote code execution vulnerabilities overnight, and woken up the following morning to a complete, working exploit

        Nope, they literally asked it to break out of it’s virtualized sandbox and create exploits, and then were big shocked when it did.

        Genuinely amazing that you’re trying to tell me what an article that you didn’t fucking read is about.

  • GuyIncognito@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 months ago

    crazy that the AI companies big selling point is always “our new model is TOO POWERFUL, it’s gone rampant and learned at a geometric rate, it enslaved six interns in the punishment sphere and subjected them to a trillion subjective years of torment. please invest, buy our stock”

    • emb@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 months ago

      They didn’t entirely miss the mark there. They publicly released the version after that and the world became worse. That certainly fits for some definition of ‘dangerous’, even tho it’s probably not how they were thinking.

  • Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    0
    ·
    3 months ago

    Ignore the “containment” framing, they made a hacking bot and it seems to actually be good at finding and exploiting vulnerabilities:

    The AI model “found a 27-year-old vulnerability in OpenBSD—which has a reputation as one of the most security-hardened operating systems in the world,” the company wrote.

    Dismiss this as marketing drivel all you want but hacking is just the sort of needle in a haystack problem that AI is very good at. It requires broad knowledge, a lot of cycles trying and failing, and is easily verifiable, ie. Can you execute arbitrary scripts or not. Even if this release is BS good hacking agents are bound to come eventually and we should be discussing the implications of that instead of burying our heads in the sand, pretending AI is useless and that this is all hype.