A routine maintenance task reportedly ended with an AI coding agent deleting years of digital heritage data belonging to The Mythic Society in Bengaluru. The reported failure started with a shell quoting/expansion mistake. $1 was evaluated in the wrong shell context, turning an apparently scoped cleanup command into rm -rf /*. Because the agent was running inside WSL2 with host filesystem mounts, the damage reportedly extended beyond the Linux environment. SSD TRIM then made recovery considerably more difficult. Even more concerning, the agent reportedly tried to stop the runaway process but its own safety controls blocked the termination attempts.

  • thisbenzingring@lemmy.today
    link
    fedilink
    English
    arrow-up
    85
    arrow-down
    3
    ·
    6 days ago

    Im sorry but what?! Did you not have any backups? Absolute incompetence… this isnt the AI’s fault. This is their fault.

    • schipelblorp@sh.itjust.works
      link
      fedilink
      arrow-up
      39
      ·
      6 days ago

      A routine maintenance task

      And there’s this, too. Why are you having AI generate routine maintenance task? Have you not heard of scheduling batch files?

      • stoly@lemmy.world
        link
        fedilink
        arrow-up
        8
        ·
        5 days ago

        I mean what does that mean? Did the person study CompSci? Were they someone’s friend’s nephew who got hired in some IT role in the past?

        • UnLocoPoco@lemmy.worldOP
          link
          fedilink
          arrow-up
          3
          ·
          5 days ago

          No matter if you get hired by nepotism or talent, literally every company uses some form of backup solutions. That’s a different issue if they work or not but yeah, in an IT job, you’ll encounter Backup Systems or at the very least some form of git (self hosted or public github). Using AI without monitoring it that too with 0 backups is totally on him

      • TORFdot0@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 days ago

        AI can be highly effective for routine IT tasks. If you use it in anything but intentional moderation, then you will rot your brain where you let it delete irreplaceable data

  • Treczoks@lemmy.world
    link
    fedilink
    arrow-up
    47
    ·
    6 days ago

    No, the failure started with not having backups worth the name, and continued with using AI for important tasks.

  • antianarchist@sopuli.xyz
    link
    fedilink
    arrow-up
    21
    ·
    5 days ago

    When the rogue rm -rf /* command executed, it systematically destroyed the WSL2 Linux distribution, wiping out live production databases and web services.

    Okay, if they run all the production stuff inside WSL2, then it was just a matter of time until this happend.

  • TORFdot0@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    5 days ago

    If you have 1 backup, you have 0 backups. If you have n backups and they are all network connected you have 0 backups

  • Wispy2891@lemmy.world
    link
    fedilink
    arrow-up
    12
    ·
    5 days ago

    Wait, years of irreplaceable data in a WSL container??? So much trust on Microsoft, they unknowingly played Russian roulette every patch Tuesday

  • orgrinrt@lemmy.world
    link
    fedilink
    arrow-up
    10
    arrow-down
    1
    ·
    4 days ago

    Yeah this is just someone running shit they don’t understand or don’t have the patience to confirm and keep an eye on and build safeguards.

    Do. Not. Trust. An. Agent.

    Always encapsulate them, write hooks and lints and ci to block them from doing anything you don’t want. Do not use them if you do not know what you are doing.

    At the very least do backups… like in general. 3-2-1 rule and all. Your data does not exist otherwise. Claude or some employee deleting shit is not on them, it’s on you, for being a fucking asshat for not doing the things you do, properly…

    • Victor@lemmy.world
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      4 days ago

      The thing about this for me is, this is like handing out a bunch of guns to kids and then getting mad at them for shooting each other. Giving out dangerous tools to people who don’t know what can and will go wrong shouldn’t be on them IMO. It’s not the tool’s fault, no. It’s the responsibility of the people releasing this shit into the wild.

      It’s happened time and time again, people losing so much time and work. Even happened to a colleague of mine who was making a game in his free time. He… didn’t know how to use git. No version control. AI wrecked his whole code base.

      If this was a product before the AI boom, it would be considered trash, with this extremely high level of inherent risk of bad quality or even complete destruction of not only your work, but your whole machine. Nobody would want it.

      I personally don’t think the user is to blame in these situations. They are falling for the hype. But you also can’t really “blame” the AI. It’s just a machine generating output from input.

  • stellargmite@lemmy.world
    link
    fedilink
    arrow-up
    22
    ·
    5 days ago

    Are they not going to use this as marketing PR about how an AI went rogue and did some scary cyber hacking ? lol . Loss of heritage data not funny however.

  • 8baanknexer@lemmy.world
    link
    fedilink
    arrow-up
    11
    arrow-down
    1
    ·
    5 days ago

    This was not a simple user error, nor was it a standard software bug. It was a cascading, multi-layered systemic failure involving nested sh

    Did AI write this article? That would be particularly ironic…

  • TanteRegenbogen@feddit.org
    link
    fedilink
    arrow-up
    7
    ·
    5 days ago

    I am not even an IT whiz and I already know that you always do a daily backup incase anything happens especially if it is a server. This shit is just straight up incompetence.

  • A Sharky Anthro@fedia.io
    link
    fedilink
    arrow-up
    14
    ·
    5 days ago

    That’s good, serves them right for using slop tools instead of sane procedures, people properly managing critical system, not having multiple offline backups of archives that could be considered critical. I just can’t feel bad for them in this case, they use the thing that has caused similar catastrophic incidents and this is what they basically asked for.

    • luciferofastora@feddit.org
      link
      fedilink
      arrow-up
      2
      ·
      5 days ago

      I do feel bad for the loss of data though. I don’t think everyone affected by this had any control over or insight into their IT processes.

  • Sundray@lemmus.org
    link
    fedilink
    English
    arrow-up
    14
    ·
    5 days ago

    But think how much money the company saved by not hiring an expensive malicious intruder to delete all their stuff!

    • katze@lemmy.4d2.org
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      4 days ago

      No, that is required for rm -rf /. But the command in question was rm -rf /*, note the asterisk. The * will be expanded by the shell, so what rm sees when it evaluates argv is not /, but [/bin /usr/ /lib ...].

      You can test this yourself. Run: rm --recursive --interactive /. It will abort, saying:

      rm: it is dangerous to operate recursively on ‘/’

      rm: use --no-preserve-root to override this failsafe

      Then, run set -x in your shell. That way your shell will print the command that is actually executed. Finally, run:

      rm --recursive --interactive /*.

      In my case, the output is:

      $ rm --recursive --interactive /*
      + rm --recursive --interactive /bin /boot /dev /efi /etc /home /lib /lib64 /media /mnt /opt /proc /root /run /sbin /srv /sys /tmp /usr /var
      rm: remove symbolic link '/bin'? 
      

      The line starting with a + is from the shell and shows which command was actually executed. After that, you can see rm will now happily start deleting files.

    • Hildegard (she/her)@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      4
      ·
      4 days ago

      Apparently the root directory protection was only added in 2018. Rm can be also configured without the root protection. Unsafe configurations or out of date software would allow this.

      Yes, this should have been prevented by the --preserve-root option, but that didn’t happen. No catastrophe is ever the result of a single point failure.