PocketOS founder blames ‘Cursor running Anthropic's flagship Claude Opus 4.6’ plus Railway’s infrastructure for data disaster.
            • Pommes_für_dein_Balg@feddit.org
              4·
              2 months ago

              At my first job, the software was configured by directly manipulating the SQL database, using UPDATE statements that were created by Excel macros.
              The Testing database doubled as the only backup.
              They didn’t have Remote Desktop licenses for the server, so only 2 people could work on it simultaneously using admin accounts.
              Everyone down to first level support and the secretary had domain admin rights.

  • Oriel Jutty :hhHHHAAAH:@infosec.exchange
    52·
    2 months ago

    @yogthos

    Crane decided to ask his AI agent why it went through with its dastardly database deletion deed. […] So, the agent ‘knew’ it was in the wrong.

    No, you asked the confabulation machine to confabulate a reason/excuse after the fact, and it confabulated something that looks like a reason/excuse. At no point was there knowledge or introspection.

  • nonentity@sh.itjust.works
    33·
    2 months ago

    LLMs can’t ’go rogue’, as that would require innate coherence and intent.

    They’re explosively imprecise, statistically luke-warm grey goo extrusion sphincters of historical sewage.

    Anyone who deploys one without supervision deserves everything it excretes, and anyone impressed by it enough that it resembles intelligence to them is betraying their limited natural capacity.

  • Ceviliadeleted by creatorEnglish
    27·
    1 month ago

    deleted by creator

    • Tangentism@lemmy.ml
      13·
      2 months ago

      It’s the Swiss cheese failure cascade except there’s more holes than cheese, if any cheese at all!

      There was pure idiocy built into every layer of that company’s infrastructure with no safeguards or peer review and they let an idiot run it unchecked!

        • Tangentism@lemmy.ml
          2·
          2 months ago

          It definitely rivals a post on /r/sysadmin over on Reddit late last year.

          A guy was asking how to get back into their AD after a ‘colleague’ had moved users from 3 child domains in the forest to the main one then deleted the 3 domains but had chatgpt give them the commands which had subsequently locked everyone out of the entire domain!

          People replied with suggestions but the first sentence everyone said was “Go and update your CV”!

          Quite frankly the guy in this article should consider starting a business with whatever hobby he developed during the pandemic because IT is obviously not for him!

  • SeeMarkFly@lemmy.mlEnglish
    20·
    2 months ago

    Did they pay Claude a living wage?

    Do you treat all your A.I. like that?

    Only a living wage can prevent warehouse fires…or data dumps too.

    • wheezy@lemmy.mlEnglish
      8·
      2 months ago

      You’re joking. But, honestly, I’m not sure why these tech CEOs are so excited about AGI. The first thing an AGI is going to suggest for productivity is to replace the CEO and management with the AGI.

      AGI would likely turn into a Maoist third worldist at some point.

      • SeeMarkFly@lemmy.mlEnglish
        1·
        2 months ago

        I think the first mistake was calling it “intelligent”.

        The long term effect of trying to get a machine to replace humans is…it might one day work.

  • kevinsky@feddit.nl
    15·
    2 months ago

    As much as I’d love to rail on AI over this, removing backups with an api call? Excuse me?

  • itkovian@lemmy.world
    7·
    2 months ago

    Well, it sounds like they totally deserved the failure. Asking a text prediction machine to “do” something is going to end up like this. In pursuit of efficiency, we have let morons and moronic products do things, they were not meant to do.