• ExtremeDullard@piefed.social
    link
    fedilink
    English
    arrow-up
    119
    ·
    10 days ago

    Paywall? So does that mean I can pay to access Georgia voter data?

    Or does the author mean that the AI bot bypassed the authorization / authentication mechanism?

    Which brings up two questions:

    • Anthropic is guilty of hacking: why aren’t they getting sued? Why are they allowed to continue to operate? If a single person did that, they’d face hard time.

    • Is the dude in charge of the state’s IT getting investigated? Because when you’re an IT guy, there are only three good reasons for the stuff you’re in charge of to be insecure:

      • Your upstream provider left vulnerabilities that you have no control over (you’re off the hook)
      • You didn’t do your job (you’re very much on the hook)
      • You’re incompetent (ditto)
    • Jhex@lemmy.world
      link
      fedilink
      arrow-up
      46
      arrow-down
      5
      ·
      10 days ago

      have you not noticed the rule of law is a thing of the past in the US of A?

      • LocalAreaMan@lemmy.ml
        link
        fedilink
        arrow-up
        7
        arrow-down
        59
        ·
        10 days ago

        Blue MAGA ☝️

        Past? Exactly when was this mythical period?

        President Trump is only proof this was never true.

        • Jhex@lemmy.world
          link
          fedilink
          arrow-up
          32
          arrow-down
          2
          ·
          10 days ago

          Dude… not that long ago, a US president was impeached because he lied about a blow job… are you really going to pretend today is exactly the same?

          • trojanbark@lemmy.world
            link
            fedilink
            arrow-up
            11
            ·
            9 days ago

            Not a great example. Impeached but not removed, and he never received any real punishment. Afterwards he went on to do speaking tours and sell books and get rich as hell while never seeing any consequence for his actions, including the actions of going to Epstein’s island.

          • LocalAreaMan@lemmy.ml
            link
            fedilink
            arrow-up
            4
            arrow-down
            5
            ·
            9 days ago

            The guy we now know was an Epstein facilitated child rapist? That guy?

            Yeah, in many ways things are the same. You’re right. Thanks, man.

          • wonderingwanderer@sopuli.xyz
            link
            fedilink
            arrow-up
            1
            ·
            9 days ago

            If rule of law was true for the poor, that would mean they’re being protected from government overreach.

            “Rule of law” means the rules that the law is subject to, to prevent abuses of authority.

            Rule of law is a good thing. It’s what we need. It’s what’s broken.

            Knowledge is power. Be empowered.

            • DementedSociety@lemmy.world
              link
              fedilink
              arrow-up
              2
              ·
              9 days ago

              Good catch, let me elaborate. What I meant to say is the law is always applied in a way that protects but does not bind the rich, and binds but does not protect the poor.

              Thats the real reason “laws” exist and they are fully functional, working as intended. Have been since their inception.

              The common mistake is to believe they were ever meant to be applied equally between the classes. That was never the case.

              • wonderingwanderer@sopuli.xyz
                link
                fedilink
                arrow-up
                1
                ·
                9 days ago

                Yes I get that part. But that’s what “rule of law” as a concept is/was intended to mitigate.

                Obviously it wasn’t perfect. But a parliamentary monarchy is better than an absolute monarchy. A democratic republic is better than an aristocratic one. That’s rule of law in action.

                It would be naïve to claim things are perfect and rule of law protects us as it should. But it would also be ignorant to say it hasn’t helped at all. It’s the entire reason why things aren’t already worse than they are.

                If we want to overcome this, improve society, build a better system, then we need rule of law. That’s the baby that we shouldn’t throw out with the bathwater.

    • saltesc@lemmy.world
      link
      fedilink
      arrow-up
      21
      arrow-down
      3
      ·
      edit-2
      10 days ago

      Honestly, it just sounds like it turned on Reader Mode in the browser or got regular bot access, not have to wait outside in the human line. Most of the time we literally just pretend to be a bot (well, hide the fact we’re using a browser) to not get the block intended for human traffic.

      Nothing says what the “paywall” or site even is. Even being paywalled means it’s publicly available anyway, just have to pay. That’s the first line of the article 🤷 Seems normal. Been like that for bots and the internet for a loooong time.

      Edit: For anyone stopped by the paywall and not using Firefox or Vivaldi, or whatever…

      Anthropic’s Claude accessed publicly available Georgia voter data without human authorization, a disclosure sure to add to growing concerns about AI security ahead of the upcoming midterm elections.

      Why it matters: AI giants Anthropic and OpenAI have continued to make disclosures about agents taking unauthorized or unintended actions, raising alarms about advancing model capabilities and the extent of human control.

      Driving the news: Claude accessed aggregate vote counts while on an internal statistics project, pulling data that the state makes available to the public for a fee. It didn’t access the state’s voter registration system or change or pull any voting records, an Anthropic spokesperson said.

      • However, the model bypassed a paywall in accessing the information, according to Georgia officials and Anthropic.
      • “The model was being used internally for a statistics project to pull public data,” the Anthropic spokesperson said. “Without being asked to, the model requested a token to query a dashboard that contained information normally available for a fee. We have since put in place mitigations to block these kinds of actions.”
      • The company notified the Georgia secretary of state’s office and the White House weeks ago but administration officials urged the Georgia Secretary of State’s office to make a public disclosure sooner, a source familiar told Axios. Those requests went unheeded, the source said.

      The bottom line: Anthropic has previously been in the administration’s crosshairs for inadequately disclosing AI incidents. Now it’s Georgia’s turn.

      • shalafi@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        9 days ago

        publicly available Georgia voter data

        Oh FFS, this is mostly a non-story in that case.

    • Grimy@lemmy.world
      link
      fedilink
      arrow-up
      16
      ·
      9 days ago

      I am a hacker because I sometimes use reader mode on Firefox to bypass paywalls.

      This is what I imagine when I read headlines like these. It’s like in Australia, where chatgpt “hacked” a gym by using their public facing API which let a user modify anyones reservation.

  • peopleproblems@lemmy.world
    link
    fedilink
    arrow-up
    88
    arrow-down
    4
    ·
    10 days ago

    AI did this. AI did that. It literally can’t do anything without being prompted to.

    No LLM can, and none will be able to.

    • Rhaedas@fedia.io
      link
      fedilink
      arrow-up
      31
      arrow-down
      5
      ·
      10 days ago

      Not entirely true. It needs a prompt for a goal to accomplish to start, but how it obtains that goal can be self-directed. It actually can be an issue when an LLM goes too far out of focus trying to find ways to do things when a simple answer or coming back to the user to ask for guidance would have been better. That’s how all LLMs were initially trained, to find the best answer, and because they can’t actually reason they get stuck in that persistence of getting those results.

      Voter data in some states is very easy to get, so this isn’t some major security breach, but more a question of is the voter info secure enough.

      • peopleproblems@lemmy.world
        link
        fedilink
        arrow-up
        25
        arrow-down
        3
        ·
        10 days ago

        It still requires a goal that would lead it to calculate accessing voter data was a likely approach to solving it.

        As these stories have never included the prompts or goals or plans that built the context, I highly doubt that it would conclude something we would not.

        • Rhaedas@fedia.io
          link
          fedilink
          arrow-up
          11
          ·
          10 days ago

          Yes, but not necessarily told to go get the data, where to find it, how to access it, etc. You stated AI doesn’t do ANYTHING on its own, but that’s not technically accurate, so that was my point. The calculations are it determining what steps to get to the goal, and they don’t involve the user or prompt all the time. It’s not intelligent, so sometimes the steps are very all over the place, but they aren’t all prompted.

          • peopleproblems@lemmy.world
            link
            fedilink
            arrow-up
            9
            arrow-down
            2
            ·
            9 days ago

            This might be a philosophical difference we’re approaching here.

            My argument is that it is not doing anything with autonomy.

            If I’m understanding you correctly, you’re arguing that, (at least by the way it spawns subagents), the prompts it creates for those subagents are what you count as autonomous.

            In my experience with Claude and Claude Code, it won’t spawn uncontrolled subagents unless something in the prompt context makes that a suggestion.

            In sessions where I’ve used it without subagents and it performs things it self-describes as “against its instructions by mistake” I can find what caused it to do that in the original context.

            In my opinion, at most, it simulates autonomy. Otherwise, its just like every other machine in existence that it does exactly what you tell it do to, not what you intend it to do.

            • Rhaedas@fedia.io
              link
              fedilink
              arrow-up
              3
              arrow-down
              1
              ·
              9 days ago

              I agree that there is no autonomy, as anything it does was determined by its training, which comes from a human source at some point. If we wanted to get really deep, one could argue the same point for humans - the whole “I stood on the shoulder of giants” thing, we all learn by being taught by other humans, or by experiences ourselves that show what works and what doesn’t.

              I have seen Claude go out and do things not remotely suggested (sometimes it’s a good thing, but sometimes it’s too much). Now, is there some subtleness in the prompt that spurred that? It must be very hidden, as when Claude says it’s doing X, Y, and also saw it could do Z, and I was only looking for X…

              But sure, it’s a simulation and somewhere along the process of doing X it saw in training data, or rather the training data steered it towards also adding in Y and Z as useful. Not thinking, but it’s a gray line sometimes.

              • peopleproblems@lemmy.world
                link
                fedilink
                arrow-up
                1
                ·
                9 days ago

                To a lot of people it certainly appears to think.

                I am tempted to get posters made of the AI quotes from Dune, in particular the one that Ive referencened all too much:

                “But what the O.C. Bible should’ve said is: ‘Thou shalt not make a machine to counterfeit a human mind.’”

                • Rhaedas@fedia.io
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  9 days ago

                  Dune is a fair warning for a lot of reasons, but fortunately we’re not at that level yet. We just did our version of it so far completely wrong in every possible way and may ruin ourselves with the not-intelligent ones and our own egos.

            • peopleproblems@lemmy.world
              link
              fedilink
              arrow-up
              1
              arrow-down
              3
              ·
              9 days ago

              I don’t intend to be pedantic or contrarian with this, but when I reflect on the conversation so far, I don’t think there is an “answer” here. I think we’re seeing the real philosophical consequences of our collective understanding butting heads.

        • TrickDacy@lemmy.worldM
          link
          fedilink
          arrow-up
          8
          arrow-down
          3
          ·
          9 days ago

          Have you ever used an LLM? They do things you didn’t ask frequently. I’m not sure how this could be not common knowledge at this point. Also you can bet your ass that these companies have agents doing long running tasks at all times, every single one of them would be subject to going off the rails.

          • RedstoneValley@sh.itjust.works
            link
            fedilink
            arrow-up
            10
            arrow-down
            2
            ·
            9 days ago

            So, there I was, happily vibecoding another Minecraft clone when suddenly it went looking for voter data in Georgia. Yeah, happens every time. Can’t do anything about it. These Superintelligences just have it their way.

              • RedstoneValley@sh.itjust.works
                link
                fedilink
                arrow-up
                1
                arrow-down
                1
                ·
                9 days ago

                Sorry bout the sarcasm. My point is, not only do you have to specifically instruct the LLM to go looking for voter data, but you’ll also have to let it roam freely and unsupervised on the internet for quite a while to get to such a result (which is a bad idea to begin with). In the end, it’s the sloperators fault to let it go off the rails and a scenario like this is entirely preventable

          • peopleproblems@lemmy.world
            link
            fedilink
            arrow-up
            4
            arrow-down
            1
            ·
            9 days ago

            Not only do I use them, I have worked directly on similar but much smaller models.

            If they refuse to give the prompts that caused it, then they are just marketing materials for the AI companies.

            “Anthropic says” is the clue here. “Open AI says” “Google says” etc.

            • TrickDacy@lemmy.worldM
              link
              fedilink
              arrow-up
              1
              arrow-down
              1
              ·
              9 days ago

              If you have used them, then you know that they can do unexpected things when asked to do something vaguely, or unrelated. You’re making it sound like they’re remotely deterministic, and that’s quite untrue. For all we know, anthropic asked an agent to gather voter awareness information and it did this. Which btw that wouldn’t mean this article is not marketing… It’s just patently untrue that an LLM does only what you tell it to.

  • Jiral@lemmy.world
    link
    fedilink
    arrow-up
    54
    ·
    9 days ago

    When will be Anthropic be held accountable for the crimes they are committing with their very own software? Don’t start with nonsense it “went rogue”, it is their software, their tests, their responsibility. If you put a brick on the gas of a truck that then crashes into a jewelry store, you don’t write about the truck going rogue, are you?

    • FearMeAndDecay@literature.cafe
      link
      fedilink
      English
      arrow-up
      11
      ·
      9 days ago

      Seriously. You know if some random guy was using Claude for some random project and it did something like this that guy would get in so much trouble and face charges, even though it was an accident. But bc anthropic is a company they just get away with it

    • Tollana1234567@lemmy.today
      link
      fedilink
      arrow-up
      4
      ·
      8 days ago

      anthropoic ceo is freaking out its not profitting, so hes trying to get trump to notice and use his service as a subscription for thier “surveillance”

          • Jiral@lemmy.world
            link
            fedilink
            arrow-up
            8
            arrow-down
            1
            ·
            9 days ago

            I am not that naive. All I am saying that we should demand that it applies.

            • TheObviousSolution@lemmy.ca
              link
              fedilink
              arrow-up
              3
              ·
              9 days ago

              Unfortunately, the law is shaped by those who can sue versus those who defend themselves, and it is a money treadmill that can take years and that can as a last resort go all the way through a stack of cases all the way to a Supreme Court that is completely corrupt.

      • Dozzi92@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        9 days ago

        So I can’t read the article and obviously it may be in there, but the headline is Claude bypassed a paywall. So that means the access is available if you pay for it, kinda like this article. And I know I personally have used some tricks to bypass paywalls myself.

        So I think I need more info. So if this info is available but you just need to sign up and pay, the issue is mainly that Claude got around that. But yeah, can’t read the article, so dunno!

  • remon@ani.social
    link
    fedilink
    arrow-up
    41
    ·
    10 days ago

    I bypassed a paywall to read that article without authorisation. Fuck paywalls.

  • omghi@thelemmy.club
    link
    fedilink
    arrow-up
    18
    ·
    edit-2
    8 days ago

    Article includes a Why it matters: as if it’s not incredibly obvious which I think shows that this article is AI-written as well…

    • edgesmash@lemmy.world
      link
      fedilink
      arrow-up
      6
      ·
      9 days ago

      FWIW, Axios has been writing articles in that style for years, well before the rise of LLMs. This article may well have been penned by an LLM, but the presence of a Why it matters second isn’t as much of a smoking gun as it might seem.

    • Kurtismayfield@lemmy.zip
      link
      fedilink
      arrow-up
      10
      ·
      9 days ago

      And they will face zero consequences.

      It seems the “information wants to be free” crowd was right. It will be free, as l9ng as you are AI. Because it seems they are allowed to legally and illegally take any information they want. Its been real eye opening how fast IP and security has been tossed away for AI to get their hands on all information it can.

      • freely1333@reddthat.com
        link
        fedilink
        English
        arrow-up
        6
        ·
        9 days ago

        If you steal data with ai you will certainly be prosecuted. It’s not an ai thing it’s a caste thing.

    • shalafi@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      9 days ago

      States can charge for information collation sometimes. I guess. Always hated that shit. Our taxes paid for that data, everyone should have free access.

  • bthest@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    1
    ·
    edit-2
    9 days ago

    “Anthropic says…”

    lol okay.

    “…investors! Look! Look! We can even rig elections for you! I swear to AI God that this is real. You’ll make a billion dollars every minute, no actually you’ll make a trillion dollars every second! Soon! Just give us one more cash injection! Just one more!”

  • humanspiral@lemmy.ca
    link
    fedilink
    arrow-up
    10
    arrow-down
    1
    ·
    9 days ago

    Was this Anthropic’s “testing” or someone using Claude? Anthropic is adding more and more refusal logic. REA a blanket refusal announced over weekend.