MTGZone
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Lee Duna@lemmy.nz to Fuck AI@lemmy.worldEnglish · 3 months ago

Wikipedia is struggling with voracious AI bot crawlers

www.engadget.com

external-link
message-square
4
fedilink
2
external-link

Wikipedia is struggling with voracious AI bot crawlers

www.engadget.com

Lee Duna@lemmy.nz to Fuck AI@lemmy.worldEnglish · 3 months ago
message-square
4
fedilink
Wikimedia has seen a 50 percent increase in bandwidth used for downloading multimedia content since January 2024 due to AI crawlers taking its content to train generative AI models. It has to find a way to address the problem, because it could slow down actual readers' access to its pages and assets.
alert-triangle
You must log in or register to comment.
  • Admiral Patrick@dubvee.org
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    3 months ago

    Fuckin’ crawlers, man.

    There’s not even a reason to crawl Wikipedia. You can literally download dumps and feed them in, and those dumps are mirrored as to not DDoS Wikipedia itself.

    • The Quuuuuill@slrpnk.netM
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 months ago

      when you’re a moron ai tech bro with a hammer, everything looks like a nail

      also

      i think they want to ddos wikipedia. that way if we want info we have to ask their chat bots

  • Churbleyimyam@lemm.ee
    link
    fedilink
    arrow-up
    0
    ·
    3 months ago

    Is there an easy way to download Wikipedia for offline use and periodically update it? I realise it will be a lot of data.

    • teft@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      3 months ago

      https://en.wikipedia.org/wiki/Wikipedia:Database_download

Fuck AI@lemmy.world

fuck_ai@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !fuck_ai@lemmy.world

“We did it, Patrick! We made a technological breakthrough!”

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 915 users / day
  • 2.9K users / week
  • 6.62K users / month
  • 10.5K users / 6 months
  • 1 local subscriber
  • 3.14K subscribers
  • 587 Posts
  • 6.72K Comments
  • Modlog
  • mods:
  • VerbFlow@lemmy.world
  • MrMcGasion@lemmy.world
  • TootSweet@lemmy.world
  • BigMikeInAustin@lemmy.world
  • cynar@lemmy.world
  • themaninblack@lemmy.world
  • drmeanfeel@lemmy.world
  • pavnilschanda@lemmy.world
  • CriticalMedicine@lemmy.world
  • WonderfulWanderer@lemmy.world
  • Communist@lemmy.ml
  • eatCasserole@lemmy.world
  • SpaceNoodle@lemmy.world
  • NutWrench@lemmy.world
  • Soup@lemmy.cafe
  • iAvicenna@lemmy.world
  • Tinks@lemmy.world
  • wizblizz@lemmy.world
  • corus_kt@lemmy.world
  • Prandom_returns@lemm.ee
  • TrickDacy@lemmy.world
  • TheFriar@lemm.ee
  • Queen HawlSera@lemm.ee
  • andrew_bidlaw@sh.itjust.works
  • MeDuViNoX@sh.itjust.works
  • 33550336@lemmy.world
  • Nougat@fedia.io
  • Lost_My_Mind@lemmy.world
  • Sterile_Technique@lemmy.world
  • The Quuuuuill@slrpnk.net
  • Ogmios@sh.itjust.works
  • scratsearcher 🔍🔮📊🎲@sopuli.xyz
  • e8d79@discuss.tchncs.de
  • ThefuzzyFurryComrade@pawb.social
  • BE: 0.19.5
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org