

Hardware limitations. A model that big would require millions of video cards, thousands of terabytes of storage, and hundreds of terabytes of ram.
This is also where AI ethics plays into whether such a model should exist in the first place. People are really scared of AI but they don’t know that ethics standards are being enforced at the top level.
Edit: get Elon Musk on the phone, he’s deranged enough to spend that much money on something like this while ignoring the ethical and moral implications /s
Later in the article
It is also worth looking at the graph later in the article, which shows that over the past 2k years the temperature has maintained a baseline, and post-industrial era it turned into a hockey stick.