Lots of people told me that blockchains would take over once the blocks got bigger. Just needed a few years to improve the tech and then everyone would be storing everything on there and we'd solve the world's ills. Billions of dollars were pumped into that industry based on these early claims. The billions of dollars became a validator for others to invest, because no idiot would throw billions of dollars at an idea without expert knowledge that it was all going to work.
Genie 3 has a context window of 60 seconds, it just needs to be bigger and then there's no holding it back! We've gone from six fingered renders to photo real cats on skateboards with lasers. Victory is just around the corner.
Or it's not, it's fundamentally not, based on the current core of LLM. Most fixes to help improve things like context have been more money, more hardware, more compute. billions of dollars.
It's an arms race. Whoever gives up first loses, but who actually wins. Remember the push to get to the moon? For that window of time, money and profit were not in question, it was do anything to land man on the moon. Did it open up a new paradigm for humanity, did we establish bases and create new industries off world? No, once the battle was done, the money dried up and no one went to the moon any more because it just burned so much fucking money that it was unaffordable.
Getting to the moon did push some things forward, we gained some great tech from it. I have no doubt that we will from this AI push too, but the sheet amount of money being burned now is insane. The cost of rendering some slop GTA VI mock up is unsustainable. Little Timmy is not running this on his console unless he wants to bankrupt his parents over a weekend gaming session.
No one cares about affordability or optimization right now, because they're just building bigger rockets to be the first to get to the moon. We could have left the solar system by now using something like Project Orion, maybe it would have been great, but the return probably wouldn't be worth it apart from to say we did it.
We're burning cycles on AI generated slop right now just to say we did it.