Something interesting about their card lineup for this is that they dropped NVLink support on the 4090. Now, I don't think NVLink was ever terribly popular on consumer cards for gaming, but it is quite useful for AI applications. If I got two 3090s and an NVLink bridge (total under $2000) then what I have is in some respects better than the workstation card for that generation (A6000, which costs $5000), I would have to split models (and NVLink makes this easier to manage since they have a dedicated communication lane through it) but I would have the same total VRAM and two cores that are the same as the A6000, and I can play games on it. But you can't do that as effectively on a 4090 now which is quite a suspicious thing to do in the middle of an explosion in popularity of CUDA usage on consumer PCs.
They are definitely focusing as much as they can on AI and data center cards at the expense of everything else. They have an effective monopoly on the field. A lot of large models can effectively only be trained on nvidia A100/H100 cores because they put a huge amount of HBM on them. The only real alternative is Google's TPU platform, but their best offering is only as fast as Ampere (last gen) and has only 32GB of HBM per core vs 80 for the A/H100s. As long as AMD's head is so thoroughly and completely stuck up their own ass, Nvidia is in a good position. Demand for chips for AI processing might wane, but that would be years off for sure, because right now there's more avenues of research than people can even fully investigate!
i hear nvidia has a bit of a ponzi scheme going on these days. A lot of AI investment is coming from NVIDIA and obviously those same companies need AI hardware from NVIDIA. I guess if the current AI/ML hype ends up actually working out NVIDIA will be in a pretty good spot, but if it turns out to be just another stop in the grift shift...man... rip nvidia unless they manage to nail an elusive third grift.
:yea: the bubble is bound to pop. llms are cool and all but the demand is bound to slow down.
The line went up for crypto mining and they cannot let it go back down
I found a YouTube link in your post. Here are links to the same video on alternative frontends that protect your privacy:
