I wouldn't call it rampant consumerism. People are running 70b models at 3+ t/s on 4090s.
I wouldn't call it rampant consumerism. People are running 70b models at 3+ t/s on 4090s.
How many 4090 owners do you honestly think are using it for non-gaming purposes?
How many 4090 owners do you honestly think are using it for non-gaming purposes?
Enough to run the price up. I heard 50% of the latest ycombinator class was doing AI.
Enough to run the price up. I heard 50% of the latest ycombinator class was doing AI.
(post is archived)