Figures when I'm actually thinking about replacing my 2080S this shit gets stupid expensive again.
I just pulled the trigger on a (AMD) RX 9070 XT to replace a old card. It should be good enough to last me at least 5+ years without another upgrade while allowing me to do some local-only AI workloads as well.
Not sure what kind of local ai workload you do or need, but fuck my ryzen 9 7840h (think thats right) is doing qwen fine, its almost conversational, the reply starts quick....the "typing" could be faster, but its very workable. And by that I have no GPU.
I do a lot of experimenting. Different models, agents, tools, etc. Having the power to do it quickly makes it more interesting and burns less of my time.
A good video card does usually last a long time.
Well, the nice thing is that even though it is replacing a old card, that old card can go into my homelab to be used for local-only AI workflows too so it still has a purpose. I try to reuse whatever I can until it falls apart or is so old/broken there is no point in using it anymore.