I just pulled the trigger on a (AMD) RX 9070 XT to replace a old card. It should be good enough to last me at least 5+ years without another upgrade while allowing me to do some local-only AI workloads as well.
Not sure what kind of local ai workload you do or need, but fuck my ryzen 9 7840h (think thats right) is doing qwen fine, its almost conversational, the reply starts quick....the "typing" could be faster, but its very workable. And by that I have no GPU.
I do a lot of experimenting. Different models, agents, tools, etc. Having the power to do it quickly makes it more interesting and burns less of my time.
Fair. Did you load up claudebot, clawbot? I was looking to do it on an isolated host and play with it, get a foot hold into molt social thing, just summarizing, I forgot the names as I ain't dug far enough.....then I read the most downloaded skill has malware. lulz. After hearing about building a skill to take my news interests, do some general research to add color, then compile that into a 30 min podcast, to deliver to me so I could listen while I drive/work on a daily basis is something that I think is a cool idea.
Fuck, how about a daily PoalCAST, summarized the conversations, maybe a weekend special, all the tops shit for the week. That would be shit hot to me.
But I don't have time to fuck with it, for sure when the attack surface is so great with the access it needs on a machine. I am not ready to give any AI any of my logins to anything.
That would likely be a TOS violation anyway, but it could be done with other sites and some specific x profiles, and then be a curated news aggregator to podcast.....personally that would (fuck hit post) back now, be useful for me.
A good video card does usually last a long time.
Well, the nice thing is that even though it is replacing a old card, that old card can go into my homelab to be used for local-only AI workflows too so it still has a purpose. I try to reuse whatever I can until it falls apart or is so old/broken there is no point in using it anymore.