Not sure what kind of local ai workload you do or need, but fuck my ryzen 9 7840h (think thats right) is doing qwen fine, its almost conversational, the reply starts quick....the "typing" could be faster, but its very workable. And by that I have no GPU.
I do a lot of experimenting. Different models, agents, tools, etc. Having the power to do it quickly makes it more interesting and burns less of my time.
Fair. Did you load up claudebot, clawbot? I was looking to do it on an isolated host and play with it, get a foot hold into molt social thing, just summarizing, I forgot the names as I ain't dug far enough.....then I read the most downloaded skill has malware. lulz. After hearing about building a skill to take my news interests, do some general research to add color, then compile that into a 30 min podcast, to deliver to me so I could listen while I drive/work on a daily basis is something that I think is a cool idea.
Fuck, how about a daily PoalCAST, summarized the conversations, maybe a weekend special, all the tops shit for the week. That would be shit hot to me.
But I don't have time to fuck with it, for sure when the attack surface is so great with the access it needs on a machine. I am not ready to give any AI any of my logins to anything.
That would likely be a TOS violation anyway, but it could be done with other sites and some specific x profiles, and then be a curated news aggregator to podcast.....personally that would (fuck hit post) back now, be useful for me.
I have not messed with claw. I have been seeing so much stupid with it I figured I would let it sit for a while. Seems like that is a good decision. I know several people that mess with this too so we kind of bounce things around with each other. I am pretty happy I didn't mess with that even though it would be in a sandbox. Seems kind of fucked from a security view.