Welcome • User Guide
ToS • Privacy • Canary
Donate • Bugs • License

©2025 Poal.co

1.2K

I was on a ham radio net recently and the topic of AI came up. The other operator I was talking with convinced me to download Ollama (Meta, yuck) to at least play and see how it works.

Supposedly there are versions of Meta's Ollama that aren't woke or at least are more politically incorrect, but I didn't have the 500GB space on the VM I was working with, yet...

But before I move into building and deploying some massive AI into a VM, are there any recommendations for a better non-Facebook AI?

I was on a ham radio net recently and the topic of AI came up. The other operator I was talking with convinced me to download Ollama (Meta, yuck) to at least play and see how it works. Supposedly there are versions of Meta's Ollama that aren't woke or at least are more politically incorrect, but I didn't have the 500GB space on the VM I was working with, yet... But before I move into building and deploying some massive AI into a VM, are there any recommendations for a better non-Facebook AI?

(post is archived)

You are currently inside a comment thread.
Click here to see all the comments (20).
[–] • 2 pts (edited )

I run Arch and in this case completely headless. It's running an i7-12700, RTX 3060 and a Tesla P40. I don't have a lot of memory in it because I just tossed in what I had laying around which is 32GB. The M.2 in there isn't huge either, but I have what is essentially a NAS that I store anything I don't want to lose on, so space isn't really a big deal.

Ollama was smart and I didn't need to do any kind of special SLI set up or physically link the cards. It just uses them both, filling the memory on the first card (in my case the Tesla) and then using the second card as needed. I've forwarded a port via ssh so that I can use novelcrafter on my laptop or desktop and have it access the local LLM.

I'm hoping to get some fine-tuning done soon since what I want to use it for is quite specific. That reminds me that I came across a model on huggingface I need to see if I can get running well in ollama locally. I use Gemini and Claude (both online) a lot, though Claude is limited in queries. I don't like the censorship and moralizing on them and it's quite funny to see from update to update the behavior changes.

I'm hoping to get a completely uncensored one up and running, but tagging my data is brutal and I've been trying to script that out using ML, but I'm no coder, so it's slow going. I'm having to pick up python as I go.

[–] • 0 pt

Thats awesome, thanks for the details! Are you at liberty to tell what you use it for? Again, just curious. I am totally new to all of it but want to learn more.

[–] • 1 pt

I'm an audiobook narrator and work has dried up. It's just Indian scammers or people asking for extremely complex stuff and paying very little per finished hour - down to where it would 10-20$ per hour for the time I put in. I'm not a writer by any stretch but an avid reader. I read hundreds of books a year, so I am hoping to use the AI and guide it to write books that I'd enjoy reading and then I can put them up on amazon as text and audiobooks.

[–] • 0 pt

That's fantastic - I hope it is successful for you! Thanks again for the info...