For those of you wanting to run local LLM's, this can be useful.
Archive: https://archive.today/yh5rT
From the post:
>How slopsome.com calculates VRAM requirements, tokens/sec estimates and model fit.
For those of you wanting to run local LLM's, this can be useful.
Archive: https://archive.today/yh5rT
From the post:
>>How slopsome.com calculates VRAM requirements, tokens/sec estimates and model fit.
Login or register