

24·
13 hours agoSelf-hosted LLMs are the way.
♻️
Self-hosted LLMs are the way.
NecessaryNecessity is the mother of invention
Are there any ETFs that I can put money into that short Tesla for mentally handicapped retail investors like me? For example, inverse REITs are an easy way to short the housing market.
mallablemalleable
Oof, ok, my apologies.
I am, admittedly, “GPU rich”; I have at ~48GB of VRAM at my disposal on my main workstation, and 24GB on my gaming rig. Thus, I am using Q8 and Q6_L quantized
GGUF
s.Naturally, my experience with the “fidelity” of my LLM models re: hallucinations would be better.