New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
LET’S GO! RACKNERD BLACK FRIDAY 2026 IS LIVE: https://www.racknerd.com/BlackFriday/ ⚡
Time to double the bandwidth! Please and thank you!
8359245901
BTW, have you heard about Colibri? It streams from your SSD keeping only the important parts of the model in RAM. This way, I was able to run a 400+b model on 32GB RAM. Extremely slow though.
WHO'S SLEEPING? NOT ME, BABY! IT'S GIVEAWAY TIME!
yep quantization sucks, makes hallucinations more prevalent.
WHO'S SLEEPING? NOT ME, BABY! IT'S GIVEAWAY TIME!
WHO'S SLEEPING? NOT ME, BABY! IT'S ~MUG~ GIVEAWAY TIME!
I have been using GGUFs with llama. Do you think safete sors would be better?
WE'RE READY FOR MORE GIVEAWAYS! RACKNERD IS THE BEST.
GET DADEV A NEW COFFEE MUG!
Don't know, been sticking with vllm on the sparks
Not much, one of the issues with many is the hallucinations.
You can fix it a bit by writing a bunch of harness stuff and skills etc but it’s not a long term solution due to how trash it really is.
PLEASE HELP GET DADEV A NEW COFFEE MUG! (LIKE NOOB SAID LOL)
RESOURCE UPGRADE GIVEAWAY, YOU ARE MISSED!
Alright. I will try it later and let you guys know.
HAH! NEED MORE STORAGE FOR MY INSANE EBOOK COLLECTION!
Exactly. Crazy hallucination. Can work in batches and by crazy prompting, but it still hallucinates.
@op23 what do you do for work?
STORAGE UPGRADE PLEASE!
since last check, it has done a decent bit more work now at 1.42B total tokens XD
Time to double the bandwidth! Excited to try the San Jose location, please and thank you!
Order Number: 5094861468
6028907038
Time to double the bandwidth
LET’S GO! RACKNERD BLACK FRIDAY 2026 IS LIVE: https://www.racknerd.com/BlackFriday/ ⚡
5 million output tokens is equivalent to roughly 37 to 47 average-length novels. That's just in adversarial reviews and documentation reasoning XD but the docs its pumping out using my methods are kissed by chef level good
hehe, I used the credits on a few community projects but I don't need to renew them until like 2029/2030 now
Though, I do want some of those tasty upgrades and flash sales. While I would like the flash I sniped last year, in Chicago, LA is fine for a 2x Ryzen & 2.5G (includes a .5G ram upgrade) for like 13/yr.
NOICE!
I also pumped year ones credits into a vps and its gonna be around for a good while!
LET’S GO! RACKNERD BLACK FRIDAY 2026 IS LIVE: https://www.racknerd.com/BlackFriday/ ⚡
Me too. Got good amount of RN credits.