New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
Good for experiment but not practical. 20$ subscription for Claude, Gpt or open router might worth way more than using LLM on KS-LE-6.
Basically, to get something usable like 30t/s you would need a GPU.
Maybe the 1bit quant would be faster but to much brain damage.
I just found this out by accident, I have expected speeds at about 4t/s but I didn't expect the tps to be stable.
6 hybrid
KS-LE-3 in stonks
It’s nice to see that you can get stable 3.5 tps on a LE-6.
Sure it’s no coding assistant but this doesn’t matter for overnight tasks. I could just throw something on it and come back next day to find what I needed. Perfect and I don’t need to give up a kidney to buy hardware to do the same.
I use a modified python script, with a one shoot prompt.
It keeps doing the task until it deems to be done.
It runs at a stable 3.6 to 3.8, at 60k context right now.
Currently I told it to clone a certain browser game.
https://stats.neoon.net/monitor/f453e94d2c671cadd6c7eba1cca35a0b
No dent in CPU usage more or less, perfection.