New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Comments
I just have an EU Account
ie is EU
Looking for a KS-MYSTERY with 2x4T HDD or similar in SGB or GRA. Underlying specs don’t matter much to me, just the storage does. Must be transferable to CA account.
Oh, I didn’t know that. I thought ie was like ca
Thanks!
Also, looking for KS-MYSTERY with 2x450 (or greater SSD), and 2x 4TB in Europe that can be transferred to CA account.
llama-bench on AMD EPYC 7351P for Gemma3 12b qat version here
Did anyone got Xeon E-2288G, 128GB in GRA? Seems that the best upgrade in GRA was Xeon with 64GB or am I wrong?
https://lowendtalk.com/discussion/comment/4382266#Comment_4382266
Here is one, the best lottery from E-2288G that we had was 64gb 2x 960nvme + 2x 6TB
Xeon G
KS-LE-B
Thanks for running this! I’ve been curious how they would perform on such bench, especially when compared to the differences in single-core performance
MYSTERY E5, up to 3 tokens better than KS-LE-B but mostly on par.
So rather keep the KS-LE_B for LLM's.
No problem.
what config do you have on your KS LE-B?
I benched on the E3-1270 v6 @ 3.80GHz with 64gigs
This config will struggle with LLMs right?
Intel Xeon E3-1245v5 - 4c/8t - 3.5 GHz/3.9 GHz - 32GB
No idea, guess depends on the model and the size.
Quantization if any, I tried Qwen 2.5 32b on the Xeon G with 4 bit quantization, it does struggle quite a bit.
I ran a few models on this setup with Ollama including Deepseek V3 and R1, Llama 3.3, phi 3, Gemma 3. They worked but were SLOOOOOOWWWW.
Any CPU only LLM will be really slow. You need fast processing and even faster memory. Only the tiniest models output fast enough but at that point it's waste of dedicated machine and you're better off remting DDR5 Ryzen or Epyc VPS with just couple gigs of RAM.
Absolutely. Was just messing around with a spare machine I had to figure stuff out.
I asked refund from OVH and the support asked me to cancel the service by hand and reply to their message.
Is this a new policy? I knew that OVH cancel the server too in case of refund request.
I asked for a refund cos one of my KS-MYSTERYs got delivered with 32GB Ram. They offered me a transfer of the time remaining on the problem server to one of my other KS-MYSTERYS. I had to manually cancel it myself.
I've had both happen, either I have to cancel it myself or they cancel it for me. Seems a bit inconsistent but it's not a big deal either way imo
Not sure if is in GRA, but some people got E-2288G + 128G + 2x1.92T NVME
I'm giving away my KS-C server in GRA2. It's paid until May 1st, but has a commitment ending on July 1st, 2025. Feel free to DM me if you're interested. EU account.
Considering transferring it?
Already done traded it for a 2288G
Looking for some servers $$$
I mean the model he used for the benchmark:
https://huggingface.co/google/gemma-3-12b-it-qat-q4_0-gguf
Is actually usable, up to 25t/s, not bad for 12b, on a 5 year old CPU.
A couple of gig's won't cut it, you likely need at least 16 or 32gig, to test any model that would be to slow to be run on these dedi's.
Not sure at this point, if a VDS Ryzen with 32gig would be cheaper than this Dedi and then the question would be, how fast it would be.
I should try the unsloth models on the MYSTERY boxes.