New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
AMD Ryzen 8600G dedicated servers for AI compute? good/bad?
Does anyone here do any AI compute with just the newer Ryzen with the integrated graphics?
Curious to see if anyone has any feedback on them and how well they work for smaller AI compute projects.
We are looking for a new CPU/build to roll out as a dedicated server and figured this might be a good choice.
Would this be a good useful for anyone doing smaller AI compute stuff?
CPU: AMD Ryzen 8600G
MEM: 64G DDR5
NVME: 1TB
Thanks
Oplink.net
Comments
@oplink
AMD Ryzen AI 9 365 is a much better option
Its a mobile CPU? Not sure I see anything for 1u servers for this CPU
We need something we can build with a 1U
@oplink
It will be interesting as a test project, if a project like this can be done on 8600g server
if you have a server, I can try.
https://community.amd.com/t5/ai/developer-blog-build-a-chatbot-with-ryzen-ai-processors/ba-p/680693
yes, mostly for high end laptops and small size desktops.
I don’t think it can be used for 1U server
I dont have one yet to play with.
Hardly any search results on LET if you search for 8600G.
Are most people renting servers to run AI compute to sell it back to try to make profit?
Or just for personal testing?
Interesting that the mobile CPU has a better integrated gpu
https://technical.city/en/cpu/Ryzen-5-8600G-vs-Ryzen-AI-9-365
Exactly and that is why Ryzen AI 9 365 is a much better option for building small AI projects.
Best Buy has this laptop for pre-order
https://www.bestbuy.com/site/asus-zenbook-s-16-16-3k-oled-touch-screen-laptop-amd-ryzen-ai-9-365-24gb-memory-1tb-ssd-scandinavian-white/6584435.p?skuId=6584435
The 880M is 12CU and will likely be within pitting distance of the 780M, which is in the 8700G.
The part to watch is the 16CU variant, 890M, although it probably won't hit desktop space until 2025.
But I think either of these parts are too weak for any reasonable "AI" usage, and the software support for XDNA is just not there.
A M2 Pro Mac Mini might be more compelling to developers tbh, much greater memory bandwidth.
If need asap, 8700G (doesn’t support ECC) or 8700GE (support ECC), both with 780m
If can wait, 9700G next year with 880m (0-30% faster than 780m, ASUS claims it’s 15% faster)