New on LowEndTalk? Please Register and read our Community Rules.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
What would be the cost/month of 24GB VRAM GPU instance
Qwen 3.8 27b is launched, i see lot of people are sharing their views its near by the level of Opus 4.6 which is insane and size of the model can fit inside 24GB VRAM GPU (depends on Cuda cores tokens per second speed will differ).
If that's the case many will start renting them and run ai agents 24/7. What would be the cost of dedicated server along with 24GB VRAM per month ? 🤔
Thanked by 1mustafamw3
Comments
Speaking of it, I saw that @GorillaServers has this beast available.
AMD EPYC 7443P (24 Cores / 48 Threads)
128GB RAM
1.92TB Gen4 NVMe
4 x RTX 3090 GPU
1Gbps Unmetered Port
/29 IPv4
Datacenter - Ogden, Utah
$699/m
@servarica_hani offers the "Bee" VPS with a dedicated Nvidia Tesla P40 (24gb of VRAM) for CAD$110/month... but they're all out stock and I suspect they won't be restocked at that price anytime soon.