All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.
Cheapest set up for a Qwen 27b model
I need an ablated Qwen for regular penetration testing. I believe an ablated DS is unnecessary and that Qwen 27b should suffice.
I am now being mature enough to care about wasting money and time,and wonder whether to choose cloud-based options or build my own hardware, with cost as the main factor.
My usage need is about 4 hours per day.
For cloud services, I am considering RunPod or MeshLLM? (RunPod would run the model, and MeshLLM would use an API, but I dislike MeshLLM’s KYC policy, nor do I trust its owner, to be clear.)
Regarding hardware, many poor YouTubers and AI sources recommend a 3090, but I think I can achieve the same result with older hardware and skill, such as a P100 16GB (yes, I know AI sources say no).
I am not wealthy, and I am truly concerned about the best choice here; I would appreciate help.
Thanks to everyone for your long support on this forum, and I will see you in the comments for the BF soon anyway!
Naas
Comments
Check out the level1techs forums. Those guys love discussing janky-ass local AI builds.
Mac? The 64gb ones with m1. Maybe higher entry point but you might have better resell value so overall could end up cheaper
Thanks, will check that
True for most apple product so i take your advise, but man i hate apple