Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Shells Virtual Desktop
BMail.ag - Secure Email Service
Server.net
CPLicense.net
VPS Server
Buy VPN
Vultr
VMs for AI
HostDare
ReliableSite White-Label Dedicated Hosting for Resellers
InterServer VPS
BMail.ag - Secure Email Service
Best VPN
High-Performance Bare Metal Server Solutions
Karvl.com
Server Mania Cloud Hosting
DataWagon Hosting
AlphaVPS Hosting
Evoxt.com
Clouvider
VPS Hosting with NVMe
Residential IPs in the US & 4G Mobile Proxies in EU & US with Unlimited Bandwidth
ReliableSite White-Label Dedicated Hosting for Resellers
Rabisu - Hosting Solutions
Shells Virtual Desktop
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

RTX 4060 (or similar)+Ryzen 7900 AIO Tower Server (Taking pre-orders) - HostCram LLC

ShakibShakib Member, Patron Provider

Hello Team,

As the title suggests, I plan to build a new GPU + CPU + AIO Liquid-Cooled 10 Gbps Tower server this year. Since we are running on Proxmox, I believe GPU passthrough for VPS will be straightforward.

Below are the specifications I’m currently taking pre-orders for, though I can also provide custom configurations:

Pre-order: GPU + Ryzen 7900 AIO VPS

• 4× Ryzen 9 7900 Core + GPU access
• 8 GB DDR5 RAM
• 80 GB NVMe Storage
• 40 TB Bandwidth @ 10 Gbps Port
• 1 Dedicated IPv4

Order here: https://my.hostcram.com/order/main/packages/special-offers/

This is a pre-order only plan.

Expected delivery: March 2026

I already have 192 GB DDR5 RAM and a Ryzen 7900 CPU. Pre-order funds will be used to purchase the remaining parts required to complete the build.

One consideration: I’m still deciding which GPU to use. I can allocate a maximum of 120W for the GPU. I’d appreciate your input and ideas. <3

  • Shakib
Thanked by 2gsea4 JerryHou
«13

Comments

  • Good offers

    Thanked by 1Shakib
  • How can a server’s GPU be shared, and are there any limitations?

  • AstroAstro Member

    @hayuri said: How can a server’s GPU be shared, and are there any limitations?

    Yeah I am curious about this as well

    Thanked by 2Shakib lowenddude
  • Could you provide more details regarding GPU access?

    Thanked by 1Shakib
  • ShakibShakib Member, Patron Provider

    @hayuri said:
    How can a server’s GPU be shared, and are there any limitations?

    This VM would be good for light GPU needs.

    I will have to do a lot of experiments before making it production ready.

    Thanked by 1hayuri
  • ShakibShakib Member, Patron Provider

    @hayuri said:
    Could you provide more details regarding GPU access?

    Can't confirm anything until I do testing.

    Thanked by 1hayuri
  • @Shakib said:

    @hayuri said:
    Could you provide more details regarding GPU access?

    Can't confirm anything until I do testing.

    I’m excited to see what interesting products HostCram may offer in 2026.

    Thanked by 1Shakib
  • DataWagonDataWagon Member, Patron Provider
    edited January 11

    The GPU can only be passed through to one VM.

  • SaahibSaahib Host Rep, Veteran
  • ShakibShakib Member, Patron Provider

    @DataWagon said:
    The GPU can only be passed through to one VM.

    I know that.

    Looking into alternative solution.

  • What location is the vps in?

    Thanked by 1Shakib
  • oomeroomer Member

    I don't think the 4060 can masquerade as a supported gpu, thus would be blocked from running vgpu. I have a 2080 Ti at Fiberstate on an AMD 5700G dedi running Proxmox and it runs great for passthrough for gaming and Blender to multiple win11 vm's. I just bought an Intel Arc B50 to try an out-of-the-box support for vgpu. I also have a 7950x dedi with a 4060TI and I can pass it to one VM OR attach it to the host and pass it to lxc's only since the lxc is sharing the kernel.

    Thanked by 1Shakib
  • DataWagonDataWagon Member, Patron Provider

    @Shakib said:

    @DataWagon said:
    The GPU can only be passed through to one VM.

    I know that.

    Looking into alternative solution.

    There aren’t really any good alternatives. You kind of need one of the enterprise cards that support vGPU. Nvidia purposely makes it hard to share GPU across VMs on the consumer cards.

  • ShakibShakib Member, Patron Provider

    @DataWagon said:

    @Shakib said:

    @DataWagon said:
    The GPU can only be passed through to one VM.

    I know that.

    Looking into alternative solution.

    There aren’t really any good alternatives. You kind of need one of the enterprise cards that support vGPU. Nvidia purposely makes it hard to share GPU across VMs on the consumer cards.

    A2000 or A4000 will work right?

  • @Shakib said:

    @DataWagon said:

    @Shakib said:

    @DataWagon said:
    The GPU can only be passed through to one VM.

    I know that.

    Looking into alternative solution.

    There aren’t really any good alternatives. You kind of need one of the enterprise cards that support vGPU. Nvidia purposely makes it hard to share GPU across VMs on the consumer cards.

    A2000 or A4000 will work right?

    https://docs.nvidia.com/vgpu/latest/grid-vgpu-release-notes-generic-linux-kvm/index.html#hardware-configuration
    Supported GPUs!

    Thanked by 1Shakib
  • AlexBarakovAlexBarakov Patron Provider, Veteran

    @Shakib said:

    @DataWagon said:

    @Shakib said:

    @DataWagon said:
    The GPU can only be passed through to one VM.

    I know that.

    Looking into alternative solution.

    There aren’t really any good alternatives. You kind of need one of the enterprise cards that support vGPU. Nvidia purposely makes it hard to share GPU across VMs on the consumer cards.

    A2000 or A4000 will work right?

    Nope. You also need a license. If it made sense, everyone would have done it already.

  • ShakibShakib Member, Patron Provider

    @AlexBarakov said:

    @Shakib said:

    @DataWagon said:

    @Shakib said:

    @DataWagon said:
    The GPU can only be passed through to one VM.

    I know that.

    Looking into alternative solution.

    There aren’t really any good alternatives. You kind of need one of the enterprise cards that support vGPU. Nvidia purposely makes it hard to share GPU across VMs on the consumer cards.

    A2000 or A4000 will work right?

    Nope. You also need a license. If it made sense, everyone would have done it already.

    It seems that I can bypass drivers with 20 series cards but I don't want to do that.

  • mawsmaws Member

    If you are selling these and have US presence that can be legally risky don't forget DC use is not permitted for RTX cards

    Thanked by 1Shakib
  • Do you have a Windows server with my own license option I only saw that Linux is available.

    Thanked by 1Shakib
  • ShakibShakib Member, Patron Provider

    @monjur46 said:
    Do you have a Windows server with my own license option I only saw that Linux is available.

    Yes

  • ShakibShakib Member, Patron Provider

    @Ruriko said:
    What location is the vps in?

    Salt Lake City, USA

  • taizitaizi Member

    @Shakib said:

    @AlexBarakov said:

    @Shakib said:

    @DataWagon said:

    @Shakib said:

    @DataWagon said:
    The GPU can only be passed through to one VM.

    I know that.

    Looking into alternative solution.

    There aren’t really any good alternatives. You kind of need one of the enterprise cards that support vGPU. Nvidia purposely makes it hard to share GPU across VMs on the consumer cards.

    A2000 or A4000 will work right?

    Nope. You also need a license. If it made sense, everyone would have done it already.

    It seems that I can bypass drivers with 20 series cards but I don't want to do that.

    some chinese already do with 40 series

    Thanked by 1Shakib
  • ShakibShakib Member, Patron Provider

    It seems Intel Arc Pro B50 vGPU is free to use.

  • ShakibShakib Member, Patron Provider

    The Intel Arc Pro B50 in Proxmox enables cost-effective Virtual Desktop Infrastructure (VDI) via SR-IOV (Single Root I/O Virtualization), allowing one GPU to be sliced for multiple VMs, offering GPU acceleration for virtual desktops. Setting it up involves specific kernels (like a patched 6.17) and drivers, tackling challenges like AppArmor and initial driver instability, but it provides excellent GPU performance for virtual environments, albeit with some early-stage complexities and potential for performance variance between slices.
    Key Concepts:
    Intel Arc Pro B50: A professional GPU with 16GB VRAM, designed for enterprise use, including VDI and AI, offering strong performance compared to Nvidia's A1000.
    SR-IOV: A hardware feature that lets a single physical PCIe device (like the B50) appear as multiple virtual functions (VFs) to different virtual machines, effectively slicing the GPU.
    Proxmox VE: A virtualization platform that supports SR-IOV, allowing you to pass these GPU slices to VMs for hardware acceleration.
    How it Works (Simplified):
    Physical Installation: Install the B50 in your Proxmox server.
    Kernel & Drivers: Use a Proxmox kernel with SR-IOV support (often requires custom patching for older kernels like Proxmox 9) and load the VFIO drivers.
    Enable SR-IOV: Configure the host to create multiple Virtual Functions (VFs) from the B50's Physical Function (PF).
    Assign to VMs: Pass these VFs to your guest VMs (e.g., Windows, Linux) for tasks like 3D rendering, video editing, or AI inference.
    Pros & Cons for Proxmox:
    Pros:
    Cost-Effective: Slices a single GPU for multiple users, reducing hardware needs.
    Performance: Delivers excellent GPU acceleration for virtual desktops, vastly improving 3D performance over CPU-based rendering.
    Open-Source Focus: Aligns with open-source VDI goals.
    Cons:
    Early Adoption: Still considered an early-stage implementation with potential bugs (like AppArmor issues or driver quirks).
    Complexity: Requires specific kernel patches and configurations, not a simple plug-and-play setup.
    Monitoring: GPU usage within VMs isn't easily monitored yet.
    Resources:
    Level1Techs Forums: Great for detailed guides and community experiences with the B50 and Proxmox.
    Proxmox Support Forum: Discussions on specific issues and configurations.

    Thanked by 1yoursunny
  • ShakibShakib Member, Patron Provider

    So I can actually do it?

  • edited January 12

    I can understand taking pre-orders for hardware-to-be-delivered but before even that is finalized and software is in the air, that is certainly a decision.

  • ShakibShakib Member, Patron Provider

    @CyberneticTitan said:
    I can understand taking pre-orders for hardware-to-be-delivered but before even that is finalized and software is in the air, that is certainly a decision.

    Not my first time. :)

    Btw, I didn't start taking pre-orders yet.

  • ShakibShakib Member, Patron Provider

    Arc Pro B50+Gen 5 NVMe RAID1

    Might do more storage as well.

  • The b60 would probably be better, but a pure calculator seems like an unnecessary extravagance: 16/20 cores and 16/24 GB of memory for $350/$650, respectively.

    And there's another problem with the b60—it's practically impossible to find in the US.

    If you decide to buy one, you can find it at Central Computer and Tech America, and possibly at your system integrator.

    Thanked by 1Shakib
  • oomeroomer Member

    I got a B50 at https://www.bhphotovideo.com 2 weeks ago, but so far been unsuccessful with getting SRIOV working and sliced into virtual functions that I can pass to my VM's. Updating the firmware on a Win10 machine to see if that helps... My ancient Supermicro MB doesn't have resizable bar param so that be may a sticking point.

    Thanked by 1tronyx
Sign In or Register to comment.