Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Who's selling gpu containers?

2»

Comments

  • SolidVPSSolidVPS Member, Patron Provider
    edited September 2024

    @Levi its possible with AMD MX GPU

    "With AMD MxGPU, multiple Windows virtual machines (VMs) share an AMD GPU by making the GPU appear as multiple PCI passthrough devices. AMD MxGPU provides direct pass-through to a physical GPU, providing a user with unrestricted, dedicated access to a single GPU. AMD MxGPU is supported for Windows desktops only'

    If you need dedicated Isolated GPU, this is where we offer the Dedicated GPU and its powered by Nvidia Grid

  • jbilohjbiloh Administrator, Veteran

    Quick follow up to this thread. We're working on a new "VPS for AI Agents" page on LowEndBox, which will be launching soon.

    The goal is to highlight providers offering affordable VPS and compute solutions suitable for running AI agents, LLM workloads, automation frameworks, and related applications.

    If you're a provider with a relevant offering and would like to be considered for inclusion, please submit your offers through our helpdesk:

    https://services.lowendtalk.com

    We're particularly interested in competitive pricing, useful hardware specifications, and configurations that make sense for AI workloads. Both CPU based and GPU powered solutions are welcome.

    We'd love to feature a good mix of providers and help users discover affordable infrastructure for this growing market.

    There is no cost to be included.

    Thanked by 1tux
  • edited 6:14PM

    @jbiloh said: We are going to publish an article on LowEndBox soon about what providers in our community are offering gpu compute instances.

    On demand or reserved?

    In general I think it is quite difficult for lowend providers to compete in GPU space

    Edit: didn't see original pots was from 2024. Sorry, disregard!

  • @jbiloh said: Quick follow up to this thread. We're working on a new "VPS for AI Agents" page on LowEndBox, which will be launching soon.

    Neat, would love to see what lowend providers are offering sandbox solutions. Space is filling up so quickly e.g. Sailboxes, Boat, Agent37, Orble etc. but definitely room for sandboxes at lowend pricing!

  • jbilohjbiloh Administrator, Veteran

    @averagedatahoarder said:

    @jbiloh said: Quick follow up to this thread. We're working on a new "VPS for AI Agents" page on LowEndBox, which will be launching soon.

    Neat, would love to see what lowend providers are offering sandbox solutions. Space is filling up so quickly e.g. Sailboxes, Boat, Agent37, Orble etc. but definitely room for sandboxes at lowend pricing!

    We put this together ages ago: https://lowendbox.com/cheap-gpu-list-nvidia-gpus-for-ai-training-llm-models-and-more/

    What we are working on now, soon to be released, will be much better.

    Thanked by 1averagedatahoarder
  • @jbiloh said:
    Quick follow up to this thread. We're working on a new "VPS for AI Agents" page on LowEndBox, which will be launching soon.

    The goal is to highlight providers offering affordable VPS and compute solutions suitable for running AI agents, LLM workloads, automation frameworks, and related applications.

    If you're a provider with a relevant offering and would like to be considered for inclusion, please submit your offers through our helpdesk:

    https://services.lowendtalk.com

    We're particularly interested in competitive pricing, useful hardware specifications, and configurations that make sense for AI workloads. Both CPU based and GPU powered solutions are welcome.

    We'd love to feature a good mix of providers and help users discover affordable infrastructure for this growing market.

    There is no cost to be included.

    @computebox

  • tuxtux Veteran

    @jbiloh Can you also create similar list for AI compatible AMD and Intel GPU providers?

  • edited 6:33PM

    @jbiloh said:

    @averagedatahoarder said:

    @jbiloh said: Quick follow up to this thread. We're working on a new "VPS for AI Agents" page on LowEndBox, which will be launching soon.

    Neat, would love to see what lowend providers are offering sandbox solutions. Space is filling up so quickly e.g. Sailboxes, Boat, Agent37, Orble etc. but definitely room for sandboxes at lowend pricing!

    We put this together ages ago: https://lowendbox.com/cheap-gpu-list-nvidia-gpus-for-ai-training-llm-models-and-more/

    What we are working on now, soon to be released, will be much better.

    Not a list of providers but main things I look for for agent sandboxes (roughly sorted from most to least important) - just what I can think of off the top of my head will probably comment with more here:

    • Competitive pricing. I don't want to be paying Modal prices for a glorified Hetzner wrapper.
    • Pay per second billing, nobody wants hourly or monthly billing for this, otherwise just get a VPS
    • No charges for VM/sandbox starts! Many providers are charging for this, this is unacceptable.
    • Desktop environment so agents can control browser, etc. And a VM not a container! Firecracker is fine
    • Fast startup, <100ms ideally.
    • Some sort of persistence.
    • Tying in to persistence, being able to duplicate/fork VMs on the fly while they are still running, good for spinning up subagents rapidly.
    • Decently fast network, IPv4 support (yes some of these sandbox startups are IPv6 only, @yoursunny would be happy but I am sad.)

    If any providers can offer this would be very interested. Most of the features above are not that hard to implement with a bit of work, can probably be done in a week if you know what you are doing and have a few agents working alongside you.

Sign In or Register to comment.