Playground for Docker / K8s

FlorinMarian

Hello!
Since in my career the next stage is to do the management of some k8s clusters, not only DevOps for the hosted applications, I wanted to ask you, if any of you have played or intend to do it with at least 3 nodes (one master and two workers) and how much/where you paid.
Obviously, I will most likely play on the HAZI.ro infrastructure, thus creating ansible roles from 0 for cluster management (from installation to security patches), but I do not rule out offering this installation for free to my customers who buy the minimum number of servers required (probably with a generous offer, since it is a bundle) to simulate a "production ready" environment, even if it is not in reality due to the fact that we have only one AZ.
I'm making this topic because I'm not convinced if I'm the only one who has this passion in my blood for the latest trends related to infra or if there are others like me who didn't have the courage to take steps in this direction.

yoursunny

Mentally strong people use plain Docker Compose.
So-called cluster often breaks Ethernet traffic and sometimes forces NAT, not good.

Val

I would recommend at least three master, you can do a setup where each of the master are also workers.
OVH/Vultr and a few other providers usually offer the control plane. To offer that freely, they usually run the control plane software inside of another k8s cluster where all of their customers' master are themselves containerized, and the dedicated worker nodes connects to these pods on the other cluster.

FlorinMarian

@Val said:
I would recommend at least three master, you can do a setup where each of the master are also workers.
OVH/Vultr and a few other providers usually offer the control plane. To offer that freely, they usually run the control plane software inside of another k8s cluster where all of their customers' master are themselves containerized, and the dedicated worker nodes connects to these pods on the other cluster.

Thanks for feedback!
What about costs on OVH/other solutions you found?

Val

@FlorinMarian said:

@Val said:
I would recommend at least three master, you can do a setup where each of the master are also workers.
OVH/Vultr and a few other providers usually offer the control plane. To offer that freely, they usually run the control plane software inside of another k8s cluster where all of their customers' master are themselves containerized, and the dedicated worker nodes connects to these pods on the other cluster.

Thanks for feedback!
What about costs on OVH/other solutions you found?

The price of managed k8s is usually just the usual price of the underlying VPS (+ storage, traffic...), excluding masters which is frequently free.
But be careful, offering a managed k8s is not just about 3 VPS with k8s running on it. You need to support provisioning of volumes (StorageClass), creating Load Balancers...

Peppery9

I have a couple of OpenShift clusters - one running on Kimsufis as cheaply as possible, the other at home. The Kimsufi one is a 3 control plane cluster, running workloads on the control plane.

Managed offerings are usually tightly integrated with other cloud services, like load balancing, cluster autoscaling, storage, etc. Upgrading can be a bit more involved than the normal "apt upgrade -y".

If you're wanting to learn, k3s is a great option for setting up a multi-node cluster in minutes on low end boxes. @vitobotta has a great tool to run it on Hetzner

vitobotta

Thanks @Peppery9. @FlorinMarian if you end up trying it let me know if you run into any issues. Happy to help

Otus9051

@yoursunny said:
Mentally strong people use plain Docker Compose.
So-called cluster often breaks Ethernet traffic and sometimes forces NAT, not good.

mentally fucked people use lxc

nezam05

mentally fucked people use lxc

What's wrong with lxc?