Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Sign In Register

Quick Links


Categories

In this Discussion

› › Horrible upload performance with virtio and Kernel 4.19.
New on LowEndTalk? Please Register and read our Community Rules.

Horrible upload performance with virtio and Kernel 4.19.

edfoxedfox Member
in Help

Hello,
I'm having some issues with a fresh install of Debian 10.
Out of the box, the network performance is quite horrible. I'm on a KVM host and using virtio as driver.

Windows Server 2019 and Debian 9 can reach speeds up to 1000/100mbit, but Debian 10 seems like the upload is capped to exactly 4.01mbit/s.

On subsequent tests i get 3.76, 3.9, 3.1, 2.9, 3.81 and a lot of times exactly 4.01mbps.
If i look at the network graph i can see that while the download has a steady curve, upload starts with a spike and then goes down completely and dies until the speedtest expires.

What could it be? I tryed asking everywhere but i really can't find anything around about this issue...

Comments

  • TheLinuxBugTheLinuxBug Member
    edited July 2019

    Did you update sysctl settings for the network? The default in 10 may be different than the previous versions. This would be the first thing I would check.

    maybe something like:

    net.ipv4.tcp_max_tw_buckets=400000
net.ipv4.tcp_tw_reuse=1
net.core.netdev_max_backlog=20480
net.ipv4.tcp_rmem = 4096 25165824 25165824
net.core.rmem_max = 25165824
net.core.rmem_default = 25165824
net.ipv4.tcp_wmem = 4096 65536 25165824
net.core.wmem_max = 25165824
net.core.wmem_default = 65536
net.core.optmem_max = 25165824

    Cheers!

    Thanked by 1vimalware
  • AzenotAzenot Member
    edited July 2019

    I have the same problem. Php-friends, Debian 10.

    Testing from PHP-Friends GmbH (2.59.xxx.xxx)...
Retrieving speedtest.net server list...
Retrieving information for the selected server...
Hosted by LeaseWeb (Haarlem) [354.17 km]: 24.756 ms
Testing download speed................................................................................
Download: 577.89 Mbit/s
Testing upload speed.....................................................................................................
.Upload: 4.15 Mbit/s
  • edfoxedfox Member

    @Azenot said:
    I have the same problem. Php-friends, Debian 10.

    Did you try with another os? Does it work that way?

  • AzenotAzenot Member

    @TheLinuxBug said:
    Did you update sysctl settings for the network? The default in 10 may be different than the previous versions. This would be the first thing I would check.

    maybe something like:

    > net.ipv4.tcp_max_tw_buckets=400000
> net.ipv4.tcp_tw_reuse=1
> net.core.netdev_max_backlog=20480
> net.ipv4.tcp_rmem = 4096 25165824 25165824
> net.core.rmem_max = 25165824
> net.core.rmem_default = 25165824
> net.ipv4.tcp_wmem = 4096 65536 25165824
> net.core.wmem_max = 25165824
> net.core.wmem_default = 65536
> net.core.optmem_max = 25165824
>

    Cheers!

    It's fresh install. What you mean?

  • AzenotAzenot Member

    @edfox said:

    @Azenot said:
    I have the same problem. Php-friends, Debian 10.

    Did you try with another os? Does it work that way?

    Didn't try. I don't have the opportunity, server already used for production.

  • edfoxedfox Member

    @TheLinuxBug said:
    Did you update sysctl settings for the network? The default in 10 may be different than the previous versions. This would be the first thing I would check.

    Cheers!

    Nope. Still exactly 4.01mbit of upload. (I've added those lines to /etc/sysctl.d/99-sysctl.conf, that's how it works, right?)

  • TheLinuxBugTheLinuxBug Member

    edfox said: Nope. Still exactly 4.01mbit of upload. (I've added those lines to /etc/sysctl.d/99-sysctl.conf, that's how it works, right?)

    Usually /etc/sysctl.conf and then you run 'sysctl -p' to apply them.

    Cheers!

  • edfoxedfox Member

    @TheLinuxBug said:

    Usually /etc/sysctl.conf and then you run 'sysctl -p' to apply them.

    Nope. Still stuck at 4.01 :(

  • TheLinuxBugTheLinuxBug Member

    edfox said: Nope. Still stuck at 4.01

    Hmm, are you installing from a template or ISO? If ISO I am interested in testing this my self, let me know and I will spin up a quick VM and see if I can replicate the issue.

    Cheers!

    Thanked by 1vimalware
  • ofitofit Member

    @Azenot said:
    I have the same problem. Php-friends, Debian 10.

    > Testing from PHP-Friends GmbH (2.59.xxx.xxx)...
> Retrieving speedtest.net server list...
> Retrieving information for the selected server...
> Hosted by LeaseWeb (Haarlem) [354.17 km]: 24.756 ms
> Testing download speed................................................................................
> Download: 577.89 Mbit/s
> Testing upload speed.....................................................................................................
> .Upload: 4.15 Mbit/s
>

    this is bug of speedtest not debian. I have the same on ubuntu 18.04

    Thanked by 3Azenot miniswift vimalware
  • FranciscoFrancisco Member, Top Host, Host Rep

    I've had the same on ubuntu 18.04.

    Francisco

  • edfoxedfox Member

    @TheLinuxBug said:

    edfox said: Nope. Still stuck at 4.01

    Hmm, are you installing from a template or ISO? If ISO I am interested in testing this my self, let me know and I will spin up a quick VM and see if I can replicate the issue.

    Happening to me both by installing using Debian 10 netinstall, but also by upgrading a Debian 9 template to kernel 4.19

  • dedotatedwamdedotatedwam Member

    Same here. Ubuntu 18.04

  • edfoxedfox Member

    @ofit said:

    this is bug of speedtest not debian. I have the same on ubuntu 18.04

    You may be right. Getting much higher speeds with iperf3.

    Thanked by 1vimalware
  • AzenotAzenot Member
    edited July 2019

    @ofit said:

    @Azenot said:
    I have the same problem. Php-friends, Debian 10.

    > > Testing from PHP-Friends GmbH (2.59.xxx.xxx)...
> > Retrieving speedtest.net server list...
> > Retrieving information for the selected server...
> > Hosted by LeaseWeb (Haarlem) [354.17 km]: 24.756 ms
> > Testing download speed................................................................................
> > Download: 577.89 Mbit/s
> > Testing upload speed.....................................................................................................
> > .Upload: 4.15 Mbit/s
> >

    this is bug of speedtest not debian. I have the same on ubuntu 18.04

    Yes you are right. In any other case i can use full 1 Gbit/sec.

  • TheLinuxBugTheLinuxBug Member

    Azenot said: Yes you are right. In any other case i can use full 1 Gbit/sec.

    If that is true then a library the speedtest is using is causing the slow down.

    I am in the middle of spinning up a VM on my dev box to see if I can replicate any other network issues, are they only limited to the speedtest-cli, is that the overall consensus here?

    Will report my findings as well.

    Cheers!

  • TheLinuxBugTheLinuxBug Member
    edited July 2019

    Hmmm...

    I can't replicate this issue with speedtest-cli my self:

     ./speedtest.py
Retrieving speedtest.net configuration...
Testing from Hetzner Online GmbH (176.9.x.xx)...
Retrieving speedtest.net server list...
Selecting best server based on ping...
Hosted by goetel GmbH (Göttingen) [39.90 km]: 14.275 ms
Testing download speed................................................................................
Download: 571.11 Mbit/s
Testing upload speed................................................................................................
Upload: 606.18 Mbit/s

    Linux debian10 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) x86_64 GNU/Linux

    It seems I don't see that same limitation you guys were seeing.

    Cheers!

  • AzenotAzenot Member
    edited July 2019

    @TheLinuxBug said:
    Hmmm...

    I can't replicate this issue with speedtest-cli my self:

    >  ./speedtest.py
> Retrieving speedtest.net configuration...
> Testing from Hetzner Online GmbH (176.9.x.xx)...
> Retrieving speedtest.net server list...
> Selecting best server based on ping...
> Hosted by goetel GmbH (Göttingen) [39.90 km]: 14.275 ms
> Testing download speed................................................................................
> Download: 571.11 Mbit/s
> Testing upload speed................................................................................................
> Upload: 606.18 Mbit/s
>

    Linux debian10 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) x86_64 GNU/Linux

    It seems I don't see that same limitation you guys were seeing.

    Cheers!

    set the destination server from any other country, not germany. https://c.speedtest.net/speedtest-servers-static.php
    For example:

    speedtest-cli --server 3587
  • TheLinuxBugTheLinuxBug Member
    edited July 2019

    Azenot said: et destination server in any other country, not germany. https://c.speedtest.net/speedtest-servers-static.php
    For example:
    speedtest-cli --server 3587

    speedtest-cli# ./speedtest.py --server 3587
Retrieving speedtest.net configuration...
Testing from Hetzner Online GmbH (176.9.xx.xx)...
Retrieving speedtest.net server list...
Retrieving information for the selected server...
Hosted by LeaseWeb (Haarlem) [354.17 km]: 19.256 ms
Testing download speed................................................................................
Download: 530.80 Mbit/s
Testing upload speed................................................................................................
Upload: 655.19 Mbit/s

    It may have to do with MTU settings or something in your case for more distant servers, however, I don't seems to replicate that here still, even specifying a different server.

    I believe it that some are running into this, however, I just can't seem to replicate it here.

    Cheers!

  • hyperblasthyperblast Member

    same here. speedtest-cli mostly upload 4.xx Mbit/s.

  • TheLinuxBugTheLinuxBug Member
    edited July 2019

    Ohhh, I see the difference in my test VS the others in here. I cloned the git repo and ran the version from there, my guess is a bunch of you used 'apt-get install speedtest-cli' and the version installed from the repo does seem to be broken and work as you reported:

    speedtest-cli --server 3587
Retrieving speedtest.net configuration...
Testing from Hetzner Online GmbH (176.9.xx.xx)...
Retrieving speedtest.net server list...
Retrieving information for the selected server...
Hosted by LeaseWeb (Haarlem) [354.17 km]: 20.358 ms
Testing download speed................................................................................
Download: 478.19 Mbit/s
Testing upload speed......................................................................................................
Upload: 4.15 Mbit/s

    However, if you clone the latest python version from github, it doesn't have this issue:

    git clone https://github.com/sivel/speedtest-cli.git
cd speedtest-cli
./speedtest.py --server 3587
Retrieving speedtest.net configuration...
Testing from Hetzner Online GmbH (176.9.xx.xx)...
Retrieving speedtest.net server list...
Retrieving information for the selected server...
Hosted by LeaseWeb (Haarlem) [354.17 km]: 19.256 ms
Testing download speed................................................................................
Download: 530.80 Mbit/s
Testing upload speed................................................................................................
Upload: 655.19 Mbit/s

This for example works without having that same problem.

    This has to do with the compiled version in the Debian repo having some issues it seems and maybe the libraries it is leveraging. So this isn't something specific to Debian 10 but to that specific package and the libraries it is compiled against, I would bet.

    Cheers!

    Thanked by 4dedotatedwam AlwaysSkint vimalware caracal
  • KousakaKousaka Member

    Same here on Debian 10, but only with speedtest-cli

  • levnodelevnode Member

    This is the bug of speedtest-cli which is already known on Ubuntu 18.04. try other test such as bench/nench.

Sign In or Register to comment.