Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!


Why RackNerd has lower packet loss than ColoCrossing and EthernetServers ???
New on LowEndTalk? Please Register and read our Community Rules.

All new Registrations are manually reviewed and approved, so a short delay after registration may occur before your account becomes active.

Why RackNerd has lower packet loss than ColoCrossing and EthernetServers ???

I ran ping over period of many hours got these results:

RackNerd (Ashburn) packet loss: 0.017% over 50+ hours
ColoCrossing (NY) packet loss: 7.22% over 8 hours. I re-ran tests and got similar numbers again. I raised a ticket with them and they said it's all fine.
EthernetServers (Frankfurt) packet loss: 1.5% over 4 hours.

I know RackNerd uses ColoCrossing datacenter so how is it even possible for RackNerd to have lower packet loss than ColoCrossing??

I am paying the $11/year plan for RackNerd and $12 for ColoCrossing and $15 for EthernetServers. So why do I get lower packet loss on the cheaper plan than the more expensive plan?

Why is packet loss from my (UK) location to RackNerd US location (0.017%) lower than to Frankfurt (1.5%), even though Frankfurt is closer to the UK?

I am extremely confused and would appreciate if anyone could explain.

Comments

  • kevindskevinds Member, LIR
    edited March 21

    @johnvmevpstorage said:
    I am extremely confused and would appreciate if anyone could explain.

    Different routing (transit) blend.

    They have/use different upstream companies.

    There are (usually) many providers in a data centre, a company can use any combination of them to connect to the internet.

    7.22% seems high to me.. Personally, I open tickets when it is above 1%.

  • You've discovered the power of bandwidth doubling

  • @kevinds said:

    @johnvmevpstorage said:
    I am extremely confused and would appreciate if anyone could explain.

    Different routing (transit) blend.

    They have/use different upstream companies.

    There are (usually) many providers in a data centre, a company can use any combination of them to connect to the internet.

    What kind of provider are you talking about? Do you mean the network e.g. NTT or Level 3/Twelve99?

  • kevindskevinds Member, LIR
    edited March 21

    @johnvmevpstorage said:
    What kind of provider are you talking about? Do you mean the network e.g. NTT or Level 3/Twelve99?

    Exactly. There are many of them and they can be mixed together in different ways.

    Thanked by 1johnvmevpstorage
  • @johnvmevpstorage said:
    I ran ping over period of many hours got these results:

    RackNerd (Ashburn) packet loss: 0.017% over 50+ hours
    ColoCrossing (NY) packet loss: 7.22% over 8 hours. I re-ran tests and got similar numbers again. I raised a ticket with them and they said it's all fine.
    EthernetServers (Frankfurt) packet loss: 1.5% over 4 hours.

    I know RackNerd uses ColoCrossing datacenter so how is it even possible for RackNerd to have lower packet loss than ColoCrossing??

    I am paying the $11/year plan for RackNerd and $12 for ColoCrossing and $15 for EthernetServers. So why do I get lower packet loss on the cheaper plan than the more expensive plan?

    Why is packet loss from my (UK) location to RackNerd US location (0.017%) lower than to Frankfurt (1.5%), even though Frankfurt is closer to the UK?

    I am extremely confused and would appreciate if anyone could explain.

    Can you post traceroutes for each? And yes you're comparing different networks, of course they perform differently.

  • kevindskevinds Member, LIR

    Also, what are you pinging?

  • edited March 21

    UPDATE: I ran mtr with -T option (TCP) and got 0.0% packet loss for colocrossing over 25,000 packets, whereas with UDP I got 6.1% packet loss over 25,000 packets so I'm inclined to think that twelve99 is randomly dropping UDP and ICMP packets while allowing TCP traffic.

    EDIT: I am an idiot. My mtr for UDP only contains first 7 hops. So I actually don't know the real packet loss rate for UDP. Here are the UDP mtr results:

    Start: 2024-03-21T19:32:00+0000
    HOST: my PC Loss% Snt Last Avg Best Wrst StDev
    1.|-- _gateway 90.0% 250 0.7 0.6 0.5 0.8 0.1
    ...[my ISP]...
    8.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    9.|-- ldn-b11-link.ip.twelve99.net 60.4% 250 5257. 63.7 2.9 5257. 528.9
    10.|-- ldn-bb2-link.ip.twelve99.net 94.0% 250 2602. 196.6 3.6 2602. 669.6
    11.|-- nyk-bb1-link.ip.twelve99.net 19.2% 250 74.6 74.0 72.7 79.7 0.8
    12.|-- buf-b2-link.ip.twelve99.net 0.0% 250 92.6 92.5 91.5 93.6 0.3
    13.|-- hostpapa-ic-xxxxxx.ip.twelve99-cust.net 49.2% 250 2847. 107.0 81.9 2847. 245.2
    14.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    15.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    16.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    17.|-- host.colocrossing.com 89.6% 250 93.2 95.4 92.0 125.0 7.7

    This is still bad for me though because I want to use UDP for health checks.

    The packet drops seem to be random though, not prolonged, so maybe if I send extra packets when there is a packet loss then it will make up for the lossy network.

  • rcy026rcy026 Member

    What are you pinging?

    If you ping a device with 100% load you will get losses even if the network is the best in the world.

    Thanked by 1johnvmevpstorage
  • edited March 21

    @rcy026 said:
    What are you pinging?

    If you ping a device with 100% load you will get losses even if the network is the best in the world.

    I am pinging my VPS which is a newly installed Linux system, not running anything.

  • kevindskevinds Member, LIR

    @johnvmevpstorage said:
    I am pinging my VPS which is a newly installed Linux system, not running anything.

    You need to use a 'known good' destination.

    Thanked by 1johnvmevpstorage
  • edited March 21

    mtr for UDP shows 90% packet loss, holy cow:

    Start: 2024-03-21T19:32:00+0000
    HOST: my PC Loss% Snt Last Avg Best Wrst StDev
    1.|-- _gateway 90.0% 250 0.7 0.6 0.5 0.8 0.1
    ...[my ISP]...
    8.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    9.|-- ldn-b11-link.ip.twelve99.net 60.4% 250 5257. 63.7 2.9 5257. 528.9
    10.|-- ldn-bb2-link.ip.twelve99.net 94.0% 250 2602. 196.6 3.6 2602. 669.6
    11.|-- nyk-bb1-link.ip.twelve99.net 19.2% 250 74.6 74.0 72.7 79.7 0.8
    12.|-- buf-b2-link.ip.twelve99.net 0.0% 250 92.6 92.5 91.5 93.6 0.3
    13.|-- hostpapa-ic-xxxxxx.ip.twelve99-cust.net 49.2% 250 2847. 107.0 81.9 2847. 245.2
    14.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    15.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    16.|-- ??? 100.0 250 0.0 0.0 0.0 0.0 0.0
    17.|-- host.colocrossing.com 89.6% 250 93.2 95.4 92.0 125.0 7.7

  • KrisKris Member

    Possibly your ISP?

    MTR is always needed both ways to prove anything. Could be an asymmetric route 'Fake packet loss' in the middle doesn't mean anything until it follows down.

    MTR from your servers at CC, etc. back to your ISP for a better idea of where the issue lies.

    Thanked by 1johnvmevpstorage
  • @kevinds said:

    @johnvmevpstorage said:
    I am pinging my VPS which is a newly installed Linux system, not running anything.

    You need to use a 'known good' destination.

    But why? What I care about is having low packet loss from my PC to my VPS. Since I'm going to be sending packets from my PC to my VPS all the time.

  • EthernetServersEthernetServers Member, Patron Provider
    edited March 21

    I'd be interested in seeing MTR's for all three hosts with the MTR's run for the same duration, and captured at the same time.

    Perhaps you can take a screenshot or use code tags, in order to maintain formatting that's a little easier to read.

    Thanked by 1johnvmevpstorage
  • kevindskevinds Member, LIR

    @johnvmevpstorage said:
    But why? What I care about is having low packet loss from my PC to my VPS. Since I'm going to be sending packets from my PC to my VPS all the time.

    The way I read it that you were pinging from one VPS to another..

    Well, if it is from your home, you need to include a known-good address to determine if your home's internet connection is causing issues.

  • edited March 21

    I think the mtr -u is not right because I used nc and manually sent UDP packets and saw only around 10% packet loss with my colocrossing VPS.

    iperf confirmed that the real UDP packet loss for my colocrossing VPS was 12%:

    root@linux:$ iperf -s -u
    ------------------------------------------------------------
    Server listening on UDP port x
    UDP buffer size:  208 KByte (default)
    ------------------------------------------------------------
    [  1] local x.x.x.x port x connected with x.x.x.x port x
    [ ID] Interval       Transfer     Bandwidth        Jitter   Lost/Total Datagrams
    [  1] 0.0000-10.0146 sec  1.11 MBytes   930 Kbits/sec   0.757 ms 103/895 (12%)
    [  3] WARNING: ack of last datagram failed.
    

    Well, if it is from your home, you need to include a known-good address to determine if your home's internet connection is causing issues.

    I know my home internet is fine because I get near zero (0.017%) packet loss pinging my RackNerd VPS from my home PC.

    UPDATE:

    I just ran iperf for 10 seconds on my EthernetServer VPS and saw 0% UDP packet loss:

    root@linux:~# iperf -s -u
    ------------------------------------------------------------
    Server listening on UDP port x
    UDP buffer size:  208 KByte (default)
    ------------------------------------------------------------
    [  1] local x.x.x.x port x connected with x.x.x.x port x
    [ ID] Interval       Transfer     Bandwidth        Jitter   Lost/Total Datagrams
    [  1] 0.0000-10.0155 sec  1.25 MBytes  1.05 Mbits/sec   0.358 ms 0/895 (0%)
    [  3] WARNING: ack of last datagram failed.
    

    So maybe the packet loss is only ICMP or maybe it doesn't happen all the time.

  • kevindskevinds Member, LIR

    @johnvmevpstorage said:
    I know my home internet is fine because I get near zero (0.017%) packet loss pinging my RackNerd VPS from my home PC.

    Alright....

  • APIAPI Member
    edited March 21

    I'd also say that you need to test a known good location. Using one of the larger websites or test IP of a huge cloud provider, for example. Maybe the issue is the network you're testing from, or to, or both, but you won't know until you test a known good location.

    Thanked by 1johnvmevpstorage
  • @API said:
    I'd also say that you need to test a known good location. Using one of the larger websites or test IP of a huge cloud provider, for example. Maybe the issue is the network you're testing from, or to, or both, but you won't know until you test a known good location.

    Do you mean I should ping 8.8.8.8 from my home PC, or ping 8.8.8.8 from my VPSes?

  • APIAPI Member
    edited March 21

    @johnvmevpstorage said:
    Do you mean I should ping 8.8.8.8 from my home PC, or ping 8.8.8.8 from my VPSes?

    Exactly. I'd test both ways. That way you can compare between them and try to see which server's network is acting up.

    Thanked by 1johnvmevpstorage
  • kevindskevinds Member, LIR
    edited March 21

    @johnvmevpstorage said:
    Do you mean I should ping 8.8.8.8 from my home PC, or ping 8.8.8.8 from my VPSes?

    Maybe bbc.co.uk too. It isn't multi-casted like 8.8.8.8 is.

    Thanked by 1johnvmevpstorage
  • edited March 21

    @EthernetServers said:
    I'd be interested in seeing MTR's for all three hosts with the MTR's run for the same duration, and captured at the same time.

    Perhaps you can take a screenshot or use code tags, in order to maintain formatting that's a little easier to read.

    I'll run the ping and mtr again, while at the same time pinging other known-good IPs, will have the results by tomorrow.

    Should I raise a ticket with EthernetServers if the ping packet loss is greater than 1%?

    I don't know how much packet loss is considered normal/acceptable.

  • JosephFJosephF Member

    @CyberneticTitan said:
    You've discovered the power of bandwidth doubling

    Are you referring to multihoming?

  • bdlbdl Member

    Welcome to the Internet

  • edited March 21

    @JosephF said:

    @CyberneticTitan said:
    You've discovered the power of bandwidth doubling

    Are you referring to multihoming?

    You mean the RackNerd network is multi-homed?

  • raindog308raindog308 Administrator, Veteran

    3 hours of pinging my $20 @ColoCrossing dedi in Buffalo, NY from Portland, OR:

        Packets: Sent = 10979, Received = 10978, Lost = 1 (0% loss),
    Reply from x.x.x.x: Approximate round trip times in milli-seconds:
        Minimum = 82ms, Maximum = 325ms, Average = 88ms
    
    Thanked by 1johnvmevpstorage
  • edited March 22

    Okay I finished pinging IPs overnight got these results:

    8.8.8.8: 0.005% packet loss

    --- 8.8.8.8 ping statistics ---
    41349 packets transmitted, 41347 received, 0.00483688% packet loss, time 41411341ms
    rtt min/avg/max/mdev = 2.500/3.589/51.348/0.556 ms
    

    1.1.1.1: 0% packet loss (WOW!)

    --- 1.1.1.1 ping statistics ---
    41351 packets transmitted, 41351 received, 0% packet loss, time 41413576ms
    rtt min/avg/max/mdev = 2.457/3.592/103.860/0.861 ms
    

    BBC: 0.005% packet loss

    --- 151.101.128.81 ping statistics ---
    41264 packets transmitted, 41262 received, 0.00484684% packet loss, time 41315231ms
    rtt min/avg/max/mdev = 1.833/2.961/79.933/1.073 ms
    

    I had my ColoCrossing VPS moved to a different node, ran iperf3 again now 0% UDP packet loss:

    [ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
    [  5]   0.00-1.00   sec   112 KBytes   915 Kbits/sec  1.812 ms  0/79 (0%)  
    [  5]   1.00-2.00   sec   122 KBytes   996 Kbits/sec  0.697 ms  0/86 (0%)  
    [  5]   2.00-3.00   sec   123 KBytes  1.01 Mbits/sec  0.062 ms  0/87 (0%)  
    [  5]   3.00-4.00   sec   122 KBytes   996 Kbits/sec  1.944 ms  0/86 (0%)  
    [  5]   4.00-5.00   sec   122 KBytes   996 Kbits/sec  1.704 ms  0/86 (0%)  
    [  5]   5.00-6.00   sec   123 KBytes  1.01 Mbits/sec  1.458 ms  0/87 (0%)  
    [  5]   6.00-7.00   sec   122 KBytes   996 Kbits/sec  0.507 ms  0/86 (0%)  
    [  5]   7.00-8.00   sec   122 KBytes   996 Kbits/sec  0.246 ms  0/86 (0%)  
    [  5]   8.00-9.00   sec   123 KBytes  1.01 Mbits/sec  0.789 ms  0/87 (0%)  
    [  5]   9.00-10.00  sec   122 KBytes   996 Kbits/sec  0.435 ms  0/86 (0%)  
    [  5]  10.00-10.09  sec  11.3 KBytes  1.03 Mbits/sec  1.753 ms  0/8 (0%)  
    - - - - - - - - - - - - - - - - - - - - - - - - -
    [ ID] Interval           Transfer     Bitrate         Jitter    Lost/Total Datagrams
    [  5]   0.00-10.09  sec  1.19 MBytes   992 Kbits/sec  1.753 ms  0/864 (0%)  receiver
    -----------------------------------------------------------
    

    Also ran ping for 1800 seconds, 0% packet loss. So all issues seems to be resolved on that side. Props to ColoCrossing support for responding quickly and effectively resolving the issue.

    EthernetServers Frankfurt looking glass: 1.33% packet loss

    --- 194.62.251.1 ping statistics ---
    41372 packets transmitted, 40821 received, 1.33182% packet loss, time 41448973ms
    rtt min/avg/max/mdev = 14.314/15.605/223.309/1.347 ms
    

    EthernetServers Frankfurt VPS: 1.25% packet loss

    --- x.x.x.x ping statistics ---
    41418 packets transmitted, 40899 received, 1.25308% packet loss, time 41488309ms
    rtt min/avg/max/mdev = 14.049/15.345/72.066/0.685 ms
    

    So it looks like it's not an issue with my EthernetServers VPS because I get the exact same amount of packet loss pinging their looking glass. So I think it's unlikely that I'll be able to get this issue resolved (if it is indeed an issue), but I'll raise a ticket anyway and see what they say about it.

    EDIT: I just realized that I fucked up my mtr by running multiple mtrs at the same time, apparently they collide and make the result unreadable.

    Fuck I'm an idiot.

  • edited March 22

    I just ran mtr both directions from my EthernetServer VPS to my AWS UK EC2 instance and got 0% packet loss in both directions out of 1000 packets.

    So, I'm not sure what's going on.

    Seems like the packet loss only happens when I'm pinging the EthernetServers VPS from my home PC and not when I'm pinging it from my AWS instance.

    I'll raise a ticket with EthernetServers and see what they have to say about it.

Sign In or Register to comment.