IPerf Tests


        
            
                Markdown 4.78 KB
                                    
                        | None                    
                
                                        |
    0    0                            

            
                
                                    raw
                    download
                    clone
                    embed
                    print
                
                                    report
                
                
                            
        
        
            CALC http://www.linux-admins.net/2010/09/linux-tcp-tuning.html
Bandwidth-in-bits-per-second * Round-trip-latency-in-seconds = TCP window size in bits / 8 = TCP window size in bytes
10,000,000,000 Bits * 0.060 = 600,000,000 / 8 = 75,000,000 Byte TCP Window = 75MB 
net.ipv4.tcp_rmem = 4096 87380 85000000

net.ipv4.tcp_wmem = 4096 65536 76000000

net.core.rmem_max = 120000000

net.core.wmem_max = 80000000

net.core.netdev_max_backlog = 30000
ifconfig eth0 txqueuelen 5000
DEAFULTS
64 bytes from hpcf1r02n06.hpc.ford.com (19.59.18.145): icmp_seq=3 ttl=59 time=57.3 ms

net.core.optmem_max = 20480
net.core.rmem_default = 212992
net.core.rmem_max = 24000000
net.core.wmem_default = 212992
net.core.wmem_max = 24000000
net.ipv4.igmp_max_memberships = 20
net.ipv4.tcp_mem = 380337       507117  760674
net.ipv4.tcp_rmem = 4096        87380   6291456
net.ipv4.tcp_wmem = 4096        16384   4194304
net.ipv4.udp_mem = 760674       1014234 1521348
net.ipv4.udp_rmem_min = 4096
net.ipv4.udp_wmem_min = 4096
vm.lowmem_reserve_ratio = 256   256     32      1
vm.memory_failure_early_kill = 0
vm.memory_failure_recovery = 1
vm.nr_hugepages_mempolicy = 0
vm.overcommit_memory = 0
./src/iperf3 -V -c hpcf1r02n06 -P 1 -C cubic
Test Complete. Summary Results:
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   742 MBytes   622 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   526 MBytes   441 Mbits/sec                  receiver
CPU Utilization: local/sender 4.0% (0.2%u/3.7%s), remote/receiver 3.4% (0.3%u/3.1%s)
snd_tcp_congestion cubic
rcv_tcp_congestion cubic

./src/iperf3 -V -c hpcf1r02n06 -P 10 -C cubic
[SUM]   0.00-10.00  sec  1.04 GBytes   895 Mbits/sec    1             sender
[SUM]   0.00-10.00  sec   984 MBytes   826 Mbits/sec                  receiver
CPU Utilization: local/sender 5.6% (0.9%u/4.8%s), remote/receiver 1.8% (0.1%u/1.7%s)
snd_tcp_congestion cubic
rcv_tcp_congestion cubic
./src/iperf3 -V -c hpcf1r02n06 -P 1 -C  scalable
Test Complete. Summary Results:
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   703 MBytes   590 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   703 MBytes   589 Mbits/sec                  receiver
CPU Utilization: local/sender 3.6% (0.3%u/3.3%s), remote/receiver 3.4% (0.3%u/3.2%s)
snd_tcp_congestion scalable
rcv_tcp_congestion cubic

./src/iperf3 -V -c hpcf1r02n06 -P 10 -C  scalable
[SUM]   0.00-10.00  sec  1.04 GBytes   894 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   963 MBytes   807 Mbits/sec                  receiver
CPU Utilization: local/sender 5.6% (0.5%u/5.2%s), remote/receiver 4.1% (0.2%u/3.9%s)
snd_tcp_congestion scalable
rcv_tcp_congestion cubic
./src/iperf3 -V -c hpcf1r02n06 -P 10 -C  scalable -w 5MB
[SUM]   0.00-10.00  sec  1.10 GBytes   945 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   964 MBytes   809 Mbits/sec                  receiver
CPU Utilization: local/sender 5.6% (0.3%u/5.3%s), remote/receiver 6.7% (0.5%u/6.2%s)
snd_tcp_congestion scalable
rcv_tcp_congestion reno

./src/iperf3 -V -c hpcf1r02n06 -P 10 -C  scalable -w 10MB
[SUM]   0.00-10.00  sec  1.18 GBytes  1.01 Gbits/sec    0             sender
[SUM]   0.00-10.00  sec   955 MBytes   801 Mbits/sec                  receiver
CPU Utilization: local/sender 5.8% (0.3%u/5.5%s), remote/receiver 2.7% (0.2%u/2.4%s)
snd_tcp_congestion scalable
rcv_tcp_congestion reno

./src/iperf3 -V -c hpcf1r02n06 -P 10 -C  scalable -w 24MB
[SUM]   0.00-10.00  sec  1.34 GBytes  1.15 Gbits/sec    0             sender
[SUM]   0.00-10.00  sec   946 MBytes   793 Mbits/sec                  receiver
CPU Utilization: local/sender 6.3% (0.4%u/5.9%s), remote/receiver 3.5% (0.3%u/3.2%s)
snd_tcp_congestion scalable
rcv_tcp_congestion reno
./src/iperf3 -V -c hpcf1r02n06 -P 1 -C  reno
Test Complete. Summary Results:
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec   733 MBytes   615 Mbits/sec    0             sender
[  4]   0.00-10.00  sec   732 MBytes   614 Mbits/sec                  receiver
CPU Utilization: local/sender 3.3% (0.2%u/3.0%s), remote/receiver 4.8% (0.4%u/4.4%s)
snd_tcp_congestion reno
rcv_tcp_congestion reno
./src/iperf3 -V -c hpcf1r02n06 -P 10 -C  reno
[SUM]   0.00-10.00  sec  1.04 GBytes   894 Mbits/sec    0             sender
[SUM]   0.00-10.00  sec   975 MBytes   818 Mbits/sec                  receiver
CPU Utilization: local/sender 5.3% (0.8%u/4.6%s), remote/receiver 2.0% (0.1%u/1.9%s)
snd_tcp_congestion reno
rcv_tcp_congestion reno
./src/iperf3 -V -c hpcf1r02n06 -P 2 -w 80M
hpcf1r02n06

hpcf1r03n06