Жутко тормозит RAID1
Форум — Admin
CentOS Linux 7.2.1511
Собран RAID1
Данная машина используется как NFS-сервер, сливаются виртуалки.Интерфейс гигабитный, отдельный для бэкапа.
Общий объем виртуалок в районе 500-600Gb. Затрачиваемое время равно 17часов!! С 23:00 до 18-17 часов! По atop-у видно что «затык» именно на винтах.
Данная машина ранее выполняла те же функции(gmirror) под управлением FreeBSD - время копирования составляло 3-4 часа. Переход был обусловлен приведению парка серверов к единообразию.
Что не так? Винты смартом смотрел - все ок. Куда копать?
[root@NFS /]# cat /proc/mdstat
Personalities : [raid1]
md124 : active raid1 sda5[0] sdb5[1]
961411072 blocks super 1.2 [2/2] [UU]
bitmap: 3/8 pages [12KB], 65536KB chunk
md125 : active raid1 sdb1[1] sda1[0]
10485760 blocks super 1.2 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md126 : active raid1 sda3[0] sdb3[1]
525248 blocks super 1.0 [2/2] [UU]
bitmap: 0/1 pages [0KB], 65536KB chunk
md127 : active raid1 sda2[0] sdb2[1]
4194304 blocks super 1.2 [2/2] [UU]
unused devices: <none>
PRC | sys 23m53s | user 15.30s | | #proc 139 | #trun 1 | #tslpi 150 | | #tslpu 8 | #zombie 0 | clones 16583 | | #exit 0 |
CPU | sys 2% | user 0% | irq 0% | | idle 69% | wait 129% | | | steal 0% | guest 0% | curf 2.33GHz | curscal ?% |
cpu | sys 1% | user 0% | irq 0% | | idle 36% | cpu001 w 63% | | | steal 0% | guest 0% | curf 2.33GHz | curscal ?% |
cpu | sys 1% | user 0% | irq 0% | | idle 33% | cpu000 w 66% | | | steal 0% | guest 0% | curf 2.33GHz | curscal ?% |
CPL | avg1 8.46 | avg5 8.50 | | avg15 8.54 | | | csw 66133044 | intr 75947e3 | | | numcpu 2 | |
MEM | tot 1.8G | free 62.8M | cache 1.4G | dirty 0.0M | buff 50.2M | slab 103.1M | slrec 75.2M | shmem 8.7M | shrss 0.2M | vmbal 0.0M | hptot 0.0M | hpuse 0.0M |
SWP | tot 4.0G | free 4.0G | | | | | | | | | vmcom 305.8M | vmlim 4.9G |
PAG | scan 73301e3 | steal 7330e4 | stall 0 | | | | | | | | swin 0 | swout 0 |
MDD | md127 | busy 0% | read 125 | | write 0 | KiB/r 8 | KiB/w 0 | MBr/s 0.00 | MBw/s 0.00 | | avq 0.00 | avio 0.00 ms |
MDD | md126 | busy 0% | read 494 | | write 16 | KiB/r 52 | KiB/w 3 | MBr/s 0.00 | MBw/s 0.00 | | avq 0.00 | avio 0.00 ms |
MDD | md125 | busy 0% | read 26879 | | write 19897 | KiB/r 18 | KiB/w 20 | MBr/s 0.01 | MBw/s 0.01 | | avq 0.00 | avio 0.00 ms |
MDD | md124 | busy 0% | read 4920 | | write 9259e3 | KiB/r 4 | KiB/w 33 | MBr/s 0.00 | MBw/s 5.29 | | avq 0.00 | avio 0.00 ms |
DSK | sdb | busy 76% | read 9168 | | write 3592e3 | KiB/r 22 | KiB/w 85 | MBr/s 0.00 | MBw/s 5.30 | | avq 2.59 | avio 11.9 ms |
DSK | sda | busy 76% | read 19588 | | write 3592e3 | KiB/r 18 | KiB/w 85 | MBr/s 0.01 | MBw/s 5.30 | | avq 2.58 | avio 11.8 ms |
NET | transport | tcpi 80411e3 | tcpo 8488659 | udpi 784 | udpo 1078 | tcpao 949 | tcppo 40958 | tcprs 47 | tcpie 0 | tcpor 4 | udpnp 1 | udpie 0 |
NET | network | ipi 80423025 | ipo 8489674 | | ipfrw 0 | deliv 8042e4 | | | | | icmpi 14 | icmpo 20 |
NET | enp3s4 4% | pcki 20766e4 | pcko 7477714 | si 43 Mbps | so 163 Kbps | coll 0 | | mlti 0 | erri 0 | erro 0 | drpi 207 | drpo 0 |
NET | ens7 0% | pcki 2624099 | pcko 1896 | si 558 Kbps | so 0 Kbps | coll 0 | | mlti 2050 | erri 0 | erro 0 | drpi 0 | drpo 0 |
NET | ens6 0% | pcki 2047 | pcko 1014207 | si 0 Kbps | so 9 Kbps | coll 0 | | mlti 2047 | erri 0 | erro 0 | drpi 0 | drpo 0 |
NET | bond0 ---- | pcki 2626146 | pcko 1016103 | si 558 Kbps | so 9 Kbps | coll 0 | | mlti 4097 | erri 0 | erro 0 | drpi 0 | drpo 0 |
NET | lo ---- | pcki 95 | pcko 95 | si 0 Kbps | so 0 Kbps | coll 0 | | mlti 0 | erri 0 | erro 0 | drpi 0 | drpo 0 |
*** system and process activity since boot ***
PID TID RUID EUID THR SYSCPU USRCPU VGROW RGROW RDDSK WRDSK ST EXC S CPUNR CPU CMD 1/4
1522 - root root 1 2m20s 0.00s 0K 0K 1180K 34.5G N- - D 0 0% nfsd
1504 - root root 1 2m19s 0.00s 0K 0K 4720K 34.5G N- - D 0 0% nfsd
1503 - root root 1 2m19s 0.00s 0K 0K 2340K 34.5G N- - D 0 0% nfsd
1518 - root root 1 2m19s 0.00s 0K 0K 1208K 34.5G N- - D 0 0% nfsd
1510 - root root 1 2m19s 0.00s 0K 0K 2864K 34.5G N- - D 1 0% nfsd
1517 - root root 1 2m19s 0.00s 0K 0K 1796K 34.5G N- - D 1 0% nfsd
1508 - root root 1 2m19s 0.00s 0K 0K 2784K 34.5G N- - D 1 0% nfsd
1512 - root root 1 2m19s 0.00s 0K 0K 1700K 34.5G N- - D 1 0% nfsd
47 - root root 1 78.76s 0.00s 0K 0K 0K 0K N- - S 0 0% kswapd0
623 - root root 1 66.28s 0.00s 0K 0K 0K 64488K N- - S 1 0% jbd2/md124-8