qu'est-ce que la colonne VIRT dans HTOP? frais généraux de mémoire?

Question

Que signifie la colonne VIRT dans cette sortie HTOP? Il apparaît en rouge et en gras.

J'exécute un cluster elasticsearch avec 4 nœuds et j'indexe des données massives.

1700 index avec 3 fragments, certains avec 10 petits documents, d'autres avec 500 000 petits documents
1 index avec 3 fragments avec 60 millions de petits documents

Il montre la santé verte tout le temps.

Il s'agit d'une gouttelette DigitalOcean avec 4 Go RAM et 2 processeurs. Je configure la taille de tas sur 2 Go (-Xms et -Xmx).

S'agit-il d'une surcharge de RAM mémoire?

 1 [||||| 9.4%] Tasks: 26, 122 thr; 2 running 2 [||| 4.3%] Load average: 0.25 0.47 0.65 Mem[||||||||||||||||||||||||||||||2592/3954MB] Uptime: 2 days, 01:05:57 Swp[ 0/0MB] PID USER PRI NI VIRT RES SHR S CPU% MEM% TIME+ Command 9629 root 20 0 16.2G 2516M 97360 S 12.0 63.6 27h02:30 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 21564 root 20 0 16.2G 2516M 97360 S 4.0 63.6 1:12.17 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9644 root 20 0 16.2G 2516M 97360 S 1.0 63.6 47:39.34 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 20451 root 20 0 25808 2020 1208 R 0.0 0.0 25:19.48 htop 9654 root 20 0 16.2G 2516M 97360 S 1.0 63.6 5:43.32 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9651 root 20 0 16.2G 2516M 97360 S 0.0 63.6 6:34.53 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9653 root 20 0 16.2G 2516M 97360 S 1.0 63.6 1:46.23 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 21565 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1:12.48 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 21563 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1:11.12 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 21472 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1:15.85 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9652 root 20 0 16.2G 2516M 97360 S 0.0 63.6 5:40.13 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 21562 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1:10.93 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9631 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1h19:18 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9632 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1h19:19 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9633 root 20 0 16.2G 2516M 97360 S 0.0 63.6 7h19:13 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9850 root 20 0 16.2G 2516M 97360 S 0.0 63.6 18:16.00 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9634 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1h29:54 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9722 root 20 0 16.2G 2516M 97360 S 0.0 63.6 50:24.42 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9703 root 20 0 16.2G 2516M 97360 S 0.0 63.6 4h25:50 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9704 root 20 0 16.2G 2516M 97360 S 0.0 63.6 4h26:01 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9662 root 20 0 16.2G 2516M 97360 S 0.0 63.6 1:19.60 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9669 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:08.13 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9665 root 20 0 16.2G 2516M 97360 S 0.0 63.6 6:39.74 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 385 syslog 20 0 243M 1696 872 S 0.0 0.0 0:13.37 rsyslogd -c5 397 syslog 20 0 243M 1696 872 S 0.0 0.0 0:05.58 rsyslogd -c5 9640 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:24.60 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9647 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:10.90 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9635 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:38.98 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 950 root 20 0 15988 664 488 S 0.0 0.0 0:21.99 /usr/sbin/irqbalance 9645 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:19.28 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9700 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:10.25 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 19171 root 20 0 86232 2316 1364 S 0.0 0.1 0:10.56 sshd: root@pts/0 9648 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:09.37 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9639 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:32.61 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9642 root 20 0 16.2G 2516M 97360 S 0.0 63.6 3:04.59 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9643 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:37.35 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9649 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:55.92 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9650 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:15.67 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9706 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:51.00 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9705 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:38.98 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9667 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:08.34 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9646 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:10.10 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9668 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:07.83 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 9666 root 20 0 16.2G 2516M 97360 S 0.0 63.6 0:08.01 /usr/bin/Java -Xms256m -Xmx1g -Xss256k - 398 syslog 20 0 243M 1696 872 S 0.0 0.0 0:01.40 rsyslogd -c5 632 root 20 0 50044 1648 1036 S 0.0 0.0 0:02.10 /usr/sbin/sshd -D 1 root 20 0 24300 1644 740 S 0.0 0.0 0:01.80 /sbin/init

Je peux acheter plus de machines, mais je ne sais pas laquelle est la meilleure: une autre machine VS plus de RAM.

MISE À JOUR: première et dernière lignes pmap d'un processus

 root@es2:~# pmap -d 3589 3589: /usr/bin/Java -Xms256m -Xmx1g -Xss256k -Djava.awt.headless=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -Delasticsearch -Des.foreground=yes -Des.path.home=/root/elasticsearch -cp :/root/elasticsearch/lib/elasticsearch-1.1.1.jar:/root/elasticsearch/lib/*:/root/elasticsearch/lib/sigar/* -Xmx2g -Xms2g -Des.node.name=es2 -Des.node.data=true -Des.node.master=false org.elasticsearch.bootstrap.Elasticsearch Address Kbytes Mode Offset Device Mapping 0000000000400000 4 r-x-- 0000000000000000 0fd:00000 Java 0000000000600000 4 r---- 0000000000000000 0fd:00000 Java 0000000000601000 4 rw--- 0000000000001000 0fd:00000 Java 000000000188d000 132 rw--- 0000000000000000 000:00000 [ anon ] 0000000775a00000 2118400 rw--- 0000000000000000 000:00000 [ anon ] 00000007f6ec0000 37696 rw--- 0000000000000000 000:00000 [ anon ] 00000007f9390000 111040 rw--- 0000000000000000 000:00000 [ anon ] 00007f6cb0132000 4872 r--s- 0000000000000000 0fd:00000 _8d.fdt 00007f6cb05f4000 5792 r--s- 0000000000000000 0fd:00000 _8d_es090_0.tim 00007f6cb0b9c000 6208 r--s- 0000000000000000 0fd:00000 _8c.fdt 00007f6cb11ac000 6548 r--s- 0000000000000000 0fd:00000 _a0.fdt 00007f6cb1811000 7648 r--s- 0000000000000000 0fd:00000 _a0_es090_0.tim 00007f6cb1f89000 5356 r--s- 0000000000000000 0fd:00000 _78.fdt 00007f6cb24c4000 6236 r--s- 0000000000000000 0fd:00000 _78_es090_0.tim .... ....... .... (huge text) .... ...... .. 00007f703dc6e000 4 rw--- 0000000000007000 0fd:00000 librt-2.15.so 00007f703dc6f000 84 r-x-- 0000000000000000 0fd:00000 libgcc_s.so.1 00007f703dc84000 2044 ----- 0000000000015000 0fd:00000 libgcc_s.so.1 00007f703de83000 4 r---- 0000000000014000 0fd:00000 libgcc_s.so.1 00007f703de84000 4 rw--- 0000000000015000 0fd:00000 libgcc_s.so.1 00007f703de85000 1004 r-x-- 0000000000000000 0fd:00000 libm-2.15.so 00007f703df80000 2044 ----- 00000000000fb000 0fd:00000 libm-2.15.so 00007f703e17f000 4 r---- 00000000000fa000 0fd:00000 libm-2.15.so 00007f703e180000 4 rw--- 00000000000fb000 0fd:00000 libm-2.15.so 00007f703e181000 904 r-x-- 0000000000000000 0fd:00000 libstdc++.so.6.0.16 00007f703e263000 2044 ----- 00000000000e2000 0fd:00000 libstdc++.so.6.0.16 00007f703e462000 32 r---- 00000000000e1000 0fd:00000 libstdc++.so.6.0.16 00007f703e46a000 8 rw--- 00000000000e9000 0fd:00000 libstdc++.so.6.0.16 00007f703e46c000 84 rw--- 0000000000000000 000:00000 [ anon ] 00007f703e481000 10988 r-x-- 0000000000000000 0fd:00000 libjvm.so 00007f703ef3c000 2048 ----- 0000000000abb000 0fd:00000 libjvm.so 00007f703f13c000 608 r---- 0000000000abb000 0fd:00000 libjvm.so 00007f703f1d4000 140 rw--- 0000000000b53000 0fd:00000 libjvm.so 00007f703f1f7000 180 rw--- 0000000000000000 000:00000 [ anon ] 00007f703f224000 88 r-x-- 0000000000000000 0fd:00000 libz.so.1.2.3.4 00007f703f23a000 2044 ----- 0000000000016000 0fd:00000 libz.so.1.2.3.4 00007f703f439000 4 r---- 0000000000015000 0fd:00000 libz.so.1.2.3.4 00007f703f43a000 4 rw--- 0000000000016000 0fd:00000 libz.so.1.2.3.4 00007f703f43b000 96 r-x-- 0000000000000000 0fd:00000 libpthread-2.15.so 00007f703f453000 2044 ----- 0000000000018000 0fd:00000 libpthread-2.15.so 00007f703f652000 4 r---- 0000000000017000 0fd:00000 libpthread-2.15.so 00007f703f653000 4 rw--- 0000000000018000 0fd:00000 libpthread-2.15.so 00007f703f654000 16 rw--- 0000000000000000 000:00000 [ anon ] 00007f703f658000 8 r-x-- 0000000000000000 0fd:00000 libdl-2.15.so 00007f703f65a000 2048 ----- 0000000000002000 0fd:00000 libdl-2.15.so 00007f703f85a000 4 r---- 0000000000002000 0fd:00000 libdl-2.15.so 00007f703f85b000 4 rw--- 0000000000003000 0fd:00000 libdl-2.15.so 00007f703f85c000 1748 r-x-- 0000000000000000 0fd:00000 libc-2.15.so 00007f703fa11000 2048 ----- 00000000001b5000 0fd:00000 libc-2.15.so 00007f703fc11000 16 r---- 00000000001b5000 0fd:00000 libc-2.15.so 00007f703fc15000 8 rw--- 00000000001b9000 0fd:00000 libc-2.15.so 00007f703fc17000 20 rw--- 0000000000000000 000:00000 [ anon ] 00007f703fc1c000 52 r-x-- 0000000000000000 0fd:00000 libjli.so 00007f703fc29000 2044 ----- 000000000000d000 0fd:00000 libjli.so 00007f703fe28000 4 r---- 000000000000c000 0fd:00000 libjli.so 00007f703fe29000 4 rw--- 000000000000d000 0fd:00000 libjli.so 00007f703fe2a000 136 r-x-- 0000000000000000 0fd:00000 ld-2.15.so 00007f703fe4c000 32 r--s- 000000000005a000 0fd:00000 lucene-codecs-4.7.2.jar 00007f703fe54000 16 r--s- 0000000000085000 0fd:00000 localedata.jar 00007f703fe58000 8 r--s- 0000000000012000 0fd:00000 zipfs.jar 00007f703fe5a000 12 r--s- 0000000000032000 0fd:00000 sunjce_provider.jar 00007f703fe5d000 16 r--s- 000000000003b000 0fd:00000 sunpkcs11.jar 00007f703fe61000 556 rw--- 0000000000000000 000:00000 [ anon ] 00007f703feec000 72 rw--- 0000000000000000 000:00000 [ anon ] 00007f703fefe000 220 rw--- 0000000000000000 000:00000 [ anon ] 00007f703ff35000 40 rw--- 0000000000000000 000:00000 [ anon ] 00007f703ff3f000 148 rw--- 0000000000000000 000:00000 [ anon ] 00007f703ff64000 580 rw--- 0000000000000000 000:00000 [ anon ] 00007f703fff5000 32 rw-s- 0000000000000000 0fd:00000 3279 00007f703fffd000 12 ----- 0000000000000000 000:00000 [ anon ] 00007f7040000000 268 rw--- 0000000000000000 000:00000 [ anon ] 00007f7040043000 4 r--s- 0000000000008000 0fd:00000 lucene-memory-4.7.2.jar 00007f7040044000 8 r--s- 000000000000f000 0fd:00000 Pulse-Java.jar 00007f7040046000 4 r--s- 0000000000007000 0fd:00000 Java-atk-wrapper.jar 00007f7040047000 4 r--s- 0000000000002000 0fd:00000 dnsns.jar 00007f7040048000 4 rw--- 0000000000000000 000:00000 [ anon ] 00007f7040049000 4 r---- 0000000000000000 000:00000 [ anon ] 00007f704004a000 8 rw--- 0000000000000000 000:00000 [ anon ] 00007f704004c000 4 r---- 0000000000022000 0fd:00000 ld-2.15.so 00007f704004d000 8 rw--- 0000000000023000 0fd:00000 ld-2.15.so 00007fff9dcbe000 132 rw--- 0000000000000000 000:00000 [ stack ] 00007fff9ddfe000 8 r-x-- 0000000000000000 000:00000 [ anon ] ffffffffff600000 4 r-x-- 0000000000000000 000:00000 [ anon ] ffffffffff600000 4 r-x-- 0000000000000000 000:00000 [ anon ] mapped: 17052740K writeable/private: 2523144K shared: 13562836K root@es2:~#

pete23 · Accepted Answer

J'arrêterais de m'inquiéter pour la chose VIRT.

tilisation de la mémoire virtuelle de Java sous Linux, trop de mémoire utilisée

Je soupçonne que la première page est allouée à des fins vsyscall (voir Que sont vdso et vsyscall? ). Cela signifie que bien que votre processus dispose d'une plage de mémoire virtuelle de 16 Go mappée, il n'utilise certainement rien de tel en termes de mémoire physique. Passez par l'entrée RES.

Que vous ayez besoin de plus de machines ou de mémoire ... Est-ce lent? Vous auriez besoin de faire plus de criminalistique sur l'endroit où se trouvent vos goulots d'étranglement, mais la capture du htop ne semble pas être sous beaucoup de pression.