Trace number 4397438

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.03 2400.31

General information on the benchmark

NamePseudoBoolean/PseudoBoolean-dec-spng/
Pb-NG-K171.xml
MD5SUMfad44a9d187d2d79449e3ca32a08f321
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables20349
Number of constraints20693
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":20349}]
Minimum variable degree3
Maximum variable degree12
Distribution of variable degrees[{"degree":3,"count":1},{"degree":4,"count":299},{"degree":5,"count":2083},{"degree":6,"count":9159},{"degree":7,"count":5590},{"degree":8,"count":2200},{"degree":9,"count":678},{"degree":10,"count":169},{"degree":11,"count":1},{"degree":12,"count":169}]
Minimum constraint arity1
Maximum constraint arity171
Distribution of constraint arities[{"arity":1,"count":2},{"arity":2,"count":2210},{"arity":3,"count":9180},{"arity":4,"count":5610},{"arity":5,"count":2380},{"arity":6,"count":510},{"arity":7,"count":170},{"arity":9,"count":170},{"arity":119,"count":342},{"arity":171,"count":119}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":20693}]
Optimization problemNO
Type of objective

Solver Data 

3.59/3.66	c root propagations     : 742         
3.59/3.66	c restarts enabled, print stats at every restarts
3.59/3.66	c
3.59/3.66	c
3.59/3.66	c
3.59/3.66	c This is cosoco 2.00 --  
3.59/3.66	c
3.59/3.66	c command line: cosoco -lc -model -restarts -stick HOME/instance-4397438-1568583839.xml 
3.59/3.66	c ========================================[ Problem Statistics ]===========================================
3.59/3.66	c |                                                                                                       
3.59/3.66	c |  Parse time        :         2.18 s 
3.59/3.66	c |
3.59/3.66	c |               Variables: 20349
3.59/3.66	c |            Domain Sizes: 2..2
3.59/3.66	c |
3.59/3.66	c |             Constraints: 20693
3.59/3.66	c |                   Arity: 1..171  -- Unary: 2  -- Binary: 2210  -- Ternary: 9180
3.59/3.66	c | 
3.59/3.66	c |                   Types: 
3.59/3.66	c |                          Sum: 20693
3.59/3.66	c |                          
3.59/3.66	c =========================================================================================================
3.59/3.66	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
10.59/10.62	c 101            16133          1026735        275083         742            0              1193   15830   10024
16.49/16.59	c 211            39841          1980656        706863         742            0              402   18850   17568
19.49/19.53	c 332            46452          2389681        867363         742            0              1951   5144   4198
26.58/26.61	c 465            59425          3519864        1254350        742            0              1951   2508   2145
33.19/33.22	c 611            81986          4287911        1560111        742            0              1826   4077   3650
36.29/36.35	c 771            91868          4669477        1721119        742            0              877   5512   3990
41.69/41.72	c 947            103220         5423368        2052755        742            0              1670   3436   2050
44.68/44.72	c 1140           108738         5886211        2252884        742            0              1710   1826   1763
51.68/51.77	c 1352           138263         6430371        2444866        742            0              1109   3842   3102
55.79/55.87	c 1585           148268         6980298        2680523        742            0              1752   2802   2138
60.29/60.30	c 1841           156370         7683349        2953117        742            0              1988   2781   2082
64.48/64.51	c 2122           163321         8366709        3251184        742            0              1515   2153   2113
74.59/74.63	c 2431           173520         10271991       3921262        742            0              1544   1766   1707
80.18/80.25	c 2770           185015         11149385       4245826        742            0              1430   1906   1761
93.58/93.63	c 3142           193358         13675502       5179674        742            0              1361   1740   1687
101.48/101.51	c 3551           204916         14889133       5704718        742            0              1238   1404   1291
122.48/122.52	c 4000           219356         18586708       7018294        742            0              814   1016   938
130.09/130.13	c 4493           236889         19643113       7567711        742            0              870   2378   2234
137.48/137.50	c 5035           249222         20942182       8150989        742            0              1541   2427   2270
144.67/144.74	c 5631           266857         22096922       8585729        742            0              1725   1960   1839
155.58/155.60	c 6286           287671         23882770       9239677        742            0              1404   1927   1635
167.09/167.13	c 7006           301737         26262595       10149563       742            0              1556   1744   1674
179.67/179.74	c 7798           332857         28162781       10979443       742            0              409   2629   1909
186.77/186.84	c 8669           357899         29144113       11362506       742            0              1496   1915   1657
203.46/203.54	c 9627           390813         32044808       12610568       742            0              1274   1732   1503
217.36/217.40	c 10680          420783         34248728       13535150       742            0              1189   1474   1385
227.35/227.44	c 11838          447907         35846420       14206879       742            0              1167   1390   1243
245.06/245.14	c 13111          477378         38988569       15377166       742            0              933   1850   1329
262.45/262.52	c 14511          520740         41618310       16714671       742            0              1071   1946   1297
273.54/273.67	c 16051          543189         43731777       17812564       742            0              1139   1673   1301
297.24/297.33	c 17745          609529         47221050       19906258       742            0              1196   1945   1540
320.94/321.09	c 19608          694206         50952816       21190591       742            0              1290   2329   1760
360.83/360.95	c 21657          739435         58357379       24712185       742            0              1241   1482   1348
379.32/379.47	c 23910          775559         61508294       26403861       742            0              1069   1154   1127
411.52/411.66	c 26388          823509         67367710       28893529       742            0              778   1024   830
454.02/454.14	c 29113          910353         75348155       32729429       742            0              707   2184   1922
508.41/508.51	c 32110          1082818        82614871       35919997       742            0              976   1670   1312
568.80/568.96	c 35406          1305842        90230796       39440775       742            0              756   2769   1836
651.80/651.94	c 39031          1478397        105082782      45201057       742            0              1387   1770   1588
736.38/736.52	c 43018          1694369        119541152      51370682       742            0              851   2292   1980
832.48/832.69	c 47403          1819476        138937910      57865350       742            0              1428   1583   1507
940.87/941.10	c 52226          2280360        150194221      62731350       742            0              1376   2466   2018
1035.75/1035.95	c 57531          2606661        163602493      69558757       742            0              1501   2667   2010
1109.34/1109.59	c 63366          2872213        174334833      74192076       742            0              1859   2355   2101
1236.83/1237.04	c 69784          3131367        196427470      83822114       742            0              1511   1903   1739
1386.41/1386.68	c 76843          3799778        212222417      89492777       742            0              802   2531   2143
1546.39/1546.63	c 84607          4299887        235400364      99723138       742            0              1711   2518   1972
1705.57/1705.89	c 93147          4716378        261967725      111272791      742            0              1566   2148   1828
1952.15/1952.41	c 102541         5232363        304157319      127687970      742            0              1268   1870   1550
2147.13/2147.44	c 112874         5737631        335399363      143684257      742            0              1260   1610   1468
2318.21/2318.56	c 124240         6067921        366624726      157566996      742            0              1186   1501   1402
2400.01/2400.30	
2400.01/2400.30	c *** INTERRUPTED ***
2400.01/2400.30	c restarts              : 51          
2400.01/2400.30	c conflicts             : 130989       (55 /sec)
2400.01/2400.30	c decisions             : 6226818      (2596 /sec)
2400.01/2400.30	c propagations          : 165286489   (68916 /sec)
2400.01/2400.30	c root propagations     : 742         
2400.01/2400.30	c filter calls          : 382404601      (159442 /sec)
2400.01/2400.30	c useless filter calls  : 350618327      (91 %)
2400.01/2400.30	c Memory used           : 2913.20 MB
2400.01/2400.30	c CPU time              : 2398.39 s
2400.01/2400.30	c real time             : 2400.3 s
2400.01/2400.30	
2400.01/2400.30	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15060 MiB free)
  memory of node 1: 16384 MiB (13819 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397438-1568583839/watcher-4397438-1568583839 -o /tmp/evaluation-result-4397438-1568583839/solver-4397438-1568583839 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node121-1568572742-32492 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397438-1568583839.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=2143, runsolver pid=2140
Current StackSize limit: 8192 KiB


[startup+0.100205 s]*
/proc/loadavg: 2.02 2.02 2.05 3/200 2144
/proc/meminfo: memFree=29558224/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=42084 memory=18284 CPUtime=0.1 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 4764 0 0 0 10 0 0 0 20 0 1 0 434646581 43094016 4571 33554432000 4194304 6211092 140735571034976 140735571031512 5742222 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 10521 4571 809 493 0 3826 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 42084 KiB
Current children cumulated memory: 18284 KiB

[startup+0.209828 s]*
/proc/loadavg: 2.02 2.02 2.05 3/200 2144
/proc/meminfo: memFree=29550412/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=51096 memory=27260 CPUtime=0.2 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 7032 0 0 0 20 0 0 0 20 0 1 0 434646581 52322304 6815 33554432000 4194304 6211092 140735571034976 140735571031512 140088910834661 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 12774 6815 837 493 0 6079 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 51096 KiB
Current children cumulated memory: 27260 KiB

[startup+0.309719 s]*
/proc/loadavg: 2.02 2.02 2.05 3/200 2144
/proc/meminfo: memFree=29533300/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=66492 memory=42836 CPUtime=0.31 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 10899 0 0 0 30 1 0 0 20 0 1 0 434646581 68087808 10709 33554432000 4194304 6211092 140735571034976 140735571031512 5443112 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 16623 10709 837 493 0 9928 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 66492 KiB
Current children cumulated memory: 42836 KiB

[startup+0.700397 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 2144
/proc/meminfo: memFree=29381152/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=270652 memory=246908 CPUtime=0.69 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 61919 0 0 0 62 7 0 0 20 0 1 0 434646581 277147648 61727 33554432000 4194304 6211092 140735571034976 140735571031512 140088923599651 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 67663 61727 837 493 0 60968 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 270652 KiB
Current children cumulated memory: 246908 KiB

[startup+1.50044 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 2144
/proc/meminfo: memFree=29096228/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=936952 memory=913144 CPUtime=1.49 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 228511 0 0 0 122 27 0 0 20 0 1 0 434646581 959438848 228286 33554432000 4194304 6211092 140735571034976 140735571029112 140088910882720 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 234238 228286 837 493 0 227543 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 936952 KiB
Current children cumulated memory: 913144 KiB

[startup+3.11012 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 2144
/proc/meminfo: memFree=27897036/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=1699964 memory=1676432 CPUtime=3.1 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 429853 0 0 0 259 51 0 0 20 0 1 0 434646581 1740763136 419108 33554432000 4194304 6211092 140735571034976 140735571033240 5397226 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 424991 419108 863 493 0 418296 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 1699964 KiB
Current children cumulated memory: 1676432 KiB

[startup+6.30042 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 2145
/proc/meminfo: memFree=27591996/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2014372 memory=1987316 CPUtime=6.28 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 532514 0 0 0 564 64 0 0 20 0 1 0 434646581 2062716928 496829 33554432000 4194304 6211092 140735571034976 140735571032568 5156465 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 503593 496829 873 493 0 496898 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 2014372 KiB
Current children cumulated memory: 1987316 KiB

[startup+12.7004 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 2145
/proc/meminfo: memFree=26965300/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2673904 memory=2606216 CPUtime=12.69 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 763229 0 0 0 1181 88 0 0 20 0 1 0 434646581 2738077696 651554 33554432000 4194304 6211092 140735571034976 140735571032936 140088910904288 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 668476 651554 874 493 0 661781 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 2673904 KiB
Current children cumulated memory: 2606216 KiB

[startup+25.5005 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 2145
/proc/meminfo: memFree=26713096/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2857832 CPUtime=25.48 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 934563 0 0 0 2446 102 0 0 20 0 1 0 434646581 3054706688 714458 33554432000 4194304 6211092 140735571034976 140735571032936 5397365 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714458 874 493 0 739083 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2857832 KiB

[startup+51.1098 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 2147
/proc/meminfo: memFree=26711980/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=51.09 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1044131 0 0 0 4998 111 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5409461 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2151
/proc/meminfo: memFree=26711676/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=102.28 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1133741 0 0 0 10112 116 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5186452 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2155
/proc/meminfo: memFree=26711956/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=162.28 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1195506 0 0 0 16107 121 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5156908 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2161
/proc/meminfo: memFree=26710880/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=222.25 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1253925 0 0 0 22101 124 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5156476 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2165
/proc/meminfo: memFree=26710816/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=282.24 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1301461 0 0 0 28098 126 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5155707 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2169
/proc/meminfo: memFree=26710996/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=342.23 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1338733 0 0 0 34094 129 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5155671 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2175
/proc/meminfo: memFree=26710428/32770624 swapFree=66984652/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=402.22 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1377693 0 0 0 40091 131 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5409424 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 2187
/proc/meminfo: memFree=26710320/32770624 swapFree=66984656/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2858056 CPUtime=462.22 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1431128 0 0 0 46087 135 0 0 20 0 1 0 434646581 3054706688 714514 33554432000 4194304 6211092 140735571034976 140735571032936 5250272 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 714514 874 493 0 739083 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858056 KiB


################
# More data... #
################

/proc/2143/statm: 745778 722842 874 493 0 739083 0
Current children cumulated CPU time: 1662.08 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2891368 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2420
/proc/meminfo: memFree=28290480/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2891368 CPUtime=1722.07 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1832697 0 0 0 172046 161 0 0 20 0 1 0 434646581 3054706688 722842 33554432000 4194304 6211092 140735571034976 140735571032936 5409461 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 722842 874 493 0 739083 0
Current children cumulated CPU time: 1722.07 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2891368 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2425
/proc/meminfo: memFree=28290916/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2891372 CPUtime=1782.06 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1834668 0 0 0 178045 161 0 0 20 0 1 0 434646581 3054706688 722843 33554432000 4194304 6211092 140735571034976 140735571032936 5155341 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 722843 874 493 0 739083 0
Current children cumulated CPU time: 1782.06 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2891372 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2431
/proc/meminfo: memFree=28272260/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2909016 CPUtime=1842.06 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1836064 0 0 0 184045 161 0 0 20 0 1 0 434646581 3054706688 727254 33554432000 4194304 6211092 140735571034976 140735571032936 5397375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 727254 874 493 0 739083 0
Current children cumulated CPU time: 1842.06 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2909016 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2435
/proc/meminfo: memFree=28247860/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2932680 CPUtime=1902.05 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1837459 0 0 0 190044 161 0 0 20 0 1 0 434646581 3054706688 733170 33554432000 4194304 6211092 140735571034976 140735571032936 5156256 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 733170 874 493 0 739083 0
Current children cumulated CPU time: 1902.05 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2932680 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2439
/proc/meminfo: memFree=28230140/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2950816 CPUtime=1962.05 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1841107 0 0 0 196043 162 0 0 20 0 1 0 434646581 3054706688 737704 33554432000 4194304 6211092 140735571034976 140735571032936 5250284 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 737704 874 493 0 739083 0
Current children cumulated CPU time: 1962.05 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2950816 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2445
/proc/meminfo: memFree=28226380/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2022.04 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1842794 0 0 0 202042 162 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5409453 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2022.04 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2449
/proc/meminfo: memFree=28226492/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2082.04 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1844159 0 0 0 208042 162 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5409453 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2082.04 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2453
/proc/meminfo: memFree=28226944/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2142.03 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1845799 0 0 0 214041 162 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5156256 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2142.03 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2459
/proc/meminfo: memFree=28227264/32770624 swapFree=66984676/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2202.02 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1848919 0 0 0 220040 162 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5156256 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2202.02 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2470
/proc/meminfo: memFree=28226912/32770624 swapFree=66984680/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2262.02 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1850488 0 0 0 226040 162 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5250251 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2262.02 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2474
/proc/meminfo: memFree=28226940/32770624 swapFree=66984680/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2322.01 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1853715 0 0 0 232039 162 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5155353 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2322.01 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2480
/proc/meminfo: memFree=28226780/32770624 swapFree=66984680/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2382.02 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1854730 0 0 0 238039 163 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5155712 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2382.02 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2480
/proc/meminfo: memFree=28226656/32770624 swapFree=66984680/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2400.01 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1855097 0 0 0 239838 163 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5409465 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2400.01 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.31 s]
# the end of solver process 2143 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2398.39 s, system=1.64485 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 2480
/proc/meminfo: memFree=28226656/32770624 swapFree=66984680/67108860
[pid=2143] ppid=2140 vsize=2983112 memory=2954156 CPUtime=2400.01 cores=0,2,4,6
/proc/2143/stat : 2143 (cosoco) R 2140 2143 32461 0 -1 4202496 1855097 0 0 0 239838 163 0 0 20 0 1 0 434646581 3054706688 738539 33554432000 4194304 6211092 140735571034976 140735571032936 5409465 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33124352 140735571043339 140735571043441 140735571043441 140735571046350 0
/proc/2143/statm: 745778 738539 874 493 0 739083 0
Current children cumulated CPU time: 2400.01 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2954156 KiB

Child status: 1
Real time (s): 2400.31
CPU time (s): 2400.03
CPU user time (s): 2398.39
CPU system time (s): 1.64485
CPU usage (%): 99.9883
Max. virtual memory (cumulated for all children) (KiB): 2983112
Max. memory (cumulated for all children) (KiB): 2954156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2398.39
system time used= 1.64485
maximum resident set size= 2954224
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1855148
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 138
involuntary context switches= 3006


# summary of solver processes directly reported to runsolver:
#   pid: 2143
#   total CPU time (s): 2400.03
#   total CPU user time (s): 2398.39
#   total CPU system time (s): 1.64485

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.55018 second user time and 17.9803 second system time

The end

Launcher Data 

Begin job on node121 at 2019-09-15 23:43:17
IDJOB=4397438
IDBENCH=134796
IDSOLVER=2849
FILE ID=node121/4397438-1568583839
RUNJOBID= node121-1568572742-32492
PBS_JOBID= 21703328
Free space on /tmp= 61260 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/PseudoBoolean/PseudoBoolean-dec-spng/Pb-NG-K171.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397438-1568583839/watcher-4397438-1568583839 -o /tmp/evaluation-result-4397438-1568583839/solver-4397438-1568583839 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node121-1568572742-32492 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397438-1568583839.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fad44a9d187d2d79449e3ca32a08f321
RANDOM SEED=2049076970

node121.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29572240 kB
MemAvailable:   30337272 kB
Buffers:          194176 kB
Cached:           875908 kB
SwapCached:        16432 kB
Active:          2176000 kB
Inactive:         479140 kB
Active(anon):    1572404 kB
Inactive(anon):    54700 kB
Active(file):     603596 kB
Inactive(file):   424440 kB
Unevictable:      108516 kB
Mlocked:          108516 kB
SwapTotal:      67108860 kB
SwapFree:       66984652 kB
Dirty:              4020 kB
Writeback:             4 kB
AnonPages:       1677268 kB
Mapped:            41892 kB
Shmem:             33212 kB
Slab:             134592 kB
SReclaimable:     105660 kB
SUnreclaim:        28932 kB
KernelStack:        3568 kB
PageTables:         9064 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2109180 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1626112 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 61400 MiB
End job on node121 at 2019-09-16 00:23:18