Trace number 4390158

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2400.13 2399.85

General information on the benchmark

NamePseudoBoolean/PseudoBoolean-dec-spng/
Pb-NG-K171.xml
MD5SUMfad44a9d187d2d79449e3ca32a08f321
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables20349
Number of constraints20693
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":20349}]
Minimum variable degree3
Maximum variable degree12
Distribution of variable degrees[{"degree":3,"count":1},{"degree":4,"count":299},{"degree":5,"count":2083},{"degree":6,"count":9159},{"degree":7,"count":5590},{"degree":8,"count":2200},{"degree":9,"count":678},{"degree":10,"count":169},{"degree":11,"count":1},{"degree":12,"count":169}]
Minimum constraint arity1
Maximum constraint arity171
Distribution of constraint arities[{"arity":1,"count":2},{"arity":2,"count":2210},{"arity":3,"count":9180},{"arity":4,"count":5610},{"arity":5,"count":2380},{"arity":6,"count":510},{"arity":7,"count":170},{"arity":9,"count":170},{"arity":119,"count":342},{"arity":171,"count":119}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":20693}]
Optimization problemNO
Type of objective

Solver Data 

3.59/3.61	c root propagations     : 742         
3.59/3.61	c restarts enabled, print stats at every restarts
3.59/3.61	c
3.59/3.61	c
3.59/3.61	c
3.59/3.61	c This is cosoco 2.00 --  
3.59/3.61	c
3.59/3.61	c command line: cosoco -lc -model -restarts -stick HOME/instance-4390158-1568347634.xml 
3.59/3.61	c ========================================[ Problem Statistics ]===========================================
3.59/3.61	c |                                                                                                       
3.59/3.61	c |  Parse time        :         2.13 s 
3.59/3.61	c |
3.59/3.61	c |               Variables: 20349
3.59/3.61	c |            Domain Sizes: 2..2
3.59/3.61	c |
3.59/3.61	c |             Constraints: 20693
3.59/3.61	c |                   Arity: 1..171  -- Unary: 2  -- Binary: 2210  -- Ternary: 9180
3.59/3.61	c | 
3.59/3.61	c |                   Types: 
3.59/3.61	c |                          Sum: 20693
3.59/3.61	c |                          
3.59/3.61	c =========================================================================================================
3.59/3.61	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
10.49/10.53	c 101            16133          1026735        275083         742            0              1193   15830   10024
16.39/16.48	c 211            39841          1980656        706863         742            0              402   18850   17568
19.39/19.41	c 332            46452          2389681        867363         742            0              1951   5144   4198
26.39/26.44	c 465            59425          3519864        1254350        742            0              1951   2508   2145
33.01/33.01	c 611            81986          4287911        1560111        742            0              1826   4077   3650
36.10/36.14	c 771            91868          4669477        1721119        742            0              877   5512   3990
41.40/41.48	c 947            103220         5423368        2052755        742            0              1670   3436   2050
44.39/44.45	c 1140           108738         5886211        2252884        742            0              1710   1826   1763
51.39/51.49	c 1352           138263         6430371        2444866        742            0              1109   3842   3102
55.50/55.56	c 1585           148268         6980298        2680523        742            0              1752   2802   2138
59.90/59.98	c 1841           156370         7683349        2953117        742            0              1988   2781   2082
64.11/64.18	c 2122           163321         8366709        3251184        742            0              1515   2153   2113
74.19/74.26	c 2431           173520         10271991       3921262        742            0              1544   1766   1707
79.80/79.85	c 2770           185015         11149385       4245826        742            0              1430   1906   1761
93.20/93.23	c 3142           193358         13675502       5179674        742            0              1361   1740   1687
101.01/101.08	c 3551           204916         14889133       5704718        742            0              1238   1404   1291
121.90/122.00	c 4000           219356         18586708       7018294        742            0              814   1016   938
129.50/129.59	c 4493           236889         19643113       7567711        742            0              870   2378   2234
136.91/136.94	c 5035           249222         20942182       8150989        742            0              1541   2427   2270
144.12/144.15	c 5631           266857         22096922       8585729        742            0              1725   1960   1839
154.91/154.99	c 6286           287671         23882770       9239677        742            0              1404   1927   1635
166.51/166.50	c 7006           301737         26262595       10149563       742            0              1556   1744   1674
179.92/179.94	c 7798           332857         28162781       10979443       742            0              409   2629   1909
188.12/188.15	c 8669           357899         29144113       11362506       742            0              1496   1915   1657
206.42/206.49	c 9627           390813         32044808       12610568       742            0              1274   1732   1503
221.72/221.75	c 10680          420783         34248728       13535150       742            0              1189   1474   1385
233.03/233.09	c 11838          447907         35846420       14206879       742            0              1167   1390   1243
252.22/252.26	c 13111          477378         38988569       15377166       742            0              933   1850   1329
271.53/271.59	c 14511          520740         41618310       16714671       742            0              1071   1946   1297
283.93/283.97	c 16051          543189         43731777       17812564       742            0              1139   1673   1301
310.73/310.77	c 17745          609529         47221050       19906258       742            0              1196   1945   1540
338.34/338.39	c 19608          694206         50952816       21190591       742            0              1290   2329   1760
381.15/381.18	c 21657          739435         58357379       24712185       742            0              1241   1482   1348
401.65/401.64	c 23910          775559         61508294       26403861       742            0              1069   1154   1127
436.54/436.50	c 26388          823509         67367710       28893529       742            0              778   1024   830
483.55/483.51	c 29113          910353         75348155       32729429       742            0              707   2184   1922
545.77/545.75	c 32110          1082818        82614871       35919997       742            0              976   1670   1312
616.37/616.31	c 35406          1305842        90230796       39440775       742            0              756   2769   1836
708.69/708.69	c 39031          1478397        105082782      45201057       742            0              1387   1770   1588
804.20/804.16	c 43018          1694369        119541152      51370682       742            0              851   2292   1980
908.81/908.78	c 47403          1819476        138937910      57865350       742            0              1428   1583   1507
1037.24/1037.11	c 52226          2280360        150194221      62731350       742            0              1376   2466   2018
1147.84/1147.70	c 57531          2606661        163602493      69558757       742            0              1501   2667   2010
1223.34/1223.25	c 63366          2872213        174334833      74192076       742            0              1859   2355   2101
1352.45/1352.34	c 69784          3131367        196427470      83822114       742            0              1511   1903   1739
1502.88/1502.78	c 76843          3799778        212222417      89492777       742            0              802   2531   2143
1664.59/1664.41	c 84607          4299887        235400364      99723138       742            0              1711   2518   1972
1825.51/1825.32	c 93147          4716378        261967725      111272791      742            0              1566   2148   1828
2073.93/2073.74	c 102541         5232363        304157319      127687970      742            0              1268   1870   1550
2269.56/2269.39	c 112874         5737631        335399363      143684257      742            0              1260   1610   1468
2400.07/2399.80	
2400.07/2399.80	c *** INTERRUPTED ***
2400.07/2399.80	c restarts              : 50          
2400.07/2399.80	c conflicts             : 120697       (50 /sec)
2400.07/2399.80	c decisions             : 5979587      (2493 /sec)
2400.07/2399.80	c propagations          : 153997920   (64214 /sec)
2400.07/2399.80	c root propagations     : 742         
2400.07/2399.80	c filter calls          : 359468741      (149892 /sec)
2400.07/2399.80	c useless filter calls  : 329976187      (91 %)
2400.07/2399.80	c Memory used           : 2913.20 MB
2400.07/2399.80	c CPU time              : 2398.19 s
2400.07/2399.80	c real time             : 2399.8 s
2400.07/2399.80	
2400.07/2399.80	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15331 MiB free)
  memory of node 1: 16384 MiB (15544 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390158-1568347634/watcher-4390158-1568347634 -o /tmp/evaluation-result-4390158-1568347634/solver-4390158-1568347634 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568347592-21996 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390158-1568347634.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=22025, runsolver pid=22022
Current StackSize limit: 8192 KiB


[startup+0.100109 s]*
/proc/loadavg: 1.00 1.09 1.48 3/200 22026
/proc/meminfo: memFree=31590008/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=42084 memory=18284 CPUtime=0.1 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 4764 0 0 0 10 0 0 0 20 0 1 0 410701305 43094016 4571 33554432000 4194304 6210612 140720972722880 140720972718824 5504023 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 10521 4571 807 493 0 3826 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 42084 KiB
Current children cumulated memory: 18284 KiB

[startup+0.209567 s]*
/proc/loadavg: 1.00 1.09 1.48 3/200 22026
/proc/meminfo: memFree=31565560/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=51264 memory=27524 CPUtime=0.21 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 7071 0 0 0 20 1 0 0 20 0 1 0 410701305 52494336 6881 33554432000 4194304 6210612 140720972722880 140720972718824 140502116465637 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 12816 6881 834 493 0 6121 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 51264 KiB
Current children cumulated memory: 27524 KiB

[startup+0.309539 s]*
/proc/loadavg: 1.00 1.09 1.48 3/200 22026
/proc/meminfo: memFree=31509016/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=66492 memory=42836 CPUtime=0.31 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 10896 0 0 0 30 1 0 0 20 0 1 0 410701305 68087808 10709 33554432000 4194304 6210612 140720972722880 140720972716920 5524528 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 16623 10709 834 493 0 9928 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 66492 KiB
Current children cumulated memory: 42836 KiB

[startup+0.700291 s]
/proc/loadavg: 1.00 1.09 1.48 3/200 22026
/proc/meminfo: memFree=31261636/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=270652 memory=246908 CPUtime=0.69 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 61917 0 0 0 62 7 0 0 20 0 1 0 410701305 277147648 61727 33554432000 4194304 6210612 140720972722880 140720972720152 5722772 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 67663 61727 834 493 0 60968 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 270652 KiB
Current children cumulated memory: 246908 KiB

[startup+1.50031 s]
/proc/loadavg: 1.00 1.09 1.48 3/200 22026
/proc/meminfo: memFree=30655152/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=951024 memory=927124 CPUtime=1.49 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 232004 0 0 0 120 29 0 0 20 0 1 0 410701305 973848576 231781 33554432000 4194304 6210612 140720972722880 140720972717032 140502116513696 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 237756 231781 834 493 0 231061 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 951024 KiB
Current children cumulated memory: 927124 KiB

[startup+3.11001 s]
/proc/loadavg: 1.00 1.09 1.48 3/200 22026
/proc/meminfo: memFree=28844032/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=1699964 memory=1676360 CPUtime=3.1 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 429862 0 0 0 257 53 0 0 20 0 1 0 410701305 1740763136 419090 33554432000 4194304 6210612 140720972722880 140720972721144 5397066 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 424991 419090 845 493 0 418296 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 1699964 KiB
Current children cumulated memory: 1676360 KiB

[startup+6.30032 s]
/proc/loadavg: 1.08 1.10 1.49 4/200 22026
/proc/meminfo: memFree=28145000/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=2014372 memory=1987416 CPUtime=6.29 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 533033 0 0 0 564 65 0 0 20 0 1 0 410701305 2062716928 496854 33554432000 4194304 6210612 140720972722880 140720972720472 5154977 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 503593 496854 869 493 0 496898 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 2014372 KiB
Current children cumulated memory: 1987416 KiB

[startup+12.7003 s]
/proc/loadavg: 1.16 1.12 1.49 3/200 22026
/proc/meminfo: memFree=27215120/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=2681876 memory=2611892 CPUtime=12.7 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 767491 0 0 0 1181 89 0 0 20 0 1 0 410701305 2746241024 652973 33554432000 4194304 6210612 140720972722880 140720972720472 5008544 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 670469 652973 871 493 0 663774 0
Current children cumulated CPU time: 12.7 s
Current children cumulated vsize: 2681876 KiB
Current children cumulated memory: 2611892 KiB

[startup+25.5003 s]
/proc/loadavg: 1.34 1.16 1.50 4/201 22029
/proc/meminfo: memFree=26955944/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2857820 CPUtime=25.49 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 933156 0 0 0 2448 101 0 0 20 0 1 0 410701305 3054706688 714455 33554432000 4194304 6210612 140720972722880 140720972720840 5249907 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714455 871 493 0 739083 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2857820 KiB

[startup+51.1099 s]
/proc/loadavg: 1.57 1.23 1.51 3/200 22029
/proc/meminfo: memFree=26955100/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=51.1 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1042269 0 0 0 5002 108 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5157090 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+102.3 s]
/proc/loadavg: 1.81 1.35 1.54 4/199 22033
/proc/meminfo: memFree=26954200/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=102.3 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1132925 0 0 0 10115 115 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5155432 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+162.3 s]
/proc/loadavg: 1.88 1.45 1.56 3/199 22039
/proc/meminfo: memFree=26954536/32770624 swapFree=66917868/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=162.31 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1194509 0 0 0 16112 119 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5155002 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+222.3 s]
/proc/loadavg: 1.95 1.55 1.59 4/200 22051
/proc/meminfo: memFree=26952232/32770624 swapFree=66917876/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=222.32 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1261325 0 0 0 22109 123 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5409316 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 222.32 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+282.3 s]
/proc/loadavg: 1.98 1.63 1.61 3/200 22055
/proc/meminfo: memFree=26952264/32770624 swapFree=66917876/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=282.33 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1305366 0 0 0 28107 126 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5154977 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 282.33 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+342.3 s]
/proc/loadavg: 1.99 1.70 1.64 4/201 22062
/proc/meminfo: memFree=26951840/32770624 swapFree=66917876/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=342.33 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1364224 0 0 0 34102 131 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5155888 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.75 1.66 3/200 22066
/proc/meminfo: memFree=26953516/32770624 swapFree=66917876/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=402.34 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1413239 0 0 0 40100 134 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5249733 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 402.34 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.80 1.68 3/201 22071
/proc/meminfo: memFree=26951980/32770624 swapFree=66917876/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=462.35 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 1455634 0 0 0 46098 137 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5409284 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 462.35 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB


################
# More data... #
################

/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 1602.48 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 1.99 1.91 4/201 22184
/proc/meminfo: memFree=26917056/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=1662.49 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2118457 0 0 0 166071 178 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 1662.49 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/200 22188
/proc/meminfo: memFree=26917024/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=1722.5 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2153573 0 0 0 172070 180 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 1722.5 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 1.92 3/199 22194
/proc/meminfo: memFree=26916284/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=1782.5 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2160894 0 0 0 178070 180 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5154973 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 1782.5 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 1.92 3/199 22198
/proc/meminfo: memFree=26916680/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=1842.51 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2195010 0 0 0 184069 182 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 1842.51 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 1.93 3/199 22202
/proc/meminfo: memFree=26916584/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858044 CPUtime=1902.52 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2203148 0 0 0 190069 183 0 0 20 0 1 0 410701305 3054706688 714511 33554432000 4194304 6210612 140720972722880 140720972720840 5409284 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714511 871 493 0 739083 0
Current children cumulated CPU time: 1902.52 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858044 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 1.93 4/199 22208
/proc/meminfo: memFree=26916536/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858068 CPUtime=1962.53 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2208964 0 0 0 196069 184 0 0 20 0 1 0 410701305 3054706688 714517 33554432000 4194304 6210612 140720972722880 140720972720840 5155888 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714517 871 493 0 739083 0
Current children cumulated CPU time: 1962.53 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858068 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 1.94 4/200 22220
/proc/meminfo: memFree=26916468/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858068 CPUtime=2022.53 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2214084 0 0 0 202069 184 0 0 20 0 1 0 410701305 3054706688 714517 33554432000 4194304 6210612 140720972722880 140720972720840 5249727 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714517 871 493 0 739083 0
Current children cumulated CPU time: 2022.53 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858068 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/200 22224
/proc/meminfo: memFree=26917132/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858068 CPUtime=2082.54 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2241286 0 0 0 208068 186 0 0 20 0 1 0 410701305 3054706688 714517 33554432000 4194304 6210612 140720972722880 140720972720840 5409284 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714517 871 493 0 739083 0
Current children cumulated CPU time: 2082.54 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858068 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/200 22230
/proc/meminfo: memFree=26916512/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858068 CPUtime=2142.54 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2248109 0 0 0 214068 186 0 0 20 0 1 0 410701305 3054706688 714517 33554432000 4194304 6210612 140720972722880 140720972720840 5185856 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714517 871 493 0 739083 0
Current children cumulated CPU time: 2142.54 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858068 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/200 22234
/proc/meminfo: memFree=26916272/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858188 CPUtime=2202.55 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2252652 0 0 0 220068 187 0 0 20 0 1 0 410701305 3054706688 714547 33554432000 4194304 6210612 140720972722880 140720972720840 5409284 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714547 871 493 0 739083 0
Current children cumulated CPU time: 2202.55 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858188 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/200 22238
/proc/meminfo: memFree=26915184/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858764 CPUtime=2262.56 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2255410 0 0 0 226069 187 0 0 20 0 1 0 410701305 3054706688 714691 33554432000 4194304 6210612 140720972722880 140720972720840 5409305 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714691 871 493 0 739083 0
Current children cumulated CPU time: 2262.56 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858764 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 22244
/proc/meminfo: memFree=26914972/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858764 CPUtime=2322.56 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2274430 0 0 0 232068 188 0 0 20 0 1 0 410701305 3054706688 714691 33554432000 4194304 6210612 140720972722880 140720972720840 5154977 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714691 871 493 0 739083 0
Current children cumulated CPU time: 2322.56 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858764 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 22248
/proc/meminfo: memFree=26915064/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2858764 CPUtime=2382.56 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2277804 0 0 0 238068 188 0 0 20 0 1 0 410701305 3054706688 714691 33554432000 4194304 6210612 140720972722880 140720972720840 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 714691 871 493 0 739083 0
Current children cumulated CPU time: 2382.56 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2858764 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.8 s]
/proc/loadavg: 2.00 1.99 1.95 3/199 22248
/proc/meminfo: memFree=26912536/32770624 swapFree=66917896/67108860
[pid=22025] ppid=22022 vsize=2983112 memory=2861760 CPUtime=2400.07 cores=1,3,5,7
/proc/22025/stat : 22025 (cosoco) R 22022 22025 21964 0 -1 4202496 2280166 0 0 0 239818 189 0 0 20 0 1 0 410701305 3054706688 715440 33554432000 4194304 6210612 140720972722880 140720972720840 5409293 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 38227968 140720972731403 140720972731505 140720972731505 140720972734414 0
/proc/22025/statm: 745778 715440 871 493 0 739083 0
Current children cumulated CPU time: 2400.07 s
Current children cumulated vsize: 2983112 KiB
Current children cumulated memory: 2861760 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.85 s]
# the end of solver process 22025 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2398.19 s, system=1.94325 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2399.85
CPU time (s): 2400.13
CPU user time (s): 2398.19
CPU system time (s): 1.94325
CPU usage (%): 100.012
Max. virtual memory (cumulated for all children) (KiB): 2983112
Max. memory (cumulated for all children) (KiB): 2861760

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2398.19
system time used= 1.94325
maximum resident set size= 2861832
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2280220
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 80
involuntary context switches= 638


# summary of solver processes directly reported to runsolver:
#   pid: 22025
#   total CPU time (s): 2400.13
#   total CPU user time (s): 2398.19
#   total CPU system time (s): 1.94325

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0202 second user time and 17.8882 second system time

The end

Launcher Data 

Begin job on node141 at 2019-09-13 06:06:32
IDJOB=4390158
IDBENCH=134796
IDSOLVER=2830
FILE ID=node141/4390158-1568347634
RUNJOBID= node141-1568347592-21996
PBS_JOBID= 21701171
Free space on /tmp= 56108 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/PseudoBoolean/PseudoBoolean-dec-spng/Pb-NG-K171.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390158-1568347634/watcher-4390158-1568347634 -o /tmp/evaluation-result-4390158-1568347634/solver-4390158-1568347634 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568347592-21996 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390158-1568347634.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fad44a9d187d2d79449e3ca32a08f321
RANDOM SEED=1459747004

node141.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31616772 kB
MemAvailable:   31842436 kB
Buffers:          135356 kB
Cached:           378072 kB
SwapCached:        81556 kB
Active:           233472 kB
Inactive:         365172 kB
Active(anon):       9248 kB
Inactive(anon):   106464 kB
Active(file):     224224 kB
Inactive(file):   258708 kB
Unevictable:      109204 kB
Mlocked:          109204 kB
SwapTotal:      67108860 kB
SwapFree:       66917868 kB
Dirty:              7780 kB
Writeback:             0 kB
AnonPages:        112904 kB
Mapped:            33744 kB
Shmem:             21916 kB
Slab:             146604 kB
SReclaimable:     117136 kB
SUnreclaim:        29468 kB
KernelStack:        3296 kB
PageTables:         5976 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     503972 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      128384 kB
DirectMap2M:    33417216 kB

Free space on /tmp at the end= 56104 MiB
End job on node141 at 2019-09-13 06:46:32