Trace number 4408570

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.07 2400.2

General information on the benchmark

NameQRandom/QRandom-mdd-7-25-5-p7/
mdd-7-25-5-ps05-psh07-3.xml
MD5SUM740fe7811b49d7235b98ec4fc0ed8229
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark56.0776
Satisfiable
(Un)Satisfiability was proved
Number of variables25
Number of constraints58
Number of domains1
Minimum domain size5
Maximum domain size5
Distribution of domain sizes[{"size":5,"count":25}]
Minimum variable degree8
Maximum variable degree23
Distribution of variable degrees[{"degree":8,"count":1},{"degree":11,"count":1},{"degree":12,"count":1},{"degree":13,"count":3},{"degree":14,"count":1},{"degree":15,"count":4},{"degree":16,"count":1},{"degree":17,"count":4},{"degree":18,"count":2},{"degree":19,"count":3},{"degree":20,"count":1},{"degree":21,"count":2},{"degree":23,"count":1}]
Minimum constraint arity7
Maximum constraint arity7
Distribution of constraint arities[{"arity":7,"count":58}]
Number of extensional constraints58
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":58}]
Optimization problemNO
Type of objective

Solver Data 

14.28/14.39	c root propagations     : 0           
14.28/14.39	c restarts enabled, print stats at every restarts
14.28/14.39	c
14.28/14.39	c
14.28/14.39	c
14.28/14.39	c This is cosoco 2.00 --  
14.28/14.39	c
14.28/14.39	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408570-1569792199.xml 
14.28/14.39	c ========================================[ Problem Statistics ]===========================================
14.28/14.39	c |                                                                                                       
14.28/14.39	c |  Parse time        :        14.24 s 
14.28/14.39	c |
14.28/14.39	c |               Variables: 25
14.28/14.39	c |            Domain Sizes: 5..5
14.28/14.39	c |
14.28/14.39	c |             Constraints: 58
14.28/14.39	c |                   Arity: 7..7
14.28/14.39	c | 
14.28/14.39	c |                   Types: 
14.28/14.39	c |                          Extension: 58  (nb tuples: 38527..39595) -- (shared: 0)
14.28/14.39	c |                          
14.28/14.39	c =========================================================================================================
14.28/14.39	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
17.48/17.52	c 101            212            14600          4816           0              0              6   12   8     
21.78/21.84	c 211            463            31689          10704          0              0              5   12   8     
24.58/24.64	c 332            771            52078          17062          0              0              6   13   9     
28.58/28.68	c 465            1060           72044          24122          0              0              6   13   8     
31.78/31.88	c 611            1378           94108          31260          0              0              6   12   8     
35.78/35.86	c 771            1751           120319         39605          0              0              6   12   9     
40.28/40.37	c 947            2142           149093         49033          0              0              6   12   9     
45.78/45.89	c 1140           2578           180093         59041          0              0              5   12   8     
52.09/52.13	c 1352           3037           212341         69417          0              0              7   12   8     
57.48/57.52	c 1585           3590           250050         81570          0              0              6   14   9     
63.18/63.28	c 1841           4187           289074         94365          0              0              6   12   9     
68.99/69.09	c 2122           4826           328589         107502         0              0              5   13   8     
74.88/74.99	c 2431           5583           374228         122755         0              0              6   13   9     
86.17/86.22	c 2770           6361           427931         140149         0              0              5   12   8     
95.57/95.69	c 3142           7199           483190         159476         0              0              5   13   8     
107.77/107.84	c 3551           8166           546860         180793         0              0              4   12   8     
118.36/118.41	c 4000           9259           620235         206060         0              0              6   12   8     
130.76/130.81	c 4493           10401          698130         231457         0              0              5   13   8     
141.65/141.72	c 5035           11700          782011         258595         0              0              5   14   9     
157.24/157.31	c 5631           13132          877029         290122         0              0              4   13   9     
172.05/172.18	c 6286           14687          977903         324135         0              0              5   12   9     
187.05/187.11	c 7006           16290          1086514        360709         0              0              6   13   9     
211.64/211.77	c 7798           18040          1207216        401692         0              0              4   12   8     
235.05/235.13	c 8669           20089          1342005        447082         0              0              4   13   8     
257.95/258.04	c 9627           22328          1493434        496736         0              0              5   13   9     
280.44/280.51	c 10680          24741          1650558        551397         0              0              4   13   8     
316.54/316.69	c 11838          27584          1843417        614570         0              0              4   15   8     
356.64/356.78	c 13111          30607          2053328        684743         0              0              5   14   8     
391.24/391.30	c 14511          34002          2282385        761495         0              0              5   14   9     
435.04/435.18	c 16051          37541          2524794        842621         0              0              4   13   8     
468.73/468.83	c 17745          41418          2791588        930437         0              0              5   14   8     
535.33/535.41	c 19608          45882          3104076        1034124        0              0              4   13   8     
571.13/571.22	c 21657          50721          3434053        1141860        0              0              5   13   9     
627.22/627.33	c 23910          55905          3781306        1257283        0              0              5   14   8     
694.03/694.16	c 26388          61655          4166409        1384285        0              0              4   15   8     
765.42/765.59	c 29113          68418          4636451        1531574        0              0              4   14   9     
818.22/818.30	c 32110          75460          5110061        1685427        0              0              5   13   9     
882.21/882.33	c 35406          83432          5628624        1848437        0              0              5   15   9     
955.51/955.69	c 39031          91977          6190969        2030080        0              0              3   15   8     
1040.31/1040.44	c 43018          101400         6779217        2217172        0              0              4   14   8     
1168.31/1168.48	c 47403          111822         7476454        2448169        0              0              3   13   8     
1287.20/1287.39	c 52226          123581         8270596        2705315        0              0              4   15   8     
1459.20/1459.36	c 57531          136179         9117591        2977617        0              0              4   15   8     
1599.39/1599.57	c 63366          149899         10020430       3266014        0              0              4   16   8     
1707.58/1707.73	c 69784          164354         10997403       3581889        0              0              5   14   8     
1939.27/1939.48	c 76843          181167         12157510       3953162        0              0              3   15   8     
2126.67/2126.80	c 84607          199972         13401766       4356268        0              0              3   16   8     
2360.36/2360.51	c 93147          220099         14747136       4793079        0              0              4   14   8     
2400.06/2400.20	
2400.06/2400.20	c *** INTERRUPTED ***
2400.06/2400.20	c restarts              : 48          
2400.06/2400.20	c conflicts             : 94587        (39 /sec)
2400.06/2400.20	c decisions             : 223640       (93 /sec)
2400.06/2400.20	c propagations          : 4868371     (2029 /sec)
2400.06/2400.20	c root propagations     : 0           
2400.06/2400.20	c filter calls          : 14987442       (6245 /sec)
2400.06/2400.20	c useless filter calls  : 12565284       (83 %)
2400.06/2400.20	c Memory used           : 200.06 MB
2400.06/2400.20	c CPU time              : 2399.88 s
2400.06/2400.20	c real time             : 2400.2 s
2400.06/2400.20	
2400.06/2400.20	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15284 MiB free)
  memory of node 1: 16384 MiB (15592 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408570-1569792199/watcher-4408570-1569792199 -o /tmp/evaluation-result-4408570-1569792199/solver-4408570-1569792199 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1569787336-17163 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408570-1569792199.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=18329, runsolver pid=18326
Current StackSize limit: 8192 KiB


[startup+0.100198 s]*
/proc/loadavg: 2.04 2.00 1.96 3/201 18330
/proc/meminfo: memFree=31618512/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=28844 memory=4728 CPUtime=0.1 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 1499 0 0 0 10 0 0 0 20 0 1 0 555473038 29536256 1182 33554432000 4194304 6211132 140728473993520 140728473990056 140227929140197 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 7211 1182 803 493 0 516 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28844 KiB
Current children cumulated memory: 4728 KiB

[startup+0.209573 s]*
/proc/loadavg: 2.04 2.00 1.96 3/201 18330
/proc/meminfo: memFree=31616652/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=30404 memory=5880 CPUtime=0.21 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 2007 0 0 0 21 0 0 0 20 0 1 0 555473038 31133696 1470 33554432000 4194304 6211132 140728473993520 140728473990056 5816217 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 7601 1470 803 493 0 906 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30404 KiB
Current children cumulated memory: 5880 KiB

[startup+0.309215 s]*
/proc/loadavg: 2.04 2.00 1.96 3/201 18330
/proc/meminfo: memFree=31611692/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=34656 memory=10760 CPUtime=0.31 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 3420 0 0 0 31 0 0 0 20 0 1 0 555473038 35487744 2690 33554432000 4194304 6211132 140728473993520 140728473990056 5483326 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 8664 2690 809 493 0 1969 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 34656 KiB
Current children cumulated memory: 10760 KiB

[startup+0.700354 s]
/proc/loadavg: 1.87 1.97 1.95 3/201 18330
/proc/meminfo: memFree=31608508/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=38988 memory=14716 CPUtime=0.69 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 4431 0 0 0 69 0 0 0 20 0 1 0 555473038 39923712 3679 33554432000 4194304 6211132 140728473993520 140728473990792 5818472 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 9747 3679 809 493 0 3052 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 38988 KiB
Current children cumulated memory: 14716 KiB

[startup+1.50037 s]
/proc/loadavg: 1.87 1.97 1.95 3/201 18330
/proc/meminfo: memFree=31603424/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=49788 memory=24484 CPUtime=1.49 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 6896 0 0 0 149 0 0 0 20 0 1 0 555473038 50982912 6121 33554432000 4194304 6211132 140728473993520 140728473990792 140227945202816 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 12447 6121 809 493 0 5752 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 49788 KiB
Current children cumulated memory: 24484 KiB

[startup+3.10974 s]
/proc/loadavg: 1.87 1.97 1.95 3/201 18330
/proc/meminfo: memFree=31584496/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=66184 memory=38308 CPUtime=3.09 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 11783 0 0 0 309 0 0 0 20 0 1 0 555473038 67772416 9577 33554432000 4194304 6211132 140728473993520 140728473990792 5484897 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 16546 9577 809 493 0 9851 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 66184 KiB
Current children cumulated memory: 38308 KiB

[startup+6.30039 s]
/proc/loadavg: 1.88 1.97 1.95 3/201 18330
/proc/meminfo: memFree=31554204/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=100944 memory=70652 CPUtime=6.28 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 21333 0 0 0 627 1 0 0 20 0 1 0 555473038 103366656 17663 33554432000 4194304 6211132 140728473993520 140728473990792 5816697 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 25236 17663 810 493 0 18541 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 100944 KiB
Current children cumulated memory: 70652 KiB

[startup+12.7003 s]
/proc/loadavg: 1.89 1.97 1.95 3/201 18330
/proc/meminfo: memFree=31495552/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=170972 memory=133808 CPUtime=12.68 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 38930 0 0 0 1264 4 0 0 20 0 1 0 555473038 175075328 33452 33554432000 4194304 6211132 140728473993520 140728473990792 5812158 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 42743 33452 810 493 0 36048 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 170972 KiB
Current children cumulated memory: 133808 KiB

[startup+25.5003 s]
/proc/loadavg: 1.84 1.95 1.95 3/201 18330
/proc/meminfo: memFree=31454740/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=167416 CPUtime=25.48 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 121276 0 0 0 2538 10 0 0 20 0 1 0 555473038 209772544 41854 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 41854 855 493 0 44519 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 167416 KiB

[startup+51.1096 s]
/proc/loadavg: 1.90 1.96 1.95 3/201 18332
/proc/meminfo: memFree=31453180/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=167416 CPUtime=51.09 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 161346 0 0 0 5097 12 0 0 20 0 1 0 555473038 209772544 41854 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 41854 855 493 0 44519 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 167416 KiB

[startup+102.3 s]
/proc/loadavg: 1.96 1.96 1.95 3/201 18336
/proc/meminfo: memFree=31452104/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=167648 CPUtime=102.27 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 201419 0 0 0 10213 14 0 0 20 0 1 0 555473038 209772544 41912 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 41912 855 493 0 44519 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 167648 KiB

[startup+162.3 s]
/proc/loadavg: 1.98 1.97 1.95 3/199 18341
/proc/meminfo: memFree=31443876/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=176208 CPUtime=162.24 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 231855 0 0 0 16209 15 0 0 20 0 1 0 555473038 209772544 44052 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 44052 855 493 0 44519 0
Current children cumulated CPU time: 162.24 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 176208 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 1.99 1.96 3/199 18347
/proc/meminfo: memFree=31438972/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=222.24 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 239088 0 0 0 22208 16 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038992 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+282.3 s]
/proc/loadavg: 2.01 1.99 1.96 3/199 18351
/proc/meminfo: memFree=31438576/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=282.24 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 239992 0 0 0 28208 16 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5037825 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+342.3 s]
/proc/loadavg: 2.10 2.02 1.97 3/199 18420
/proc/meminfo: memFree=31380628/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=342.24 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 240896 0 0 0 34208 16 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+402.3 s]
/proc/loadavg: 2.04 2.01 1.97 3/199 18490
/proc/meminfo: memFree=31380060/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=402.23 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 241800 0 0 0 40207 16 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 402.23 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.01 1.97 3/200 18502
/proc/meminfo: memFree=31379212/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=462.23 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 242704 0 0 0 46207 16 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 462.23 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB


################
# More data... #
################

/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 1602.19 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+1662.3 s]
/proc/loadavg: 2.25 2.13 2.02 3/200 18673
/proc/meminfo: memFree=31244480/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=1662.19 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 259340 0 0 0 166202 17 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 1662.19 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+1722.3 s]
/proc/loadavg: 2.09 2.11 2.02 3/200 18677
/proc/meminfo: memFree=31244624/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=1722.18 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 260244 0 0 0 172201 17 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 1722.18 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+1782.3 s]
/proc/loadavg: 2.03 2.09 2.02 3/200 18681
/proc/meminfo: memFree=31244852/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=1782.18 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 261073 0 0 0 178201 17 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5037825 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 1782.18 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.07 2.02 3/201 18700
/proc/meminfo: memFree=31243416/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=1842.18 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 261842 0 0 0 184201 17 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 1842.18 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+1902.3 s]
/proc/loadavg: 2.08 2.08 2.02 3/201 18704
/proc/meminfo: memFree=31244408/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=1902.18 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 262537 0 0 0 190201 17 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 1902.18 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+1962.3 s]
/proc/loadavg: 2.03 2.06 2.02 3/200 18709
/proc/meminfo: memFree=31244680/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=1962.18 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 263441 0 0 0 196200 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 1962.18 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+2022.3 s]
/proc/loadavg: 2.13 2.08 2.04 3/200 18715
/proc/meminfo: memFree=31244536/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2022.18 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 264333 0 0 0 202200 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2022.18 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+2082.3 s]
/proc/loadavg: 2.05 2.07 2.04 3/200 18719
/proc/meminfo: memFree=31244512/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2082.17 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 265163 0 0 0 208199 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2082.17 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+2142.3 s]
/proc/loadavg: 2.02 2.06 2.04 3/199 18724
/proc/meminfo: memFree=31244328/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2142.17 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 266067 0 0 0 214199 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5037841 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2142.17 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.04 2.04 3/199 18730
/proc/meminfo: memFree=31243760/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2202.17 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 266868 0 0 0 220199 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5037823 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2202.17 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.04 2.04 3/200 18742
/proc/meminfo: memFree=31242624/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2262.17 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 267586 0 0 0 226199 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2262.17 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.03 2.04 3/201 18772
/proc/meminfo: memFree=31242904/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2322.16 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 268246 0 0 0 232198 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2322.16 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.03 2.04 3/201 18778
/proc/meminfo: memFree=31242920/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2382.16 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 269150 0 0 0 238198 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5039014 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2382.16 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 2.00 2.02 2.04 3/201 18778
/proc/meminfo: memFree=31242768/32770624 swapFree=66999256/67108860
[pid=18329] ppid=18326 vsize=204856 memory=181096 CPUtime=2400.06 cores=0,2,4,6
/proc/18329/stat : 18329 (cosoco) R 18326 18329 17132 0 -1 4202496 269744 0 0 0 239988 18 0 0 20 0 1 0 555473038 209772544 45274 33554432000 4194304 6211132 140728473993520 140728473991480 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 15773696 140728474002443 140728474002545 140728474002545 140728474005454 0
/proc/18329/statm: 51214 45274 855 493 0 44519 0
Current children cumulated CPU time: 2400.06 s
Current children cumulated vsize: 204856 KiB
Current children cumulated memory: 181096 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.2 s]
# the end of solver process 18329 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.88 s, system=0.18899 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.2
CPU time (s): 2400.07
CPU user time (s): 2399.88
CPU system time (s): 0.18899
CPU usage (%): 99.9946
Max. virtual memory (cumulated for all children) (KiB): 204856
Max. memory (cumulated for all children) (KiB): 181096

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.88
system time used= 0.18899
maximum resident set size= 181156
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 269794
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 35
involuntary context switches= 822


# summary of solver processes directly reported to runsolver:
#   pid: 18329
#   total CPU time (s): 2400.07
#   total CPU user time (s): 2399.88
#   total CPU system time (s): 0.18899

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.5415 second user time and 14.9903 second system time

The end

Launcher Data 

Begin job on node103 at 2019-09-29 23:22:21
IDJOB=4408570
IDBENCH=125596
IDSOLVER=2875
FILE ID=node103/4408570-1569792199
RUNJOBID= node103-1569787336-17163
PBS_JOBID= 21705840
Free space on /tmp= 61996 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/QRandom/QRandom-mdd-7-25-5-p7/mdd-7-25-5-ps05-psh07-3.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408570-1569792199/watcher-4408570-1569792199 -o /tmp/evaluation-result-4408570-1569792199/solver-4408570-1569792199 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1569787336-17163 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408570-1569792199.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 740fe7811b49d7235b98ec4fc0ed8229
RANDOM SEED=1626370221

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31619784 kB
MemAvailable:   31863352 kB
Buffers:          161124 kB
Cached:           427212 kB
SwapCached:         7000 kB
Active:           374408 kB
Inactive:         238776 kB
Active(anon):      32172 kB
Inactive(anon):    74928 kB
Active(file):     342236 kB
Inactive(file):   163848 kB
Unevictable:      107020 kB
Mlocked:          107020 kB
SwapTotal:      67108860 kB
SwapFree:       66999256 kB
Dirty:             35964 kB
Writeback:             0 kB
AnonPages:        126096 kB
Mapped:            28720 kB
Shmem:             73656 kB
Slab:             135200 kB
SReclaimable:     106636 kB
SUnreclaim:        28564 kB
KernelStack:        3568 kB
PageTables:         5560 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     578168 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     79872 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 61960 MiB
End job on node103 at 2019-09-30 00:02:21