Trace number 4267413

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco-mini 1.12? (TO) 2400.01 2399.8999

General information on the benchmark

NameQRandom/QRandom-mdd-7-25-5/
mdd-7-25-5-56-16.xml
MD5SUM9d7406c968f8af9220e5e662d0bd5052
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables25
Number of constraints56
Number of domains1
Minimum domain size5
Maximum domain size5
Distribution of domain sizes[{"size":5,"count":25}]
Minimum variable degree8
Maximum variable degree24
Distribution of variable degrees[{"degree":8,"count":1},{"degree":9,"count":1},{"degree":10,"count":1},{"degree":11,"count":1},{"degree":13,"count":2},{"degree":14,"count":2},{"degree":15,"count":2},{"degree":16,"count":4},{"degree":17,"count":3},{"degree":18,"count":3},{"degree":19,"count":3},{"degree":20,"count":1},{"degree":24,"count":1}]
Minimum constraint arity7
Maximum constraint arity7
Distribution of constraint arities[{"arity":7,"count":56}]
Number of extensional constraints56
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":56}]
Optimization problemNO
Type of objective

Solver Data 

13.59/13.68	c root propagations     : 0           
13.59/13.68	c restarts enabled, print stats at every restarts
13.59/13.68	c
13.59/13.68	c
13.59/13.68	c
13.59/13.68	c This is cosoco 1.12 --  
13.59/13.68	c
13.59/13.68	c command line: cosoco -lc -model -restarts HOME/instance-4267413-1502606160.xml 
13.59/13.68	c ========================================[ Problem Statistics ]===========================================
13.59/13.68	c |                                                                                                       
13.59/13.68	c |  Parse time        :        13.54 s 
13.59/13.68	c |
13.59/13.68	c |               Variables: 25
13.59/13.68	c |            Domain Sizes: 5..5
13.59/13.68	c |
13.59/13.68	c |             Constraints: 56
13.59/13.68	c |                   Arity: 7..7
13.59/13.68	c | 
13.59/13.68	c |                   Types: 
13.59/13.68	c |                          Extension: 56  (nb tuples: 33018..45409) -- (shared: 0)
13.59/13.68	c |                          
13.59/13.68	c =========================================================================================================
13.59/13.68	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
14.09/14.18	c 101            205            13758          4107           0              0              11   15   13   
14.79/14.80	c 211            490            32330          9483           0              0              8   16   12    
15.59/15.63	c 332            775            50160          15358          0              0              8   15   11    
15.99/16.03	c 465            1089           67886          20630          0              0              8   17   12    
16.59/16.63	c 611            1464           90980          27565          0              0              7   17   12    
17.29/17.34	c 771            1823           113628         34401          0              0              8   16   11    
17.99/18.10	c 947            2300           142309         42946          0              0              8   17   12    
19.19/19.20	c 1140           2750           170628         51777          0              0              8   16   11    
19.89/20.00	c 1352           3264           203338         61819          0              0              8   16   12    
21.69/21.71	c 1585           3860           240074         72959          0              0              7   15   11    
23.28/23.36	c 1841           4516           278862         84031          0              0              9   15   12    
24.29/24.31	c 2122           5196           322054         97017          0              0              8   14   11    
25.49/25.53	c 2431           5948           369586         111434         0              0              8   16   11    
27.49/27.56	c 2770           6896           426676         128080         0              0              8   17   12    
31.19/31.27	c 3142           7912           489167         145791         0              0              7   17   11    
33.89/33.93	c 3551           8857           551981         164015         0              0              8   16   12    
36.00/36.10	c 4000           10091          627646         186028         0              0              7   15   11    
38.19/38.23	c 4493           11279          705157         209829         0              0              8   16   11    
41.89/41.90	c 5035           12649          794136         235787         0              0              7   16   11    
45.89/45.93	c 5631           14253          893437         264259         0              0              7   17   12    
48.69/48.71	c 6286           15713          990583         293593         0              0              8   16   11    
53.19/53.23	c 7006           17621          1106681        327287         0              0              6   17   11    
56.99/57.09	c 7798           19563          1235094        365084         0              0              8   16   11    
62.49/62.51	c 8669           21930          1380059        406519         0              0              7   17   11    
68.69/68.79	c 9627           24466          1554412        456065         0              0              7   17   11    
73.49/73.50	c 10680          27274          1731869        507264         0              0              7   16   11    
78.89/78.90	c 11838          30132          1912402        559742         0              0              7   16   11    
84.79/84.84	c 13111          33211          2095639        614603         0              0              7   18   11    
93.59/93.61	c 14511          36518          2308177        677463         0              0              7   17   11    
106.89/106.97	c 16051          40571          2572753        753262         0              0              7   17   11    
114.38/114.47	c 17745          44799          2845238        832949         0              0              7   16   11    
124.09/124.15	c 19608          50018          3166683        924990         0              0              6   17   11    
136.29/136.32	c 21657          55659          3499341        1021480        0              0              7   18   12    
146.59/146.63	c 23910          61443          3855196        1125557        0              0              6   17   11    
157.78/157.89	c 26388          67749          4254429        1242614        0              0              6   17   11    
176.87/176.92	c 29113          74909          4698733        1371585        0              0              6   17   11    
194.77/194.87	c 32110          82944          5194226        1514432        0              0              6   18   11    
222.67/222.79	c 35406          91412          5731955        1670235        0              0              6   17   11    
240.57/240.68	c 39031          100690         6328525        1840000        0              0              6   17   11    
268.77/268.87	c 43018          110526         6970108        2018807        0              0              7   18   11    
287.57/287.61	c 47403          121615         7676060        2223403        0              0              6   17   11    
321.87/322.00	c 52226          134191         8448995        2447298        0              0              6   17   11    
349.09/349.18	c 57531          148553         9327040        2702366        0              0              5   17   11    
380.68/380.76	c 63366          164558         10289602       2981873        0              0              6   17   11    
422.38/422.45	c 69784          181784         11381759       3295290        0              0              6   17   11    
450.48/450.53	c 76843          199891         12525745       3625727        0              0              6   17   11    
496.18/496.20	c 84607          219745         13778827       3988533        0              0              6   17   11    
547.19/547.24	c 93147          242115         15122608       4374824        0              0              6   18   11    
592.19/592.28	c 102541         266742         16643238       4818977        0              0              6   17   11    
640.79/640.87	c 112874         293399         18301075       5300801        0              0              6   17   11    
706.10/706.16	c 124240         322657         20168022       5846994        0              0              5   17   11    
767.60/767.61	c 136742         355687         22308174       6454524        0              0              5   18   11    
813.60/813.68	c 150494         389547         24526036       7119898        0              0              6   17   11    
902.41/902.47	c 165621         427452         26946986       7820247        0              0              6   18   11    
975.92/975.99	c 182260         471423         29592092       8590940        0              0              5   18   12    
1083.53/1083.58	c 200562         521058         32689989       9469480        0              0              5   18   11    
1183.23/1183.22	c 220694         574853         35958403       10407473       0              0              5   17   11    
1289.24/1289.29	c 242839         630531         39560645       11453181       0              0              6   17   11    
1480.74/1480.74	c 267198         692058         43530865       12575431       0              0              5   17   11    
1631.55/1631.54	c 293992         762270         47866026       13820566       0              0              4   17   11    
1802.26/1802.22	c 323465         838784         52779980       15218679       0              0              5   18   11    
1985.08/1985.07	c 355885         922419         58042733       16722988       0              0              6   17   11    
2142.98/2143.00	c 391547         1014919        63887733       18416509       0              0              6   17   11    
2361.50/2361.42	c 430775         1115555        70324163       20241621       0              0              5   19   11    
2400.00/2399.90	
2400.00/2399.90	c *** INTERRUPTED ***
2400.00/2399.90	c restarts              : 64          
2400.00/2399.90	c conflicts             : 438226       (183 /sec)
2400.00/2399.90	c decisions             : 1134375      (473 /sec)
2400.00/2399.90	c propagations          : 20583300    (8577 /sec)
2400.00/2399.90	c root propagations     : 0           
2400.00/2399.90	c filter calls          : 71471759       (29782 /sec)
2400.00/2399.90	c useless filter calls  : 59776957       (83 %)
2400.00/2399.90	c Memory used           : 192.38 MB
2400.00/2399.90	c CPU time              : 2399.85 s
2400.00/2399.90	
2400.00/2399.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15171 MiB free)
  memory of node 1: 16384 MiB (15502 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4267413-1502606160/watcher-4267413-1502606160 -o /tmp/evaluation-result-4267413-1502606160/solver-4267413-1502606160 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node102-1502602094-2571 --watchdog 2560 cosoco -lc -model -restarts HOME/instance-4267413-1502606160.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=5390, runsolver pid=5387

[startup+0.100785 s]*
/proc/loadavg: 1.84 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31408616/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=28384 memory=4308 CPUtime=0.1 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 1392 0 0 0 10 0 0 0 20 0 1 0 93704348 29065216 1077 33554432000 4194304 5748600 140728676141600 140728676136312 140080874265573 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 7096 1077 701 380 0 514 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28384 KiB
Current children cumulated memory: 4308 KiB

[startup+0.209486 s]*
/proc/loadavg: 1.84 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31406848/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=29944 memory=5460 CPUtime=0.21 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 1902 0 0 0 21 0 0 0 20 0 1 0 93704348 30662656 1365 33554432000 4194304 5748600 140728676141600 140728676136312 5221265 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 7486 1365 701 380 0 904 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29944 KiB
Current children cumulated memory: 5460 KiB

[startup+0.309041 s]*
/proc/loadavg: 1.84 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31401640/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=33924 memory=10032 CPUtime=0.3 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 3224 0 0 0 30 0 0 0 20 0 1 0 93704348 34738176 2508 33554432000 4194304 5748600 140728676141600 140728676136312 5479234 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 8481 2508 707 380 0 1899 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 33924 KiB
Current children cumulated memory: 10032 KiB

[startup+0.700285 s]
/proc/loadavg: 1.84 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31397920/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=38572 memory=14252 CPUtime=0.69 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 4320 0 0 0 69 0 0 0 20 0 1 0 93704348 39497728 3563 33554432000 4194304 5748600 140728676141600 140728676138248 5474884 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 9643 3563 707 380 0 3061 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 38572 KiB
Current children cumulated memory: 14252 KiB

[startup+1.5003 s]
/proc/loadavg: 1.84 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31394572/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=48912 memory=24020 CPUtime=1.49 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 6728 0 0 0 148 1 0 0 20 0 1 0 93704348 50085888 6005 33554432000 4194304 5748600 140728676141600 140728676138248 5477507 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 12228 6005 707 380 0 5646 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 48912 KiB
Current children cumulated memory: 24020 KiB

[startup+3.10959 s]
/proc/loadavg: 1.84 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31371264/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=65484 memory=38600 CPUtime=3.09 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 12045 0 0 0 308 1 0 0 20 0 1 0 93704348 67055616 9650 33554432000 4194304 5748600 140728676141600 140728676138248 5479425 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 16371 9650 707 380 0 9789 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 65484 KiB
Current children cumulated memory: 38600 KiB

[startup+6.3003 s]
/proc/loadavg: 1.85 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31341244/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=100684 memory=70388 CPUtime=6.28 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 21610 0 0 0 626 2 0 0 20 0 1 0 93704348 103100416 17597 33554432000 4194304 5748600 140728676141600 140728676138248 5474855 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 25171 17597 708 380 0 18589 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 100684 KiB
Current children cumulated memory: 70388 KiB

[startup+12.7003 s]
/proc/loadavg: 1.86 1.97 2.02 3/188 5391
/proc/meminfo: memFree=31279864/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=172372 memory=137196 CPUtime=12.69 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 39982 0 0 0 1264 5 0 0 20 0 1 0 93704348 176508928 34299 33554432000 4194304 5748600 140728676141600 140728676138248 5478686 0 0 4096 0 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 43093 34299 708 380 0 36511 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 172372 KiB
Current children cumulated memory: 137196 KiB

[startup+25.5004 s]
/proc/loadavg: 1.89 1.98 2.02 3/188 5391
/proc/meminfo: memFree=31245480/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=161648 CPUtime=25.49 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 119703 0 0 0 2540 9 0 0 20 0 1 0 93704348 201715712 40412 33554432000 4194304 5748600 140728676141600 140728676139000 4894829 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 40412 752 380 0 42665 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 161648 KiB

[startup+51.1097 s]
/proc/loadavg: 1.93 1.98 2.02 3/188 5391
/proc/meminfo: memFree=31243364/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=161648 CPUtime=51.1 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 158662 0 0 0 5100 10 0 0 20 0 1 0 93704348 201715712 40412 33554432000 4194304 5748600 140728676141600 140728676139000 4894279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 40412 752 380 0 42665 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 161648 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 1.98 2.02 3/188 5392
/proc/meminfo: memFree=31237980/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=162136 CPUtime=102.29 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 197623 0 0 0 10217 12 0 0 20 0 1 0 93704348 201715712 40534 33554432000 4194304 5748600 140728676141600 140728676139000 4894306 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 40534 752 380 0 42665 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 162136 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 1.99 2.02 3/188 5393
/proc/meminfo: memFree=31230424/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=168664 CPUtime=162.28 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 227438 0 0 0 16214 14 0 0 20 0 1 0 93704348 201715712 42166 33554432000 4194304 5748600 140728676141600 140728676139000 4894270 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 42166 752 380 0 42665 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 168664 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 5395
/proc/meminfo: memFree=31225040/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=222.27 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 237058 0 0 0 22213 14 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894412 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 5396
/proc/meminfo: memFree=31226148/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=282.27 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 238101 0 0 0 28213 14 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894294 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 5397
/proc/meminfo: memFree=31226512/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=342.28 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 238101 0 0 0 34214 14 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894309 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 5399
/proc/meminfo: memFree=31226428/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=402.28 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 239144 0 0 0 40214 14 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894294 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/187 5400
/proc/meminfo: memFree=31227000/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=462.28 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 239144 0 0 0 46214 14 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB


################
# More data... #
################

/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 1662.36 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/188 6134
/proc/meminfo: memFree=31403744/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=1722.36 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 249747 0 0 0 172221 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894270 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 1722.36 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 6135
/proc/meminfo: memFree=31404028/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=1782.36 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 249747 0 0 0 178221 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 1782.36 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 6136
/proc/meminfo: memFree=31403904/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=1842.36 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 250790 0 0 0 184221 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894294 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 1842.36 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 6137
/proc/meminfo: memFree=31403908/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=1902.36 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 250790 0 0 0 190221 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894270 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 1902.36 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 6138
/proc/meminfo: memFree=31403784/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=1962.37 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 251365 0 0 0 196222 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894425 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 1962.37 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6140
/proc/meminfo: memFree=31404104/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2022.37 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 251833 0 0 0 202222 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894270 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2022.37 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6141
/proc/meminfo: memFree=31404232/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2082.37 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 252388 0 0 0 208222 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2082.37 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+2142.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/187 6142
/proc/meminfo: memFree=31404480/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2142.38 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 252388 0 0 0 214223 15 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894275 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2142.38 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+2202.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 6144
/proc/meminfo: memFree=31404124/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2202.39 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 253501 0 0 0 220223 16 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894405 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2202.39 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/187 6145
/proc/meminfo: memFree=31404760/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2262.39 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 253501 0 0 0 226223 16 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2262.39 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6153
/proc/meminfo: memFree=31403524/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2322.4 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 254192 0 0 0 232224 16 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2322.4 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6176
/proc/meminfo: memFree=31402220/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2382.4 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 254544 0 0 0 238224 16 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894279 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2382.4 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6176
/proc/meminfo: memFree=31402220/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2400 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 255152 0 0 0 239984 16 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894421 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2400 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.9 s]
# the end of solver process 5390 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.85 s, system=0.162009 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 6176
/proc/meminfo: memFree=31402220/32770624 swapFree=67108860/67108860
[pid=5390] ppid=5387 vsize=196988 memory=173224 CPUtime=2400 cores=1,3,5,7
/proc/5390/stat : 5390 (cosoco) R 5387 5390 2539 0 -1 4202496 255152 0 0 0 239984 16 0 0 20 0 1 0 93704348 201715712 43306 33554432000 4194304 5748600 140728676141600 140728676139000 4894421 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 7849824 7854664 23379968 140728676148415 140728676148510 140728676148510 140728676151246 0
/proc/5390/statm: 49247 43306 752 380 0 42665 0
Current children cumulated CPU time: 2400 s
Current children cumulated vsize: 196988 KiB
Current children cumulated memory: 173224 KiB

Child status: 1
Real time (s): 2399.9
CPU time (s): 2400.01
CPU user time (s): 2399.85
CPU system time (s): 0.162009
CPU usage (%): 100.004
Max. virtual memory (cumulated for all children) (KiB): 196988
Max. memory (cumulated for all children) (KiB): 173224

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.85
system time used= 0.162009
maximum resident set size= 173292
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 255201
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 59
involuntary context switches= 625


# summary of solver processes directly reported to runsolver:
#   pid: 5390
#   total CPU time (s): 2400.01
#   total CPU user time (s): 2399.85
#   total CPU system time (s): 0.162009

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.94493 second user time and 17.497 second system time

The end

Launcher Data 

Begin job on node102 at 2017-08-13 08:21:42
IDJOB=4267413
IDBENCH=126094
IDSOLVER=2657
FILE ID=node102/4267413-1502606160
RUNJOBID= node102-1502602094-2571
PBS_JOBID= 20628294
Free space on /tmp= 61844 MiB

SOLVER NAME= cosoco-mini 1.12
BENCH NAME= XCSP17/QRandom/QRandom-mdd-7-25-5/mdd-7-25-5-56-16.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4267413-1502606160/watcher-4267413-1502606160 -o /tmp/evaluation-result-4267413-1502606160/solver-4267413-1502606160 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node102-1502602094-2571 --watchdog 2560  cosoco -lc -model -restarts HOME/instance-4267413-1502606160.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9d7406c968f8af9220e5e662d0bd5052
RANDOM SEED=1547716626

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31410972 kB
MemAvailable:   31833144 kB
Buffers:           94188 kB
Cached:           612832 kB
SwapCached:            0 kB
Active:           797144 kB
Inactive:         119380 kB
Active(anon):     162012 kB
Inactive(anon):    75648 kB
Active(file):     635132 kB
Inactive(file):    43732 kB
Unevictable:        6436 kB
Mlocked:            6436 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             34768 kB
Writeback:             0 kB
AnonPages:        280140 kB
Mapped:            44612 kB
Shmem:             25228 kB
Slab:             145148 kB
SReclaimable:     118288 kB
SUnreclaim:        26860 kB
KernelStack:        3376 kB
PageTables:         5352 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     520584 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 61876 MiB
End job on node102 at 2017-08-13 09:01:42