Trace number 4241230

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.08 2400.6

General information on the benchmark

NameSteiner3/Steiner3-m1-s1/
Steiner3-08.xml
MD5SUMe66788b55a8c4825b73f7b3fa22372b6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables27
Number of constraints45
Number of domains1
Minimum domain size8
Maximum domain size8
Distribution of domain sizes[{"size":8,"count":27}]
Minimum variable degree9
Maximum variable degree9
Distribution of variable degrees[{"degree":9,"count":27}]
Minimum constraint arity3
Maximum constraint arity6
Distribution of constraint arities[{"arity":3,"count":9},{"arity":6,"count":36}]
Number of extensional constraints36
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":36},{"type":"ordered","count":9}]
Optimization problemNO
Type of objective

Solver Data 

0.59/0.67	c root propagations     : 54          
0.59/0.67	c restarts enabled, print stats at every restarts
0.59/0.67	c
0.59/0.67	c
0.59/0.67	c
0.59/0.67	c This is cosoco 1.0 --  
0.59/0.67	c
0.59/0.67	c ========================================[ Problem Statistics ]===========================================
0.59/0.67	c |                                                                                                       
0.59/0.67	c |  Parse time        :         0.50 s 
0.59/0.67	c |
0.59/0.67	c |               Variables: 27
0.59/0.67	c |            Domain Sizes: 8..8
0.59/0.67	c |
0.59/0.67	c |             Constraints: 54
0.59/0.67	c |                   Arity: 2..6  -- Binary: 18
0.59/0.67	c | 
0.59/0.67	c |                   Types: 
0.59/0.67	c |                          (X - Y < k): 18
0.59/0.67	c |                          Extension: 36  (nb tuples: 80640..80640) -- (shared: 35)
0.59/0.67	c |                          
0.59/0.67	c =========================================================================================================
0.59/0.67	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.69/0.76	c 101            170            3146           1290           27             0              7   23   18    
0.79/0.86	c 211            348            6212           2746           27             0              3   23   20    
0.89/0.96	c 332            549            9717           4348           27             0              4   23   20    
0.99/1.07	c 465            777            14024          6202           27             0              3   22   20    
1.10/1.18	c 611            1028           18432          8037           27             0              3   23   20    
1.29/1.32	c 771            1296           23263          10301          27             0              4   23   20    
1.39/1.45	c 947            1596           28830          12599          27             0              3   23   20    
1.59/1.61	c 1140           1921           34766          15405          27             0              3   25   20    
1.69/1.76	c 1352           2305           41611          18565          27             0              7   25   20    
1.89/1.93	c 1585           2709           48801          21791          27             0              3   25   20    
2.09/2.10	c 1841           3175           56989          25496          27             0              3   25   20    
2.20/2.29	c 2122           3697           66549          29392          27             0              4   25   20    
2.39/2.49	c 2431           4246           76443          33705          27             0              3   25   20    
2.59/2.69	c 2770           4820           86255          38078          27             0              4   25   21    
2.89/2.94	c 3142           5505           99193          43629          27             0              7   25   20    
3.19/3.22	c 3551           6192           111600         49476          27             0              3   25   21    
3.49/3.51	c 4000           7010           126701         55931          27             0              3   25   21    
3.79/3.82	c 4493           7913           142897         63054          27             0              3   25   21    
4.09/4.15	c 5035           8896           160473         71027          27             0              3   25   21    
4.50/4.54	c 5631           9962           180159         79539          27             0              3   25   21    
4.89/4.93	c 6286           11166          201855         89431          27             0              5   25   21    
5.29/5.39	c 7006           12527          225914         99412          27             0              4   25   21    
5.79/5.83	c 7798           13988          252330         111310         27             0              7   25   21    
6.29/6.32	c 8669           15558          281422         123918         27             0              4   25   21    
6.89/6.90	c 9627           17242          310786         137006         27             0              4   25   21    
7.39/7.47	c 10680          19076          343086         151914         27             0              3   25   21    
7.89/7.99	c 11838          21253          381490         168164         27             0              4   25   21    
8.69/8.76	c 13111          23573          424248         187898         27             0              7   25   21    
9.49/9.54	c 14511          26121          471258         208362         27             0              3   25   21    
10.39/10.49	c 16051          28892          521608         231807         27             0              7   25   21    
11.49/11.50	c 17745          32027          578027         256808         27             0              3   25   21    
12.59/12.62	c 19608          35427          637992         283623         27             0              3   25   21    
13.79/13.82	c 21657          39140          705463         314192         27             0              3   25   21    
14.99/15.09	c 23910          43418          782066         347478         27             0              3   25   21    
16.59/16.64	c 26388          48108          868553         384351         27             0              3   25   21    
18.18/18.25	c 29113          53184          961552         425300         27             0              3   25   21    
19.79/19.83	c 32110          58600          1058471        468138         27             0              3   25   21    
21.68/21.74	c 35406          64757          1173150        517190         27             0              3   25   21    
23.68/23.73	c 39031          71523          1296018        573084         27             0              3   25   21    
25.48/25.55	c 43018          79137          1436750        633181         27             0              5   25   21    
27.78/27.81	c 47403          87236          1585361        700171         27             0              7   25   21    
30.28/30.31	c 52226          95892          1743108        771936         27             0              4   25   21    
32.77/32.86	c 57531          105837         1924487        851243         27             0              3   25   21    
35.47/35.52	c 63366          116695         2125279        939653         27             0              7   25   21    
38.27/38.35	c 69784          128862         2349101        1034124        27             0              3   25   21    
41.78/41.85	c 76843          141702         2585027        1136532        27             0              4   25   21    
45.47/45.56	c 84607          156191         2853778        1253749        27             0              3   25   21    
49.17/49.23	c 93147          172373         3164599        1371142        27             0              4   25   21    
53.47/53.51	c 102541         189784         3477606        1511684        27             0              3   25   21    
58.37/58.45	c 112874         209068         3831859        1667479        27             0              7   25   21    
63.87/63.92	c 124240         230440         4214805        1836027        27             0              3   25   21    
69.57/69.69	c 136742         254095         4657067        2008115        27             0              4   25   21    
75.16/75.20	c 150494         280531         5144810        2221960        27             0              7   25   21    
82.47/82.56	c 165621         308510         5647351        2452826        27             0              7   25   21    
89.76/89.82	c 182260         340097         6211233        2704383        27             0              3   25   21    
98.26/98.32	c 200562         373718         6820637        2984745        27             0              7   25   21    
105.76/105.87	c 220694         410206         7443829        3264413        27             0              4   25   21    
115.35/115.41	c 242839         451321         8170871        3587355        27             0              3   25   21    
125.95/126.04	c 267198         496358         8971969        3956205        27             0              3   25   21    
135.45/135.57	c 293992         544865         9832303        4342983        27             0              3   25   21    
148.75/148.81	c 323465         601677         10839963       4783888        27             0              3   25   21    
160.04/160.16	c 355885         662185         11941517       5277366        27             0              7   25   21    
174.34/174.46	c 391547         728805         13139269       5820306        27             0              7   25   21    
191.54/191.66	c 430775         804612         14495807       6428293        27             0              3   25   21    
207.53/207.60	c 473925         885261         15942007       7082370        27             0              7   25   21    
228.83/228.95	c 521390         975712         17551869       7783742        27             0              3   25   21    
247.62/247.78	c 573601         1074540        19315680       8576910        27             0              7   25   21    
269.32/269.49	c 631033         1183393        21264564       9452392        27             0              7   25   21    
296.81/296.93	c 694208         1304309        23409092       10350208       27             0              4   25   21    
330.51/330.65	c 763700         1433514        25724245       11396929       27             0              3   25   21    
359.61/359.73	c 840141         1573526        28196440       12521576       27             0              3   25   21    
392.00/392.10	c 924226         1728944        30965141       13786339       27             0              3   25   21    
430.79/430.93	c 1016719        1903523        34102218       15196887       27             0              7   25   21    
478.49/478.67	c 1118461        2098315        37612727       16749279       27             0              3   25   21    
522.07/522.21	c 1230377        2303516        41249073       18400584       27             0              3   25   21    
582.26/582.49	c 1353484        2536038        45467189       20268676       27             0              3   25   21    
630.95/631.13	c 1488901        2786299        49864001       22241523       27             0              3   25   21    
702.84/703.06	c 1637859        3069776        54950790       24450951       27             0              3   25   21    
775.32/775.51	c 1801712        3383726        60542314       26790512       27             0              4   25   21    
861.29/861.51	c 1981950        3725944        66908040       29397058       27             0              4   25   21    
953.48/953.73	c 2180211        4102307        73757116       32477988       27             0              7   25   21    
1059.75/1060.07	c 2398298        4512872        81215857       35855600       27             0              7   25   21    
1172.43/1172.73	c 2638193        4969474        89366050       39437775       27             0              3   25   21    
1270.80/1271.16	c 2902077        5457387        98152454       43442884       27             0              7   25   21    
1408.89/1409.23	c 3192349        6001456        107800970      47579270       27             0              4   25   21    
1550.35/1550.71	c 3511648        6616762        118809918      52371348       27             0              3   25   21    
1717.62/1718.05	c 3862876        7282767        130844636      57776413       27             0              3   25   21    
1901.28/1901.77	c 4249226        8025967        144400337      63670083       27             0              3   25   21    
2105.63/2106.13	c 4674211        8829743        158719616      69755376       27             0              4   25   21    
2324.89/2325.42	c 5141694        9715320        174899872      77009733       27             0              6   25   21

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4241230-1500629295/watcher-4241230-1500629295 -o /tmp/evaluation-result-4241230-1500629295/solver-4241230-1500629295 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node105-1500623785-3429 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4241230-1500629295.xml 

pid=4960
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 1.92 2.00 1.99 3/186 4963
/proc/meminfo: memFree=31604692/32770624 swapFree=6204/410896
[pid=4963] ppid=4960 vsize=26992 CPUtime=0 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 977 0 0 0 0 0 0 0 20 0 1 0 17588082 27639808 766 33554432000 4194304 5970956 140729786841696 140729786838344 5417044 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 6748 766 684 434 0 112 0

[startup+0.100111 s]
/proc/loadavg: 1.92 2.00 1.99 3/186 4963
/proc/meminfo: memFree=31604692/32770624 swapFree=6204/410896
[pid=4963] ppid=4960 vsize=27800 CPUtime=0.09 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 1190 0 0 0 9 0 0 0 20 0 1 0 17588082 28467200 928 33554432000 4194304 5970956 140729786841696 140729786838296 5369026 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 6950 928 725 434 0 314 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27800

[startup+0.200239 s]
/proc/loadavg: 1.92 2.00 1.99 3/186 4963
/proc/meminfo: memFree=31604692/32770624 swapFree=6204/410896
[pid=4963] ppid=4960 vsize=28712 CPUtime=0.19 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 1525 0 0 0 19 0 0 0 20 0 1 0 17588082 29401088 1171 33554432000 4194304 5970956 140729786841696 140729786838296 5668396 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 7178 1171 725 434 0 542 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 28712

[startup+0.300219 s]
/proc/loadavg: 1.92 2.00 1.99 3/186 4963
/proc/meminfo: memFree=31604692/32770624 swapFree=6204/410896
[pid=4963] ppid=4960 vsize=30008 CPUtime=0.29 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 1970 0 0 0 29 0 0 0 20 0 1 0 17588082 30728192 1461 33554432000 4194304 5970956 140729786841696 140729786838296 5672956 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 7502 1461 725 434 0 866 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 30008

[startup+0.700253 s]
/proc/loadavg: 1.92 2.00 1.99 3/186 4963
/proc/meminfo: memFree=31604692/32770624 swapFree=6204/410896
[pid=4963] ppid=4960 vsize=53916 CPUtime=0.69 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 8617 0 0 0 68 1 0 0 20 0 1 0 17588082 55209984 7509 33554432000 4194304 5970956 140729786841696 140729786839304 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7509 730 434 0 6843 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 53916

[startup+1.50019 s]
/proc/loadavg: 1.92 2.00 1.99 3/187 4964
/proc/meminfo: memFree=31577736/32770624 swapFree=6204/410680
[pid=4963] ppid=4960 vsize=53916 CPUtime=1.49 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 8619 0 0 0 148 1 0 0 20 0 1 0 17588082 55209984 7509 33554432000 4194304 5970956 140729786841696 140729786839032 4934527 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7509 730 434 0 6843 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 53916

[startup+3.10019 s]
/proc/loadavg: 1.92 2.00 1.99 3/187 4964
/proc/meminfo: memFree=31577488/32770624 swapFree=6204/410680
[pid=4963] ppid=4960 vsize=53916 CPUtime=3.09 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 11331 0 0 0 308 1 0 0 20 0 1 0 17588082 55209984 7572 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7572 774 434 0 6843 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 53916

[startup+6.30017 s]
/proc/loadavg: 1.93 2.00 1.99 3/187 4964
/proc/meminfo: memFree=31577148/32770624 swapFree=6204/410680
[pid=4963] ppid=4960 vsize=53916 CPUtime=6.29 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 14043 0 0 0 628 1 0 0 20 0 1 0 17588082 55209984 7572 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7572 774 434 0 6843 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 53916

[startup+12.7002 s]
/proc/loadavg: 1.93 2.00 1.99 3/187 4964
/proc/meminfo: memFree=31577132/32770624 swapFree=6204/410688
[pid=4963] ppid=4960 vsize=53916 CPUtime=12.69 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 16755 0 0 0 1268 1 0 0 20 0 1 0 17588082 55209984 7572 33554432000 4194304 5970956 140729786841696 140729786839032 4934357 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7572 774 434 0 6843 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 53916

[startup+25.5002 s]
/proc/loadavg: 1.95 2.00 1.99 3/187 4964
/proc/meminfo: memFree=31577040/32770624 swapFree=6204/410704
[pid=4963] ppid=4960 vsize=53916 CPUtime=25.48 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 21797 0 0 0 2547 1 0 0 20 0 1 0 17588082 55209984 7572 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7572 774 434 0 6843 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 53916

[startup+51.1002 s]
/proc/loadavg: 1.97 2.00 1.99 3/187 4964
/proc/meminfo: memFree=31576276/32770624 swapFree=6204/410736
[pid=4963] ppid=4960 vsize=53916 CPUtime=51.07 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 22068 0 0 0 5106 1 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 53916

[startup+102.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/187 4965
/proc/meminfo: memFree=31576356/32770624 swapFree=6204/410804
[pid=4963] ppid=4960 vsize=53916 CPUtime=102.26 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 22333 0 0 0 10225 1 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4933153 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 53916

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 1.99 3/188 4974
/proc/meminfo: memFree=31576036/32770624 swapFree=6204/410860
[pid=4963] ppid=4960 vsize=53916 CPUtime=162.24 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 22598 0 0 0 16223 1 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 53916

[startup+222.306 s]
/proc/loadavg: 2.04 2.01 1.99 3/188 4975
/proc/meminfo: memFree=31576336/32770624 swapFree=6204/410924
[pid=4963] ppid=4960 vsize=53916 CPUtime=222.24 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 22863 0 0 0 22223 1 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 53916

[startup+282.3 s]
/proc/loadavg: 2.01 2.01 1.99 3/188 4976
/proc/meminfo: memFree=31575828/32770624 swapFree=6204/410984
[pid=4963] ppid=4960 vsize=53916 CPUtime=282.22 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 23128 0 0 0 28221 1 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 282.22
Current children cumulated vsize (KiB) 53916

[startup+342.3 s]
/proc/loadavg: 2.01 2.01 1.99 3/188 4977
/proc/meminfo: memFree=31575752/32770624 swapFree=6204/411020
[pid=4963] ppid=4960 vsize=53916 CPUtime=342.2 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 23393 0 0 0 34219 1 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4933210 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 53916

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 1.99 3/188 4978
/proc/meminfo: memFree=31576448/32770624 swapFree=6204/411068
[pid=4963] ppid=4960 vsize=53916 CPUtime=402.2 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 23658 0 0 0 40218 2 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934545 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 402.2
Current children cumulated vsize (KiB) 53916

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 1.99 3/187 4979
/proc/meminfo: memFree=31576228/32770624 swapFree=6204/411112
[pid=4963] ppid=4960 vsize=53916 CPUtime=462.19 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 23923 0 0 0 46217 2 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934214 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 53916

[startup+522.3 s]
/proc/loadavg: 2.00 2.01 1.99 3/187 4980
/proc/meminfo: memFree=31576196/32770624 swapFree=6204/411144
[pid=4963] ppid=4960 vsize=53916 CPUtime=522.17 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 24188 0 0 0 52215 2 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 522.17
Current children cumulated vsize (KiB) 53916

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 1.99 3/187 4981
/proc/meminfo: memFree=31576324/32770624 swapFree=6204/411196
[pid=4963] ppid=4960 vsize=53916 CPUtime=582.16 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 24410 0 0 0 58214 2 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934335 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 582.16
Current children cumulated vsize (KiB) 53916


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/188 5011
/proc/meminfo: memFree=31575132/32770624 swapFree=6204/411768
[pid=4963] ppid=4960 vsize=53916 CPUtime=1481.97 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 28086 0 0 0 148194 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934864 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1481.97
Current children cumulated vsize (KiB) 53916

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.01 3/188 5012
/proc/meminfo: memFree=31574888/32770624 swapFree=6204/411796
[pid=4963] ppid=4960 vsize=53916 CPUtime=1541.96 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 28282 0 0 0 154193 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1541.96
Current children cumulated vsize (KiB) 53916

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/188 5013
/proc/meminfo: memFree=31574768/32770624 swapFree=6204/411844
[pid=4963] ppid=4960 vsize=53916 CPUtime=1601.94 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 28581 0 0 0 160191 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1601.94
Current children cumulated vsize (KiB) 53916

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/187 5015
/proc/meminfo: memFree=31574804/32770624 swapFree=6204/411880
[pid=4963] ppid=4960 vsize=53916 CPUtime=1661.93 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 28804 0 0 0 166190 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1661.93
Current children cumulated vsize (KiB) 53916

[startup+1722.3 s]
/proc/loadavg: 2.05 2.03 2.02 3/187 5016
/proc/meminfo: memFree=31575312/32770624 swapFree=6204/411908
[pid=4963] ppid=4960 vsize=53916 CPUtime=1721.91 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 29069 0 0 0 172188 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1721.91
Current children cumulated vsize (KiB) 53916

[startup+1782.3 s]
/proc/loadavg: 2.02 2.02 2.02 3/187 5017
/proc/meminfo: memFree=31574848/32770624 swapFree=6204/411956
[pid=4963] ppid=4960 vsize=53916 CPUtime=1781.9 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 29299 0 0 0 178187 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1781.9
Current children cumulated vsize (KiB) 53916

[startup+1842.3 s]
/proc/loadavg: 2.01 2.02 2.02 3/187 5019
/proc/meminfo: memFree=31574844/32770624 swapFree=6204/411988
[pid=4963] ppid=4960 vsize=53916 CPUtime=1841.89 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 29472 0 0 0 184186 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1841.89
Current children cumulated vsize (KiB) 53916

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/187 5020
/proc/meminfo: memFree=31574968/32770624 swapFree=6204/412020
[pid=4963] ppid=4960 vsize=53916 CPUtime=1901.88 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 29737 0 0 0 190185 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1901.88
Current children cumulated vsize (KiB) 53916

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/187 5028
/proc/meminfo: memFree=31574464/32770624 swapFree=6204/412068
[pid=4963] ppid=4960 vsize=53916 CPUtime=1961.86 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 29942 0 0 0 196183 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 1961.86
Current children cumulated vsize (KiB) 53916

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/188 5113
/proc/meminfo: memFree=31573548/32770624 swapFree=6204/412136
[pid=4963] ppid=4960 vsize=53916 CPUtime=2021.85 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 30132 0 0 0 202182 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2021.85
Current children cumulated vsize (KiB) 53916

[startup+2082.3 s]
/proc/loadavg: 2.06 2.03 2.02 3/188 5114
/proc/meminfo: memFree=31573516/32770624 swapFree=6204/412240
[pid=4963] ppid=4960 vsize=53916 CPUtime=2081.84 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 30361 0 0 0 208181 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2081.84
Current children cumulated vsize (KiB) 53916

[startup+2142.3 s]
/proc/loadavg: 2.02 2.02 2.02 3/188 5115
/proc/meminfo: memFree=31573048/32770624 swapFree=6204/412312
[pid=4963] ppid=4960 vsize=53916 CPUtime=2141.82 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 30626 0 0 0 214179 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2141.82
Current children cumulated vsize (KiB) 53916

[startup+2202.31 s]
/proc/loadavg: 2.01 2.02 2.02 3/188 5116
/proc/meminfo: memFree=31572676/32770624 swapFree=6204/412360
[pid=4963] ppid=4960 vsize=53916 CPUtime=2201.81 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 30850 0 0 0 220178 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934342 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2201.81
Current children cumulated vsize (KiB) 53916

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/188 5117
/proc/meminfo: memFree=31572264/32770624 swapFree=6204/412388
[pid=4963] ppid=4960 vsize=53916 CPUtime=2261.8 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 31070 0 0 0 226177 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2261.8
Current children cumulated vsize (KiB) 53916

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/187 5118
/proc/meminfo: memFree=31571748/32770624 swapFree=6204/412452
[pid=4963] ppid=4960 vsize=53916 CPUtime=2321.78 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 31306 0 0 0 232175 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 5321390 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2321.78
Current children cumulated vsize (KiB) 53916

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/187 5119
/proc/meminfo: memFree=31572568/32770624 swapFree=6204/412492
[pid=4963] ppid=4960 vsize=53916 CPUtime=2381.77 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 31561 0 0 0 238174 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4934357 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2381.77
Current children cumulated vsize (KiB) 53916



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.6 s]
/proc/loadavg: 2.00 2.01 2.02 3/187 5119
/proc/meminfo: memFree=31572692/32770624 swapFree=6204/412496
[pid=4963] ppid=4960 vsize=53916 CPUtime=2400.07 cores=0,2,4,6
/proc/4963/stat : 4963 (cosoco) R 4960 4963 3398 0 -1 4202496 31751 0 0 0 240004 3 0 0 20 0 1 0 17588082 55209984 7576 33554432000 4194304 5970956 140729786841696 140729786839032 4933182 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 21409792 140729786844353 140729786844483 140729786844483 140729786847182 0
/proc/4963/statm: 13479 7576 774 434 0 6843 0
Current children cumulated CPU time (s) 2400.07
Current children cumulated vsize (KiB) 53916

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 4963 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.6
CPU time (s): 2400.08
CPU user time (s): 2400.04
CPU system time (s): 0.037991
CPU usage (%): 99.9784
Max. virtual memory (cumulated for all children) (KiB): 53916

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.04
system time used= 0.037991
maximum resident set size= 30348
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 31779
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13
involuntary context switches= 122290

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.68226 second user time and 8.03855 second system time

The end

Launcher Data 

Begin job on node105 at 2017-07-21 11:28:15
IDJOB=4241230
IDBENCH=126253
IDSOLVER=2620
FILE ID=node105/4241230-1500629295
RUNJOBID= node105-1500623785-3429
PBS_JOBID= 20623022
Free space on /tmp= 62012 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/Steiner3/Steiner3-m1-s1/Steiner3-08.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4241230-1500629295/watcher-4241230-1500629295 -o /tmp/evaluation-result-4241230-1500629295/solver-4241230-1500629295 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node105-1500623785-3429 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4241230-1500629295.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e66788b55a8c4825b73f7b3fa22372b6
RANDOM SEED=835873702

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2267.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31605500 kB
MemAvailable:   32007744 kB
Buffers:          159336 kB
Cached:           531684 kB
SwapCached:            0 kB
Active:           318712 kB
Inactive:         427916 kB
Active(anon):      58168 kB
Inactive(anon):    17020 kB
Active(file):     260544 kB
Inactive(file):   410896 kB
Unevictable:        6204 kB
Mlocked:            6212 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              3304 kB
Writeback:             0 kB
AnonPages:         61440 kB
Mapped:            34740 kB
Shmem:             17044 kB
Slab:             118412 kB
SReclaimable:      93276 kB
SUnreclaim:        25136 kB
KernelStack:        3280 kB
PageTables:         5012 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     336276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 62008 MiB
End job on node105 at 2017-07-21 12:08:16