Trace number 4241246

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.04 2401.41

General information on the benchmark

NameSteiner3/Steiner3-m1-s1/
Steiner3-10.xml
MD5SUM33acbdbf13e8fba51e0fc3db0676c789
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables45
Number of constraints120
Number of domains1
Minimum domain size10
Maximum domain size10
Distribution of domain sizes[{"size":10,"count":45}]
Minimum variable degree15
Maximum variable degree15
Distribution of variable degrees[{"degree":15,"count":45}]
Minimum constraint arity3
Maximum constraint arity6
Distribution of constraint arities[{"arity":3,"count":15},{"arity":6,"count":105}]
Number of extensional constraints105
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":105},{"type":"ordered","count":15}]
Optimization problemNO
Type of objective

Solver Data 

5.78/5.88	c root propagations     : 90          
5.78/5.88	c restarts enabled, print stats at every restarts
5.78/5.88	c
5.78/5.88	c
5.78/5.88	c
5.78/5.88	c This is cosoco 1.0 --  
5.78/5.88	c
5.78/5.88	c ========================================[ Problem Statistics ]===========================================
5.78/5.88	c |                                                                                                       
5.78/5.88	c |  Parse time        :         2.52 s 
5.78/5.88	c |
5.78/5.88	c |               Variables: 45
5.78/5.88	c |            Domain Sizes: 10..10
5.78/5.88	c |
5.78/5.88	c |             Constraints: 135
5.78/5.88	c |                   Arity: 2..6  -- Binary: 30
5.78/5.88	c | 
5.78/5.88	c |                   Types: 
5.78/5.88	c |                          (X - Y < k): 30
5.78/5.88	c |                          Extension: 105  (nb tuples: 423360..423360) -- (shared: 104)
5.78/5.88	c |                          
5.78/5.88	c =========================================================================================================
5.78/5.88	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
8.58/8.60	c 101            141            4715           1389           45             0              7   32   24    
10.88/10.96	c 211            299            9373           2709           45             0              4   32   27    
14.39/14.44	c 332            464            14185          4394           45             0              4   31   26    
17.59/17.62	c 465            652            19901          6086           45             0              7   32   27    
21.28/21.38	c 611            855            26787          8167           45             0              3   31   26    
23.97/24.04	c 771            1094           34333          10190          45             0              6   32   28    
27.78/27.85	c 947            1331           41542          12419          45             0              3   32   27    
32.27/32.37	c 1140           1600           49695          15037          45             0              7   32   28    
37.27/37.35	c 1352           1884           57878          17682          45             0              7   31   26    
41.37/41.42	c 1585           2203           67566          20559          45             0              4   32   28    
47.16/47.25	c 1841           2539           77537          24077          45             0              6   31   28    
53.26/53.37	c 2122           2914           89068          27714          45             0              3   32   27    
58.37/58.41	c 2431           3341           102812         31642          45             0              6   32   29    
64.55/64.67	c 2770           3815           117853         36216          45             0              3   31   28    
73.25/73.34	c 3142           4299           132531         41631          45             0              7   31   29    
79.75/79.88	c 3551           4825           148110         46997          45             0              3   31   28    
88.44/88.57	c 4000           5409           165817         52730          45             0              7   31   28    
96.94/97.02	c 4493           6088           186685         59155          45             0              5   32   29    
108.13/108.22	c 5035           6833           207837         66706          45             0              7   31   30    
117.62/117.71	c 5631           7633           231051         75214          45             0              3   31   29    
131.31/131.45	c 6286           8509           256792         84978          45             0              7   31   30    
146.01/146.13	c 7006           9491           285778         95683          45             0              3   31   30    
159.09/159.27	c 7798           10497          316331         107160         45             0              7   31   29    
176.28/176.48	c 8669           11690          350947         119799         45             0              3   31   30    
190.19/190.32	c 9627           13061          394360         132166         45             0              7   32   30    
207.17/207.34	c 10680          14447          433476         146961         45             0              3   31   30    
226.26/226.48	c 11838          16027          483121         163137         45             0              7   32   30    
246.75/246.96	c 13111          17762          533627         181991         45             0              7   31   30    
267.53/267.75	c 14511          19698          594468         200033         45             0              3   32   30    
289.62/289.83	c 16051          21773          655227         222253         45             0              7   31   30    
315.20/315.45	c 17745          24184          730439         245306         45             0              7   32   30    
343.89/344.12	c 19608          26771          807699         271023         45             0              3   32   30    
373.17/373.41	c 21657          29600          891540         301223         45             0              5   32   30    
396.26/396.50	c 23910          32888          994487         329819         45             0              7   32   30    
440.85/441.12	c 26388          36287          1095003        365302         45             0              7   31   30    
480.62/480.98	c 29113          40006          1206504        404999         45             0              3   32   30    
521.29/521.62	c 32110          44118          1334366        443139         45             0              7   32   30    
576.07/576.43	c 35406          48719          1472361        492280         45             0              7   37   31    
625.33/625.71	c 39031          53824          1613435        542124         45             0              2   31   29    
677.21/677.63	c 43018          59626          1792820        593773         45             0              3   32   30    
743.37/743.86	c 47403          65597          1972207        655803         45             0              7   32   30    
794.24/794.73	c 52226          72738          2195586        715936         45             0              3   32   30    
852.30/852.84	c 57531          80214          2430287        784673         45             0              7   32   30    
936.66/937.23	c 63366          87972          2656190        867285         45             0              3   32   30    
1002.81/1003.45	c 69784          97068          2955415        962150         45             0              7   37   33    
1084.77/1085.41	c 76843          106714         3258407        1056247        45             0              7   37   32    
1202.81/1203.55	c 84607          117383         3583756        1171682        45             0              3   37   31    
1331.73/1332.59	c 93147          129016         3931837        1279515        45             0              4   32   30    
1454.76/1455.60	c 102541         141695         4313767        1405872        45             0              7   32   30    
1615.07/1616.04	c 112874         155598         4748061        1554065        45             0              7   37   31    
1742.89/1743.96	c 124240         172436         5312648        1731005        45             0              5   37   34    
1889.20/1890.36	c 136742         190540         5888394        1908333        45             0              5   37   32    
2053.11/2054.39	c 150494         210145         6477074        2107782        45             0              4   37   32    
2226.62/2227.95	c 165621         232322         7178701        2303724        45             0              6   37   31

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4241246-1500629394/watcher-4241246-1500629394 -o /tmp/evaluation-result-4241246-1500629394/solver-4241246-1500629394 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1500626434-5655 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4241246-1500629394.xml 

pid=5972
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 1.96 2/186 5975
/proc/meminfo: memFree=31490960/32770624 swapFree=6912/387156
[pid=5975] ppid=5972 vsize=26992 CPUtime=0 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 980 0 0 0 0 0 0 0 20 0 1 0 16362426 27639808 766 33554432000 4194304 5970956 140724872453136 140724872449784 140657089440741 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 6748 766 684 434 0 112 0

[startup+0.100144 s]
/proc/loadavg: 2.00 2.01 1.96 2/186 5975
/proc/meminfo: memFree=31490960/32770624 swapFree=6912/387156
[pid=5975] ppid=5972 vsize=27820 CPUtime=0.09 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 1219 0 0 0 9 0 0 0 20 0 1 0 16362426 28487680 998 33554432000 4194304 5970956 140724872453136 140724872449736 140657089440741 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 6955 998 725 434 0 319 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27820

[startup+0.200274 s]
/proc/loadavg: 2.00 2.01 1.96 2/186 5975
/proc/meminfo: memFree=31490960/32770624 swapFree=6912/387156
[pid=5975] ppid=5972 vsize=28864 CPUtime=0.19 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 1570 0 0 0 19 0 0 0 20 0 1 0 16362426 29556736 1242 33554432000 4194304 5970956 140724872453136 140724872449736 5475246 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 7216 1242 725 434 0 580 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 28864

[startup+0.300249 s]
/proc/loadavg: 2.00 2.01 1.96 2/186 5975
/proc/meminfo: memFree=31490960/32770624 swapFree=6912/387156
[pid=5975] ppid=5972 vsize=30160 CPUtime=0.29 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 2013 0 0 0 29 0 0 0 20 0 1 0 16362426 30883840 1466 33554432000 4194304 5970956 140724872453136 140724872449736 140657089440741 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 7540 1466 725 434 0 904 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 30160

[startup+0.700217 s]
/proc/loadavg: 2.00 2.01 1.96 2/186 5975
/proc/meminfo: memFree=31490960/32770624 swapFree=6912/387156
[pid=5975] ppid=5972 vsize=34072 CPUtime=0.69 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 3413 0 0 0 69 0 0 0 20 0 1 0 16362426 34889728 2508 33554432000 4194304 5970956 140724872453136 140724872449736 140657089440741 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 8518 2508 725 434 0 1882 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 34072

[startup+1.50021 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 5976
/proc/meminfo: memFree=31478180/32770624 swapFree=6912/387088
[pid=5975] ppid=5972 vsize=47776 CPUtime=1.49 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 5549 0 0 0 148 1 0 0 20 0 1 0 16362426 48922624 4858 33554432000 4194304 5970956 140724872453136 140724872449736 140657089440741 0 0 4096 0 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 11944 4858 725 434 0 5308 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 47776

[startup+3.10028 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 5976
/proc/meminfo: memFree=31468308/32770624 swapFree=6912/387088
[pid=5975] ppid=5972 vsize=400720 CPUtime=3.09 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 97550 0 0 0 297 12 0 0 20 0 1 0 16362426 410337280 93458 33554432000 4194304 5970956 140724872453136 140724872450392 4934327 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93458 733 434 0 93544 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 400720

[startup+6.30029 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 5976
/proc/meminfo: memFree=31119108/32770624 swapFree=6912/387088
[pid=5975] ppid=5972 vsize=400720 CPUtime=6.29 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 154930 0 0 0 615 14 0 0 20 0 1 0 16362426 410337280 93500 33554432000 4194304 5970956 140724872453136 140724872450744 4934272 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93500 774 434 0 93544 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 400720

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 1.96 3/187 5983
/proc/meminfo: memFree=31117280/32770624 swapFree=6912/387100
[pid=5975] ppid=5972 vsize=400720 CPUtime=12.69 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 188511 0 0 0 1253 16 0 0 20 0 1 0 16362426 410337280 93502 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93502 776 434 0 93544 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 400720

[startup+25.5004 s]
/proc/loadavg: 2.08 2.03 1.97 3/187 5983
/proc/meminfo: memFree=31117676/32770624 swapFree=6912/387124
[pid=5975] ppid=5972 vsize=400720 CPUtime=25.48 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 234650 0 0 0 2530 18 0 0 20 0 1 0 16362426 410337280 93502 33554432000 4194304 5970956 140724872453136 140724872450472 4934318 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93502 776 434 0 93544 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 400720

[startup+51.1004 s]
/proc/loadavg: 2.11 2.04 1.97 3/187 5983
/proc/meminfo: memFree=31118048/32770624 swapFree=6912/387148
[pid=5975] ppid=5972 vsize=400720 CPUtime=51.06 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 275602 0 0 0 5086 20 0 0 20 0 1 0 16362426 410337280 93502 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93502 776 434 0 93544 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 400720

[startup+102.3 s]
/proc/loadavg: 2.11 2.05 1.98 3/187 5984
/proc/meminfo: memFree=31116608/32770624 swapFree=6912/387216
[pid=5975] ppid=5972 vsize=400720 CPUtime=102.24 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 311796 0 0 0 10202 22 0 0 20 0 1 0 16362426 410337280 93502 33554432000 4194304 5970956 140724872453136 140724872450472 4933153 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93502 776 434 0 93544 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 400720

[startup+162.3 s]
/proc/loadavg: 2.11 2.06 1.98 3/187 5985
/proc/meminfo: memFree=31116396/32770624 swapFree=6912/387268
[pid=5975] ppid=5972 vsize=400720 CPUtime=162.19 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 341011 0 0 0 16195 24 0 0 20 0 1 0 16362426 410337280 93502 33554432000 4194304 5970956 140724872453136 140724872450472 4934538 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93502 776 434 0 93544 0
Current children cumulated CPU time (s) 162.19
Current children cumulated vsize (KiB) 400720

[startup+222.306 s]
/proc/loadavg: 2.04 2.05 1.98 3/187 5986
/proc/meminfo: memFree=31116184/32770624 swapFree=6912/387316
[pid=5975] ppid=5972 vsize=400720 CPUtime=222.16 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 361186 0 0 0 22191 25 0 0 20 0 1 0 16362426 410337280 93502 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93502 776 434 0 93544 0
Current children cumulated CPU time (s) 222.16
Current children cumulated vsize (KiB) 400720

[startup+282.3 s]
/proc/loadavg: 2.07 2.05 1.99 3/187 5987
/proc/meminfo: memFree=31115288/32770624 swapFree=6912/387368
[pid=5975] ppid=5972 vsize=400720 CPUtime=282.12 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 364451 0 0 0 28187 25 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934342 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 282.12
Current children cumulated vsize (KiB) 400720

[startup+342.3 s]
/proc/loadavg: 2.03 2.04 1.99 3/187 5988
/proc/meminfo: memFree=31114940/32770624 swapFree=6912/387412
[pid=5975] ppid=5972 vsize=400720 CPUtime=342.09 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 365338 0 0 0 34184 25 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 342.09
Current children cumulated vsize (KiB) 400720

[startup+402.3 s]
/proc/loadavg: 2.01 2.04 1.99 3/187 5989
/proc/meminfo: memFree=31115200/32770624 swapFree=6912/387456
[pid=5975] ppid=5972 vsize=400720 CPUtime=402.06 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 366226 0 0 0 40181 25 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 402.06
Current children cumulated vsize (KiB) 400720

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 1.99 3/187 5990
/proc/meminfo: memFree=31115660/32770624 swapFree=6912/387492
[pid=5975] ppid=5972 vsize=400720 CPUtime=462.03 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 367113 0 0 0 46177 26 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 462.03
Current children cumulated vsize (KiB) 400720

[startup+522.3 s]
/proc/loadavg: 2.08 2.04 1.99 3/187 5991
/proc/meminfo: memFree=31115944/32770624 swapFree=6912/387536
[pid=5975] ppid=5972 vsize=400720 CPUtime=521.99 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 368000 0 0 0 52173 26 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 521.99
Current children cumulated vsize (KiB) 400720

[startup+582.3 s]
/proc/loadavg: 2.03 2.04 1.99 3/187 5992
/proc/meminfo: memFree=31115556/32770624 swapFree=6912/387580
[pid=5975] ppid=5972 vsize=400720 CPUtime=581.96 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 368896 0 0 0 58170 26 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 581.96
Current children cumulated vsize (KiB) 400720


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/187 6021
/proc/meminfo: memFree=31114288/32770624 swapFree=6912/388132
[pid=5975] ppid=5972 vsize=400720 CPUtime=1481.45 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 380639 0 0 0 148117 28 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1481.45
Current children cumulated vsize (KiB) 400720

[startup+1542.31 s]
/proc/loadavg: 2.09 2.04 2.02 3/187 6023
/proc/meminfo: memFree=31114180/32770624 swapFree=6912/388176
[pid=5975] ppid=5972 vsize=400720 CPUtime=1541.42 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 381078 0 0 0 154114 28 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1541.42
Current children cumulated vsize (KiB) 400720

[startup+1602.3 s]
/proc/loadavg: 2.03 2.04 2.02 3/187 6024
/proc/meminfo: memFree=31113800/32770624 swapFree=6912/388200
[pid=5975] ppid=5972 vsize=400720 CPUtime=1601.37 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 381571 0 0 0 160109 28 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934354 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1601.37
Current children cumulated vsize (KiB) 400720

[startup+1662.3 s]
/proc/loadavg: 2.01 2.03 2.02 3/187 6025
/proc/meminfo: memFree=31113932/32770624 swapFree=6912/388236
[pid=5975] ppid=5972 vsize=400720 CPUtime=1661.34 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 382466 0 0 0 166106 28 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4933072 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1661.34
Current children cumulated vsize (KiB) 400720

[startup+1722.3 s]
/proc/loadavg: 2.00 2.02 2.02 3/187 6027
/proc/meminfo: memFree=31114056/32770624 swapFree=6912/388268
[pid=5975] ppid=5972 vsize=400720 CPUtime=1721.3 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 383122 0 0 0 172102 28 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934354 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1721.3
Current children cumulated vsize (KiB) 400720

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 2.02 3/187 6028
/proc/meminfo: memFree=31114040/32770624 swapFree=6912/388300
[pid=5975] ppid=5972 vsize=400720 CPUtime=1781.27 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 383872 0 0 0 178099 28 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1781.27
Current children cumulated vsize (KiB) 400720

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/187 6052
/proc/meminfo: memFree=31118228/32770624 swapFree=6912/388340
[pid=5975] ppid=5972 vsize=400720 CPUtime=1841.24 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 384605 0 0 0 184095 29 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4933209 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1841.24
Current children cumulated vsize (KiB) 400720

[startup+1902.3 s]
/proc/loadavg: 1.90 1.98 2.01 3/188 6366
/proc/meminfo: memFree=31115168/32770624 swapFree=6912/388616
[pid=5975] ppid=5972 vsize=400720 CPUtime=1901.19 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 385497 0 0 0 190090 29 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1901.19
Current children cumulated vsize (KiB) 400720

[startup+1962.3 s]
/proc/loadavg: 2.06 2.02 2.02 3/188 6367
/proc/meminfo: memFree=31115504/32770624 swapFree=6912/388704
[pid=5975] ppid=5972 vsize=400720 CPUtime=1961.16 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 386186 0 0 0 196087 29 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 1961.16
Current children cumulated vsize (KiB) 400720

[startup+2022.3 s]
/proc/loadavg: 2.02 2.01 2.02 3/188 6368
/proc/meminfo: memFree=31115428/32770624 swapFree=6912/388768
[pid=5975] ppid=5972 vsize=400720 CPUtime=2021.13 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 386926 0 0 0 202083 30 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934864 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2021.13
Current children cumulated vsize (KiB) 400720

[startup+2082.3 s]
/proc/loadavg: 2.01 2.01 2.02 3/188 6491
/proc/meminfo: memFree=31115652/32770624 swapFree=6912/388880
[pid=5975] ppid=5972 vsize=400720 CPUtime=2081.1 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 387828 0 0 0 208080 30 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2081.1
Current children cumulated vsize (KiB) 400720

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/188 6492
/proc/meminfo: memFree=31115832/32770624 swapFree=6912/388952
[pid=5975] ppid=5972 vsize=400720 CPUtime=2141.07 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 388269 0 0 0 214076 31 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934398 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2141.07
Current children cumulated vsize (KiB) 400720

[startup+2202.31 s]
/proc/loadavg: 2.00 2.01 2.02 3/187 6493
/proc/meminfo: memFree=31115672/32770624 swapFree=6912/389016
[pid=5975] ppid=5972 vsize=400720 CPUtime=2201.04 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 388759 0 0 0 220073 31 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2201.04
Current children cumulated vsize (KiB) 400720

[startup+2262.3 s]
/proc/loadavg: 2.11 2.04 2.03 3/187 6494
/proc/meminfo: memFree=31115608/32770624 swapFree=6912/389060
[pid=5975] ppid=5972 vsize=400720 CPUtime=2261 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 389641 0 0 0 226069 31 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2261
Current children cumulated vsize (KiB) 400720

[startup+2322.3 s]
/proc/loadavg: 2.04 2.04 2.03 3/187 6495
/proc/meminfo: memFree=31115116/32770624 swapFree=6912/389096
[pid=5975] ppid=5972 vsize=400720 CPUtime=2320.97 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 390339 0 0 0 232066 31 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934327 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2320.97
Current children cumulated vsize (KiB) 400720

[startup+2382.3 s]
/proc/loadavg: 2.02 2.03 2.03 3/187 6496
/proc/meminfo: memFree=31115404/32770624 swapFree=6912/389140
[pid=5975] ppid=5972 vsize=400720 CPUtime=2380.93 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 391077 0 0 0 238062 31 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934318 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2380.93
Current children cumulated vsize (KiB) 400720



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2401.41 s]
/proc/loadavg: 2.01 2.03 2.03 3/187 6496
/proc/meminfo: memFree=31115444/32770624 swapFree=6912/389160
[pid=5975] ppid=5972 vsize=400720 CPUtime=2400.03 cores=0,2,4,6
/proc/5975/stat : 5975 (cosoco) R 5972 5975 5624 0 -1 4202496 391480 0 0 0 239972 31 0 0 20 0 1 0 16362426 410337280 93794 33554432000 4194304 5970956 140724872453136 140724872450472 4934366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 31797248 140724872455361 140724872455491 140724872455491 140724872458190 0
/proc/5975/statm: 100180 93794 776 434 0 93544 0
Current children cumulated CPU time (s) 2400.03
Current children cumulated vsize (KiB) 400720

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 5975 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2401.41
CPU time (s): 2400.04
CPU user time (s): 2399.73
CPU system time (s): 0.318822
CPU usage (%): 99.9432
Max. virtual memory (cumulated for all children) (KiB): 400720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.73
system time used= 0.318822
maximum resident set size= 375224
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 391509
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 29
involuntary context switches= 124115

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.78521 second user time and 10.0379 second system time

The end

Launcher Data 

Begin job on node151 at 2017-07-21 11:29:55
IDJOB=4241246
IDBENCH=126260
IDSOLVER=2620
FILE ID=node151/4241246-1500629394
RUNJOBID= node151-1500626434-5655
PBS_JOBID= 20623026
Free space on /tmp= 62024 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/Steiner3/Steiner3-m1-s1/Steiner3-10.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4241246-1500629394/watcher-4241246-1500629394 -o /tmp/evaluation-result-4241246-1500629394/solver-4241246-1500629394 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1500626434-5655 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4241246-1500629394.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 33acbdbf13e8fba51e0fc3db0676c789
RANDOM SEED=2041792059

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2267.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31491736 kB
MemAvailable:   32006176 kB
Buffers:          237244 kB
Cached:           556664 kB
SwapCached:            0 kB
Active:           461228 kB
Inactive:         395792 kB
Active(anon):      65812 kB
Inactive(anon):     8636 kB
Active(file):     395416 kB
Inactive(file):   387156 kB
Unevictable:        6912 kB
Mlocked:            6920 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              7912 kB
Writeback:             0 kB
AnonPages:         69800 kB
Mapped:            34148 kB
Shmem:              8848 kB
Slab:             121340 kB
SReclaimable:      95404 kB
SUnreclaim:        25936 kB
KernelStack:        3344 kB
PageTables:         4680 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     331852 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 62020 MiB
End job on node151 at 2017-07-21 12:09:56