Trace number 4240203

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.04 2400.7

General information on the benchmark

NameKnights/Knights-m1-s1/
Knights-050-09.xml
MD5SUM78e001d21a1411ecb51795c063836bf7
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark309.78299
Satisfiable
(Un)Satisfiability was proved
Number of variables9
Number of constraints36
Number of domains1
Minimum domain size2500
Maximum domain size2500
Distribution of domain sizes[{"size":2500,"count":9}]
Minimum variable degree7
Maximum variable degree7
Distribution of variable degrees[{"degree":7,"count":9}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":36}]
Number of extensional constraints0
Number of intensional constraints36
Distribution of constraint types[{"type":"intension","count":36}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c intension x[0] != x[2]  using generic constraint 
0.00/0.01	c intension x[0] != x[3]  using generic constraint 
0.00/0.01	c intension x[0] != x[4]  using generic constraint 
0.00/0.01	c intension x[0] != x[5]  using generic constraint 
0.00/0.01	c intension x[0] != x[6]  using generic constraint 
0.00/0.01	c intension x[0] != x[7]  using generic constraint 
0.00/0.02	c intension x[1] != x[3]  using generic constraint 
0.00/0.02	c intension x[1] != x[4]  using generic constraint 
0.00/0.02	c intension x[1] != x[5]  using generic constraint 
0.00/0.02	c intension x[1] != x[6]  using generic constraint 
0.00/0.02	c intension x[1] != x[7]  using generic constraint 
0.00/0.02	c intension x[1] != x[8]  using generic constraint 
0.00/0.03	c intension x[2] != x[4]  using generic constraint 
0.00/0.03	c intension x[2] != x[5]  using generic constraint 
0.00/0.03	c intension x[2] != x[6]  using generic constraint 
0.00/0.03	c intension x[2] != x[7]  using generic constraint 
0.00/0.03	c intension x[2] != x[8]  using generic constraint 
0.00/0.03	c intension x[3] != x[5]  using generic constraint 
0.00/0.04	c intension x[3] != x[6]  using generic constraint 
0.00/0.04	c intension x[3] != x[7]  using generic constraint 
0.00/0.04	c intension x[3] != x[8]  using generic constraint 
0.00/0.04	c intension x[4] != x[6]  using generic constraint 
0.00/0.04	c intension x[4] != x[7]  using generic constraint 
0.00/0.04	c intension x[4] != x[8]  using generic constraint 
0.00/0.04	c intension x[5] != x[7]  using generic constraint 
0.00/0.05	c intension x[5] != x[8]  using generic constraint 
0.00/0.05	c intension x[6] != x[8]  using generic constraint 
0.00/0.07	c root propagations     : 0           
0.00/0.07	c restarts enabled, print stats at every restarts
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c This is cosoco 1.0 --  
0.00/0.07	c
0.00/0.07	c ========================================[ Problem Statistics ]===========================================
0.00/0.07	c |                                                                                                       
0.00/0.07	c |  Parse time        :         0.06 s 
0.00/0.07	c |
0.00/0.07	c |               Variables: 9
0.00/0.07	c |            Domain Sizes: 2500..2500
0.00/0.07	c |
0.00/0.07	c |             Constraints: 36
0.00/0.07	c |                   Arity: 2..2  -- Binary: 36
0.00/0.07	c | 
0.00/0.07	c |                   Types: 
0.00/0.07	c |                          (X != Y): 27
0.00/0.07	c |                          Intension: 9
0.00/0.07	c |                          
0.00/0.07	c =========================================================================================================
0.00/0.07	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.09/0.16	c 101            118            2753           349550         0              0              4   7   4      
0.19/0.27	c 211            285            7713           806977         0              0              3   7   5      
0.29/0.34	c 332            435            11050          1203997        0              0              4   7   4      
0.39/0.48	c 465            648            17286          1766354        0              0              4   7   6      
0.49/0.56	c 611            857            22200          2080446        0              0              4   7   4      
0.59/0.65	c 771            1081           27376          2396774        0              0              4   7   4      
0.69/0.74	c 947            1324           32891          2733325        0              0              4   7   4      
0.89/0.92	c 1140           1638           41166          3406200        0              0              4   7   5      
0.99/1.06	c 1352           1919           47389          4129649        0              0              4   7   4      
1.19/1.22	c 1585           2230           54386          4935411        0              0              4   7   4      
1.39/1.44	c 1841           2603           63905          5895071        0              0              2   7   5      
1.49/1.59	c 2122           2996           72887          6463474        0              0              4   7   4      
1.69/1.76	c 2431           3423           82469          7091489        0              0              4   7   4      
2.09/2.10	c 2770           3939           95970          8509077        0              0              2   7   5      
2.29/2.38	c 3142           4458           108133         9857241        0              0              4   7   4      
2.79/2.83	c 3551           5117           125372         11748921       1              0              2   7   4      
3.19/3.21	c 4000           5796           142197         13372854       2              0              2   7   5      
3.49/3.58	c 4493           6515           160376         14876901       3              0              2   7   4      
3.79/3.84	c 5035           7257           176785         15810417       3              0              4   7   4      
4.29/4.34	c 5631           8114           197899         18097215       3              0              3   7   5      
4.68/4.76	c 6286           9086           220644         19743061       4              0              2   7   4      
5.18/5.23	c 7006           10170          246359         21437396       5              0              4   7   5      
5.78/5.87	c 7798           11338          276511         24244276       5              0              2   7   5      
6.48/6.51	c 8669           12566          306341         27293422       5              0              3   7   5      
7.18/7.27	c 9627           13983          341549         30517562       6              0              2   7   5      
8.18/8.24	c 10680          15679          386231         34606782       7              0              2   7   5      
8.98/9.07	c 11838          17307          426803         38284418       7              0              2   7   5      
10.08/10.15	c 13111          19172          474285         43263659       7              0              2   7   5      
11.18/11.22	c 14511          21148          522477         47733313       8              0              2   7   5      
11.88/11.90	c 16051          23083          564811         50684621       8              0              2   7   4      
12.88/12.93	c 17745          25278          615647         55143171       8              0              2   7   5      
13.58/13.60	c 19608          27541          662869         57824665       8              0              2   7   4      
15.38/15.42	c 21657          30538          739676         65980487       8              0              2   7   5      
16.58/16.66	c 23910          33323          800288         72170899       8              0              2   7   4      
17.88/17.95	c 26388          36412          867280         77909449       9              0              2   7   4      
20.17/20.28	c 29113          40580          974197         88084610       9              0              2   7   5      
22.47/22.58	c 32110          44615          1073168        98610712       9              0              2   7   5      
24.87/24.99	c 35406          49302          1187400        109450144      9              0              2   7   5      
27.17/27.21	c 39031          54100          1298864        119261554      9              0              2   7   5      
29.46/29.57	c 43018          59414          1422873        129878717      9              0              2   7   5      
32.36/32.49	c 47403          65261          1561581        143182614      9              0              2   7   5      
35.17/35.25	c 52226          71715          1712245        154745295      9              0              2   7   5      
39.56/39.64	c 57531          78574          1885885        177707874      9              0              2   7   4      
44.16/44.21	c 63366          86921          2094099        198211128      9              0              2   7   5      
48.05/48.19	c 69784          95387          2292456        215878705      9              0              2   7   4      
52.76/52.88	c 76843          104760         2511324        236901307      9              0              2   7   4      
58.85/58.99	c 84607          115590         2777242        264177762      9              0              2   7   5      
64.54/64.68	c 93147          126855         3038517        289303975      9              0              2   7   4      
71.24/71.34	c 102541         139526         3340614        318584542      9              0              2   7   4      
79.53/79.68	c 112874         154776         3722376        354684596      9              0              2   7   5      
88.33/88.44	c 124240         171262         4126098        392137229      9              0              2   7   5      
98.72/98.81	c 136742         188502         4570429        440733014      9              0              2   7   4      
109.02/109.15	c 150494         208016         5044202        485271890      9              0              2   7   5      
120.52/120.69	c 165621         229757         5579366        535298617      9              0              2   7   5      
133.92/134.03	c 182260         253854         6174339        593516563      9              0              2   7   5      
149.31/149.46	c 200562         281440         6864475        660376510      9              0              2   7   5      
164.81/164.99	c 220694         311115         7593666        727374715      9              0              2   7   5      
184.00/184.12	c 242839         344355         8432777        809281390      9              0              2   7   5      
203.41/203.54	c 267198         380300         9323725        891532378      9              0              2   7   5      
224.50/224.65	c 293992         418685         10275421       982268465      9              0              2   7   5      
246.99/247.11	c 323465         461708         11331782       1078229640     9              0              2   7   5      
272.38/272.52	c 355885         509947         12531010       1186739297     9              0              2   7   5      
301.77/301.93	c 391547         562514         13837817       1312889172     9              0              2   7   5      
333.96/334.16	c 430775         620322         15284244       1451354978     9              0              2   7   5      
369.16/369.36	c 473925         684104         16881070       1607778923     9              0              2   7   5      
410.04/410.25	c 521390         755667         18703180       1779128336     9              0              2   7   5      
454.24/454.40	c 573601         834505         20692412       1965752848     9              0              2   7   5      
502.12/502.38	c 631033         920643         22845067       2175395888     9              0              2   7   5      
554.10/554.37	c 694208         1014944        25209285       2397922270     9              0              2   7   5      
609.89/610.15	c 763700         1117297        27759158       2638074589     9              0              2   7   5      
673.77/674.03	c 840141         1230934        30610644       2910609972     9              0              2   7   5      
743.75/744.00	c 924226         1357469        33789733       3210589222     9              0              2   7   5      
819.14/819.45	c 1016719        1494096        37199519       3535860051     9              0              2   7   5      
901.92/902.27	c 1118461        1644643        40954019       3893944336     9              0              2   7   5      
995.79/996.19	c 1230377        1811888        45172142       4296940957     9              0              2   7   5      
1097.06/1097.46	c 1353484        1993912        49742018       4733850890     9              0              2   7   5      
1207.43/1207.81	c 1488901        2193480        54732632       5209427766     9              0              2   7   5      
1333.39/1333.80	c 1637859        2418375        60422718       5745784061     9              0              2   7   5      
1469.07/1469.51	c 1801712        2669851        66800277       6319302041     9              0              2   7   5      
1617.03/1617.55	c 1981950        2940267        73589175       6960721665     9              0              2   7   5      
1779.78/1780.38	c 2180211        3234850        80959339       7663375099     9              0              2   7   5      
1954.34/1954.90	c 2398298        3552206        88836719       8424148145     9              0              2   7   5      
2149.28/2149.98	c 2638193        3904583        97639310       9268784526     9              0              2   7   5      
2370.04/2370.78	c 2902077        4294536        107462621      10213594344    9              0              2   7   5

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4240203-1500623890/watcher-4240203-1500623890 -o /tmp/evaluation-result-4240203-1500623890/solver-4240203-1500623890 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node102-1500623787-4393 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4240203-1500623890.xml 

pid=4736
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 1.67 0.60 0.25 3/192 4739
/proc/meminfo: memFree=31128168/32770624 swapFree=6824/679112
[pid=4739] ppid=4736 vsize=27132 CPUtime=0 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1037 0 0 0 0 0 0 0 20 0 1 0 23668379 27783168 832 33554432000 4194304 5970956 140737062543808 140737062543168 140223520061888 0 0 4096 0 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 6783 832 706 434 0 147 0

[startup+0.100114 s]
/proc/loadavg: 1.67 0.60 0.25 3/192 4739
/proc/meminfo: memFree=31128168/32770624 swapFree=6824/679112
[pid=4739] ppid=4736 vsize=27900 CPUtime=0.09 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1301 0 0 0 9 0 0 0 20 0 1 0 23668379 28569600 1096 33554432000 4194304 5970956 140737062543808 140737062541416 5070892 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 6975 1096 785 434 0 339 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27900

[startup+0.200266 s]
/proc/loadavg: 1.67 0.60 0.25 3/192 4739
/proc/meminfo: memFree=31128168/32770624 swapFree=6824/679112
[pid=4739] ppid=4736 vsize=27900 CPUtime=0.19 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1302 0 0 0 19 0 0 0 20 0 1 0 23668379 28569600 1096 33554432000 4194304 5970956 140737062543808 140737062541144 4964535 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 6975 1096 785 434 0 339 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 27900

[startup+0.300197 s]
/proc/loadavg: 1.67 0.60 0.25 3/192 4739
/proc/meminfo: memFree=31128168/32770624 swapFree=6824/679112
[pid=4739] ppid=4736 vsize=27900 CPUtime=0.29 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1303 0 0 0 29 0 0 0 20 0 1 0 23668379 28569600 1096 33554432000 4194304 5970956 140737062543808 140737062541144 5069712 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 6975 1096 785 434 0 339 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 27900

[startup+0.700179 s]
/proc/loadavg: 1.67 0.60 0.25 3/192 4739
/proc/meminfo: memFree=31128168/32770624 swapFree=6824/679112
[pid=4739] ppid=4736 vsize=27900 CPUtime=0.69 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1306 0 0 0 69 0 0 0 20 0 1 0 23668379 28569600 1096 33554432000 4194304 5970956 140737062543808 140737062541144 4964510 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 6975 1096 785 434 0 339 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 27900

[startup+1.50018 s]
/proc/loadavg: 1.67 0.60 0.25 3/193 4740
/proc/meminfo: memFree=31126896/32770624 swapFree=6824/679116
[pid=4739] ppid=4736 vsize=27900 CPUtime=1.49 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1312 0 0 0 149 0 0 0 20 0 1 0 23668379 28569600 1096 33554432000 4194304 5970956 140737062543808 140737062541144 4968244 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 6975 1096 785 434 0 339 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 27900

[startup+3.10019 s]
/proc/loadavg: 1.67 0.60 0.25 3/193 4740
/proc/meminfo: memFree=31126136/32770624 swapFree=6824/679124
[pid=4739] ppid=4736 vsize=28032 CPUtime=3.09 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1488 0 0 0 309 0 0 0 20 0 1 0 23668379 28704768 1165 33554432000 4194304 5970956 140737062543808 140737062541144 5052048 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7008 1165 824 434 0 372 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 28032

[startup+6.30019 s]
/proc/loadavg: 1.61 0.61 0.26 3/193 4740
/proc/meminfo: memFree=31126384/32770624 swapFree=6824/679128
[pid=4739] ppid=4736 vsize=28032 CPUtime=6.28 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 1891 0 0 0 628 0 0 0 20 0 1 0 23668379 28704768 1167 33554432000 4194304 5970956 140737062543808 140737062541144 4964389 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7008 1167 824 434 0 372 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 28032

[startup+12.7002 s]
/proc/loadavg: 1.64 0.63 0.27 3/193 4740
/proc/meminfo: memFree=31125764/32770624 swapFree=6824/679132
[pid=4739] ppid=4736 vsize=28032 CPUtime=12.68 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 2184 0 0 0 1268 0 0 0 20 0 1 0 23668379 28704768 1172 33554432000 4194304 5970956 140737062543808 140737062541144 5069735 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7008 1172 824 434 0 372 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 28032

[startup+25.5002 s]
/proc/loadavg: 1.72 0.70 0.30 3/193 4740
/proc/meminfo: memFree=31125764/32770624 swapFree=6824/679148
[pid=4739] ppid=4736 vsize=28164 CPUtime=25.47 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 2783 0 0 0 2547 0 0 0 20 0 1 0 23668379 28839936 1191 33554432000 4194304 5970956 140737062543808 140737062541144 5070101 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7041 1191 824 434 0 405 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 28164

[startup+51.1002 s]
/proc/loadavg: 1.82 0.81 0.34 3/193 4740
/proc/meminfo: memFree=31126092/32770624 swapFree=6824/679176
[pid=4739] ppid=4736 vsize=28428 CPUtime=51.05 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 3253 0 0 0 5105 0 0 0 20 0 1 0 23668379 29110272 1263 33554432000 4194304 5970956 140737062543808 140737062541144 4964336 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7107 1263 824 434 0 471 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 28428

[startup+102.3 s]
/proc/loadavg: 1.92 0.99 0.43 3/193 4741
/proc/meminfo: memFree=31125372/32770624 swapFree=6824/679240
[pid=4739] ppid=4736 vsize=28560 CPUtime=102.23 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 3710 0 0 0 10223 0 0 0 20 0 1 0 23668379 29245440 1306 33554432000 4194304 5970956 140737062543808 140737062541144 5098928 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7140 1306 824 434 0 504 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 28560

[startup+162.3 s]
/proc/loadavg: 2.04 1.20 0.54 3/194 4808
/proc/meminfo: memFree=31115972/32770624 swapFree=6824/679348
[pid=4739] ppid=4736 vsize=28692 CPUtime=162.21 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 4154 0 0 0 16220 1 0 0 20 0 1 0 23668379 29380608 1329 33554432000 4194304 5970956 140737062543808 140737062541144 5070880 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1329 824 434 0 537 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 28692

[startup+222.306 s]
/proc/loadavg: 2.01 1.35 0.63 3/193 4829
/proc/meminfo: memFree=31114812/32770624 swapFree=6824/679424
[pid=4739] ppid=4736 vsize=28692 CPUtime=222.2 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 4595 0 0 0 22218 2 0 0 20 0 1 0 23668379 29380608 1329 33554432000 4194304 5970956 140737062543808 140737062541144 4964366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1329 824 434 0 537 0
Current children cumulated CPU time (s) 222.2
Current children cumulated vsize (KiB) 28692

[startup+282.3 s]
/proc/loadavg: 2.01 1.47 0.71 3/192 4830
/proc/meminfo: memFree=31115460/32770624 swapFree=6824/679480
[pid=4739] ppid=4736 vsize=28692 CPUtime=282.18 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 5038 0 0 0 28216 2 0 0 20 0 1 0 23668379 29380608 1330 33554432000 4194304 5970956 140737062543808 140737062541144 5069977 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1330 824 434 0 537 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 28692

[startup+342.3 s]
/proc/loadavg: 2.00 1.56 0.79 3/192 4831
/proc/meminfo: memFree=31115960/32770624 swapFree=6824/679524
[pid=4739] ppid=4736 vsize=28692 CPUtime=342.16 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 5481 0 0 0 34214 2 0 0 20 0 1 0 23668379 29380608 1330 33554432000 4194304 5970956 140737062543808 140737062541144 4964389 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1330 824 434 0 537 0
Current children cumulated CPU time (s) 342.16
Current children cumulated vsize (KiB) 28692

[startup+402.3 s]
/proc/loadavg: 2.14 1.69 0.89 3/192 4832
/proc/meminfo: memFree=31116036/32770624 swapFree=6824/679584
[pid=4739] ppid=4736 vsize=28692 CPUtime=402.15 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 5923 0 0 0 40213 2 0 0 20 0 1 0 23668379 29380608 1330 33554432000 4194304 5970956 140737062543808 140737062541144 5098928 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1330 824 434 0 537 0
Current children cumulated CPU time (s) 402.15
Current children cumulated vsize (KiB) 28692

[startup+462.3 s]
/proc/loadavg: 2.05 1.74 0.96 3/191 4833
/proc/meminfo: memFree=31116300/32770624 swapFree=6824/679636
[pid=4739] ppid=4736 vsize=28692 CPUtime=462.13 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 6365 0 0 0 46211 2 0 0 20 0 1 0 23668379 29380608 1330 33554432000 4194304 5970956 140737062543808 140737062541144 5093213 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1330 824 434 0 537 0
Current children cumulated CPU time (s) 462.13
Current children cumulated vsize (KiB) 28692

[startup+522.3 s]
/proc/loadavg: 2.07 1.81 1.03 3/191 4834
/proc/meminfo: memFree=31115780/32770624 swapFree=6824/679680
[pid=4739] ppid=4736 vsize=28692 CPUtime=522.11 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 6808 0 0 0 52209 2 0 0 20 0 1 0 23668379 29380608 1330 33554432000 4194304 5970956 140737062543808 140737062541144 5070102 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1330 824 434 0 537 0
Current children cumulated CPU time (s) 522.11
Current children cumulated vsize (KiB) 28692

[startup+582.3 s]
/proc/loadavg: 2.03 1.84 1.09 3/191 4835
/proc/meminfo: memFree=31115904/32770624 swapFree=6824/679716
[pid=4739] ppid=4736 vsize=28692 CPUtime=582.1 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 7251 0 0 0 58208 2 0 0 20 0 1 0 23668379 29380608 1331 33554432000 4194304 5970956 140737062543808 140737062541144 4961266 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1331 824 434 0 537 0
Current children cumulated CPU time (s) 582.1
Current children cumulated vsize (KiB) 28692


################
# More data... #
################


[startup+1542.31 s]
/proc/loadavg: 2.01 2.02 1.69 3/192 4862
/proc/meminfo: memFree=31114828/32770624 swapFree=6824/680372
[pid=4739] ppid=4736 vsize=28692 CPUtime=1541.85 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 14347 0 0 0 154181 4 0 0 20 0 1 0 23668379 29380608 1337 33554432000 4194304 5970956 140737062543808 140737062541144 5070008 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1337 824 434 0 537 0
Current children cumulated CPU time (s) 1541.85
Current children cumulated vsize (KiB) 28692

[startup+1602.3 s]
/proc/loadavg: 2.00 2.02 1.71 3/192 4863
/proc/meminfo: memFree=31115380/32770624 swapFree=6824/680408
[pid=4739] ppid=4736 vsize=28692 CPUtime=1601.83 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 14784 0 0 0 160179 4 0 0 20 0 1 0 23668379 29380608 1337 33554432000 4194304 5970956 140737062543808 140737062541144 4968249 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1337 824 434 0 537 0
Current children cumulated CPU time (s) 1601.83
Current children cumulated vsize (KiB) 28692

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 1.73 3/191 4865
/proc/meminfo: memFree=31114808/32770624 swapFree=6824/680456
[pid=4739] ppid=4736 vsize=28692 CPUtime=1661.81 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 15243 0 0 0 166177 4 0 0 20 0 1 0 23668379 29380608 1337 33554432000 4194304 5970956 140737062543808 140737062541144 5070102 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7173 1337 824 434 0 537 0
Current children cumulated CPU time (s) 1661.81
Current children cumulated vsize (KiB) 28692

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 1.75 3/191 4866
/proc/meminfo: memFree=31114684/32770624 swapFree=6824/680488
[pid=4739] ppid=4736 vsize=28956 CPUtime=1721.8 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 15742 0 0 0 172176 4 0 0 20 0 1 0 23668379 29650944 1372 33554432000 4194304 5970956 140737062543808 140737062540872 5069728 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7239 1372 824 434 0 603 0
Current children cumulated CPU time (s) 1721.8
Current children cumulated vsize (KiB) 28956

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 1.76 3/191 4867
/proc/meminfo: memFree=31114560/32770624 swapFree=6824/680524
[pid=4739] ppid=4736 vsize=28956 CPUtime=1781.78 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 16243 0 0 0 178174 4 0 0 20 0 1 0 23668379 29650944 1389 33554432000 4194304 5970956 140737062543808 140737062541144 5070008 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7239 1389 824 434 0 603 0
Current children cumulated CPU time (s) 1781.78
Current children cumulated vsize (KiB) 28956

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 1.78 3/191 4869
/proc/meminfo: memFree=31114940/32770624 swapFree=6824/680548
[pid=4739] ppid=4736 vsize=28956 CPUtime=1841.77 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 16731 0 0 0 184173 4 0 0 20 0 1 0 23668379 29650944 1389 33554432000 4194304 5970956 140737062543808 140737062541144 5069728 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7239 1389 824 434 0 603 0
Current children cumulated CPU time (s) 1841.77
Current children cumulated vsize (KiB) 28956

[startup+1902.3 s]
/proc/loadavg: 2.15 2.06 1.81 3/191 4870
/proc/meminfo: memFree=31114576/32770624 swapFree=6824/680596
[pid=4739] ppid=4736 vsize=28956 CPUtime=1901.75 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 17219 0 0 0 190171 4 0 0 20 0 1 0 23668379 29650944 1389 33554432000 4194304 5970956 140737062543808 140737062541144 4964629 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7239 1389 824 434 0 603 0
Current children cumulated CPU time (s) 1901.75
Current children cumulated vsize (KiB) 28956

[startup+1962.3 s]
/proc/loadavg: 2.05 2.05 1.82 3/191 4876
/proc/meminfo: memFree=31113380/32770624 swapFree=6824/680632
[pid=4739] ppid=4736 vsize=29088 CPUtime=1961.73 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 17809 0 0 0 196169 4 0 0 20 0 1 0 23668379 29786112 1414 33554432000 4194304 5970956 140737062543808 140737062541144 5069712 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7272 1414 824 434 0 636 0
Current children cumulated CPU time (s) 1961.73
Current children cumulated vsize (KiB) 29088

[startup+2022.3 s]
/proc/loadavg: 2.08 2.05 1.84 3/191 4877
/proc/meminfo: memFree=31113940/32770624 swapFree=6824/680676
[pid=4739] ppid=4736 vsize=29088 CPUtime=2021.72 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 18347 0 0 0 202168 4 0 0 20 0 1 0 23668379 29786112 1439 33554432000 4194304 5970956 140737062543808 140737062541144 5098928 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7272 1439 824 434 0 636 0
Current children cumulated CPU time (s) 2021.72
Current children cumulated vsize (KiB) 29088

[startup+2082.3 s]
/proc/loadavg: 2.03 2.04 1.85 3/191 4878
/proc/meminfo: memFree=31114064/32770624 swapFree=6824/680696
[pid=4739] ppid=4736 vsize=29088 CPUtime=2081.71 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 18889 0 0 0 208167 4 0 0 20 0 1 0 23668379 29786112 1439 33554432000 4194304 5970956 140737062543808 140737062541144 5069712 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7272 1439 824 434 0 636 0
Current children cumulated CPU time (s) 2081.71
Current children cumulated vsize (KiB) 29088

[startup+2142.3 s]
/proc/loadavg: 2.01 2.04 1.86 3/191 4879
/proc/meminfo: memFree=31114180/32770624 swapFree=6824/680740
[pid=4739] ppid=4736 vsize=29220 CPUtime=2141.68 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 19463 0 0 0 214164 4 0 0 20 0 1 0 23668379 29921280 1439 33554432000 4194304 5970956 140737062543808 140737062540872 4964366 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7305 1439 824 434 0 669 0
Current children cumulated CPU time (s) 2141.68
Current children cumulated vsize (KiB) 29220

[startup+2202.31 s]
/proc/loadavg: 2.00 2.03 1.87 3/191 4880
/proc/meminfo: memFree=31114304/32770624 swapFree=6824/680784
[pid=4739] ppid=4736 vsize=29220 CPUtime=2201.68 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 20033 0 0 0 220164 4 0 0 20 0 1 0 23668379 29921280 1464 33554432000 4194304 5970956 140737062543808 140737062541144 5070768 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7305 1464 824 434 0 669 0
Current children cumulated CPU time (s) 2201.68
Current children cumulated vsize (KiB) 29220

[startup+2262.3 s]
/proc/loadavg: 2.00 2.02 1.87 3/191 4881
/proc/meminfo: memFree=31114548/32770624 swapFree=6824/680824
[pid=4739] ppid=4736 vsize=29220 CPUtime=2261.66 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 20596 0 0 0 226161 5 0 0 20 0 1 0 23668379 29921280 1464 33554432000 4194304 5970956 140737062543808 140737062541144 5070008 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7305 1464 824 434 0 669 0
Current children cumulated CPU time (s) 2261.66
Current children cumulated vsize (KiB) 29220

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 1.88 3/191 4882
/proc/meminfo: memFree=31114052/32770624 swapFree=6824/680848
[pid=4739] ppid=4736 vsize=29220 CPUtime=2321.65 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 21159 0 0 0 232160 5 0 0 20 0 1 0 23668379 29921280 1464 33554432000 4194304 5970956 140737062543808 140737062541144 4964524 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7305 1464 824 434 0 669 0
Current children cumulated CPU time (s) 2321.65
Current children cumulated vsize (KiB) 29220

[startup+2382.3 s]
/proc/loadavg: 2.05 2.03 1.89 3/191 4883
/proc/meminfo: memFree=31113920/32770624 swapFree=6824/680880
[pid=4739] ppid=4736 vsize=29220 CPUtime=2381.63 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 21735 0 0 0 238158 5 0 0 20 0 1 0 23668379 29921280 1464 33554432000 4194304 5970956 140737062543808 140737062541144 4967744 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7305 1464 824 434 0 669 0
Current children cumulated CPU time (s) 2381.63
Current children cumulated vsize (KiB) 29220



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.7 s]
/proc/loadavg: 2.04 2.03 1.89 3/191 4884
/proc/meminfo: memFree=31113920/32770624 swapFree=6824/680908
[pid=4739] ppid=4736 vsize=29220 CPUtime=2400.03 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 22258 0 0 0 239998 5 0 0 20 0 1 0 23668379 29921280 1464 33554432000 4194304 5970956 140737062543808 140737062541144 4908979 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7305 1464 824 434 0 669 0
Current children cumulated CPU time (s) 2400.03
Current children cumulated vsize (KiB) 29220

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 4739 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.7 s]
/proc/loadavg: 2.04 2.03 1.89 3/191 4884
/proc/meminfo: memFree=31113920/32770624 swapFree=6824/680908
[pid=4739] ppid=4736 vsize=29220 CPUtime=2400.03 cores=0,2,4,6
/proc/4739/stat : 4739 (cosoco) R 4736 4739 4362 0 -1 4202496 22258 0 0 0 239998 5 0 0 20 0 1 0 23668379 29921280 1464 33554432000 4194304 5970956 140737062543808 140737062541144 4908979 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8070896 8075904 28160000 140737062548673 140737062548803 140737062548803 140737062551502 0
/proc/4739/statm: 7305 1464 824 434 0 669 0
Current children cumulated CPU time (s) 2400.03
Current children cumulated vsize (KiB) 29220

Child status: 1
Real time (s): 2400.7
CPU time (s): 2400.04
CPU user time (s): 2399.98
CPU system time (s): 0.051985
CPU usage (%): 99.9723
Max. virtual memory (cumulated for all children) (KiB): 29220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.98
system time used= 0.051985
maximum resident set size= 5900
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22285
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 122773

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.81825 second user time and 9.32157 second system time

The end

Launcher Data 

Begin job on node102 at 2017-07-21 09:58:10
IDJOB=4240203
IDBENCH=120666
IDSOLVER=2620
FILE ID=node102/4240203-1500623890
RUNJOBID= node102-1500623787-4393
PBS_JOBID= 20623025
Free space on /tmp= 61892 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/Knights/Knights-m1-s1/Knights-050-09.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4240203-1500623890/watcher-4240203-1500623890 -o /tmp/evaluation-result-4240203-1500623890/solver-4240203-1500623890 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node102-1500623787-4393 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4240203-1500623890.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 78e001d21a1411ecb51795c063836bf7
RANDOM SEED=1641234969

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31128552 kB
MemAvailable:   31987816 kB
Buffers:          159492 kB
Cached:           984864 kB
SwapCached:            0 kB
Active:           515148 kB
Inactive:         695980 kB
Active(anon):      69688 kB
Inactive(anon):    16868 kB
Active(file):     445460 kB
Inactive(file):   679112 kB
Unevictable:        6824 kB
Mlocked:            6824 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2364 kB
Writeback:             0 kB
AnonPages:         73624 kB
Mapped:            35364 kB
Shmem:             17104 kB
Slab:             126572 kB
SReclaimable:     101052 kB
SUnreclaim:        25520 kB
KernelStack:        3392 kB
PageTables:         5464 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     342600 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      354332 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     14336 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      136576 kB
DirectMap2M:    33409024 kB

Free space on /tmp at the end= 61888 MiB
End job on node102 at 2017-07-21 10:38:11