Trace number 4242162

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
R1: cosoco-sat 1.1? (TO) 2400.02 2400.4

General information on the benchmark

NameKnapsack/Knapsack-m1-s60/
Knapsack-60-250-03.xml
MD5SUM51492dfdc05fd658a6c92bd20bc2cdd8
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1358
Best CPU time to get the best result obtained on this benchmark148.35001
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of constraints1
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":60}]
Minimum variable degree2
Maximum variable degree2
Distribution of variable degrees[{"degree":2,"count":60}]
Minimum constraint arity60
Maximum constraint arity60
Distribution of constraint arities[{"arity":60,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":1}]
Optimization problemYES
Type of objectivemax SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c SAT : Variables: 120 -- Clauses: 120
0.00/0.00	c best=?? lower=0 upper=3507 
0.00/0.00	c
0.00/0.00	c This is cosoco 1.0 --  
0.00/0.00	c
0.00/0.00	c enable optimization
0.00/0.00	c ========================================[ Problem Statistics ]===========================================
0.00/0.00	c |                                                                                                       
0.00/0.00	c |  Parse time        :         0.00 s 
0.00/0.00	c |
0.00/0.00	c |               Variables: 60
0.00/0.00	c |            Domain Sizes: 2..2
0.00/0.00	c |
0.00/0.00	c |             Constraints: 2
0.00/0.00	c |                   Arity: 60..60
0.00/0.00	c | 
0.00/0.00	c |                   Types: 
0.00/0.00	c |                          Sum: 2
0.00/0.00	c |                          
0.00/0.00	c =========================================================================================================
0.00/0.00	o 0
0.00/0.00	c    1 calls to solver: best=0 lower=1 upper=3507 
0.00/0.00	o 76
0.00/0.00	o 87
0.00/0.00	c    3 calls to solver: best=87 lower=88 upper=3507 
0.00/0.01	o 88
0.00/0.01	o 96
0.00/0.01	c    5 calls to solver: best=96 lower=97 upper=3507 
0.00/0.01	o 147
0.00/0.01	o 162
0.00/0.01	c    7 calls to solver: best=162 lower=163 upper=3507 
0.00/0.01	o 172
0.00/0.01	o 177
0.00/0.01	c    9 calls to solver: best=177 lower=178 upper=3507 
0.00/0.01	o 224
0.00/0.01	o 239
0.00/0.01	c   11 calls to solver: best=239 lower=240 upper=3507 
0.00/0.01	o 270
0.00/0.01	o 286
0.00/0.01	c   13 calls to solver: best=286 lower=287 upper=3507 
0.00/0.01	o 333
0.00/0.01	o 382
0.00/0.01	c   15 calls to solver: best=382 lower=383 upper=3507 
0.00/0.01	o 386
0.00/0.01	o 470
0.00/0.01	c   17 calls to solver: best=470 lower=471 upper=3507 
0.00/0.01	o 486
0.00/0.02	o 491
0.00/0.02	c   19 calls to solver: best=491 lower=492 upper=3507 
0.00/0.02	o 504
0.00/0.02	o 558
0.00/0.02	c   21 calls to solver: best=558 lower=559 upper=3507 
0.00/0.02	o 565
0.00/0.02	o 575
0.00/0.02	c   23 calls to solver: best=575 lower=576 upper=3507 
0.00/0.02	o 656
0.00/0.02	o 723
0.00/0.02	c   25 calls to solver: best=723 lower=724 upper=3507 
0.00/0.02	o 729
0.00/0.02	o 738
0.00/0.02	c   27 calls to solver: best=738 lower=739 upper=3507 
0.00/0.02	o 748
0.00/0.02	o 766
0.00/0.02	c   29 calls to solver: best=766 lower=767 upper=3507 
0.00/0.03	o 785
0.00/0.03	o 812
0.00/0.03	c   31 calls to solver: best=812 lower=813 upper=3507 
0.00/0.03	o 828
0.00/0.03	o 847
0.00/0.03	c   33 calls to solver: best=847 lower=848 upper=3507 
0.00/0.03	o 851
0.00/0.03	o 874
0.00/0.03	c   35 calls to solver: best=874 lower=875 upper=3507 
0.00/0.03	o 906
0.00/0.03	o 968
0.00/0.03	c   37 calls to solver: best=968 lower=969 upper=3507 
0.00/0.03	o 974
0.29/0.34	conflict 37lvl : 39 bt39-99:0(38)X81987
0.29/0.34	conflict 35lvl : 38 bt37-7:0(38)X82311
0.29/0.38	o 977
0.29/0.38	c   39 calls to solver: best=977 lower=978 upper=3507 
0.29/0.39	o 983
0.39/0.41	o 993
0.39/0.41	c   41 calls to solver: best=993 lower=994 upper=3507 
0.39/0.41	o 1000
0.39/0.41	o 1002
0.39/0.41	c   43 calls to solver: best=1002 lower=1003 upper=3507 
0.39/0.41	o 1003
0.39/0.41	o 1010
0.39/0.41	c   45 calls to solver: best=1010 lower=1011 upper=3507 
0.39/0.41	o 1013
0.39/0.42	o 1014
0.39/0.42	c   47 calls to solver: best=1014 lower=1015 upper=3507 
0.39/0.42	o 1015
0.39/0.42	o 1018
0.39/0.42	c   49 calls to solver: best=1018 lower=1019 upper=3507 
0.39/0.43	o 1034
0.39/0.43	o 1048
0.39/0.43	c   51 calls to solver: best=1048 lower=1049 upper=3507 
0.39/0.43	o 1049
0.39/0.43	o 1057
0.39/0.43	c   53 calls to solver: best=1057 lower=1058 upper=3507 
0.39/0.46	o 1060
0.49/0.57	o 1074
0.49/0.57	c   55 calls to solver: best=1074 lower=1075 upper=3507 
0.99/1.00	conflict 34lvl : 41 bt39-85:0(40)X86863
19.49/19.50	 -> -85:X(40)o 1082
21.09/21.10	o 1092
21.09/21.10	c   57 calls to solver: best=1092 lower=1093 upper=3507 
21.39/21.40	o 1100
21.39/21.48	o 1103
21.39/21.48	c   59 calls to solver: best=1103 lower=1104 upper=3507 
21.49/21.52	o 1110
21.49/21.55	o 1111
21.49/21.55	c   61 calls to solver: best=1111 lower=1112 upper=3507 
22.29/22.33	o 1112
22.79/22.87	o 1117
22.79/22.87	c   63 calls to solver: best=1117 lower=1118 upper=3507 
24.89/24.94	o 1121
26.69/26.74	o 1124
26.69/26.74	c   65 calls to solver: best=1124 lower=1125 upper=3507 
154.67/154.75	o 1125
163.47/163.59	o 1127
163.47/163.59	c   67 calls to solver: best=1127 lower=1128 upper=3507 
167.37/167.49	o 1135
168.87/168.97	o 1145
168.87/168.97	c   69 calls to solver: best=1145 lower=1146 upper=3507 
171.67/171.75	o 1149
174.26/174.39	o 1152
174.26/174.39	c   71 calls to solver: best=1152 lower=1153 upper=3507 
177.86/177.92	o 1157
180.86/180.94	o 1160
180.86/180.94	c   73 calls to solver: best=1160 lower=1161 upper=3507 
184.36/184.42	o 1162
205.56/205.60	o 1167
205.56/205.60	c   75 calls to solver: best=1167 lower=1168 upper=3507 
213.76/213.89	o 1175
220.86/220.93	o 1177
220.86/220.93	c   77 calls to solver: best=1177 lower=1178 upper=3507 
224.86/224.91	o 1195
225.86/225.91	o 1196
225.86/225.91	c   79 calls to solver: best=1196 lower=1197 upper=3507 
226.66/226.73	o 1198
227.56/227.60	o 1202
227.56/227.60	c   81 calls to solver: best=1202 lower=1203 upper=3507 
228.16/228.28	o 1207
228.46/228.57	o 1216
228.46/228.57	c   83 calls to solver: best=1216 lower=1217 upper=3507 
228.56/228.68	o 1232
265.06/265.16	o 1234
265.06/265.16	c   85 calls to solver: best=1234 lower=1235 upper=3507 
272.65/272.72	o 1238
553.61/553.74	o 1245
553.61/553.74	c   87 calls to solver: best=1245 lower=1246 upper=3507 
574.11/574.24	conflict 10lvl : 25 bt25-109:0(22)X101872
619.40/619.54	o 1247
658.59/658.74	o 1254
658.59/658.74	c   89 calls to solver: best=1254 lower=1255 upper=3507 
685.49/685.63	o 1255
720.98/721.12	o 1261
720.98/721.12	c   91 calls to solver: best=1261 lower=1262 upper=3507 
988.54/988.75	o 1276
1178.91/1179.19	conflict 11lvl : 35 bt35-51:0(24)X103301
1277.39/1277.69	 -> -51:X(24)o 1285
1277.39/1277.69	c   93 calls to solver: best=1285 lower=1286 upper=3507 
1452.27/1452.54	conflict 6lvl : 35 bt35-9:0(10)X103785
1512.76/1513.03	 -> -9:X(10)o 1289
1663.83/1664.13	o 1290
1663.83/1664.13	c   95 calls to solver: best=1290 lower=1291 upper=3507 
1715.73/1716.04	o 1297
1835.61/1835.94	o 1300
1835.61/1835.94	c   97 calls to solver: best=1300 lower=1301 upper=3507 
1866.70/1867.05	conflict 7lvl : 36 bt28-11:0(25)X104178
1985.68/1986.07	 -> -11:X(25)o 1302
2046.78/2047.11	o 1303
2046.78/2047.11	c   99 calls to solver: best=1303 lower=1304 upper=3507 
2090.06/2090.45	o 1308
2108.66/2109.08	o 1320
2108.66/2109.08	c  101 calls to solver: best=1320 lower=1321 upper=3507 
2139.16/2139.53	o 1343
2228.25/2228.69	conflict 5lvl : 39 bt38-63:0(11)X104672
2242.94/2243.30	conflict 6lvl : 38 bt36-11:0(25)X104680

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4242162-1500655386/watcher-4242162-1500655386 -o /tmp/evaluation-result-4242162-1500655386/solver-4242162-1500655386 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node123-1500648174-2490 --watchdog 2560 HOME/cosoco -lc -model -restarts -sat HOME/instance-4242162-1500655386.xml 

pid=3730
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3733
/proc/meminfo: memFree=31349076/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31480 CPUtime=0.01 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1050 0 0 0 1 0 0 0 20 0 1 0 807060 32235520 832 33554432000 4194304 5970956 140733928186288 140733928182936 140281223773280 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7870 832 735 434 0 1234 0

[startup+0.100148 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3733
/proc/meminfo: memFree=31349076/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31480 CPUtime=0.09 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1070 0 0 0 9 0 0 0 20 0 1 0 807060 32235520 898 33554432000 4194304 5970956 140733928186288 140733928183848 5047532 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7870 898 783 434 0 1234 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31480

[startup+0.200317 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3733
/proc/meminfo: memFree=31349076/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31480 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1110 0 0 0 19 0 0 0 20 0 1 0 807060 32235520 898 33554432000 4194304 5970956 140733928186288 140733928183848 5045183 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7870 898 783 434 0 1234 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 31480

[startup+0.300247 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3733
/proc/meminfo: memFree=31349076/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31612 CPUtime=0.29 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1153 0 0 0 29 0 0 0 20 0 1 0 807060 32370688 964 33554432000 4194304 5970956 140733928186288 140733928183048 5136625 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 964 783 434 0 1267 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 31612

[startup+0.700223 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3733
/proc/meminfo: memFree=31349076/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31612 CPUtime=0.69 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1185 0 0 0 69 0 0 0 20 0 1 0 807060 32370688 964 33554432000 4194304 5970956 140733928186288 140733928173592 5136786 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 964 783 434 0 1267 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 31612

[startup+1.50022 s]
/proc/loadavg: 2.00 2.01 2.03 3/244 3734
/proc/meminfo: memFree=31348012/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31612 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1191 0 0 0 149 0 0 0 20 0 1 0 807060 32370688 1030 33554432000 4194304 5970956 140733928186288 140733928183624 5047066 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1030 786 434 0 1267 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 31612

[startup+3.10024 s]
/proc/loadavg: 2.00 2.01 2.03 3/244 3734
/proc/meminfo: memFree=31347252/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31612 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1345 0 0 0 309 0 0 0 20 0 1 0 807060 32370688 1036 33554432000 4194304 5970956 140733928186288 140733928183624 5047604 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1036 786 434 0 1267 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 31612

[startup+6.30022 s]
/proc/loadavg: 2.00 2.01 2.03 3/244 3734
/proc/meminfo: memFree=31347252/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31612 CPUtime=6.29 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1536 0 0 0 629 0 0 0 20 0 1 0 807060 32370688 1037 33554432000 4194304 5970956 140733928186288 140733928183624 5046341 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1037 786 434 0 1267 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 31612

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.03 3/244 3734
/proc/meminfo: memFree=31346880/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31612 CPUtime=12.69 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 1709 0 0 0 1269 0 0 0 20 0 1 0 807060 32370688 1038 33554432000 4194304 5970956 140733928186288 140733928183624 5045199 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1038 786 434 0 1267 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 31612

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.03 3/244 3734
/proc/meminfo: memFree=31346880/32770624 swapFree=6268/211180
[pid=3733] ppid=3730 vsize=31612 CPUtime=25.49 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 2082 0 0 0 2549 0 0 0 20 0 1 0 807060 32370688 1041 33554432000 4194304 5970956 140733928186288 140733928183848 5045183 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1041 786 434 0 1267 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 31612

[startup+51.1003 s]
/proc/loadavg: 2.00 2.01 2.03 3/244 3734
/proc/meminfo: memFree=31346352/32770624 swapFree=6268/211376
[pid=3733] ppid=3730 vsize=31612 CPUtime=51.08 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 2268 0 0 0 5108 0 0 0 20 0 1 0 807060 32370688 1046 33554432000 4194304 5970956 140733928186288 140733928173592 5098944 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1046 786 434 0 1267 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 31612

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/244 3735
/proc/meminfo: memFree=31346504/32770624 swapFree=6268/211376
[pid=3733] ppid=3730 vsize=31612 CPUtime=102.28 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 2454 0 0 0 10228 0 0 0 20 0 1 0 807060 32370688 1047 33554432000 4194304 5970956 140733928186288 140733928173592 5046918 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1047 786 434 0 1267 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 31612

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3736
/proc/meminfo: memFree=31346812/32770624 swapFree=6268/211376
[pid=3733] ppid=3730 vsize=31612 CPUtime=162.27 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 2646 0 0 0 16227 0 0 0 20 0 1 0 807060 32370688 1048 33554432000 4194304 5970956 140733928186288 140733928183848 5136620 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1048 786 434 0 1267 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 31612

[startup+222.308 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3737
/proc/meminfo: memFree=31344816/32770624 swapFree=6268/211376
[pid=3733] ppid=3730 vsize=31612 CPUtime=222.26 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 2849 0 0 0 22226 0 0 0 20 0 1 0 807060 32370688 1049 33554432000 4194304 5970956 140733928186288 140733928173592 5136629 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1049 786 434 0 1267 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 31612

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3738
/proc/meminfo: memFree=31345012/32770624 swapFree=6268/211376
[pid=3733] ppid=3730 vsize=31612 CPUtime=282.25 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 3048 0 0 0 28225 0 0 0 20 0 1 0 807060 32370688 1052 33554432000 4194304 5970956 140733928186288 140733928183848 5136620 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1052 786 434 0 1267 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 31612

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/243 3739
/proc/meminfo: memFree=31345348/32770624 swapFree=6268/211636
[pid=3733] ppid=3730 vsize=31612 CPUtime=342.24 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 3229 0 0 0 34224 0 0 0 20 0 1 0 807060 32370688 1052 33554432000 4194304 5970956 140733928186288 140733928183848 5136608 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1052 786 434 0 1267 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 31612

[startup+402.3 s]
/proc/loadavg: 2.04 2.03 2.04 3/243 3740
/proc/meminfo: memFree=31345836/32770624 swapFree=6268/211636
[pid=3733] ppid=3730 vsize=31612 CPUtime=402.23 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 3400 0 0 0 40223 0 0 0 20 0 1 0 807060 32370688 1052 33554432000 4194304 5970956 140733928186288 140733928183848 5045461 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1052 786 434 0 1267 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 31612

[startup+462.3 s]
/proc/loadavg: 2.11 2.05 2.05 3/244 3749
/proc/meminfo: memFree=31345320/32770624 swapFree=6268/211636
[pid=3733] ppid=3730 vsize=31612 CPUtime=462.22 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 3583 0 0 0 46222 0 0 0 20 0 1 0 807060 32370688 1053 33554432000 4194304 5970956 140733928186288 140733928183848 5045568 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1053 786 434 0 1267 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 31612

[startup+522.3 s]
/proc/loadavg: 2.12 2.07 2.05 3/244 3750
/proc/meminfo: memFree=31345580/32770624 swapFree=6268/211636
[pid=3733] ppid=3730 vsize=31612 CPUtime=522.21 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 3764 0 0 0 52221 0 0 0 20 0 1 0 807060 32370688 1053 33554432000 4194304 5970956 140733928186288 140733928183848 5136803 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1053 786 434 0 1267 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 31612

[startup+582.3 s]
/proc/loadavg: 2.09 2.07 2.05 3/244 3751
/proc/meminfo: memFree=31346172/32770624 swapFree=6268/211636
[pid=3733] ppid=3730 vsize=31612 CPUtime=582.2 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 3964 0 0 0 58220 0 0 0 20 0 1 0 807060 32370688 1056 33554432000 4194304 5970956 140733928186288 140733928183624 5136608 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7903 1056 786 434 0 1267 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 31612


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.10 2.06 2.05 3/243 3933
/proc/meminfo: memFree=25132016/32770624 swapFree=6268/215072
[pid=3733] ppid=3730 vsize=31748 CPUtime=1482.06 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 6788 0 0 0 148206 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183624 5136560 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 31748

[startup+1542.31 s]
/proc/loadavg: 2.04 2.04 2.05 3/243 3934
/proc/meminfo: memFree=25133740/32770624 swapFree=6268/215276
[pid=3733] ppid=3730 vsize=31748 CPUtime=1542.06 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 6986 0 0 0 154206 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183848 5136608 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1542.06
Current children cumulated vsize (KiB) 31748

[startup+1602.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/243 3935
/proc/meminfo: memFree=25133600/32770624 swapFree=6268/215276
[pid=3733] ppid=3730 vsize=31748 CPUtime=1602.04 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 7172 0 0 0 160204 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183848 5136620 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 31748

[startup+1662.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/244 3944
/proc/meminfo: memFree=25131732/32770624 swapFree=6268/215276
[pid=3733] ppid=3730 vsize=31748 CPUtime=1662.03 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 7355 0 0 0 166203 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183848 5136625 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 31748

[startup+1722.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/244 3945
/proc/meminfo: memFree=25132400/32770624 swapFree=6268/215276
[pid=3733] ppid=3730 vsize=31748 CPUtime=1722.02 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 7568 0 0 0 172202 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183848 5046962 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 31748

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/244 3946
/proc/meminfo: memFree=25131944/32770624 swapFree=6268/215276
[pid=3733] ppid=3730 vsize=31748 CPUtime=1782.01 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 7759 0 0 0 178201 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183848 5044845 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 31748

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 3947
/proc/meminfo: memFree=25132508/32770624 swapFree=6268/215460
[pid=3733] ppid=3730 vsize=31748 CPUtime=1842 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 7957 0 0 0 184200 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928173592 5045007 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1842
Current children cumulated vsize (KiB) 31748

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 3948
/proc/meminfo: memFree=25131440/32770624 swapFree=6268/215460
[pid=3733] ppid=3730 vsize=31748 CPUtime=1901.99 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 8148 0 0 0 190199 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183624 5047604 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1901.99
Current children cumulated vsize (KiB) 31748

[startup+1962.3 s]
/proc/loadavg: 2.14 2.05 2.05 3/243 3949
/proc/meminfo: memFree=25131492/32770624 swapFree=6268/215460
[pid=3733] ppid=3730 vsize=31748 CPUtime=1961.99 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 8341 0 0 0 196199 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183624 5136608 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 1961.99
Current children cumulated vsize (KiB) 31748

[startup+2022.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/243 3950
/proc/meminfo: memFree=25131120/32770624 swapFree=6268/215460
[pid=3733] ppid=3730 vsize=31748 CPUtime=2021.97 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 8540 0 0 0 202197 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183848 5047599 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 2021.97
Current children cumulated vsize (KiB) 31748

[startup+2082.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/243 3951
/proc/meminfo: memFree=25131096/32770624 swapFree=6268/215460
[pid=3733] ppid=3730 vsize=31748 CPUtime=2081.97 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 8740 0 0 0 208197 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928173592 5136786 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 2081.97
Current children cumulated vsize (KiB) 31748

[startup+2142.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/243 3952
/proc/meminfo: memFree=25130500/32770624 swapFree=6268/215692
[pid=3733] ppid=3730 vsize=31748 CPUtime=2141.96 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 8946 0 0 0 214196 0 0 0 20 0 1 0 807060 32509952 1062 33554432000 4194304 5970956 140733928186288 140733928183848 5320400 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1062 787 434 0 1301 0
Current children cumulated CPU time (s) 2141.96
Current children cumulated vsize (KiB) 31748

[startup+2202.31 s]
/proc/loadavg: 2.06 2.04 2.05 3/243 3953
/proc/meminfo: memFree=25129996/32770624 swapFree=6268/215692
[pid=3733] ppid=3730 vsize=31748 CPUtime=2201.95 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 9122 0 0 0 220195 0 0 0 20 0 1 0 807060 32509952 1063 33554432000 4194304 5970956 140733928186288 140733928183848 5047664 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1063 787 434 0 1301 0
Current children cumulated CPU time (s) 2201.95
Current children cumulated vsize (KiB) 31748

[startup+2262.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/243 3961
/proc/meminfo: memFree=25129712/32770624 swapFree=6268/215740
[pid=3733] ppid=3730 vsize=31748 CPUtime=2261.94 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 9317 0 0 0 226194 0 0 0 20 0 1 0 807060 32509952 1063 33554432000 4194304 5970956 140733928186288 140733928183624 5045640 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1063 787 434 0 1301 0
Current children cumulated CPU time (s) 2261.94
Current children cumulated vsize (KiB) 31748

[startup+2322.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/243 3962
/proc/meminfo: memFree=25129692/32770624 swapFree=6268/215740
[pid=3733] ppid=3730 vsize=31748 CPUtime=2321.93 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 9503 0 0 0 232193 0 0 0 20 0 1 0 807060 32509952 1063 33554432000 4194304 5970956 140733928186288 140733928183624 5047504 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1063 787 434 0 1301 0
Current children cumulated CPU time (s) 2321.93
Current children cumulated vsize (KiB) 31748

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/243 3963
/proc/meminfo: memFree=25128936/32770624 swapFree=6268/215740
[pid=3733] ppid=3730 vsize=31748 CPUtime=2381.92 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 9680 0 0 0 238192 0 0 0 20 0 1 0 807060 32509952 1063 33554432000 4194304 5970956 140733928186288 140733928183624 5047618 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1063 787 434 0 1301 0
Current children cumulated CPU time (s) 2381.92
Current children cumulated vsize (KiB) 31748



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.4 s]
/proc/loadavg: 2.00 2.02 2.05 3/243 3964
/proc/meminfo: memFree=25129580/32770624 swapFree=6268/215740
[pid=3733] ppid=3730 vsize=31748 CPUtime=2400.01 cores=1,3,5,7,9,11,13,15
/proc/3733/stat : 3733 (cosoco) R 3730 3733 2456 0 -1 4202496 9844 0 0 0 240001 0 0 0 20 0 1 0 807060 32509952 1063 33554432000 4194304 5970956 140733928186288 140733928183624 5045551 0 0 4096 8405026 0 0 0 17 11 0 0 0 0 0 8070896 8075904 35303424 140733928195260 140733928195395 140733928195395 140733928198094 0
/proc/3733/statm: 7937 1063 787 434 0 1301 0
Current children cumulated CPU time (s) 2400.01
Current children cumulated vsize (KiB) 31748

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 3733 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.4
CPU time (s): 2400.02
CPU user time (s): 2400.02
CPU system time (s): 0.005999
CPU usage (%): 99.9843
Max. virtual memory (cumulated for all children) (KiB): 31748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.02
system time used= 0.005999
maximum resident set size= 4300
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9877
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 121829

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.44738 second user time and 10.4645 second system time

The end

Launcher Data 

Begin job on node123 at 2017-07-21 18:43:07
IDJOB=4242162
IDBENCH=133483
IDSOLVER=2621
FILE ID=node123/4242162-1500655386
RUNJOBID= node123-1500648174-2490
PBS_JOBID= 20623297
Free space on /tmp= 62008 MiB

SOLVER NAME= cosoco-sat 1.1
BENCH NAME= XCSP17/Knapsack/Knapsack-m1-s60/Knapsack-60-250-03.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4242162-1500655386/watcher-4242162-1500655386 -o /tmp/evaluation-result-4242162-1500655386/solver-4242162-1500655386 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node123-1500648174-2490 --watchdog 2560  HOME/cosoco -lc -model -restarts -sat HOME/instance-4242162-1500655386.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= 51492dfdc05fd658a6c92bd20bc2cdd8
RANDOM SEED=71899087

node123.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2533.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2000.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31348784 kB
MemAvailable:   31333580 kB
Buffers:           31664 kB
Cached:           265508 kB
SwapCached:            0 kB
Active:           829684 kB
Inactive:         219796 kB
Active(anon):     755192 kB
Inactive(anon):     8616 kB
Active(file):      74492 kB
Inactive(file):   211180 kB
Unevictable:        6268 kB
Mlocked:            6268 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2456 kB
Writeback:             0 kB
AnonPages:        777004 kB
Mapped:            29396 kB
Shmem:              8840 kB
Slab:              61276 kB
SReclaimable:      29920 kB
SUnreclaim:        31356 kB
KernelStack:        4272 kB
PageTables:         6628 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1131620 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    710656 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 62008 MiB
End job on node123 at 2017-07-21 19:23:07