Trace number 4242661

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
R1: cosoco-sat 1.1? (TO) 2400.05 2400.4

General information on the benchmark

NameTravellingSalesman/TravellingSalesman-m1-n150/
TravellingSalesman-150-50-14.xml
MD5SUMb2c04361dada2322dcbf50e86c385888
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark531
Best CPU time to get the best result obtained on this benchmark2400.12
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of constraints151
Number of domains2
Minimum domain size64
Maximum domain size150
Distribution of domain sizes[{"size":64,"count":150},{"size":150,"count":150}]
Minimum variable degree2
Maximum variable degree3
Distribution of variable degrees[{"degree":2,"count":150},{"degree":3,"count":150}]
Minimum constraint arity3
Maximum constraint arity150
Distribution of constraint arities[{"arity":3,"count":150},{"arity":150,"count":1}]
Number of extensional constraints150
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":150},{"type":"allDifferent","count":1}]
Optimization problemYES
Type of objectivemin SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.29/0.31	c SAT : Variables: 32100 -- Clauses: 1978950
0.29/0.31	c best=?? lower=150 upper=9600 
2.29/2.33	c
2.29/2.33	c This is cosoco 1.0 --  
2.29/2.33	c
2.29/2.33	c enable optimization
2.29/2.33	c ========================================[ Problem Statistics ]===========================================
2.29/2.33	c |                                                                                                       
2.29/2.33	c |  Parse time        :         0.29 s 
2.29/2.33	c |
2.29/2.33	c |               Variables: 300
2.29/2.33	c |            Domain Sizes: 64..150
2.29/2.33	c |
2.29/2.33	c |             Constraints: 152
2.29/2.33	c |                   Arity: 3..150  -- Ternary: 150
2.29/2.33	c | 
2.29/2.33	c |                   Types: 
2.29/2.33	c |                          All Different: 1
2.29/2.33	c |                          Extension: 150  (nb tuples: 22350..22350) -- (shared: 149)
2.29/2.33	c |                          Sum: 1
2.29/2.33	c |                          
2.29/2.33	c =========================================================================================================
2.29/2.33	o 2677
2.29/2.33	c    1 calls to solver: best=2677 lower=150 upper=2676 
49.58/49.66	o 2607
53.99/54.00	o 2541
53.99/54.00	c    3 calls to solver: best=2541 lower=150 upper=2540 
124.65/124.78	o 2540
179.35/179.49	o 2488
179.35/179.49	c    5 calls to solver: best=2488 lower=150 upper=2487 
183.14/183.24	o 2432
218.03/218.15	o 2398
218.03/218.15	c    7 calls to solver: best=2398 lower=150 upper=2397 
239.73/239.83	o 2329
415.27/415.47	o 750
415.27/415.47	c    9 calls to solver: best=750 lower=150 upper=749 
415.68/415.85	o 636
416.07/416.24	o 634
416.07/416.24	c   11 calls to solver: best=634 lower=150 upper=633 
418.47/418.68	o 633
419.08/419.27	o 632
419.08/419.27	c   13 calls to solver: best=632 lower=150 upper=631 
419.47/419.63	o 630
419.77/419.99	o 628
419.77/419.99	c   15 calls to solver: best=628 lower=150 upper=627 
420.67/420.80	o 627
420.97/421.14	o 617
420.97/421.14	c   17 calls to solver: best=617 lower=150 upper=616 
421.28/421.48	o 616
421.67/421.82	o 614
421.67/421.82	c   19 calls to solver: best=614 lower=150 upper=613 
422.77/422.92	o 596
423.57/423.72	o 595
423.57/423.72	c   21 calls to solver: best=595 lower=150 upper=594 
423.97/424.18	o 594
424.37/424.57	o 585
424.37/424.57	c   23 calls to solver: best=585 lower=150 upper=584 
424.87/425.09	o 584
425.37/425.54	o 572
425.37/425.54	c   25 calls to solver: best=572 lower=150 upper=571 
432.87/433.03	o 569
446.67/446.84	o 565
446.67/446.84	c   27 calls to solver: best=565 lower=150 upper=564 
447.07/447.23	o 564
478.76/478.91	o 563
478.76/478.91	c   29 calls to solver: best=563 lower=150 upper=562 
667.84/668.00	o 562
672.24/672.46	o 561
672.24/672.46	c   31 calls to solver: best=561 lower=150 upper=560 
680.43/680.69	o 560
684.33/684.51	o 559
684.33/684.51	c   33 calls to solver: best=559 lower=150 upper=558 
799.32/799.57	o 558
812.52/812.79	o 557
812.52/812.79	c   35 calls to solver: best=557 lower=150 upper=556 
822.82/823.04	o 555
835.82/836.04	conflict 297lvl : 268 bt268-19528:0(25041)X9772420

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4242661-1500660290/watcher-4242661-1500660290 -o /tmp/evaluation-result-4242661-1500660290/solver-4242661-1500660290 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1500648172-9863 --watchdog 2560 HOME/cosoco -lc -model -restarts -sat HOME/instance-4242661-1500660290.xml 

pid=11516
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11519
/proc/meminfo: memFree=31474556/32770624 swapFree=5928/194448
[pid=11519] ppid=11516 vsize=27532 CPUtime=0.01 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 1078 0 0 0 1 0 0 0 20 0 1 0 1293859 28192768 898 33554432000 4194304 5970956 140721126648832 140721126646632 140592901794171 0 0 4096 0 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 6883 898 712 434 0 247 0

[startup+0.100124 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11519
/proc/meminfo: memFree=31474556/32770624 swapFree=5928/194448
[pid=11519] ppid=11516 vsize=28332 CPUtime=0.09 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 1324 0 0 0 9 0 0 0 20 0 1 0 1293859 29011968 1082 33554432000 4194304 5970956 140721126648832 140721126645432 140592900938725 0 0 4096 0 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 7083 1082 714 434 0 447 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 28332

[startup+0.200272 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11519
/proc/meminfo: memFree=31474556/32770624 swapFree=5928/194448
[pid=11519] ppid=11516 vsize=74496 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 12341 0 0 0 18 1 0 0 20 0 1 0 1293859 76283904 12360 33554432000 4194304 5970956 140721126648832 140721126645736 5279679 0 0 4096 8404994 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 18624 12360 761 434 0 11988 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 74496

[startup+0.300312 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11519
/proc/meminfo: memFree=31474556/32770624 swapFree=5928/194448
[pid=11519] ppid=11516 vsize=133024 CPUtime=0.29 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 22437 0 0 0 27 2 0 0 20 0 1 0 1293859 136216576 26600 33554432000 4194304 5970956 140721126648832 140721126645656 140592900938725 0 0 4096 8404994 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 33256 26600 761 434 0 26620 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 133024

[startup+0.700265 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11519
/proc/meminfo: memFree=31474556/32770624 swapFree=5928/194448
[pid=11519] ppid=11516 vsize=157744 CPUtime=0.69 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 24466 0 0 0 67 2 0 0 20 0 1 0 1293859 161529856 28603 33554432000 4194304 5970956 140721126648832 140721126645512 4934366 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39436 28603 782 434 0 32800 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 157744

[startup+1.50027 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11520
/proc/meminfo: memFree=31363268/32770624 swapFree=5928/194580
[pid=11519] ppid=11516 vsize=158028 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 24551 0 0 0 147 2 0 0 20 0 1 0 1293859 161820672 28669 33554432000 4194304 5970956 140721126648832 140721126645752 4934556 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39507 28669 783 434 0 32871 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 158028

[startup+3.10026 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11520
/proc/meminfo: memFree=31362288/32770624 swapFree=5928/194580
[pid=11519] ppid=11516 vsize=158904 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 33439 0 0 0 306 3 0 0 20 0 1 0 1293859 162717696 28932 33554432000 4194304 5970956 140721126648832 140721126636136 4933153 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39726 28932 785 434 0 33090 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 158904

[startup+6.30026 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11520
/proc/meminfo: memFree=31361848/32770624 swapFree=5928/194580
[pid=11519] ppid=11516 vsize=159088 CPUtime=6.29 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 43440 0 0 0 626 3 0 0 20 0 1 0 1293859 162906112 28958 33554432000 4194304 5970956 140721126648832 140721126645512 4934327 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39772 28958 785 434 0 33136 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 159088

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 4/243 11520
/proc/meminfo: memFree=31361252/32770624 swapFree=5928/194604
[pid=11519] ppid=11516 vsize=159220 CPUtime=12.68 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 54022 0 0 0 1265 3 0 0 20 0 1 0 1293859 163041280 29004 33554432000 4194304 5970956 140721126648832 140721126645656 4934327 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39805 29004 785 434 0 33169 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 159220

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11520
/proc/meminfo: memFree=31361128/32770624 swapFree=5928/194616
[pid=11519] ppid=11516 vsize=159220 CPUtime=25.49 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 74033 0 0 0 2544 5 0 0 20 0 1 0 1293859 163041280 29038 33554432000 4194304 5970956 140721126648832 140721126645656 4934323 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39805 29038 785 434 0 33169 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 159220

[startup+51.1003 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11520
/proc/meminfo: memFree=31358708/32770624 swapFree=5928/194628
[pid=11519] ppid=11516 vsize=159356 CPUtime=51.08 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 86987 0 0 0 5102 6 0 0 20 0 1 0 1293859 163180544 29608 33554432000 4194304 5970956 140721126648832 140721126646392 4934272 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39839 29608 785 434 0 33203 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 159356

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11521
/proc/meminfo: memFree=31358716/32770624 swapFree=5928/194660
[pid=11519] ppid=11516 vsize=159356 CPUtime=102.27 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 102076 0 0 0 10221 6 0 0 20 0 1 0 1293859 163180544 29614 33554432000 4194304 5970956 140721126648832 140721126636136 4934327 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39839 29614 785 434 0 33203 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 159356

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11522
/proc/meminfo: memFree=31358636/32770624 swapFree=5928/194700
[pid=11519] ppid=11516 vsize=159488 CPUtime=162.25 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 117832 0 0 0 16217 8 0 0 20 0 1 0 1293859 163315712 29624 33554432000 4194304 5970956 140721126648832 140721126645800 4933153 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39872 29624 785 434 0 33236 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 159488

[startup+222.308 s]
/proc/loadavg: 2.04 2.03 2.05 3/243 11523
/proc/meminfo: memFree=31357232/32770624 swapFree=5928/194736
[pid=11519] ppid=11516 vsize=159488 CPUtime=222.24 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 133994 0 0 0 22215 9 0 0 20 0 1 0 1293859 163315712 29635 33554432000 4194304 5970956 140721126648832 140721126636136 4934366 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39872 29635 785 434 0 33236 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 159488

[startup+282.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/243 11524
/proc/meminfo: memFree=31356612/32770624 swapFree=5928/194756
[pid=11519] ppid=11516 vsize=159488 CPUtime=282.21 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 140408 0 0 0 28211 10 0 0 20 0 1 0 1293859 163315712 29682 33554432000 4194304 5970956 140721126648832 140721126646392 4934342 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39872 29682 785 434 0 33236 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 159488

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11533
/proc/meminfo: memFree=31356088/32770624 swapFree=5928/194800
[pid=11519] ppid=11516 vsize=159488 CPUtime=342.19 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 141451 0 0 0 34209 10 0 0 20 0 1 0 1293859 163315712 29686 33554432000 4194304 5970956 140721126648832 140721126646392 4934366 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39872 29686 785 434 0 33236 0
Current children cumulated CPU time (s) 342.19
Current children cumulated vsize (KiB) 159488

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11534
/proc/meminfo: memFree=31354264/32770624 swapFree=5928/194828
[pid=11519] ppid=11516 vsize=159488 CPUtime=402.18 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 142500 0 0 0 40208 10 0 0 20 0 1 0 1293859 163315712 30205 33554432000 4194304 5970956 140721126648832 140721126646392 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39872 30205 785 434 0 33236 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 159488

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11535
/proc/meminfo: memFree=31354604/32770624 swapFree=5928/194884
[pid=11519] ppid=11516 vsize=159900 CPUtime=462.16 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 143686 0 0 0 46206 10 0 0 20 0 1 0 1293859 163737600 30261 33554432000 4194304 5970956 140721126648832 140721126646392 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39975 30261 785 434 0 33339 0
Current children cumulated CPU time (s) 462.16
Current children cumulated vsize (KiB) 159900

[startup+522.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11536
/proc/meminfo: memFree=31352404/32770624 swapFree=5928/194876
[pid=11519] ppid=11516 vsize=159900 CPUtime=522.15 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 144724 0 0 0 52205 10 0 0 20 0 1 0 1293859 163737600 30775 33554432000 4194304 5970956 140721126648832 140721126636136 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39975 30775 785 434 0 33339 0
Current children cumulated CPU time (s) 522.15
Current children cumulated vsize (KiB) 159900

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/244 11537
/proc/meminfo: memFree=31352464/32770624 swapFree=5928/194904
[pid=11519] ppid=11516 vsize=159900 CPUtime=582.15 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 145784 0 0 0 58205 10 0 0 20 0 1 0 1293859 163737600 30787 33554432000 4194304 5970956 140721126648832 140721126636136 4934327 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 39975 30787 785 434 0 33339 0
Current children cumulated CPU time (s) 582.15
Current children cumulated vsize (KiB) 159900


################
# More data... #
################


[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11693
/proc/meminfo: memFree=31567860/32770624 swapFree=5928/195468
[pid=11519] ppid=11516 vsize=160164 CPUtime=1482.05 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 156619 0 0 0 148194 11 0 0 20 0 1 0 1293859 164007936 31392 33554432000 4194304 5970956 140721126648832 140721126646168 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31392 789 434 0 33405 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 160164

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11701
/proc/meminfo: memFree=31567164/32770624 swapFree=5928/195500
[pid=11519] ppid=11516 vsize=160164 CPUtime=1542.05 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 156905 0 0 0 154194 11 0 0 20 0 1 0 1293859 164007936 31392 33554432000 4194304 5970956 140721126648832 140721126646168 4933208 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31392 789 434 0 33405 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 160164

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11702
/proc/meminfo: memFree=31567376/32770624 swapFree=5928/195500
[pid=11519] ppid=11516 vsize=160164 CPUtime=1602.03 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 157207 0 0 0 160192 11 0 0 20 0 1 0 1293859 164007936 31392 33554432000 4194304 5970956 140721126648832 140721126646168 4934320 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31392 789 434 0 33405 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 160164

[startup+1662.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/243 11703
/proc/meminfo: memFree=31567328/32770624 swapFree=5928/195500
[pid=11519] ppid=11516 vsize=160164 CPUtime=1662.03 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 157512 0 0 0 166192 11 0 0 20 0 1 0 1293859 164007936 31392 33554432000 4194304 5970956 140721126648832 140721126646168 4934342 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31392 789 434 0 33405 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 160164

[startup+1722.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/243 11704
/proc/meminfo: memFree=31567500/32770624 swapFree=5928/195500
[pid=11519] ppid=11516 vsize=160164 CPUtime=1722.02 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 157783 0 0 0 172191 11 0 0 20 0 1 0 1293859 164007936 31392 33554432000 4194304 5970956 140721126648832 140721126646168 4934342 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31392 789 434 0 33405 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 160164

[startup+1782.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/243 11705
/proc/meminfo: memFree=31567048/32770624 swapFree=5928/195620
[pid=11519] ppid=11516 vsize=160164 CPUtime=1782.01 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 158099 0 0 0 178190 11 0 0 20 0 1 0 1293859 164007936 31392 33554432000 4194304 5970956 140721126648832 140721126646168 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31392 789 434 0 33405 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 160164

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11706
/proc/meminfo: memFree=31568072/32770624 swapFree=5928/195620
[pid=11519] ppid=11516 vsize=160164 CPUtime=1842.01 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 159201 0 0 0 184190 11 0 0 20 0 1 0 1293859 164007936 31392 33554432000 4194304 5970956 140721126648832 140721126646168 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31392 789 434 0 33405 0
Current children cumulated CPU time (s) 1842.01
Current children cumulated vsize (KiB) 160164

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11707
/proc/meminfo: memFree=31568528/32770624 swapFree=5928/195676
[pid=11519] ppid=11516 vsize=160164 CPUtime=1902 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 159807 0 0 0 190189 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934310 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 1902
Current children cumulated vsize (KiB) 160164

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11708
/proc/meminfo: memFree=31568480/32770624 swapFree=5928/195676
[pid=11519] ppid=11516 vsize=160164 CPUtime=1961.99 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 160369 0 0 0 196188 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934656 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 1961.99
Current children cumulated vsize (KiB) 160164

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11709
/proc/meminfo: memFree=31568920/32770624 swapFree=5928/195676
[pid=11519] ppid=11516 vsize=160164 CPUtime=2021.98 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 160924 0 0 0 202187 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2021.98
Current children cumulated vsize (KiB) 160164

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 11710
/proc/meminfo: memFree=31569200/32770624 swapFree=5928/195764
[pid=11519] ppid=11516 vsize=160164 CPUtime=2081.99 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 161455 0 0 0 208188 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2081.99
Current children cumulated vsize (KiB) 160164

[startup+2142.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/244 11719
/proc/meminfo: memFree=31567812/32770624 swapFree=5928/195796
[pid=11519] ppid=11516 vsize=160164 CPUtime=2141.97 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 161966 0 0 0 214186 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934366 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2141.97
Current children cumulated vsize (KiB) 160164

[startup+2202.31 s]
/proc/loadavg: 2.05 2.04 2.05 3/244 11720
/proc/meminfo: memFree=31567420/32770624 swapFree=5928/195796
[pid=11519] ppid=11516 vsize=160164 CPUtime=2201.97 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 162526 0 0 0 220186 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934335 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2201.97
Current children cumulated vsize (KiB) 160164

[startup+2262.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/244 11721
/proc/meminfo: memFree=31567104/32770624 swapFree=5928/195836
[pid=11519] ppid=11516 vsize=160164 CPUtime=2261.96 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 163036 0 0 0 226185 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934506 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2261.96
Current children cumulated vsize (KiB) 160164

[startup+2322.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/244 11722
/proc/meminfo: memFree=31567056/32770624 swapFree=5928/195836
[pid=11519] ppid=11516 vsize=160164 CPUtime=2321.95 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 163552 0 0 0 232184 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4933196 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2321.95
Current children cumulated vsize (KiB) 160164

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/244 11723
/proc/meminfo: memFree=31567872/32770624 swapFree=5928/195888
[pid=11519] ppid=11516 vsize=160164 CPUtime=2381.94 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 164151 0 0 0 238183 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4971214 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2381.94
Current children cumulated vsize (KiB) 160164



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.4 s]
/proc/loadavg: 2.00 2.02 2.05 3/244 11723
/proc/meminfo: memFree=31567872/32770624 swapFree=5928/195888
[pid=11519] ppid=11516 vsize=160164 CPUtime=2400.04 cores=1,3,5,7,9,11,13,15
/proc/11519/stat : 11519 (cosoco) R 11516 11519 9830 0 -1 4202496 164667 0 0 0 239993 11 0 0 20 0 1 0 1293859 164007936 31393 33554432000 4194304 5970956 140721126648832 140721126646168 4934318 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 26030080 140721126651068 140721126651203 140721126651203 140721126653902 0
/proc/11519/statm: 40041 31393 789 434 0 33405 0
Current children cumulated CPU time (s) 2400.04
Current children cumulated vsize (KiB) 160164

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 11519 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.4
CPU time (s): 2400.05
CPU user time (s): 2399.93
CPU system time (s): 0.118983
CPU usage (%): 99.9854
Max. virtual memory (cumulated for all children) (KiB): 160164

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.93
system time used= 0.118983
maximum resident set size= 125620
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 164700
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21
involuntary context switches= 120784

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.87254 second user time and 11.074 second system time

The end

Launcher Data 

Begin job on node151 at 2017-07-21 20:04:50
IDJOB=4242661
IDBENCH=135805
IDSOLVER=2621
FILE ID=node151/4242661-1500660290
RUNJOBID= node151-1500648172-9863
PBS_JOBID= 20623270
Free space on /tmp= 62020 MiB

SOLVER NAME= cosoco-sat 1.1
BENCH NAME= XCSP17/TravellingSalesman/TravellingSalesman-m1-n150/TravellingSalesman-150-50-14.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts -sat BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4242661-1500660290/watcher-4242661-1500660290 -o /tmp/evaluation-result-4242661-1500660290/solver-4242661-1500660290 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node151-1500648172-9863 --watchdog 2560  HOME/cosoco -lc -model -restarts -sat HOME/instance-4242661-1500660290.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= b2c04361dada2322dcbf50e86c385888
RANDOM SEED=1302660220

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1733.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1733.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5342.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31474328 kB
MemAvailable:   31471004 kB
Buffers:           36380 kB
Cached:           269992 kB
SwapCached:            0 kB
Active:           717680 kB
Inactive:         203132 kB
Active(anon):     616736 kB
Inactive(anon):     8684 kB
Active(file):     100944 kB
Inactive(file):   194448 kB
Unevictable:        5928 kB
Mlocked:            5960 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2428 kB
Writeback:             0 kB
AnonPages:        623412 kB
Mapped:            32376 kB
Shmem:              8848 kB
Slab:              65904 kB
SReclaimable:      34236 kB
SUnreclaim:        31668 kB
KernelStack:        4272 kB
PageTables:         6804 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     887432 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    565248 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      132480 kB
DirectMap2M:    33413120 kB

Free space on /tmp at the end= 62020 MiB
End job on node151 at 2017-07-21 20:44:50