Trace number 4103241

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 168.104 168.143

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/fctp/normalized-mps-v2-20-10-n3703.opb
MD5SUM35c934e0cd42ffa30810ffe35ff61781
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 5257865308
Optimality of the best value was proved NO
Number of variables155000
Total number of constraints5150
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints5150
Minimum length of a constraint31
Maximum length of a constraint3000
Number of terms in the objective function 154999
Biggest coefficient in the objective function 4294967296
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 29657420026984
Number of bits of the sum of numbers in the objective function 45
Biggest number in a constraint 4294967296
Number of bits of the biggest number in a constraint 33
Biggest sum of numbers in a constraint 29657420026984
Number of bits of the biggest sum of numbers45
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T09:12:10+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103241-1466233930.opb"]
0.00/0.01	c use --random-gen="54675330 3982100213 1707758827 361273070 984621575 46957900 1364859575 607348315 2456367176 1591875928 3853916793 1366291820 477870709 1600023340 214382891 3980606820 2054577376 3380785103 440279069 2869248363 4192521494 2344845750 3278165167 1282081908 1545751577 202104764 2493978143 2174708950 3117809619 3165870750 2185584755 4066019248 394630091 358532957 770454143 2887295201 1755572269 1692668771 2870017163 2731709231 2961664734 4111313917 522892507 566951671 2532524042 291966887 599862608 1451224233 226214293 3771123404 3605623471 2963787059 2023986100 3012060823 2292142901 3240253641 2563505037 4143102402 1252228596 1274064685 1578739147 2933511472 1030644320 3326852568 1897108358 4164122948 3843833071 2844497671 2312017658 1766947291 1527124238 2560633807 666260893 2347015187 531692471 1413777865 4226701460 3112833457 2120621209 805353918 1536148029 4077016832 363069743 2198687504 2593643776 1973128394 2232685278 2908751586 1153048020 3278884199 1739320347 255289040 3871065552 1720862518 1241378404 2116433990 1835784438 117071626 922503819 1837966076 585038330 1669759067 3448469417 2383206631 2959662201 1683984002 92911791 253836541 431466502 175002142 3968776806 829479431 1220285312 265532916 2733600740 1263366865 2954745763 1432425054 3214968597 657962875 2525954829 2357654219 1630124715 1916755588 2930308859 2038889950 2964806850 4209270435 3757395415 1800275291 3226914091 236176000 3299760889 1589242315 481289409 867285223 2377501219 1108547226 429654884 3499166354 3905376573 4189723449 340936691 4126979459 3111369286 1745462662 483121752 2893017716 323041049 3850164420 1919099470 1363454383 3827269012 1741183585 1294210735 3391354949 2725703145 807942628 273753635 1277051216 387641410 2092493418 2480022008 3485502479 2056603957 1043863681 2510290599 1504208804 267892969 815142804 4153590252 1742950019 76804012 1023853793 1002281986 1590555939 1767911085 1326647524 1153036727 3144563696 2353064162 1158306857 1777718037 281398573 1333573681 3541262525 4103266732 1597652982 161219213 1380153035 2028280718 3553373341 973754011 19398469 2878036578 450266666 2723077706 4058828966 4031183754 3835988161 1543378336 164071389 1068909216 1404404559 3296820227 2353389685 4050882694 2656076943 373695442 1052115959 2378968909 2805039549 2780032481 1945710052 2683461095 550863938 660639987 3488667609 3628599660 3812357391 1850639925 868311778 4194889207 3125141146 771422685 3613640664 812490303 3341664296 234164080 330068010 542980848 4001804046 1450397678 284287088 283161994 204656429 740064799 75510376 896521358 2530819052 1073636719 293574275 3904636556 2753628135 787401074 2447894492 3512894446 2998193905 2233986035 669938851 4231961899 3996540301 2535251433 2624988141 3896293998 362100189 255 362436" option to reproduce the execution
1.09/1.12	c #vars 155000
1.09/1.12	c #constraints 5150
3.68/3.77	c BCD2: Hardening is enabled.
3.68/3.77	c BCD2: BiasedSearch is enabled.
3.68/3.77	c Solving starts ...
3.68/3.77	c ============================[ Search Statistics ]============================
3.68/3.77	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
3.68/3.77	c       |         |          |          |    Limit     GC | Var      | Constra 
3.68/3.77	c =============================================================================
3.79/3.88	c  0.0s |       0 |        0 |        0 |    53433      0 |    58059 |        0
6.70/6.71	c  2.8s |       0 |     6074 |        0 |    53433      0 |    58059 |        0
6.70/6.71	c #cpu_time = 2.702s
6.70/6.71	c #wall_clock_time = 2.709s
6.70/6.71	c #decision = 6074
6.70/6.71	c #random_decision = 13
6.70/6.71	c #conflict = 0
6.70/6.71	c #restart = 0
6.70/6.72	o 82548046374

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103241-1466233930/watcher-4103241-1466233930 -o /tmp/evaluation-result-4103241-1466233930/solver-4103241-1466233930 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103241-1466233930.opb 

pid=15083
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.05 2.00 3/179 15086
/proc/meminfo: memFree=30521108/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=704956 CPUtime=0 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 2628 0 0 0 0 0 0 0 20 0 4 0 25443430 721874944 2988 33554432000 4194304 16246674 140734785121344 140734785120768 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 177007 2998 441 2943 0 173901 0
[pid=15086/tid=15087] ppid=15083 vsize=723388 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 740749312 3058 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=727484 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 744943616 3075 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=732604 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25443430 750186496 3093 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100129 s]
/proc/loadavg: 2.08 2.05 2.00 3/179 15086
/proc/meminfo: memFree=30521108/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1302084 CPUtime=0.09 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 30408 0 0 0 5 4 0 0 20 0 4 0 25443430 1333334016 30706 33554432000 4194304 16246674 140734785121344 140734785120656 7368729 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 325521 30720 799 2943 0 322415 0
[pid=15086/tid=15087] ppid=15083 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 1333334016 30730 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 1333334016 30741 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25443430 1333334016 30752 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1302084

[startup+0.200487 s]
/proc/loadavg: 2.08 2.05 2.00 3/179 15086
/proc/meminfo: memFree=30521108/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1312324 CPUtime=0.18 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 42673 0 0 0 13 5 0 0 20 0 4 0 25443430 1343819776 43482 33554432000 4194304 16246674 140734785121344 140734785120656 4206613 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 328081 43482 799 2943 0 324975 0
[pid=15086/tid=15087] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 43482 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 43482 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 43482 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 1312324

[startup+0.30044 s]
/proc/loadavg: 2.08 2.05 2.00 3/179 15086
/proc/meminfo: memFree=30521108/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1312324 CPUtime=0.29 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 44149 0 0 0 23 6 0 0 20 0 4 0 25443430 1343819776 44958 33554432000 4194304 16246674 140734785121344 140734785120656 4220536 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 328081 44958 799 2943 0 324975 0
[pid=15086/tid=15087] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 44958 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 44958 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 44958 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1312324

[startup+0.700378 s]
/proc/loadavg: 2.08 2.05 2.00 3/179 15086
/proc/meminfo: memFree=30521108/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1312324 CPUtime=0.69 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 53129 0 0 0 62 7 0 0 20 0 4 0 25443430 1343819776 53938 33554432000 4194304 16246674 140734785121344 140734785104336 14073329 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 328081 53938 802 2943 0 324975 0
[pid=15086/tid=15087] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 53938 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 53938 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25443430 1343819776 53938 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1312324

[startup+1.50039 s]
/proc/loadavg: 2.08 2.05 2.00 3/183 15090
/proc/meminfo: memFree=30261300/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1380932 CPUtime=1.48 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 86226 0 0 0 137 11 0 0 20 0 4 0 25443430 1414074368 87035 33554432000 4194304 16246674 140734785121344 140734785119232 4208632 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 345233 87035 834 2943 0 342127 0
[pid=15086/tid=15087] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 87035 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 87035 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 87035 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1380932

[startup+3.10041 s]
/proc/loadavg: 2.08 2.05 2.00 4/183 15090
/proc/meminfo: memFree=30127132/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1380932 CPUtime=3.09 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 101997 0 0 0 295 14 0 0 20 0 4 0 25443430 1414074368 102806 33554432000 4194304 16246674 140734785121344 140734785103232 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 345233 102806 836 2943 0 342127 0
[pid=15086/tid=15087] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 102806 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 102806 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 102806 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1380932

[startup+6.30039 s]
/proc/loadavg: 2.08 2.05 2.00 3/183 15090
/proc/meminfo: memFree=29831452/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1380932 CPUtime=6.29 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 171064 0 0 0 605 24 0 0 20 0 4 0 25443430 1414074368 171873 33554432000 4194304 16246674 140734785121344 140734785103232 5602147 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 345233 171873 877 2943 0 342127 0
[pid=15086/tid=15087] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 171873 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 171873 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 1414074368 171873 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1380932

[startup+12.7004 s]
/proc/loadavg: 2.07 2.05 2.00 3/183 15090
/proc/meminfo: memFree=28782772/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=1956420 CPUtime=12.69 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 429771 0 0 0 1215 54 0 0 20 0 4 0 25443430 2003374080 430580 33554432000 4194304 16246674 140734785121344 140734785119168 4220897 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 489105 430580 879 2943 0 485999 0
[pid=15086/tid=15087] ppid=15083 vsize=1956420 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 2003374080 430580 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=1956420 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 2003374080 430580 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=1956420 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 2003374080 430580 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1956420

[startup+25.5004 s]
/proc/loadavg: 2.06 2.05 2.00 3/183 15090
/proc/meminfo: memFree=26324164/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=4410948 CPUtime=25.49 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 1043405 0 0 0 2413 136 0 0 20 0 4 0 25443430 4516810752 1044214 33554432000 4194304 16246674 140734785121344 140734785120520 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 1102737 1044214 880 2943 0 1099631 0
[pid=15086/tid=15087] ppid=15083 vsize=4410948 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 4516810752 1044214 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=4410948 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 4516810752 1044214 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=4410948 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 4516810752 1044214 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 4410948

[startup+51.1004 s]
/proc/loadavg: 2.04 2.04 2.00 3/183 15090
/proc/meminfo: memFree=21912324/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=9123396 CPUtime=51.08 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 2221299 0 0 0 4815 293 0 0 20 0 4 0 25443430 9342357504 2222109 33554432000 4194304 16246674 140734785121344 140734785119168 4225154 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 2280849 2222114 880 2943 0 2277743 0
[pid=15086/tid=15087] ppid=15083 vsize=9123396 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 9342357504 2222118 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=9123396 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 9342357504 2222122 33554432000 4194304 16246674 140734785121344 140145264139280 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=9123396 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 9342357504 2222128 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9123396

[startup+102.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/183 15091
/proc/meminfo: memFree=18228072/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=12490308 CPUtime=102.28 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 3063252 0 0 0 9823 405 0 0 20 0 4 0 25443430 12790075392 3064061 33554432000 4194304 16246674 140734785121344 140734785119296 14016738 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 3122577 3064061 884 2943 0 3119471 0
[pid=15086/tid=15087] ppid=15083 vsize=12490308 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 12790075392 3064061 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=12490308 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 12790075392 3064061 33554432000 4194304 16246674 140734785121344 140145264139280 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=12490308 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 12790075392 3064061 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 12490308

[startup+162.3 s]
/proc/loadavg: 2.04 2.04 2.00 3/183 15093
/proc/meminfo: memFree=17137584/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=13826628 CPUtime=162.26 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 3350320 0 0 0 15776 450 0 0 20 0 4 0 25443430 14158467072 3398141 33554432000 4194304 16246674 140734785121344 140734785119232 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 3456657 3398141 884 2943 0 3453551 0
[pid=15086/tid=15087] ppid=15083 vsize=13827652 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 14159515648 3398147 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=13827652 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 14159515648 3398153 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=13827652 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 14159515648 3398160 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 13826628



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+167.307 s]
/proc/loadavg: 2.04 2.04 2.00 3/183 15093
/proc/meminfo: memFree=14862540/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=15894084 CPUtime=167.27 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) R 15083 15086 11324 0 -1 4202496 3867048 0 0 0 16208 519 0 0 20 0 4 0 25443430 16275542016 3914870 33554432000 4194304 16246674 140734785121344 140734785120520 4225154 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 3973521 3914878 884 2943 0 3970415 0
[pid=15086/tid=15087] ppid=15083 vsize=15894084 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15087/stat : 15087 (toysat) S 15083 15086 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25443430 16275542016 3914883 33554432000 4194304 16246674 140734785121344 140145274629360 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=15894084 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) S 15083 15086 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25443430 16275542016 3914886 33554432000 4194304 16246674 140734785121344 140145264139504 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15086/tid=15089] ppid=15083 vsize=15894084 CPUtime=0 cores=1,3,5,7
/proc/15086/task/15089/stat : 15089 (toysat) S 15083 15086 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25443430 16275542016 3914887 33554432000 4194304 16246674 140734785121344 140145185516720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 167.27
Current children cumulated vsize (KiB) 15894084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15086 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+167.6 s]
/proc/loadavg: 2.04 2.04 2.00 3/183 15093
/proc/meminfo: memFree=14862540/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=0 CPUtime=167.56 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) Z 15083 15086 11324 0 -1 4203532 3867514 0 0 0 16208 548 0 0 20 0 2 0 25443430 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 0 0 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=0 CPUtime=0.27 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) R 15083 15086 11324 0 -1 4203588 8 0 0 0 0 27 0 0 20 0 2 0 25443430 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 167.56
Current children cumulated vsize (KiB) 0

[startup+168 s]
/proc/loadavg: 2.04 2.04 2.00 3/183 15093
/proc/meminfo: memFree=14862540/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=0 CPUtime=167.96 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) Z 15083 15086 11324 0 -1 4203532 3867514 0 0 0 16208 588 0 0 20 0 2 0 25443430 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 0 0 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=0 CPUtime=0.67 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) R 15083 15086 11324 0 -1 4203588 8 0 0 0 0 67 0 0 20 0 2 0 25443430 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 167.96
Current children cumulated vsize (KiB) 0

[startup+168.1 s]
/proc/loadavg: 2.04 2.04 2.00 3/183 15093
/proc/meminfo: memFree=14862540/32872528 swapFree=249320/249320
[pid=15086] ppid=15083 vsize=0 CPUtime=168.06 cores=1,3,5,7
/proc/15086/stat : 15086 (toysat) Z 15083 15086 11324 0 -1 4203532 3867514 0 0 0 16208 598 0 0 20 0 2 0 25443430 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15086/statm: 0 0 0 0 0 0 0
[pid=15086/tid=15088] ppid=15083 vsize=0 CPUtime=0.77 cores=1,3,5,7
/proc/15086/task/15088/stat : 15088 (toysat) R 15083 15086 11324 0 -1 4203588 8 0 0 0 0 77 0 0 20 0 2 0 25443430 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 168.06
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 168.143
CPU time (s): 168.104
CPU user time (s): 162.087
CPU system time (s): 6.01708
CPU usage (%): 99.977
Max. virtual memory (cumulated for all children) (KiB): 15894084

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 162.087
system time used= 6.01708
maximum resident set size= 15661340
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3867514
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 51
involuntary context switches= 187

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.644901 second user time and 0.843871 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 09:12:10
IDJOB=4103241
IDBENCH=2307
IDSOLVER=2542
FILE ID=node103/4103241-1466233930
RUNJOBID= node103-1466206104-11341
PBS_JOBID= 19918169
Free space on /tmp= 71708 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/fctp/normalized-mps-v2-20-10-n3703.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103241-1466233930/watcher-4103241-1466233930 -o /tmp/evaluation-result-4103241-1466233930/solver-4103241-1466233930 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103241-1466233930.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 35c934e0cd42ffa30810ffe35ff61781
RANDOM SEED=376259625

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30521916 kB
Buffers:          121472 kB
Cached:           132612 kB
SwapCached:         1916 kB
Active:          1205068 kB
Inactive:         160084 kB
Active(anon):    1109764 kB
Inactive(anon):     3400 kB
Active(file):      95304 kB
Inactive(file):   156684 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             24848 kB
Writeback:             0 kB
AnonPages:       1359380 kB
Mapped:            10804 kB
Shmem:                 0 kB
Slab:             602800 kB
SReclaimable:      46568 kB
SUnreclaim:       556232 kB
KernelStack:        1448 kB
PageTables:         7040 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1500668 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    204800 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71692 MiB
End job on node103 at 2016-06-18 09:14:58