Trace number 4103153

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 208.925 208.972

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/fctp/normalized-mps-v2-20-10-n370c.opb
MD5SUM45fcfcff3cc1d21ff3924d5043b52f30
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark31665295757
Best CPU time to get the best result obtained on this benchmark1800.75
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 4871751128
Optimality of the best value was proved NO
Number of variables155000
Total number of constraints5150
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints5150
Minimum length of a constraint31
Maximum length of a constraint3000
Number of terms in the objective function 155000
Biggest coefficient in the objective function 4294967296
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 29652813254765
Number of bits of the sum of numbers in the objective function 45
Biggest number in a constraint 4294967296
Number of bits of the biggest number in a constraint 33
Biggest sum of numbers in a constraint 29652813254765
Number of bits of the biggest sum of numbers45
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T09:04:00+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103153-1466233440.opb"]
0.00/0.01	c use --random-gen="3561343660 3201688488 915589747 4125286504 2258284572 1034600569 1922275727 2367240032 357891809 1189381504 1083531474 1844901412 960618928 1918482845 2330819556 611805278 2153094586 3513846186 3933200696 1603195342 882031074 3852556989 3709384475 3490037978 2345266639 2999798902 194467685 3949827021 2218254248 2953677717 1293612018 1475414781 2256149531 3970130822 3282810092 3448781158 3215172135 897752530 3873646649 2665844617 152599971 2539300409 1199080116 169696836 1609064779 1195119646 654747256 1742860603 235622045 191162146 2755207115 2230453439 1214940464 2168567359 3558918602 1192164565 850422598 792503006 2044704590 4274344942 60421994 2058925659 1064343059 292664486 2553003398 3804440714 2062544511 266376669 2815822847 1894059063 971299564 3626437267 1762483302 3482513150 4095381017 3259399938 4145185231 2121596913 1257754949 688769020 2944115851 3135672800 1700724279 3801033790 70908434 4126632570 2529755246 3431554271 788996387 2250135495 2335735991 1336455894 2982089614 4251824574 948521503 772050750 122987933 113485503 226559772 2576726365 1175206689 928349769 2464283126 3004399458 3785052766 3471285270 1938310247 2679007050 1672549893 1881626876 292442357 2038270171 981752835 4202490601 1848725126 576775872 1490613183 2075427015 590845702 1271546594 4245362810 1467111822 858367198 4143578940 1638967852 4292064004 66350795 145762159 2878518632 1261940696 490432159 2337516235 745683679 733141615 794168203 3401297868 1801817546 1965243938 2404262827 467988726 1593242883 2556851855 1712575349 3573315575 3865454624 1913929714 3661909403 1517498193 3731029855 3536026871 2930488483 3711364753 1904524103 2997870224 3163026020 2849636089 1066096182 1606307827 23982802 967213939 355016573 239986951 3517638416 3378952214 3878361303 447478503 4106796120 2692615377 633421997 1440731445 2753232145 604926168 3237003398 1531250003 3899707636 1736550881 2184218553 3882244065 275503643 3775520467 2812523553 4241961601 3640965141 690577768 1094860839 2368198472 1466086064 650120632 1944613438 203698340 3525903064 1547843198 3004094131 2127180604 1798770948 1753513601 1994315620 1831291385 3311126800 2835466632 513388111 3750186048 1884491047 1637437932 3635912657 450671250 2189710730 393604804 1857496988 4006771161 818472168 977141320 785368862 2186771552 3203622676 2132542112 1405989226 952606342 3123335531 1260456265 3271468777 2478233715 638172239 985202471 1391496091 3030731928 2903515701 3637952359 734931874 3199168719 390298214 2900194901 278501428 3935013652 3945591035 1249566373 1955893254 1282228093 630689719 2539084459 258154537 4060192619 1642511239 3552436294 2292156318 11417035 2141926016 2959183807 2186584151 2132295184 3418302800 114430904 2895116179 1863528635 386319398 876368417 255 362436" option to reproduce the execution
1.09/1.13	c #vars 155000
1.09/1.13	c #constraints 5150
3.69/3.78	c BCD2: Hardening is enabled.
3.69/3.78	c BCD2: BiasedSearch is enabled.
3.69/3.78	c Solving starts ...
3.69/3.78	c ============================[ Search Statistics ]============================
3.69/3.78	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
3.69/3.78	c       |         |          |          |    Limit     GC | Var      | Constra 
3.69/3.78	c =============================================================================
3.89/3.90	c  0.0s |       0 |        0 |        0 |    53433      0 |    60931 |        0
6.79/6.81	c  2.9s |       0 |     6110 |        0 |    53433      0 |    60931 |        0
6.79/6.81	c #cpu_time = 2.797s
6.79/6.81	c #wall_clock_time = 2.804s
6.79/6.81	c #decision = 6110
6.79/6.81	c #random_decision = 17
6.79/6.81	c #conflict = 0
6.79/6.81	c #restart = 0
6.79/6.82	o 83318682323

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103153-1466233440/watcher-4103153-1466233440 -o /tmp/evaluation-result-4103153-1466233440/solver-4103153-1466233440 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11340 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103153-1466233440.opb 

pid=14876
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.04 2.01 3/179 14879
/proc/meminfo: memFree=30510260/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=790972 CPUtime=0 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 2967 0 0 0 0 0 0 0 20 0 4 0 25394424 809955328 2816 33554432000 4194304 16246674 140735841948560 140735841947984 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 198511 2826 441 2943 0 195405 0
[pid=14879/tid=14880] ppid=14876 vsize=808380 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 827781120 2882 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=812476 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 831975424 2900 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=817596 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25394425 837218304 2918 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100218 s]
/proc/loadavg: 2.00 2.04 2.01 3/179 14879
/proc/meminfo: memFree=30510260/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=1302084 CPUtime=0.09 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 30487 0 0 0 5 4 0 0 20 0 4 0 25394424 1333334016 30275 33554432000 4194304 16246674 140735841948560 140735841947872 8055408 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 325521 30290 799 2943 0 322415 0
[pid=14879/tid=14880] ppid=14876 vsize=1302084 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 1333334016 30300 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=1302084 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 1333334016 30311 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=1302084 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25394425 1333334016 30322 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1302084

[startup+0.200521 s]
/proc/loadavg: 2.00 2.04 2.01 3/179 14879
/proc/meminfo: memFree=30510260/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=1312324 CPUtime=0.19 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 42683 0 0 0 14 5 0 0 20 0 4 0 25394424 1343819776 42981 33554432000 4194304 16246674 140735841948560 140735841947872 4220897 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 328081 42981 799 2943 0 324975 0
[pid=14879/tid=14880] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 1343819776 42981 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 1343819776 42981 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25394425 1343819776 42981 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1312324

[startup+0.300481 s]
/proc/loadavg: 2.00 2.04 2.01 3/179 14879
/proc/meminfo: memFree=30510260/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=1312324 CPUtime=0.29 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 42692 0 0 0 24 5 0 0 20 0 4 0 25394424 1343819776 42990 33554432000 4194304 16246674 140735841948560 140735841947872 4220894 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 328081 42990 799 2943 0 324975 0
[pid=14879/tid=14880] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 1343819776 42990 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 1343819776 42990 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25394425 1343819776 42990 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1312324

[startup+0.700419 s]
/proc/loadavg: 2.00 2.04 2.01 3/179 14879
/proc/meminfo: memFree=30510260/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=1312324 CPUtime=0.69 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 54233 0 0 0 62 7 0 0 20 0 4 0 25394424 1343819776 54531 33554432000 4194304 16246674 140735841948560 140735841946432 7364499 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 328081 54531 802 2943 0 324975 0
[pid=14879/tid=14880] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 1343819776 54531 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 1343819776 54531 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25394425 1343819776 54531 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1312324

[startup+1.50041 s]
/proc/loadavg: 2.00 2.04 2.01 3/183 14883
/proc/meminfo: memFree=30249632/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=1380932 CPUtime=1.49 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 86228 0 0 0 138 11 0 0 20 0 4 0 25394424 1414074368 86526 33554432000 4194304 16246674 140735841948560 140735841946368 4208644 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 345233 86526 834 2943 0 342127 0
[pid=14879/tid=14880] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 1414074368 86526 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 1414074368 86526 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25394425 1414074368 86526 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1380932

[startup+3.1004 s]
/proc/loadavg: 2.00 2.04 2.01 3/183 14883
/proc/meminfo: memFree=30112860/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=1380932 CPUtime=3.09 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 102262 0 0 0 296 13 0 0 20 0 4 0 25394424 1414074368 102560 33554432000 4194304 16246674 140735841948560 140735841947656 13943664 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 345233 102560 836 2943 0 342127 0
[pid=14879/tid=14880] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 1414074368 102560 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 1414074368 102560 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 1414074368 102560 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1380932

[startup+6.30035 s]
/proc/loadavg: 2.00 2.04 2.01 3/183 14883
/proc/meminfo: memFree=29839328/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=1380932 CPUtime=6.29 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 167718 0 0 0 606 23 0 0 20 0 4 0 25394424 1414074368 168016 33554432000 4194304 16246674 140735841948560 140735841930432 6843977 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 345233 168016 877 2943 0 342127 0
[pid=14879/tid=14880] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 1414074368 168016 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 1414074368 168016 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=1380932 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 1414074368 168016 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1380932

[startup+12.7004 s]
/proc/loadavg: 2.00 2.04 2.00 3/183 14883
/proc/meminfo: memFree=28926340/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=2032196 CPUtime=12.69 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 448719 0 0 0 1209 60 0 0 20 0 4 0 25394424 2080968704 449017 33554432000 4194304 16246674 140735841948560 140735841947872 4206688 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 508049 449017 879 2943 0 504943 0
[pid=14879/tid=14880] ppid=14876 vsize=2032196 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 2080968704 449017 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=2032196 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 2080968704 449017 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=2032196 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 2080968704 449017 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 2032196

[startup+25.5005 s]
/proc/loadavg: 2.00 2.04 2.00 4/183 14883
/proc/meminfo: memFree=26205972/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=4536900 CPUtime=25.49 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 1074897 0 0 0 2412 137 0 0 20 0 4 0 25394424 4645785600 1075195 33554432000 4194304 16246674 140735841948560 140735841947736 15015658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 1134225 1075195 880 2943 0 1131119 0
[pid=14879/tid=14880] ppid=14876 vsize=4536900 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 4645785600 1075195 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=4536900 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 4645785600 1075195 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=4536900 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 4645785600 1075195 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 4536900

[startup+51.1005 s]
/proc/loadavg: 2.00 2.03 2.00 3/183 14884
/proc/meminfo: memFree=21890300/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=9153092 CPUtime=51.08 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 2228918 0 0 0 4814 294 0 0 20 0 4 0 25394424 9372766208 2229216 33554432000 4194304 16246674 140735841948560 140735841947224 4221016 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 2288273 2229222 880 2943 0 2285167 0
[pid=14879/tid=14880] ppid=14876 vsize=9153092 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 9372766208 2229226 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=9153092 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 9372766208 2229233 33554432000 4194304 16246674 140735841948560 140455338548240 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=9153092 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 9372766208 2229237 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9153092

[startup+102.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14885
/proc/meminfo: memFree=18840228/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=11888196 CPUtime=102.28 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 2912728 0 0 0 9837 391 0 0 20 0 4 0 25394424 12173512704 2913026 33554432000 4194304 16246674 140735841948560 140735841947736 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 2972049 2913026 884 2943 0 2968943 0
[pid=14879/tid=14880] ppid=14876 vsize=11888196 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 12173512704 2913026 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=11888196 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 12173512704 2913026 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=11888196 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 12173512704 2913026 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 11888196

[startup+162.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14935
/proc/meminfo: memFree=16748468/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=14373444 CPUtime=162.26 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 3433786 0 0 0 15749 477 0 0 20 0 4 0 25394424 14718406656 3534240 33554432000 4194304 16246674 140735841948560 140735841946496 13899658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 3593361 3534240 884 2943 0 3590255 0
[pid=14879/tid=14880] ppid=14876 vsize=14373444 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 14718406656 3534240 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=14373444 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 14718406656 3534240 33554432000 4194304 16246674 140735841948560 140455338548240 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=14373444 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 14718406656 3534240 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 14373444



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+208.007 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 14935
/proc/meminfo: memFree=6341140/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=15880772 CPUtime=207.96 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) R 14876 14879 11324 0 -1 4202496 3810649 0 0 0 20258 538 0 0 20 0 4 0 25394424 16261910528 3911359 33554432000 4194304 16246674 140735841948560 140735841947224 4221016 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 3970193 3911367 884 2943 0 3967087 0
[pid=14879/tid=14880] ppid=14876 vsize=15880772 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14880/stat : 14880 (toysat) S 14876 14879 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25394424 16261910528 3911372 33554432000 4194304 16246674 140735841948560 140455349038320 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=15880772 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) S 14876 14879 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25394425 16261910528 3911377 33554432000 4194304 16246674 140735841948560 140455338548464 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=14879/tid=14882] ppid=14876 vsize=15880772 CPUtime=0 cores=0,2,4,6
/proc/14879/task/14882/stat : 14882 (toysat) S 14876 14879 11324 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 25394425 16261910528 3911382 33554432000 4194304 16246674 140735841948560 140455328074928 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 207.96
Current children cumulated vsize (KiB) 15880772

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 14879 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+208.4 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 14935
/proc/meminfo: memFree=6341140/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=0 CPUtime=208.35 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) Z 14876 14879 11324 0 -1 4203532 3811125 0 0 0 20258 577 0 0 20 0 2 0 25394424 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 0 0 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=0 CPUtime=0.37 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) R 14876 14879 11324 0 -1 4203588 8 0 0 0 0 37 0 0 20 0 2 0 25394425 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 208.35
Current children cumulated vsize (KiB) 0

[startup+208.8 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 14935
/proc/meminfo: memFree=6341140/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=0 CPUtime=208.75 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) Z 14876 14879 11324 0 -1 4203532 3811125 0 0 0 20258 617 0 0 20 0 2 0 25394424 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 0 0 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=0 CPUtime=0.77 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) R 14876 14879 11324 0 -1 4203588 8 0 0 0 0 77 0 0 20 0 2 0 25394425 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 208.75
Current children cumulated vsize (KiB) 0

[startup+208.9 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 14935
/proc/meminfo: memFree=6341140/32872528 swapFree=249320/249320
[pid=14879] ppid=14876 vsize=0 CPUtime=208.85 cores=0,2,4,6
/proc/14879/stat : 14879 (toysat) Z 14876 14879 11324 0 -1 4203532 3811125 0 0 0 20258 627 0 0 20 0 2 0 25394424 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/14879/statm: 0 0 0 0 0 0 0
[pid=14879/tid=14881] ppid=14876 vsize=0 CPUtime=0.87 cores=0,2,4,6
/proc/14879/task/14881/stat : 14881 (toysat) R 14876 14879 11324 0 -1 4203588 8 0 0 0 0 87 0 0 20 0 2 0 25394425 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 208.85
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 208.972
CPU time (s): 208.925
CPU user time (s): 202.586
CPU system time (s): 6.33904
CPU usage (%): 99.9777
Max. virtual memory (cumulated for all children) (KiB): 15880772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 202.586
system time used= 6.33904
maximum resident set size= 15647340
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3811125
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 67
involuntary context switches= 215

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.537918 second user time and 0.801878 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 09:04:00
IDJOB=4103153
IDBENCH=2283
IDSOLVER=2542
FILE ID=node103/4103153-1466233440
RUNJOBID= node103-1466206104-11340
PBS_JOBID= 19918169
Free space on /tmp= 71708 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/fctp/normalized-mps-v2-20-10-n370c.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103153-1466233440/watcher-4103153-1466233440 -o /tmp/evaluation-result-4103153-1466233440/solver-4103153-1466233440 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11340 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103153-1466233440.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 45fcfcff3cc1d21ff3924d5043b52f30
RANDOM SEED=1949032539

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30511276 kB
Buffers:          120532 kB
Cached:           128468 kB
SwapCached:         1672 kB
Active:           130264 kB
Inactive:        1244436 kB
Active(anon):      35348 kB
Inactive(anon):  1092716 kB
Active(file):      94916 kB
Inactive(file):   151720 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             24844 kB
Writeback:             8 kB
AnonPages:       1374676 kB
Mapped:            10736 kB
Shmem:                 0 kB
Slab:             602656 kB
SReclaimable:      46328 kB
SUnreclaim:       556328 kB
KernelStack:        1456 kB
PageTables:         7044 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1515920 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1091584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71684 MiB
End job on node103 at 2016-06-18 09:07:29