Trace number 4103657

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 166.806 166.844

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-agg3.opb
MD5SUMbbee2849ae83900e79494d0f7a7c3755
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables9060
Total number of constraints429
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints429
Minimum length of a constraint30
Maximum length of a constraint1440
Number of terms in the objective function 6930
Biggest coefficient in the objective function 53730040872960
Number of bits for the biggest coefficient in the objective function 46
Sum of the numbers in the objective function 8516865379203027
Number of bits of the sum of numbers in the objective function 53
Biggest number in a constraint 22763326668800000
Number of bits of the biggest number in a constraint 55
Biggest sum of numbers in a constraint 46271983665442689
Number of bits of the biggest sum of numbers56
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:27:52+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103657-1466238471.opb"]
0.00/0.01	c use --random-gen="2081636260 3290204354 583770570 964261661 379541685 2532894047 80759586 2041504270 1823938219 1960678340 3271260852 965087431 3408646118 2162268280 2222288386 604451656 3130719029 159726208 3142472254 1349261390 3802650946 4047467231 3602467718 4212901368 2639660415 3286944300 3435375757 706955679 2753773161 762320720 2565448155 1653235112 645242034 1988169077 1240125605 1679313220 186973041 119938317 1694319115 3957656271 2740742468 3548887164 637033710 3607884409 2100461895 2236468989 512881763 3264570119 2547470340 4151749695 3621078148 2562417015 1402006079 2267190035 558118544 4218304466 1002466531 564381758 186342213 3667220994 1146407211 4121458083 3496691273 1852559638 38937255 3856368450 4287659714 368983973 172911018 1430047736 2076898813 3050304898 29475173 3608863025 3533991428 2007191903 1476866035 2715196268 1722298008 3187051455 2460849403 1693438011 3720924635 15514105 146313170 3972855569 1954471880 1882920200 2817521921 2003080539 1991374099 2958908113 1262783797 489057740 1092397682 2692674883 3132433912 2480204781 1574970169 2838683716 4188179795 2846231152 1461095311 933596214 1588354055 2622933700 2468963590 3115876059 3106523752 864492981 3213989681 1603882322 776174268 3913778007 2336652983 3778872604 3076485897 32949908 4078840604 744306422 356007267 628954477 1787178586 2533518244 713698266 701631163 951257926 2086452268 2970756139 904251817 3129319450 1314787744 2336637514 1017485321 1073163387 3066441327 169440613 880390375 1153142654 550474277 6883116 2526242953 3640074192 3149680423 3157185171 1788703273 3750278411 1753217832 1369351783 1492022851 1456570174 2820838682 2296796943 3934027803 2432624590 3334900745 1461830014 2042806226 3843186076 1553551907 589912756 4286690818 2171303171 649624650 2004057438 3849993088 2705439758 2689471506 3409926710 2575077994 2860018323 3033666813 2293417081 3664829465 2077376631 4174441076 2313012757 4213655826 1259593849 2075262805 2749324935 1192845423 477830277 2418429731 2026660737 1078479795 545004260 3041858926 134587112 2507256365 2784811385 4262884477 1689193732 942140413 564339718 3940916943 3457574268 913655413 2245386907 602172658 4029409288 2718852497 3955472910 1724838169 3090531703 66393681 1776134819 1452580354 3390706644 1752413157 4086172625 3111796563 2493684527 1417927233 90121322 3130863206 2871759901 142527990 3481728185 371157872 1814255796 339412244 3333628758 2838165223 653483547 2874757836 2446489411 504785265 2039390633 3608608569 2162437482 3295576019 3089913570 2049769759 938904743 1599627855 2954778562 3764560725 2898098299 3864981681 325597725 816841781 3264181284 4232195714 102715156 1926846585 120881651 4254025639 496899730 1051109618 1329405054 2737202925 966757695 661897833 3251643589 1971489958 255 362436" option to reproduce the execution
0.19/0.21	c #vars 9060
0.19/0.21	c #constraints 429

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103657-1466238471/watcher-4103657-1466238471 -o /tmp/evaluation-result-4103657-1466238471/solver-4103657-1466238471 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103657-1466238471.opb 

pid=15897
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.16 2.17 2.10 3/179 15900
/proc/meminfo: memFree=28556468/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=651708 CPUtime=0 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 2418 0 0 0 0 0 0 0 20 0 4 0 25897568 667348992 3290 33554432000 4194304 16246674 140737246263264 140737246262688 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 163439 3298 441 2943 0 160333 0
[pid=15900/tid=15901] ppid=15897 vsize=669116 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 685174784 3356 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=673212 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 689369088 3372 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=677308 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 693563392 3388 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.10017 s]
/proc/loadavg: 2.16 2.17 2.10 3/179 15900
/proc/meminfo: memFree=28556468/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=1303108 CPUtime=0.09 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 30433 0 0 0 5 4 0 0 20 0 4 0 25897568 1334382592 31243 33554432000 4194304 16246674 140737246263264 140737246262576 8058197 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 325777 31259 800 2943 0 322671 0
[pid=15900/tid=15901] ppid=15897 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 1334382592 31269 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 1334382592 31279 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 1334382592 31289 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200527 s]
/proc/loadavg: 2.16 2.17 2.10 3/179 15900
/proc/meminfo: memFree=28556468/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=1311300 CPUtime=0.19 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 40823 0 0 0 14 5 0 0 20 0 4 0 25897568 1342771200 42143 33554432000 4194304 16246674 140737246263264 140737246262576 7439648 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 327825 42143 801 2943 0 324719 0
[pid=15900/tid=15901] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 42143 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 42143 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 42143 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300523 s]
/proc/loadavg: 2.16 2.17 2.10 3/179 15900
/proc/meminfo: memFree=28556468/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=1311300 CPUtime=0.29 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 54959 0 0 0 22 7 0 0 20 0 4 0 25897568 1342771200 56280 33554432000 4194304 16246674 140737246263264 140737246262576 12655109 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 327825 56296 821 2943 0 324719 0
[pid=15900/tid=15901] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 56305 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 56314 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 56323 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1311300

[startup+0.700411 s]
/proc/loadavg: 2.16 2.17 2.10 3/179 15900
/proc/meminfo: memFree=28556468/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=1311300 CPUtime=0.69 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 148630 0 0 0 51 18 0 0 20 0 4 0 25897568 1342771200 149950 33554432000 4194304 16246674 140737246263264 140737246262576 12657333 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 327825 149957 821 2943 0 324719 0
[pid=15900/tid=15901] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 149960 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 149964 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 1342771200 149968 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1311300

[startup+1.50042 s]
/proc/loadavg: 2.16 2.17 2.10 3/183 15904
/proc/meminfo: memFree=27519952/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=1358404 CPUtime=1.49 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 280211 0 0 0 114 35 0 0 20 0 4 0 25897568 1391005696 281531 33554432000 4194304 16246674 140737246263264 140737246262576 6964488 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 339601 281531 833 2943 0 336495 0
[pid=15900/tid=15901] ppid=15897 vsize=1358404 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 1391005696 281531 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=1358404 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 1391005696 281531 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=1358404 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 1391005696 281531 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1358404

[startup+3.10041 s]
/proc/loadavg: 2.15 2.16 2.10 3/183 15904
/proc/meminfo: memFree=27418520/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=1474116 CPUtime=3.09 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 308903 0 0 0 271 38 0 0 20 0 4 0 25897568 1509494784 310223 33554432000 4194304 16246674 140737246263264 140737246245184 12449269 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 368529 310223 833 2943 0 365423 0
[pid=15900/tid=15901] ppid=15897 vsize=1474116 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 1509494784 310223 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=1474116 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 1509494784 310223 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=1474116 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 1509494784 310223 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1474116

[startup+6.30042 s]
/proc/loadavg: 2.15 2.16 2.10 4/183 15904
/proc/meminfo: memFree=27294568/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=1677892 CPUtime=6.29 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 360091 0 0 0 585 44 0 0 20 0 4 0 25897568 1718161408 361411 33554432000 4194304 16246674 140737246263264 140737246262576 12449422 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 419473 361411 833 2943 0 416367 0
[pid=15900/tid=15901] ppid=15897 vsize=1677892 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 1718161408 361411 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=1677892 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 1718161408 361411 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=1677892 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 1718161408 361411 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1677892

[startup+12.7004 s]
/proc/loadavg: 2.12 2.16 2.09 3/183 15904
/proc/meminfo: memFree=26147444/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=2606660 CPUtime=12.68 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 592285 0 0 0 1193 75 0 0 20 0 4 0 25897568 2669219840 593605 33554432000 4194304 16246674 140737246263264 140737246261056 4220514 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 651665 593605 834 2943 0 648559 0
[pid=15900/tid=15901] ppid=15897 vsize=2606660 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 2669219840 593605 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=2606660 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 2669219840 593605 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=2606660 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 2669219840 593605 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 2606660

[startup+25.5005 s]
/proc/loadavg: 2.18 2.17 2.10 3/183 15904
/proc/meminfo: memFree=23951660/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=4907588 CPUtime=25.48 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 1167329 0 0 0 2393 155 0 0 20 0 4 0 25897568 5025370112 1168649 33554432000 4194304 16246674 140737246263264 140737246261120 4225154 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 1226897 1168656 834 2943 0 1223791 0
[pid=15900/tid=15901] ppid=15897 vsize=4907588 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 5025370112 1168662 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=4907588 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 5025370112 1168666 33554432000 4194304 16246674 140737246263264 140482025856016 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=4907588 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 5025370112 1168671 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 4907588

[startup+51.1005 s]
/proc/loadavg: 2.13 2.15 2.09 4/183 15904
/proc/meminfo: memFree=19574412/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=9089604 CPUtime=51.08 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 2213023 0 0 0 4809 299 0 0 20 0 4 0 25897568 9307754496 2214343 33554432000 4194304 16246674 140737246263264 140737246261056 4220480 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 2272401 2214343 834 2943 0 2269295 0
[pid=15900/tid=15901] ppid=15897 vsize=9089604 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 9307754496 2214343 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=9089604 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 9307754496 2214343 33554432000 4194304 16246674 140737246263264 140482025856016 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=9089604 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 9307754496 2214343 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9089604

[startup+102.301 s]
/proc/loadavg: 2.20 2.17 2.10 3/183 15905
/proc/meminfo: memFree=14474588/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=14077508 CPUtime=102.28 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 3460005 0 0 0 9761 467 0 0 20 0 4 0 25897568 14415368192 3461325 33554432000 4194304 16246674 140737246263264 140737246261184 14013662 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 3519377 3461325 839 2943 0 3516271 0
[pid=15900/tid=15901] ppid=15897 vsize=14077508 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 14415368192 3461325 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=14077508 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 14415368192 3461325 33554432000 4194304 16246674 140737246263264 140482025856016 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=14077508 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 14415368192 3461325 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 14077508

[startup+162.3 s]
/proc/loadavg: 2.11 2.15 2.09 3/184 15909
/proc/meminfo: memFree=14374236/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=14305860 CPUtime=162.26 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 3516955 0 0 0 15747 479 0 0 20 0 4 0 25897568 14649200640 3518275 33554432000 4194304 16246674 140737246263264 140737246262440 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 3576465 3518275 839 2943 0 3573359 0
[pid=15900/tid=15901] ppid=15897 vsize=14305860 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 14649200640 3518275 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=14305860 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 14649200640 3518275 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=14305860 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 14649200640 3518275 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 14305860



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+166 s]
/proc/loadavg: 2.11 2.15 2.09 3/184 15909
/proc/meminfo: memFree=12972168/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=15902276 CPUtime=165.96 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) R 15897 15900 11324 0 -1 4202496 3916015 0 0 0 16062 534 0 0 20 0 4 0 25897568 16283930624 3917336 33554432000 4194304 16246674 140737246263264 140737246262360 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 3975569 3917347 839 2943 0 3972463 0
[pid=15900/tid=15901] ppid=15897 vsize=15902276 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15901/stat : 15901 (toysat) S 15897 15900 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25897568 16283930624 3917354 33554432000 4194304 16246674 140737246263264 140482036346096 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=15902276 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) S 15897 15900 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25897568 16283930624 3917359 33554432000 4194304 16246674 140737246263264 140482025856240 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15900/tid=15903] ppid=15897 vsize=15902276 CPUtime=0 cores=1,3,5,7
/proc/15900/task/15903/stat : 15903 (toysat) S 15897 15900 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25897568 16283930624 3917364 33554432000 4194304 16246674 140737246263264 140481937796272 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 165.96
Current children cumulated vsize (KiB) 15902276

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15900 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+166.4 s]
/proc/loadavg: 2.11 2.15 2.09 3/182 15909
/proc/meminfo: memFree=14392036/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=0 CPUtime=166.36 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) Z 15897 15900 11324 0 -1 4203532 3916513 0 0 0 16062 574 0 0 20 0 2 0 25897568 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 0 0 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=0 CPUtime=0.38 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) R 15897 15900 11324 0 -1 4203588 8 0 0 0 0 38 0 0 20 0 2 0 25897568 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 166.36
Current children cumulated vsize (KiB) 0

[startup+166.8 s]
/proc/loadavg: 2.11 2.15 2.09 3/182 15909
/proc/meminfo: memFree=14392036/32872528 swapFree=249320/249320
[pid=15900] ppid=15897 vsize=0 CPUtime=166.76 cores=1,3,5,7
/proc/15900/stat : 15900 (toysat) Z 15897 15900 11324 0 -1 4203532 3916513 0 0 0 16062 614 0 0 20 0 2 0 25897568 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15900/statm: 0 0 0 0 0 0 0
[pid=15900/tid=15902] ppid=15897 vsize=0 CPUtime=0.78 cores=1,3,5,7
/proc/15900/task/15902/stat : 15902 (toysat) R 15897 15900 11324 0 -1 4203588 8 0 0 0 0 78 0 0 20 0 2 0 25897568 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 166.76
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 166.844
CPU time (s): 166.806
CPU user time (s): 160.628
CPU system time (s): 6.17806
CPU usage (%): 99.977
Max. virtual memory (cumulated for all children) (KiB): 15902276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 160.628
system time used= 6.17806
maximum resident set size= 15671332
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3916513
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 63
involuntary context switches= 188

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.565913 second user time and 0.932858 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 10:27:51
IDJOB=4103657
IDBENCH=2423
IDSOLVER=2542
FILE ID=node103/4103657-1466238471
RUNJOBID= node103-1466206104-11341
PBS_JOBID= 19918169
Free space on /tmp= 71712 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-agg3.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103657-1466238471/watcher-4103657-1466238471 -o /tmp/evaluation-result-4103657-1466238471/solver-4103657-1466238471 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103657-1466238471.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bbee2849ae83900e79494d0f7a7c3755
RANDOM SEED=13057644

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28556600 kB
Buffers:          128780 kB
Cached:           134288 kB
SwapCached:         2188 kB
Active:          3151284 kB
Inactive:         173180 kB
Active(anon):    3059692 kB
Inactive(anon):     3672 kB
Active(file):      91592 kB
Inactive(file):   169508 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             17868 kB
Writeback:             0 kB
AnonPages:       3313860 kB
Mapped:            10712 kB
Shmem:                 0 kB
Slab:             602392 kB
SReclaimable:      46508 kB
SUnreclaim:       555884 kB
KernelStack:        1504 kB
PageTables:        10684 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3453524 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1222656 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71696 MiB
End job on node103 at 2016-06-18 10:30:38