Trace number 4103529

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 196.492 196.527

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-vtp.base.opb
MD5SUM5b3e28beae15a1c34f0e545c98eeb705
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables4524
Total number of constraints257
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints257
Minimum length of a constraint11
Maximum length of a constraint1080
Number of terms in the objective function 181
Biggest coefficient in the objective function 1073741824
Number of bits for the biggest coefficient in the objective function 31
Sum of the numbers in the objective function 7516192762
Number of bits of the sum of numbers in the objective function 33
Biggest number in a constraint 198568686125056
Number of bits of the biggest number in a constraint 48
Biggest sum of numbers in a constraint 12817928787879752
Number of bits of the biggest sum of numbers54
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:15:02+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103529-1466237702.opb"]
0.00/0.01	c use --random-gen="2695680974 390734236 1270578841 3625555239 1790128023 4278471193 1184675679 3162156209 313261488 1026152733 579948819 3260993248 888708356 3872516987 1405513769 4164100021 1166234967 4156561478 2218202879 2054987538 3734089996 1259383380 3692744911 1134738408 4025862905 614299733 1010722990 169706246 2849514979 3596178409 4065265599 3991949688 1988909201 600636190 878875184 198455035 2322066143 2196685524 2530878980 1922110550 2968884538 696194762 221513691 3484217696 2571254768 2916245083 3833161365 1058311014 3696717303 934555294 1278063579 3899181286 2274849348 462470199 4222660318 1608843994 3000431238 1408466223 3355073584 1254557931 1069163129 3227882788 634913406 716478335 3747398527 585682705 2909069292 1852735560 2609366524 821479808 2894389294 3355203663 1015730752 1375544287 1700625659 2322538302 819406412 1111882684 3089397859 2008988521 1311384781 1459562080 2056088801 3139504786 273566257 288692329 693535233 67079903 414226613 3025688911 2400615075 3066674668 341153 3506623732 1010220729 3642349420 818786956 220880705 2560638014 2777102638 2949641133 553411865 2802640568 1860044324 1951041226 2952579146 2155467621 1385968711 3256653252 355577836 3186230194 2698772547 3292243164 905543001 1048158393 3062555829 3330994795 2708388086 1597220723 217151009 3410026574 14556203 1539828554 3984806269 4216582390 3430368720 2305221784 1938699744 909072246 3044729561 3130549632 1486433253 837548733 3410620707 2556473830 3121640439 1939655125 2562429414 2327220632 96946828 303145739 2986892673 3835070216 3598590655 2426641851 831915048 2484953215 2191164519 3325122049 2172742629 1544345382 3782878940 3380435332 3168382137 2002138558 2538070918 1545062143 3668893818 500533878 1531826885 2654905768 1999043474 1693488942 2107121956 4050706603 1830372687 1952607570 1988254716 3105589972 1987044576 1568269444 501172609 1543517877 1581968268 2631769696 742903787 4004055536 2125544928 2856824708 3144936472 647678329 3238544856 2407058963 3620553128 617648669 707171187 1816003799 4082363016 132290131 1516606373 2309475443 919931995 1265709241 1737779696 1077482462 2322574691 39877347 2067597977 1014484258 3845252205 1455091878 4181173548 2136361868 3178134481 2475057829 1580107815 4111717039 3413629208 619394047 3403401318 3313103327 2053420418 2151622603 557993787 2611892824 2224999708 746383283 2789733816 571715724 3043840471 1475725781 2340107466 3006756761 3619883593 1961363280 3290226159 2028759055 2462346135 93754014 1781987596 3708995751 3179243922 49690127 4272920848 3518672078 4180256254 2075240175 130524771 1489213878 2340939871 3763760777 883444644 1054975433 244483960 3997450019 2795681098 2778330748 2201966929 3847371444 699630441 4061755413 126714284 4044894301 2443578804 683112908 1207043128 255 362436" option to reproduce the execution
0.00/0.05	c #vars 4524
0.00/0.05	c #constraints 257

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103529-1466237702/watcher-4103529-1466237702 -o /tmp/evaluation-result-4103529-1466237702/solver-4103529-1466237702 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103529-1466237702.opb 

pid=15684
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.06 2.06 2.04 3/179 15687
/proc/meminfo: memFree=30121444/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=802236 CPUtime=0 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 3007 0 0 0 0 0 0 0 20 0 4 0 25820591 821489664 3367 33554432000 4194304 16246674 140733319505296 140733319504720 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 201327 3377 441 2943 0 198221 0
[pid=15687/tid=15688] ppid=15684 vsize=820668 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 840364032 3439 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=824764 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 844558336 3456 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=828860 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25820591 848752640 3473 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100132 s]
/proc/loadavg: 2.06 2.06 2.04 3/179 15687
/proc/meminfo: memFree=30121444/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=1220164 CPUtime=0.09 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 27809 0 0 0 5 4 0 0 20 0 4 0 25820591 1249447936 28108 33554432000 4194304 16246674 140733319505296 140733319504608 12449273 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 305041 28119 833 2943 0 301935 0
[pid=15687/tid=15688] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 28128 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 28137 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 28146 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1220164

[startup+0.200483 s]
/proc/loadavg: 2.06 2.06 2.04 3/179 15687
/proc/meminfo: memFree=30121444/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=1220164 CPUtime=0.18 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 50346 0 0 0 12 6 0 0 20 0 4 0 25820591 1249447936 50645 33554432000 4194304 16246674 140733319505296 140733319504608 12371341 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 305041 50656 833 2943 0 301935 0
[pid=15687/tid=15688] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 50663 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 50671 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 50679 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 1220164

[startup+0.30045 s]
/proc/loadavg: 2.06 2.06 2.04 3/179 15687
/proc/meminfo: memFree=30121444/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=1220164 CPUtime=0.29 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 76868 0 0 0 19 10 0 0 20 0 4 0 25820591 1249447936 77166 33554432000 4194304 16246674 140733319505296 140733319504608 12684188 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 305041 77173 833 2943 0 301935 0
[pid=15687/tid=15688] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 77177 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 77181 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 77185 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1220164

[startup+0.700366 s]
/proc/loadavg: 2.06 2.06 2.04 3/179 15687
/proc/meminfo: memFree=30121444/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=1220164 CPUtime=0.69 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 167464 0 0 0 48 21 0 0 20 0 4 0 25820591 1249447936 167762 33554432000 4194304 16246674 140733319505296 140733319504608 12371341 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 305041 167774 833 2943 0 301935 0
[pid=15687/tid=15688] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 167782 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 167789 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=1220164 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 1249447936 167797 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1220164

[startup+1.50036 s]
/proc/loadavg: 2.14 2.08 2.04 3/183 15691
/proc/meminfo: memFree=29071804/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=1405508 CPUtime=1.49 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 292376 0 0 0 112 37 0 0 20 0 4 0 25820591 1439240192 292674 33554432000 4194304 16246674 140733319505296 140733319504608 12371292 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 351377 292674 835 2943 0 348271 0
[pid=15687/tid=15688] ppid=15684 vsize=1405508 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 1439240192 292674 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=1405508 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 1439240192 292674 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=1405508 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 1439240192 292674 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1405508

[startup+3.1004 s]
/proc/loadavg: 2.14 2.08 2.04 3/183 15691
/proc/meminfo: memFree=28939992/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=1405508 CPUtime=3.09 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 292507 0 0 0 272 37 0 0 20 0 4 0 25820591 1439240192 292805 33554432000 4194304 16246674 140733319505296 140733319503104 4221027 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 351377 292805 835 2943 0 348271 0
[pid=15687/tid=15688] ppid=15684 vsize=1405508 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 1439240192 292805 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=1405508 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 1439240192 292805 33554432000 4194304 16246674 140733319505296 140065818778640 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=1405508 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 1439240192 292805 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1405508

[startup+6.30035 s]
/proc/loadavg: 2.14 2.08 2.04 3/183 15691
/proc/meminfo: memFree=28745564/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=1598020 CPUtime=6.29 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 340635 0 0 0 586 43 0 0 20 0 4 0 25820591 1636372480 340933 33554432000 4194304 16246674 140733319505296 140733319503168 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 399505 340933 835 2943 0 396399 0
[pid=15687/tid=15688] ppid=15684 vsize=1598020 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 1636372480 340933 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=1598020 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 1636372480 340933 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=1598020 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 1636372480 340933 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1598020

[startup+12.7004 s]
/proc/loadavg: 2.11 2.08 2.04 3/183 15691
/proc/meminfo: memFree=27505424/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=2825796 CPUtime=12.69 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 647581 0 0 0 1187 82 0 0 20 0 4 0 25820591 2893615104 647879 33554432000 4194304 16246674 140733319505296 140733319504472 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 706449 647879 836 2943 0 703343 0
[pid=15687/tid=15688] ppid=15684 vsize=2825796 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 2893615104 647879 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=2825796 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 2893615104 647879 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=2825796 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 2893615104 647879 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 2825796

[startup+25.5004 s]
/proc/loadavg: 2.17 2.09 2.05 3/183 15691
/proc/meminfo: memFree=25512016/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=4920900 CPUtime=25.48 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 1171308 0 0 0 2400 148 0 0 20 0 4 0 25820591 5039001600 1171607 33554432000 4194304 16246674 140733319505296 140733319503168 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 1230225 1171613 836 2943 0 1227119 0
[pid=15687/tid=15688] ppid=15684 vsize=4920900 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 5039001600 1171618 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=4920900 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 5039001600 1171624 33554432000 4194304 16246674 140733319505296 140065818778640 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=4920900 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 5039001600 1171628 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 4920900

[startup+51.1004 s]
/proc/loadavg: 2.11 2.08 2.04 3/183 15692
/proc/meminfo: memFree=21180724/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=9053764 CPUtime=51.08 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 2204575 0 0 0 4822 286 0 0 20 0 4 0 25820591 9271054336 2204873 33554432000 4194304 16246674 140733319505296 140733319504392 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 2263441 2204873 836 2943 0 2260335 0
[pid=15687/tid=15688] ppid=15684 vsize=9053764 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 9271054336 2204873 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=9053764 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 9271054336 2204873 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=9053764 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 9271054336 2204873 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9053764

[startup+102.3 s]
/proc/loadavg: 2.08 2.08 2.04 3/183 15693
/proc/meminfo: memFree=18347364/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=11766340 CPUtime=102.28 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 2882725 0 0 0 9852 376 0 0 20 0 4 0 25820591 12048732160 2883023 33554432000 4194304 16246674 140733319505296 140733319504392 4220543 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 2941585 2883023 841 2943 0 2938479 0
[pid=15687/tid=15688] ppid=15684 vsize=11766340 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 12048732160 2883023 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=11766340 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 12048732160 2883023 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=11766340 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 12048732160 2883023 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 11766340

[startup+162.3 s]
/proc/loadavg: 2.09 2.08 2.04 3/183 15694
/proc/meminfo: memFree=16236592/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=13739588 CPUtime=162.26 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 3280379 0 0 0 15786 440 0 0 20 0 4 0 25820591 14069338112 3376234 33554432000 4194304 16246674 140733319505296 140733319503232 14003113 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 3434897 3376234 841 2943 0 3431791 0
[pid=15687/tid=15688] ppid=15684 vsize=13739588 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 14069338112 3376234 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=13739588 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 14069338112 3376234 33554432000 4194304 16246674 140733319505296 140065818778640 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=13739588 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 14069338112 3376234 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 13739588



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+195.7 s]
/proc/loadavg: 2.19 2.10 2.05 3/183 15695
/proc/meminfo: memFree=14443748/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=15906372 CPUtime=195.66 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) R 15684 15687 11324 0 -1 4202496 3821982 0 0 0 19054 512 0 0 20 0 4 0 25820591 16288124928 3917837 33554432000 4194304 16246674 140733319505296 140733319504472 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 3976593 3917837 841 2943 0 3973487 0
[pid=15687/tid=15688] ppid=15684 vsize=15906372 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15688/stat : 15688 (toysat) S 15684 15687 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25820591 16288124928 3917837 33554432000 4194304 16246674 140733319505296 140065829268720 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=15906372 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) S 15684 15687 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25820591 16288124928 3917837 33554432000 4194304 16246674 140733319505296 140065818778864 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15687/tid=15690] ppid=15684 vsize=15906372 CPUtime=0 cores=1,3,5,7
/proc/15687/task/15690/stat : 15690 (toysat) S 15684 15687 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25820591 16288124928 3917837 33554432000 4194304 16246674 140733319505296 140065808305328 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 195.66
Current children cumulated vsize (KiB) 15906372

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15687 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+196 s]
/proc/loadavg: 2.17 2.10 2.05 4/181 15695
/proc/meminfo: memFree=15846376/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=0 CPUtime=195.96 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) Z 15684 15687 11324 0 -1 4203532 3822467 0 0 0 19055 541 0 0 20 0 2 0 25820591 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 0 0 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=0 CPUtime=0.28 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) R 15684 15687 11324 0 -1 4203588 8 0 0 0 0 28 0 0 20 0 2 0 25820591 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 195.96
Current children cumulated vsize (KiB) 0

[startup+196.4 s]
/proc/loadavg: 2.17 2.10 2.05 4/181 15695
/proc/meminfo: memFree=15846376/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=0 CPUtime=196.36 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) Z 15684 15687 11324 0 -1 4203532 3822467 0 0 0 19055 581 0 0 20 0 2 0 25820591 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 0 0 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=0 CPUtime=0.68 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) R 15684 15687 11324 0 -1 4203588 8 0 0 0 0 68 0 0 20 0 2 0 25820591 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 196.36
Current children cumulated vsize (KiB) 0

[startup+196.5 s]
/proc/loadavg: 2.17 2.10 2.05 4/181 15695
/proc/meminfo: memFree=15846376/32872528 swapFree=249320/249320
[pid=15687] ppid=15684 vsize=0 CPUtime=196.46 cores=1,3,5,7
/proc/15687/stat : 15687 (toysat) Z 15684 15687 11324 0 -1 4203532 3822467 0 0 0 19055 591 0 0 20 0 2 0 25820591 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15687/statm: 0 0 0 0 0 0 0
[pid=15687/tid=15689] ppid=15684 vsize=0 CPUtime=0.78 cores=1,3,5,7
/proc/15687/task/15689/stat : 15689 (toysat) R 15684 15687 11324 0 -1 4203588 8 0 0 0 0 78 0 0 20 0 2 0 25820591 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 196.46
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 196.527
CPU time (s): 196.492
CPU user time (s): 190.551
CPU system time (s): 5.9411
CPU usage (%): 99.9822
Max. virtual memory (cumulated for all children) (KiB): 15906372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 190.551
system time used= 5.9411
maximum resident set size= 15673288
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3822467
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 68
involuntary context switches= 213

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.52492 second user time and 0.776881 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 10:15:02
IDJOB=4103529
IDBENCH=2387
IDSOLVER=2542
FILE ID=node103/4103529-1466237702
RUNJOBID= node103-1466206104-11341
PBS_JOBID= 19918169
Free space on /tmp= 71716 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-vtp.base.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103529-1466237702/watcher-4103529-1466237702 -o /tmp/evaluation-result-4103529-1466237702/solver-4103529-1466237702 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103529-1466237702.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5b3e28beae15a1c34f0e545c98eeb705
RANDOM SEED=1949032539

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30122088 kB
Buffers:          127572 kB
Cached:           131340 kB
SwapCached:         2188 kB
Active:          1594508 kB
Inactive:         170240 kB
Active(anon):    1504296 kB
Inactive(anon):     3672 kB
Active(file):      90212 kB
Inactive(file):   166568 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             16304 kB
Writeback:             0 kB
AnonPages:       1753680 kB
Mapped:            10740 kB
Shmem:                 0 kB
Slab:             602484 kB
SReclaimable:      46352 kB
SUnreclaim:       556132 kB
KernelStack:        1464 kB
PageTables:         7824 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1896020 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:      4096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71700 MiB
End job on node103 at 2016-06-18 10:18:18