Trace number 4103633

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 206.383 206.422

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-grow15.opb
MD5SUMb4d90975042873aa16a95872bfad2ca2
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 0
Optimality of the best value was proved NO
Number of variables17130
Total number of constraints900
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints900
Minimum length of a constraint22
Maximum length of a constraint491
Number of terms in the objective function 1335
Biggest coefficient in the objective function 3758096384
Number of bits for the biggest coefficient in the objective function 32
Sum of the numbers in the objective function 154618822482
Number of bits of the sum of numbers in the objective function 38
Biggest number in a constraint 878188741787648
Number of bits of the biggest number in a constraint 50
Biggest sum of numbers in a constraint 4550739094651140
Number of bits of the biggest sum of numbers53
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:24:24+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103633-1466238264.opb"]
0.00/0.01	c use --random-gen="2011276215 2017942546 2698908782 3367189213 1483963800 109368079 4170582895 968884141 1678916045 796329745 4020232339 2342159500 3396834065 1055695667 4008431300 3094598248 4000310586 3687116724 3719835238 1679316694 2125243310 623183815 2940811571 4132521295 3987608880 2688266832 1638566249 2186765555 1295772756 1702147220 2661844051 1074178412 2131429892 3439447438 3041461736 1429689486 36177707 4032266966 643025588 3902258990 1434978355 1584624853 3197184719 561325825 5966925 4226782267 2804367670 1286404385 755052502 2556955885 1274871366 3448909480 541765177 1377076080 1643461023 3017018057 2275798913 3067254594 2877787122 2504739516 302424885 3229192064 3114637408 1942593644 2511656314 3683418613 1417493116 3636708994 445570612 4130061717 2360582148 3732280986 1638590937 3318814651 1610066086 1161248937 2925701425 1656504251 187501390 723115940 355869492 2258178944 1904737335 1946460419 2701756330 649785652 1677327061 310299854 1372137294 3049178059 976726705 1310788850 2119361661 472122325 935164317 1510685873 1110043866 4135591116 1932823611 1458889192 1051828218 3746319736 756885355 3500200136 2642138864 928694051 3810050921 1217162243 2360191383 1110005586 702217949 1816477320 680968066 1378261511 4103498163 2825859711 4111444418 1400860219 3296743046 981379721 1931785576 3233045119 2746172700 774785924 3356244385 198658482 1590313513 973604926 761346666 2289450200 4205697598 1187472663 2934716735 1440502694 874592034 658859717 91854499 1119241117 3009752021 3560764429 2497761240 3758876603 845089767 1253000524 3488932468 112613412 3032904987 2942311498 1601460589 2701052407 2914107802 633749309 687097069 2928070184 814439767 3173990523 2227955971 4019408184 241569480 1354327073 112018743 1823786327 2870362931 496622336 3825315577 700658085 189590235 2414845296 1991143848 650703085 3451699273 3089952775 1093474364 1779282058 1322030873 3798049595 16851133 3046405155 3321179410 2916398083 932524344 1516353372 3047602126 3012185677 1753467829 1646091523 2326793909 2305489717 108715497 2804127716 500435942 1837639550 513182439 1481587677 1195793128 636134658 3458969716 2321374759 4003072690 393362388 2702640603 2206303588 2842247234 2716432067 4244025352 3303620744 1199211262 675571915 2016366691 1166344746 3426437322 1822255369 4177840784 2408058057 594851750 1693512511 1355847546 4260039556 2100680829 4243419595 2450855726 3325814489 2626110739 1180173165 708955745 2522746862 2924394999 3405744470 3788785240 2185701899 577749686 3563913635 2942367248 3485021641 435318884 3758313625 585121212 1877129953 2408276756 2172721180 3006793667 3877884874 1856933239 1489577107 3175823761 293450102 3741013170 1651962739 4006844431 376661309 1333201333 3678600701 828792217 4223906374 1232576582 455140812 255 362436" option to reproduce the execution
0.19/0.25	c #vars 17130
0.19/0.25	c #constraints 900

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103633-1466238264/watcher-4103633-1466238264 -o /tmp/evaluation-result-4103633-1466238264/solver-4103633-1466238264 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103633-1466238264.opb 

pid=15844
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.32 2.23 2.11 3/179 15847
/proc/meminfo: memFree=28934732/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=735676 CPUtime=0 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 2747 0 0 0 0 0 0 0 20 0 4 0 25876852 753332224 2597 33554432000 4194304 16246674 140735339885920 140735339885344 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 184431 2606 441 2943 0 181325 0
[pid=15847/tid=15848] ppid=15844 vsize=753084 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 771158016 2668 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=757180 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 775352320 2684 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=761276 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25876852 779546624 2700 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100177 s]
/proc/loadavg: 2.32 2.23 2.11 3/179 15847
/proc/meminfo: memFree=28934732/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1303108 CPUtime=0.09 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 30228 0 0 0 5 4 0 0 20 0 4 0 25876852 1334382592 30015 33554432000 4194304 16246674 140735339885920 140735339885232 12752373 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 325777 30031 801 2943 0 322671 0
[pid=15847/tid=15848] ppid=15844 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1334382592 30042 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1334382592 30054 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1334382592 30064 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200535 s]
/proc/loadavg: 2.32 2.23 2.11 3/179 15847
/proc/meminfo: memFree=28934732/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1311300 CPUtime=0.19 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 43299 0 0 0 14 5 0 0 20 0 4 0 25876852 1342771200 43597 33554432000 4194304 16246674 140735339885920 140735339868912 7889298 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 327825 43597 801 2943 0 324719 0
[pid=15847/tid=15848] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 43597 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 43597 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 43597 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300509 s]
/proc/loadavg: 2.32 2.23 2.11 3/179 15847
/proc/meminfo: memFree=28934732/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1311300 CPUtime=0.29 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 43333 0 0 0 24 5 0 0 20 0 4 0 25876852 1342771200 43631 33554432000 4194304 16246674 140735339885920 140735339868912 12653056 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 327825 43631 831 2943 0 324719 0
[pid=15847/tid=15848] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 43631 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 43631 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 43631 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1311300

[startup+0.700407 s]
/proc/loadavg: 2.32 2.23 2.11 3/179 15847
/proc/meminfo: memFree=28934732/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1311300 CPUtime=0.69 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 130829 0 0 0 51 18 0 0 20 0 4 0 25876852 1342771200 131128 33554432000 4194304 16246674 140735339885920 140735339868912 12449399 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 327825 131142 831 2943 0 324719 0
[pid=15847/tid=15848] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 131152 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 131161 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1342771200 131169 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1311300

[startup+1.5004 s]
/proc/loadavg: 2.32 2.23 2.11 3/183 15851
/proc/meminfo: memFree=28028336/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1360452 CPUtime=1.48 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 280553 0 0 0 113 35 0 0 20 0 4 0 25876852 1393102848 280851 33554432000 4194304 16246674 140735339885920 140735339867840 12429162 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 340113 280851 832 2943 0 337007 0
[pid=15847/tid=15848] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 280851 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 280851 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 280851 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1360452

[startup+3.10042 s]
/proc/loadavg: 2.32 2.23 2.11 3/183 15851
/proc/meminfo: memFree=27810948/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1360452 CPUtime=3.08 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 280729 0 0 0 273 35 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 140735339885232 12429241 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 340113 281027 832 2943 0 337007 0
[pid=15847/tid=15848] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 1360452

[startup+6.30043 s]
/proc/loadavg: 2.29 2.23 2.11 3/183 15851
/proc/meminfo: memFree=27800436/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1360452 CPUtime=6.28 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 280729 0 0 0 593 35 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 140735339867840 12429162 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 340113 281027 832 2943 0 337007 0
[pid=15847/tid=15848] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1360452

[startup+12.7004 s]
/proc/loadavg: 2.27 2.23 2.11 3/183 15851
/proc/meminfo: memFree=27785728/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=1360452 CPUtime=12.68 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 280729 0 0 0 1233 35 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 140735339867840 12371164 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 340113 281027 832 2943 0 337007 0
[pid=15847/tid=15848] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=1360452 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 1393102848 281027 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1360452

[startup+25.5005 s]
/proc/loadavg: 2.21 2.21 2.11 3/183 15851
/proc/meminfo: memFree=26879148/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=2240068 CPUtime=25.48 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 500641 0 0 0 2482 66 0 0 20 0 4 0 25876852 2293829632 500939 33554432000 4194304 16246674 140735339885920 140735339885016 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 560017 500939 835 2943 0 556911 0
[pid=15847/tid=15848] ppid=15844 vsize=2240068 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 2293829632 500939 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=2240068 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 2293829632 500939 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=2240068 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 2293829632 500939 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 2240068

[startup+51.1005 s]
/proc/loadavg: 2.14 2.20 2.10 3/183 15851
/proc/meminfo: memFree=21326520/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=8094276 CPUtime=51.08 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 1964031 0 0 0 4846 262 0 0 20 0 4 0 25876852 8288538624 1964329 33554432000 4194304 16246674 140735339885920 140735339884584 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 2023569 1964337 835 2943 0 2020463 0
[pid=15847/tid=15848] ppid=15844 vsize=8094276 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 8288538624 1964342 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=8094276 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 8288538624 1964347 33554432000 4194304 16246674 140735339885920 139992817966096 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=8094276 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 8288538624 1964351 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 8094276

[startup+102.301 s]
/proc/loadavg: 2.10 2.18 2.10 3/183 15853
/proc/meminfo: memFree=16749068/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=12230212 CPUtime=102.28 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 2953217 0 0 0 9829 399 0 0 20 0 4 0 25876852 12523737088 2998483 33554432000 4194304 16246674 140735339885920 140735339883840 14013662 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 3057553 2998483 840 2943 0 3054447 0
[pid=15847/tid=15848] ppid=15844 vsize=12230212 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 12523737088 2998483 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=12230212 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 12523737088 2998483 33554432000 4194304 16246674 140735339885920 139992817966096 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=12230212 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 12523737088 2998483 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 12230212

[startup+162.3 s]
/proc/loadavg: 2.12 2.16 2.09 3/183 15854
/proc/meminfo: memFree=14079656/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=14772804 CPUtime=162.27 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 3533984 0 0 0 15741 486 0 0 20 0 4 0 25876852 15127351296 3633927 33554432000 4194304 16246674 140735339885920 140735339883904 13899722 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 3693201 3633927 840 2943 0 3690095 0
[pid=15847/tid=15848] ppid=15844 vsize=14772804 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 15127351296 3633927 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=14772804 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 15127351296 3633927 33554432000 4194304 16246674 140735339885920 139992817966096 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=14772804 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 15127351296 3633927 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 14772804



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+205.6 s]
/proc/loadavg: 2.16 2.17 2.10 3/183 15855
/proc/meminfo: memFree=13317468/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=15892036 CPUtime=205.55 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) R 15844 15847 11324 0 -1 4202496 3813818 0 0 0 20034 521 0 0 20 0 4 0 25876852 16273444864 3913761 33554432000 4194304 16246674 140735339885920 140735339885016 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 3973009 3913761 840 2943 0 3969903 0
[pid=15847/tid=15848] ppid=15844 vsize=15892036 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15848/stat : 15848 (toysat) S 15844 15847 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25876852 16273444864 3913761 33554432000 4194304 16246674 140735339885920 139992828456176 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=15892036 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) S 15844 15847 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25876852 16273444864 3913761 33554432000 4194304 16246674 140735339885920 139992817966320 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15847/tid=15850] ppid=15844 vsize=15892036 CPUtime=0 cores=1,3,5,7
/proc/15847/task/15850/stat : 15850 (toysat) S 15844 15847 11324 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25876852 16273444864 3913761 33554432000 4194304 16246674 140735339885920 139992807492784 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 205.55
Current children cumulated vsize (KiB) 15892036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15847 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+206 s]
/proc/loadavg: 2.16 2.17 2.10 3/181 15855
/proc/meminfo: memFree=14717368/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=0 CPUtime=205.96 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) Z 15844 15847 11324 0 -1 4203532 3814316 0 0 0 20035 561 0 0 20 0 2 0 25876852 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 0 0 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=0 CPUtime=0.38 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) R 15844 15847 11324 0 -1 4203588 8 0 0 0 0 38 0 0 20 0 2 0 25876852 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 205.96
Current children cumulated vsize (KiB) 0

[startup+206.4 s]
/proc/loadavg: 2.16 2.17 2.10 3/181 15855
/proc/meminfo: memFree=14717368/32872528 swapFree=249320/249320
[pid=15847] ppid=15844 vsize=0 CPUtime=206.36 cores=1,3,5,7
/proc/15847/stat : 15847 (toysat) Z 15844 15847 11324 0 -1 4203532 3814316 0 0 0 20035 601 0 0 20 0 2 0 25876852 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15847/statm: 0 0 0 0 0 0 0
[pid=15847/tid=15849] ppid=15844 vsize=0 CPUtime=0.78 cores=1,3,5,7
/proc/15847/task/15849/stat : 15849 (toysat) R 15844 15847 11324 0 -1 4203588 8 0 0 0 0 78 0 0 20 0 2 0 25876852 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 206.36
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 206.422
CPU time (s): 206.383
CPU user time (s): 200.355
CPU system time (s): 6.02808
CPU usage (%): 99.9807
Max. virtual memory (cumulated for all children) (KiB): 15892036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 200.355
system time used= 6.02808
maximum resident set size= 15657036
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3814316
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 64
involuntary context switches= 231

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.564914 second user time and 0.778881 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 10:24:24
IDJOB=4103633
IDBENCH=2414
IDSOLVER=2542
FILE ID=node103/4103633-1466238264
RUNJOBID= node103-1466206104-11341
PBS_JOBID= 19918169
Free space on /tmp= 71712 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-grow15.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103633-1466238264/watcher-4103633-1466238264 -o /tmp/evaluation-result-4103633-1466238264/solver-4103633-1466238264 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103633-1466238264.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b4d90975042873aa16a95872bfad2ca2
RANDOM SEED=61941161

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28935896 kB
Buffers:          128488 kB
Cached:           134264 kB
SwapCached:         2188 kB
Active:          2773888 kB
Inactive:         172520 kB
Active(anon):    2681980 kB
Inactive(anon):     3672 kB
Active(file):      91908 kB
Inactive(file):   168848 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             17876 kB
Writeback:             0 kB
AnonPages:       2933876 kB
Mapped:            10712 kB
Shmem:                 0 kB
Slab:             602492 kB
SReclaimable:      46548 kB
SUnreclaim:       555944 kB
KernelStack:        1504 kB
PageTables:         9880 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3076692 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    878592 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71696 MiB
End job on node103 at 2016-06-18 10:27:51