Trace number 4103761

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 191.884 191.92

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-adlittle.opb
MD5SUM952cd1c498d347dda37d376c7740481e
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables2910
Total number of constraints56
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints56
Minimum length of a constraint30
Maximum length of a constraint810
Number of terms in the objective function 2460
Biggest coefficient in the objective function 88852135936000
Number of bits for the biggest coefficient in the objective function 47
Sum of the numbers in the objective function 3689448844530141
Number of bits of the sum of numbers in the objective function 52
Biggest number in a constraint 359703511040000
Number of bits of the biggest number in a constraint 49
Biggest sum of numbers in a constraint 6054438712178314
Number of bits of the biggest sum of numbers53
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:36:20+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103761-1466238980.opb"]
0.00/0.01	c use --random-gen="4102298880 2505043741 1296781782 944416584 1936784183 1277402556 1643345829 1255831519 3658502646 3853685690 1698043103 983913389 3908450398 407929492 3459615189 2724651541 1769549768 347011985 2243731393 1584534076 158105968 3354303916 2212496543 22799376 1560270895 1020726387 350104621 3914038977 3816955679 3311236708 465228073 3394613721 1466155121 1479399510 3015068367 1544914863 1063575996 405851164 3812897652 2579266750 3178331068 1694666563 2460932438 1980720228 3810076539 3112759740 640394640 696612405 3194092032 1763454492 2795858358 660628256 2469204367 3500093710 1114026210 2519001168 3071818612 3846688119 2476527703 1432832597 1162341341 2368398898 1242708225 860048168 755188422 3091187558 855671056 958033067 1332153177 313768053 4136411362 1864616907 9134122 1223010663 1811298075 79919822 1498342551 1343844430 645136043 2714365384 2702224721 1111851363 2441501368 3746080274 3267903172 3268835584 2361763899 3451598739 207503762 2827348117 515604879 48264117 3821743728 3028481467 2523201595 4229840340 3214221071 1848801951 4187110586 1208596041 1438726244 3594502133 4100313725 2732518385 3021951677 2658480246 4264009738 260352258 3970170079 2592741979 693783135 3932822572 4104588608 3561168130 4208513249 543819462 3260317516 2457973753 2069652677 1660880293 673063438 987341806 1065341005 2316303586 1053109540 2997456017 3615571676 2155448068 3981335962 1710419005 4062100617 2012719434 1466059461 1717695649 1138405980 2484774675 3967189755 3804129161 1664287056 740735368 3117225457 2550390194 1872687173 2300424914 3307161084 2219483821 3155369717 4274426113 1486574515 2332660510 3382871587 861883403 396919415 2707069081 3318860703 4030749864 3262908519 1521803706 963815411 2093111882 2571083098 4114885611 3223768549 747160892 3471887696 2009340231 4222242584 1301444705 5794926 2393682523 2207807473 3659660865 10665916 1408408816 4027915795 2959846657 2003453724 2941216973 2301945963 3687053402 3143687516 1963449651 1835899835 3387517960 2752299034 1636632754 316150450 1524992725 3647625792 3966089734 1000311280 2203539083 3945336632 225792516 3058997853 587364378 2794079626 1021336274 1446386357 2419777208 1891418794 4231462302 4223203158 504312041 2335919742 4284004637 3773412045 1739276359 2169618610 886243820 2092286659 2586477922 141899578 1725013001 3897890268 768110288 2855558322 262021136 1524691922 121573725 2876573679 472706107 2986819836 2933533041 622350567 3392048125 2765663369 2459799835 3565207754 1532335415 1282530673 1223938905 3319621856 3636383118 3733941206 2695663299 3676235583 4166946642 3131182658 412061274 2455539493 573198481 3480944472 1774841722 3752055950 745504056 1470114914 287014074 2135764464 2113954775 37390780 476862021 2930531842 3265292939 371822412 2590915273 255 362436" option to reproduce the execution
0.00/0.04	c #vars 2910
0.00/0.04	c #constraints 56

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103761-1466238980/watcher-4103761-1466238980 -o /tmp/evaluation-result-4103761-1466238980/solver-4103761-1466238980 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node116-1466206094-15196 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103761-1466238980.opb 

pid=19669
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.05 2.23 2.20 3/179 19672
/proc/meminfo: memFree=18312076/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=696900 CPUtime=0 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 2598 0 0 0 0 0 0 0 20 0 4 0 25946714 713625600 2958 33554432000 4194304 16246674 140733687815760 140733687815184 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 174993 2967 442 2943 0 171887 0
[pid=19672/tid=19673] ppid=19669 vsize=715332 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 732499968 3030 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=719428 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 736694272 3046 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=724548 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25946714 741937152 3063 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100168 s]
/proc/loadavg: 2.05 2.23 2.20 3/179 19672
/proc/meminfo: memFree=18312076/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=1220164 CPUtime=0.09 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 27130 0 0 0 6 3 0 0 20 0 4 0 25946714 1249447936 27429 33554432000 4194304 16246674 140733687815760 140733687815072 12429797 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 305041 27434 822 2943 0 301935 0
[pid=19672/tid=19673] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 27437 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 27441 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 27445 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1220164

[startup+0.200557 s]
/proc/loadavg: 2.05 2.23 2.20 3/179 19672
/proc/meminfo: memFree=18312076/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=1220164 CPUtime=0.19 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 52598 0 0 0 13 6 0 0 20 0 4 0 25946714 1249447936 52896 33554432000 4194304 16246674 140733687815760 140733687815072 12371341 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 305041 52906 822 2943 0 301935 0
[pid=19672/tid=19673] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 52913 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 52919 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 52926 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1220164

[startup+0.300512 s]
/proc/loadavg: 2.05 2.23 2.20 3/179 19672
/proc/meminfo: memFree=18312076/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=1220164 CPUtime=0.29 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 75948 0 0 0 20 9 0 0 20 0 4 0 25946714 1249447936 76246 33554432000 4194304 16246674 140733687815760 140733687815072 12657222 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 305041 76252 822 2943 0 301935 0
[pid=19672/tid=19673] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 76255 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 76259 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 76263 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1220164

[startup+0.700312 s]
/proc/loadavg: 2.05 2.23 2.20 3/179 19672
/proc/meminfo: memFree=18312076/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=1220164 CPUtime=0.69 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 173642 0 0 0 49 20 0 0 20 0 4 0 25946714 1249447936 173940 33554432000 4194304 16246674 140733687815760 140733687797632 12429797 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 305041 173946 834 2943 0 301935 0
[pid=19672/tid=19673] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 173950 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 173953 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 1249447936 173957 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1220164

[startup+1.50041 s]
/proc/loadavg: 2.05 2.23 2.20 3/183 19676
/proc/meminfo: memFree=17276488/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=1312324 CPUtime=1.49 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 269047 0 0 0 116 33 0 0 20 0 4 0 25946714 1343819776 269345 33554432000 4194304 16246674 140733687815760 140733687815072 12652957 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 328081 269345 836 2943 0 324975 0
[pid=19672/tid=19673] ppid=19669 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 1343819776 269345 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 1343819776 269345 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 1343819776 269345 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1312324

[startup+3.10041 s]
/proc/loadavg: 2.05 2.23 2.20 3/183 19676
/proc/meminfo: memFree=17094456/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=1484356 CPUtime=3.09 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 312223 0 0 0 271 38 0 0 20 0 4 0 25946714 1519980544 312521 33554432000 4194304 16246674 140733687815760 140733687815072 4220936 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 371089 312521 836 2943 0 367983 0
[pid=19672/tid=19673] ppid=19669 vsize=1484356 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 1519980544 312521 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=1484356 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 1519980544 312521 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=1484356 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 1519980544 312521 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1484356

[startup+6.30037 s]
/proc/loadavg: 2.21 2.26 2.21 4/183 19676
/proc/meminfo: memFree=16877580/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=1669700 CPUtime=6.29 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 358559 0 0 0 585 44 0 0 20 0 4 0 25946714 1709772800 358857 33554432000 4194304 16246674 140733687815760 140733687813568 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 417425 358857 836 2943 0 414319 0
[pid=19672/tid=19673] ppid=19669 vsize=1669700 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 1709772800 358857 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=1669700 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 1709772800 358857 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=1669700 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 1709772800 358857 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1669700

[startup+12.7004 s]
/proc/loadavg: 2.19 2.25 2.21 3/183 19676
/proc/meminfo: memFree=15998952/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=2545220 CPUtime=12.68 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 577439 0 0 0 1196 72 0 0 20 0 4 0 25946714 2606305280 577737 33554432000 4194304 16246674 140733687815760 140733687814936 4206568 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 636305 577737 836 2943 0 633199 0
[pid=19672/tid=19673] ppid=19669 vsize=2545220 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 2606305280 577737 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=2545220 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 2606305280 577737 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=2545220 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 2606305280 577737 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 2545220

[startup+25.5005 s]
/proc/loadavg: 2.30 2.27 2.22 3/183 19676
/proc/meminfo: memFree=16586004/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=4948548 CPUtime=25.49 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 1178273 0 0 0 2397 152 0 0 20 0 4 0 25946714 5067313152 1178571 33554432000 4194304 16246674 140733687815760 140733687815072 4220871 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 1237137 1178571 836 2943 0 1234031 0
[pid=19672/tid=19673] ppid=19669 vsize=4948548 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 5067313152 1178571 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=4948548 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 5067313152 1178571 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=4948548 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 5067313152 1178571 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 4948548

[startup+51.1005 s]
/proc/loadavg: 2.28 2.27 2.21 4/183 19676
/proc/meminfo: memFree=9460024/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=9073220 CPUtime=51.08 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 2209442 0 0 0 4823 285 0 0 20 0 4 0 25946714 9290977280 2209740 33554432000 4194304 16246674 140733687815760 140733687813632 4206864 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 2268305 2209740 836 2943 0 2265199 0
[pid=19672/tid=19673] ppid=19669 vsize=9073220 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 9290977280 2209740 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=9073220 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 9290977280 2209740 33554432000 4194304 16246674 140733687815760 140114514648080 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=9073220 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 9290977280 2209740 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9073220

[startup+102.3 s]
/proc/loadavg: 2.19 2.24 2.20 4/183 19678
/proc/meminfo: memFree=7977492/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=11010628 CPUtime=102.28 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 2693799 0 0 0 9876 352 0 0 20 0 4 0 25946714 11274883072 2694097 33554432000 4194304 16246674 140733687815760 140733687813632 4220536 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 2752657 2694097 841 2943 0 2749551 0
[pid=19672/tid=19673] ppid=19669 vsize=11010628 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 11274883072 2694097 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=11010628 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 11274883072 2694097 33554432000 4194304 16246674 140733687815760 140114514648080 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=11010628 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 11274883072 2694097 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 11010628

[startup+162.3 s]
/proc/loadavg: 2.13 2.21 2.19 3/183 19679
/proc/meminfo: memFree=13047612/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=14753348 CPUtime=162.27 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 3574648 0 0 0 15746 481 0 0 20 0 4 0 25946714 15107428352 3629623 33554432000 4194304 16246674 140733687815760 140733687813696 14014083 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 3688337 3629623 841 2943 0 3685231 0
[pid=19672/tid=19673] ppid=19669 vsize=14753348 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 15107428352 3629623 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=14753348 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 15107428352 3629623 33554432000 4194304 16246674 140733687815760 140114514648080 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=14753348 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 15107428352 3629623 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 14753348



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+191 s]
/proc/loadavg: 2.20 2.22 2.19 4/183 19680
/proc/meminfo: memFree=10944320/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=15905348 CPUtime=190.96 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) R 19669 19672 15180 0 -1 4202496 3862621 0 0 0 18569 527 0 0 20 0 4 0 25946714 16287076352 3917596 33554432000 4194304 16246674 140733687815760 140733687814856 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 3976337 3917596 841 2943 0 3973231 0
[pid=19672/tid=19673] ppid=19669 vsize=15905348 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19673/stat : 19673 (toysat) S 19669 19672 15180 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25946714 16287076352 3917596 33554432000 4194304 16246674 140733687815760 140114525138160 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=15905348 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) S 19669 19672 15180 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25946714 16287076352 3917601 33554432000 4194304 16246674 140733687815760 140114514648304 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=19672/tid=19675] ppid=19669 vsize=15905348 CPUtime=0 cores=0,2,4,6
/proc/19672/task/19675/stat : 19675 (toysat) S 19669 19672 15180 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25946714 16287076352 3917608 33554432000 4194304 16246674 140733687815760 140114504174768 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 190.96
Current children cumulated vsize (KiB) 15905348

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 19672 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+191.2 s]
/proc/loadavg: 2.20 2.22 2.19 4/183 19680
/proc/meminfo: memFree=10944320/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=0 CPUtime=191.16 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) Z 19669 19672 15180 0 -1 4203532 3863306 0 0 0 18570 546 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 0 0 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=0 CPUtime=0.18 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) R 19669 19672 15180 0 -1 4203588 8 0 0 0 0 18 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 191.16
Current children cumulated vsize (KiB) 0

[startup+191.6 s]
/proc/loadavg: 2.20 2.22 2.19 4/181 19680
/proc/meminfo: memFree=16824092/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=0 CPUtime=191.56 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) Z 19669 19672 15180 0 -1 4203532 3863306 0 0 0 18570 586 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 0 0 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=0 CPUtime=0.58 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) R 19669 19672 15180 0 -1 4203588 8 0 0 0 0 58 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 191.56
Current children cumulated vsize (KiB) 0

[startup+191.8 s]
/proc/loadavg: 2.20 2.22 2.19 4/181 19680
/proc/meminfo: memFree=16824092/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=0 CPUtime=191.76 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) Z 19669 19672 15180 0 -1 4203532 3863306 0 0 0 18570 606 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 0 0 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=0 CPUtime=0.78 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) R 19669 19672 15180 0 -1 4203588 8 0 0 0 0 78 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 191.76
Current children cumulated vsize (KiB) 0

[startup+191.9 s]
/proc/loadavg: 2.20 2.22 2.19 4/181 19680
/proc/meminfo: memFree=16824092/32872528 swapFree=1431120/1543540
[pid=19672] ppid=19669 vsize=0 CPUtime=191.86 cores=0,2,4,6
/proc/19672/stat : 19672 (toysat) Z 19669 19672 15180 0 -1 4203532 3863306 0 0 0 18570 616 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/19672/statm: 0 0 0 0 0 0 0
[pid=19672/tid=19674] ppid=19669 vsize=0 CPUtime=0.88 cores=0,2,4,6
/proc/19672/task/19674/stat : 19674 (toysat) R 19669 19672 15180 0 -1 4203588 8 0 0 0 0 88 0 0 20 0 2 0 25946714 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 191.86
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 191.92
CPU time (s): 191.884
CPU user time (s): 185.703
CPU system time (s): 6.18106
CPU usage (%): 99.9809
Max. virtual memory (cumulated for all children) (KiB): 15905348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 185.703
system time used= 6.18106
maximum resident set size= 15673124
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3863306
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 64
involuntary context switches= 198

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.21481 second user time and 1.73574 second system time

The end

Launcher Data 

Begin job on node116 at 2016-06-18 10:36:20
IDJOB=4103761
IDBENCH=2454
IDSOLVER=2542
FILE ID=node116/4103761-1466238980
RUNJOBID= node116-1466206094-15196
PBS_JOBID= 19918160
Free space on /tmp= 71712 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-adlittle.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103761-1466238980/watcher-4103761-1466238980 -o /tmp/evaluation-result-4103761-1466238980/solver-4103761-1466238980 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node116-1466206094-15196 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103761-1466238980.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 952cd1c498d347dda37d376c7740481e
RANDOM SEED=1628649859

node116.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.781
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        18313256 kB
Buffers:          119096 kB
Cached:           137148 kB
SwapCached:         2060 kB
Active:         12091240 kB
Inactive:         161632 kB
Active(anon):   11994696 kB
Inactive(anon):     4052 kB
Active(file):      96544 kB
Inactive(file):   157580 kB
Unevictable:     1543540 kB
Mlocked:         1431120 kB
SwapTotal:      67108856 kB
SwapFree:       67099604 kB
Dirty:             16332 kB
Writeback:             0 kB
AnonPages:      13538528 kB
Mapped:            10460 kB
Shmem:                 0 kB
Slab:             604668 kB
SReclaimable:      48792 kB
SUnreclaim:       555876 kB
KernelStack:        1496 kB
PageTables:        30704 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:   13681120 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    114688 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71696 MiB
End job on node116 at 2016-06-18 10:39:32