Trace number 4103329

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.38 1800.71

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/milp/normalized-mps-v2-20-10-dano3_3.opb
MD5SUM1c7fb7925778882f8c8001dcd3838f28
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables404796
Total number of constraints3709
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)3
Number of constraints which are nor clauses,nor cardinality constraints3706
Minimum length of a constraint11
Maximum length of a constraint15900
Number of terms in the objective function 30
Biggest coefficient in the objective function 536870912
Number of bits for the biggest coefficient in the objective function 30
Sum of the numbers in the objective function 1073741823
Number of bits of the sum of numbers in the objective function 30
Biggest number in a constraint 134217728000
Number of bits of the biggest number in a constraint 37
Biggest sum of numbers in a constraint 569083166190
Number of bits of the biggest sum of numbers40
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T09:36:49+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103329-1466235408.opb"]
0.00/0.01	c use --random-gen="1572032119 1988082868 2295375044 1445454419 3530632382 1870818067 2009142635 3235165291 2427349691 113604377 1273220777 931457780 1172491816 1982279723 907448020 30077674 1778821639 3280643999 2768493815 1473594220 1131158115 3571555365 1761620275 1839987197 2695126452 301123284 3178539512 3425785119 4170299176 2631194730 2854284672 930948449 4189244595 4114888439 4233747426 1753743425 1979033334 3570749918 4177786207 3643884051 3432428017 314816640 3014147357 367007358 1895275539 3110904321 3636109627 4291679603 819698996 4293719936 3039074402 3528622705 2746159071 659924153 2224911870 2502023301 3341441472 2141622270 1211240753 1844352921 4251459768 2149941538 1450004391 1489393480 642851423 3924122803 2641113502 3986546146 1649018054 3726209874 820565131 2281627679 4168038586 1722316739 473146663 76041033 3675152434 2068341228 3039079405 3160707667 3940338990 3454857837 2237353814 1644308576 3721144714 3920917049 909831509 663959603 2219401653 2618228334 561808981 1240470450 678500638 2327188481 1410799602 985589301 386933224 3062725705 2197362366 399653099 1606155663 2596501664 3650136376 3246339851 3170290014 501292240 1791005305 4079854760 2882628831 1196935674 2676572038 834080345 3205308038 2275983491 3059348662 2170612158 2800067494 219919283 264336272 1129386184 1845920568 3009706112 2746676937 4066778919 3443731510 3413025081 873390967 1656928979 1994603387 25141290 538679050 873635469 468744036 3354790557 1827665744 2521739084 75570473 3764381215 2645504839 4187044684 1495034690 1913530585 3880249059 3098415876 1138077958 4261011724 998322060 2418850221 1681283087 621375547 379918657 3985372511 1380758085 1155735300 3625367426 2108462589 4072468890 1245482884 1031689500 1351773584 27063012 2356313938 16751950 242806792 2519046903 2902502062 2193232626 2857148940 1880570912 3225858052 1297349012 2063118822 365862097 2188293835 3573001468 1494392208 1068861984 33036025 2339669157 353777209 3367715766 1304306389 2627651063 2730603045 4161568443 2923355377 3403067845 2493984991 1132022836 3579257705 3777122144 2817658774 3340224844 113280740 3930155067 2964551033 3345527988 654489153 367752262 3271071470 1409674614 1954147182 1995240698 3099426589 2252681816 3247686537 1643613298 3029235421 3339488857 60917613 3870377558 2896577202 4157752202 2826791370 2240549607 3978180688 4048873801 4065952770 2609654876 1093135802 1727371072 1536774522 342393942 2765403297 425034728 1505494648 713150204 2554021182 3198486188 1845660911 2430758450 3359946035 3980371325 2867693963 3232047833 2005520339 422056317 976228464 1442473760 1083684531 2876358469 1867010182 3206592314 1052802815 1065357346 2810505388 2839363915 997968394 1473813186 2676521500 3528544380 4105970445 2171541945 4246005132 1112962932 1135827970 255 362436" option to reproduce the execution
4.09/4.16	c #vars 404796
4.09/4.16	c #constraints 3709

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103329-1466235408/watcher-4103329-1466235408 -o /tmp/evaluation-result-4103329-1466235408/solver-4103329-1466235408 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node136-1466206055-16206 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103329-1466235408.opb 

pid=21260
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.37 2.34 2.28 4/179 21263
/proc/meminfo: memFree=29068048/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=585148 CPUtime=0 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 2154 0 0 0 0 0 0 0 20 0 4 0 25586442 599191552 3026 33554432000 4194304 16246674 140734988795664 140734988795088 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 146799 3036 441 2943 0 143693 0
[pid=21263/tid=21264] ppid=21260 vsize=602556 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 617017344 3097 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=606652 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25586442 621211648 3113 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=611772 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 626454528 3130 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.10018 s]
/proc/loadavg: 2.37 2.34 2.28 4/179 21263
/proc/meminfo: memFree=29068048/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1303108 CPUtime=0.09 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 29517 0 0 0 5 4 0 0 20 0 4 0 25586442 1334382592 30327 33554432000 4194304 16246674 140734988795664 140734988794976 8058197 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 325777 30343 801 2943 0 322671 0
[pid=21263/tid=21264] ppid=21260 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1334382592 30354 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25586442 1334382592 30366 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1334382592 30376 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200545 s]
/proc/loadavg: 2.37 2.34 2.28 4/179 21263
/proc/meminfo: memFree=29068048/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1311300 CPUtime=0.19 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 44384 0 0 0 12 7 0 0 20 0 4 0 25586442 1342771200 45704 33554432000 4194304 16246674 140734988795664 140734988794976 4220936 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 327825 45704 801 2943 0 324719 0
[pid=21263/tid=21264] ppid=21260 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1342771200 45704 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25586442 1342771200 45704 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1342771200 45704 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300493 s]
/proc/loadavg: 2.37 2.34 2.28 4/179 21263
/proc/meminfo: memFree=29068048/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1311300 CPUtime=0.29 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 45865 0 0 0 22 7 0 0 20 0 4 0 25586442 1342771200 47185 33554432000 4194304 16246674 140734988795664 140734988778656 4220520 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 327825 47185 801 2943 0 324719 0
[pid=21263/tid=21264] ppid=21260 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1342771200 47185 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25586442 1342771200 47185 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1342771200 47185 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1311300

[startup+0.700385 s]
/proc/loadavg: 2.37 2.34 2.28 4/179 21263
/proc/meminfo: memFree=29068048/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1312324 CPUtime=0.69 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 51645 0 0 0 61 8 0 0 20 0 4 0 25586442 1343819776 52965 33554432000 4194304 16246674 140734988795664 140734988778656 8055506 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 328081 52965 802 2943 0 324975 0
[pid=21263/tid=21264] ppid=21260 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1343819776 52965 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25586442 1343819776 52965 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1343819776 52965 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1312324

[startup+1.50042 s]
/proc/loadavg: 2.37 2.34 2.28 3/183 21267
/proc/meminfo: memFree=28797388/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1324612 CPUtime=1.49 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 87555 0 0 0 136 13 0 0 20 0 4 0 25586442 1356402688 91430 33554432000 4194304 16246674 140734988795664 140734988778656 4220504 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 331153 91430 802 2943 0 328047 0
[pid=21263/tid=21264] ppid=21260 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1356402688 91430 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25586442 1356402688 91430 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1356402688 91430 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1324612

[startup+3.10051 s]
/proc/loadavg: 2.58 2.39 2.30 3/183 21267
/proc/meminfo: memFree=28520068/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1349188 CPUtime=3.09 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 128813 0 0 0 290 19 0 0 20 0 4 0 25586442 1381568512 138309 33554432000 4194304 16246674 140734988795664 140734988778656 8058611 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 337297 138309 802 2943 0 334191 0
[pid=21263/tid=21264] ppid=21260 vsize=1349188 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1381568512 138309 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1349188 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25586442 1381568512 138309 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1349188 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1381568512 138309 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1349188

[startup+6.30043 s]
/proc/loadavg: 2.58 2.39 2.30 3/183 21267
/proc/meminfo: memFree=27991172/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1499716 CPUtime=6.29 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 247639 0 0 0 593 36 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 140734988777536 13950232 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/21263/statm: 374929 269399 836 2943 0 371823 0
[pid=21263/tid=21264] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1499716

[startup+12.7005 s]
/proc/loadavg: 2.49 2.38 2.29 3/183 21267
/proc/meminfo: memFree=27991320/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1499716 CPUtime=12.69 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 247639 0 0 0 1233 36 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 140734988777536 12414147 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 374929 269399 836 2943 0 371823 0
[pid=21263/tid=21264] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 269399 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1499716

[startup+25.5004 s]
/proc/loadavg: 2.57 2.40 2.30 4/183 21267
/proc/meminfo: memFree=27991708/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=1499716 CPUtime=25.48 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 248550 0 0 0 2512 36 0 0 20 0 4 0 25586442 1535709184 270310 33554432000 4194304 16246674 140734988795664 140734988777536 4220871 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 374929 270310 837 2943 0 371823 0
[pid=21263/tid=21264] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 270310 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 270310 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=1499716 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 1535709184 270310 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1499716

[startup+51.1074 s]
/proc/loadavg: 2.50 2.39 2.30 3/183 21267
/proc/meminfo: memFree=22921212/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=6368836 CPUtime=51.08 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 1512393 0 0 0 4903 205 0 0 20 0 4 0 25586442 6521688064 1534153 33554432000 4194304 16246674 140734988795664 140734988794840 4225056 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 1592209 1534153 838 2943 0 1589103 0
[pid=21263/tid=21264] ppid=21260 vsize=6368836 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 6521688064 1534153 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=6368836 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 6521688064 1534153 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=6368836 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 6521688064 1534153 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 6368836

[startup+102.3 s]
/proc/loadavg: 2.33 2.36 2.29 3/183 21268
/proc/meminfo: memFree=15582456/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=13693508 CPUtime=102.26 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 3343565 0 0 0 9778 448 0 0 20 0 4 0 25586442 14022152192 3365325 33554432000 4194304 16246674 140734988795664 140734988793536 4220504 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 3423377 3365325 839 2943 0 3420271 0
[pid=21263/tid=21264] ppid=21260 vsize=13693508 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14022152192 3365325 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=13693508 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14022152192 3365325 33554432000 4194304 16246674 140734988795664 139910453369872 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=13693508 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 14022152192 3365325 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 13693508


################
# More data... #
################

[pid=21263] ppid=21260 vsize=7080516 CPUtime=1362.04 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 23285733 0 0 0 132579 3625 0 0 20 0 4 0 25586442 7250448384 1712100 33554432000 4194304 16246674 140734988795664 140734988793472 4206864 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 1770129 1712100 843 2943 0 1767023 0
[pid=21263/tid=21264] ppid=21260 vsize=7080516 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 7250448384 1712100 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=7080516 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 7250448384 1712100 33554432000 4194304 16246674 140734988795664 139910453369872 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=7080516 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 7250448384 1712100 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.04
Current children cumulated vsize (KiB) 7080516

[startup+1422.3 s]
/proc/loadavg: 2.21 2.24 2.23 3/184 21304
/proc/meminfo: memFree=15823936/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=13142596 CPUtime=1422.03 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 24801255 0 0 0 138377 3826 0 0 20 0 4 0 25586442 13458018304 3227622 33554432000 4194304 16246674 140734988795664 140734988794760 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 3285649 3227622 843 2943 0 3282543 0
[pid=21263/tid=21264] ppid=21260 vsize=13142596 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 13458018304 3227622 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=13142596 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 13458018304 3227622 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=13142596 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 13458018304 3227622 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 13142596

[startup+1482.3 s]
/proc/loadavg: 2.35 2.27 2.24 3/184 21328
/proc/meminfo: memFree=14794216/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=14169668 CPUtime=1482.02 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 25005390 0 0 0 144341 3861 0 0 20 0 4 0 25586442 14509740032 3484390 33554432000 4194304 16246674 140734988795664 140734988793600 14013533 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 3542417 3484390 843 2943 0 3539311 0
[pid=21263/tid=21264] ppid=21260 vsize=14169668 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14509740032 3484390 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=14169668 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14509740032 3484390 33554432000 4194304 16246674 140734988795664 139910453369872 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=14169668 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 14509740032 3484390 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 14169668

[startup+1542.3 s]
/proc/loadavg: 2.26 2.25 2.23 3/183 21329
/proc/meminfo: memFree=13932704/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=14966340 CPUtime=1542.01 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 26251855 0 0 0 150148 4053 0 0 20 0 4 0 25586442 15325532160 3683559 33554432000 4194304 16246674 140734988795664 140734988793600 14006617 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 3741585 3683559 843 2943 0 3738479 0
[pid=21263/tid=21264] ppid=21260 vsize=14966340 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 15325532160 3683559 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=14966340 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 15325532160 3683559 33554432000 4194304 16246674 140734988795664 139910453369872 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=14966340 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 15325532160 3683559 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.01
Current children cumulated vsize (KiB) 14966340

[startup+1602.3 s]
/proc/loadavg: 2.18 2.23 2.22 3/183 21330
/proc/meminfo: memFree=19971600/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=8939076 CPUtime=1602 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 26484048 0 0 0 156070 4130 0 0 20 0 4 0 25586442 9153613824 2176744 33554432000 4194304 16246674 140734988795664 140734988794840 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 2234769 2176744 843 2943 0 2231663 0
[pid=21263/tid=21264] ppid=21260 vsize=8939076 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 9153613824 2176744 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=8939076 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 9153613824 2176744 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=8939076 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 9153613824 2176744 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 8939076

[startup+1662.3 s]
/proc/loadavg: 2.33 2.26 2.23 3/183 21381
/proc/meminfo: memFree=13649432/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=14310980 CPUtime=1661.99 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 27827025 0 0 0 161889 4310 0 0 20 0 4 0 25586442 14654443520 3519721 33554432000 4194304 16246674 140734988795664 140734988794840 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 3577745 3519721 843 2943 0 3574639 0
[pid=21263/tid=21264] ppid=21260 vsize=14310980 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14654443520 3519721 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=14310980 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14654443520 3519721 33554432000 4194304 16246674 140734988795664 139910453370096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=14310980 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 14654443520 3519721 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 14310980

[startup+1722.3 s]
/proc/loadavg: 2.21 2.24 2.23 3/183 21382
/proc/meminfo: memFree=16660984/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=11294276 CPUtime=1721.98 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 29022803 0 0 0 167687 4511 0 0 20 0 4 0 25586442 11565338624 2765546 33554432000 4194304 16246674 140734988795664 140734988793536 4220990 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 2823569 2765546 843 2943 0 2820463 0
[pid=21263/tid=21264] ppid=21260 vsize=11294276 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 11565338624 2765546 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=11294276 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 11565338624 2765546 33554432000 4194304 16246674 140734988795664 139910453369872 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=11294276 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 11565338624 2765546 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1721.98
Current children cumulated vsize (KiB) 11294276

[startup+1782.3 s]
/proc/loadavg: 2.22 2.24 2.23 3/183 21383
/proc/meminfo: memFree=14594304/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=14181956 CPUtime=1781.98 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 29692065 0 0 0 173591 4607 0 0 20 0 4 0 25586442 14522322944 3487441 33554432000 4194304 16246674 140734988795664 140734988793600 14013599 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 3545489 3487441 843 2943 0 3542383 0
[pid=21263/tid=21264] ppid=21260 vsize=14181956 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14522322944 3487441 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=14181956 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 14522322944 3487441 33554432000 4194304 16246674 140734988795664 139910453369872 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=14181956 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 14522322944 3487441 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1781.98
Current children cumulated vsize (KiB) 14181956



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.30 2.26 2.23 3/183 21383
/proc/meminfo: memFree=22605144/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=6184516 CPUtime=1800.07 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) R 21260 21263 16189 0 -1 4202496 29821372 0 0 0 175336 4671 0 0 20 0 4 0 25586442 6332944384 1488107 33554432000 4194304 16246674 140734988795664 140734988793472 4206534 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 1546129 1488107 843 2943 0 1543023 0
[pid=21263/tid=21264] ppid=21260 vsize=6184516 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 6332944384 1488107 33554432000 4194304 16246674 140734988795664 139910463859952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=21263/tid=21265] ppid=21260 vsize=6184516 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21265/stat : 21265 (toysat) S 21260 21263 16189 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25586442 6332944384 1488107 33554432000 4194304 16246674 140734988795664 139910453369872 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=21263/tid=21266] ppid=21260 vsize=6184516 CPUtime=0 cores=1,3,5,7
/proc/21263/task/21266/stat : 21266 (toysat) S 21260 21263 16189 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25586442 6332944384 1488107 33554432000 4194304 16246674 140734988795664 139910371601584 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 6184516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 21263 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.30 2.26 2.23 3/183 21383
/proc/meminfo: memFree=22605144/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=0 CPUtime=1800.26 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) Z 21260 21263 16189 0 -1 4203532 29821372 0 0 0 175336 4690 0 0 20 0 2 0 25586442 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 0 0 0 0 0 0 0
[pid=21263/tid=21264] ppid=21260 vsize=0 CPUtime=0.18 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) R 21260 21263 16189 0 -1 4203588 9 0 0 0 0 18 0 0 20 0 2 0 25586442 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800.26
Current children cumulated vsize (KiB) 0

[startup+1800.7 s]
/proc/loadavg: 2.30 2.26 2.23 3/183 21383
/proc/meminfo: memFree=22605144/32872528 swapFree=1459628/1655852
[pid=21263] ppid=21260 vsize=0 CPUtime=1800.36 cores=1,3,5,7
/proc/21263/stat : 21263 (toysat) Z 21260 21263 16189 0 -1 4203532 29821372 0 0 0 175336 4700 0 0 20 0 2 0 25586442 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/21263/statm: 0 0 0 0 0 0 0
[pid=21263/tid=21264] ppid=21260 vsize=0 CPUtime=0.28 cores=1,3,5,7
/proc/21263/task/21264/stat : 21264 (toysat) R 21260 21263 16189 0 -1 4203588 9 0 0 0 0 28 0 0 20 0 2 0 25586442 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1800.36
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.71
CPU time (s): 1800.38
CPU user time (s): 1753.37
CPU system time (s): 47.0109
CPU usage (%): 99.9814
Max. virtual memory (cumulated for all children) (KiB): 14966340

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1753.37
system time used= 47.0109
maximum resident set size= 14734236
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29821372
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 408
involuntary context switches= 1829

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.54931 second user time and 6.93895 second system time

The end

Launcher Data 

Begin job on node136 at 2016-06-18 09:36:49
IDJOB=4103329
IDBENCH=2329
IDSOLVER=2542
FILE ID=node136/4103329-1466235408
RUNJOBID= node136-1466206055-16206
PBS_JOBID= 19918141
Free space on /tmp= 71692 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/milp/normalized-mps-v2-20-10-dano3_3.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103329-1466235408/watcher-4103329-1466235408 -o /tmp/evaluation-result-4103329-1466235408/solver-4103329-1466235408 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node136-1466206055-16206 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103329-1466235408.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1c7fb7925778882f8c8001dcd3838f28
RANDOM SEED=210369790

node136.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29068964 kB
Buffers:          109000 kB
Cached:           197168 kB
SwapCached:            0 kB
Active:          1218700 kB
Inactive:         185204 kB
Active(anon):    1085528 kB
Inactive(anon):    14636 kB
Active(file):     133172 kB
Inactive(file):   170568 kB
Unevictable:     1655852 kB
Mlocked:         1459628 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             48612 kB
Writeback:             0 kB
AnonPages:       2755572 kB
Mapped:            16496 kB
Shmem:               204 kB
Slab:             609668 kB
SReclaimable:      53468 kB
SUnreclaim:       556200 kB
KernelStack:        1464 kB
PageTables:         9524 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2889124 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    200704 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71672 MiB
End job on node136 at 2016-06-18 10:06:50