Trace number 4104005

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.18 1800.55

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/MIPLIB/
miplib2003/normalized-mps-v2-20-10-atlanta-ip.opb
MD5SUM3d255cade6c21db991c934cb96648acb
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark12001901559546
Best CPU time to get the best result obtained on this benchmark1800.65
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 9201231431786
Optimality of the best value was proved NO
Number of variables77286
Total number of constraints23680
Number of constraints which are clauses2311
Number of constraints which are cardinality constraints (but not clauses)862
Number of constraints which are nor clauses,nor cardinality constraints20507
Minimum length of a constraint1
Maximum length of a constraint2790
Number of terms in the objective function 31296
Biggest coefficient in the objective function 1700000000000
Number of bits for the biggest coefficient in the objective function 41
Sum of the numbers in the objective function 81421012358779
Number of bits of the sum of numbers in the objective function 47
Biggest number in a constraint 1700000000000
Number of bits of the biggest number in a constraint 41
Biggest sum of numbers in a constraint 81421012358779
Number of bits of the biggest sum of numbers47
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T11:12:53+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4104005-1466241173.opb"]
0.00/0.01	c use --random-gen="1442085481 3220696819 2730972721 4070098038 2302354747 2881351246 2376313969 3193847032 4054526339 3945890915 3361437209 118862240 1177418116 4281292960 348668052 1323530638 2781319904 76697816 3826282446 1984099548 1639176528 998581363 2936984425 1897960096 1602155258 3823474868 123229690 1951024993 4068525811 2086612991 1316266891 3125092355 566871583 213539068 1261953728 1482560424 1127022189 1617285149 3538316265 2011168533 1373061329 806024238 752320999 247487646 1885513551 473047694 2451988880 2059336555 4192712428 1660570266 1136852976 292800948 2281390171 109014294 2680456141 2068104877 4091621762 1877666127 2983503307 3494347959 1468350524 887513508 3845848722 2968541242 3135096047 3216032145 3243938201 935541984 3346624320 3833638371 1121595268 4200194321 938875214 501803482 3028289117 941326810 3927189455 3556555270 716358568 486128705 3217796285 4085740919 1250962334 3947757137 4278038739 2137936553 24219224 182617531 2753282938 380199353 2800468988 1847590850 4194345031 3671071461 577445057 2864286778 2468576273 4154436972 1238625004 2554853354 3281224314 1401562858 1899112220 3888141740 1200532110 1256947774 1722163278 884828880 3383255600 732037481 980613211 7304647 438144979 3418385889 1290015371 1892398741 1883533427 2243303867 1628148377 1983636030 175306389 2193325424 3578224517 2957904439 2356934298 1628434300 3057087798 25584644 1322365609 2167291018 3214938891 634996123 3361732428 3082242636 1877350546 2859203978 2217085199 2124452510 3517381993 2220832603 477076755 1103681411 3957060256 1926113342 4086448402 2301222843 1166783084 3479199091 2951431816 1118752492 4112843019 2357043576 2723284866 999915222 2273757026 3463726151 1191301355 198799448 3374486123 787439894 4064705617 3210854325 1557660287 3968107656 2278867910 1968368029 368785323 3349962220 3822205639 3493804975 3137924679 3140224217 2407360020 1848079643 3620409597 2594441866 2501734628 637792405 694319252 886746312 1935280708 3237111719 400910395 4045646083 1319217911 3070486824 2825589128 1737928335 714191032 2483788737 3493028842 697423069 4102859175 2528714309 3027534156 277738452 1375383155 2140354129 181003207 2332287841 1538802346 4197167924 1958890514 1386608350 2667412787 2693785171 2369291686 1044414976 491126888 1166332674 858073133 2293886136 3785963460 2961592065 2548670689 3848174739 2359563695 1107190012 176485444 1408797763 2125468677 1922582645 3214463753 594709818 4113456968 2512214634 2457054696 3512811005 3416501804 378698384 3202703171 847624191 2563543379 3894317774 1332922944 3835503215 841927581 1500507919 2873631174 3068555120 395955018 665883394 333913609 1018670780 2459455113 2060014474 4246965924 418347656 683052139 1589620401 1815915646 3155592225 1320606951 2187941498 898637586 1642947861 255 362436" option to reproduce the execution
0.99/1.03	c #vars 77286
0.99/1.03	c #constraints 23680

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4104005-1466241173/watcher-4104005-1466241173 -o /tmp/evaluation-result-4104005-1466241173/solver-4104005-1466241173 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node105-1466229502-20776 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4104005-1466241173.opb 

pid=22164
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.02 2/179 22167
/proc/meminfo: memFree=30483728/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=751036 CPUtime=0 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 2807 0 0 0 0 0 0 0 20 0 4 0 26167243 769060864 3168 33554432000 4194304 16246674 140734107576688 140734107576112 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 188271 3175 441 2943 0 185165 0
[pid=22167/tid=22168] ppid=22164 vsize=768444 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 786886656 3235 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=772540 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 791080960 3252 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=776636 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 795275264 3268 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100167 s]
/proc/loadavg: 2.00 2.00 2.02 2/179 22167
/proc/meminfo: memFree=30483728/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1303108 CPUtime=0.09 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 29938 0 0 0 5 4 0 0 20 0 4 0 26167243 1334382592 30238 33554432000 4194304 16246674 140734107576688 140734107576000 12752373 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 325777 30253 798 2943 0 322671 0
[pid=22167/tid=22168] ppid=22164 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1334382592 30263 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1334382592 30274 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1334382592 30285 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200497 s]
/proc/loadavg: 2.00 2.00 2.02 2/179 22167
/proc/meminfo: memFree=30483728/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1311300 CPUtime=0.19 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 46584 0 0 0 13 6 0 0 20 0 4 0 26167243 1342771200 47394 33554432000 4194304 16246674 140734107576688 140734107576000 4221105 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 327825 47394 801 2943 0 324719 0
[pid=22167/tid=22168] ppid=22164 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1342771200 47394 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1342771200 47395 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1342771200 47395 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300467 s]
/proc/loadavg: 2.00 2.00 2.02 2/179 22167
/proc/meminfo: memFree=30483728/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1311300 CPUtime=0.28 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 46951 0 0 0 22 6 0 0 20 0 4 0 26167243 1342771200 47761 33554432000 4194304 16246674 140734107576688 140734107559680 14073329 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 327825 47761 801 2943 0 324719 0
[pid=22167/tid=22168] ppid=22164 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1342771200 47761 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1342771200 47761 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1342771200 47761 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 1311300

[startup+0.700407 s]
/proc/loadavg: 2.00 2.00 2.02 2/179 22167
/proc/meminfo: memFree=30483728/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1312324 CPUtime=0.68 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 55915 0 0 0 61 7 0 0 20 0 4 0 26167243 1343819776 56725 33554432000 4194304 16246674 140734107576688 140734107559680 4220880 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 328081 56725 802 2943 0 324975 0
[pid=22167/tid=22168] ppid=22164 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1343819776 56725 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1343819776 56725 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1343819776 56725 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 1312324

[startup+1.50039 s]
/proc/loadavg: 2.00 2.00 2.02 3/183 22171
/proc/meminfo: memFree=30211140/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1343044 CPUtime=1.49 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 159773 0 0 0 129 20 0 0 20 0 4 0 26167243 1375277056 160584 33554432000 4194304 16246674 140734107576688 140734107558592 12371445 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 335761 160602 844 2943 0 332655 0
[pid=22167/tid=22168] ppid=22164 vsize=1343044 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1375277056 160613 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1343044 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1375277056 160625 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1343044 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1375277056 160635 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1343044

[startup+3.1004 s]
/proc/loadavg: 2.00 2.00 2.02 3/183 22171
/proc/meminfo: memFree=29375380/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1343044 CPUtime=3.09 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 276386 0 0 0 275 34 0 0 20 0 4 0 26167243 1375277056 277196 33554432000 4194304 16246674 140734107576688 140734107576000 12653060 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 335761 277196 844 2943 0 332655 0
[pid=22167/tid=22168] ppid=22164 vsize=1343044 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1375277056 277196 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1343044 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1375277056 277196 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1343044 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1375277056 277196 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1343044

[startup+6.30041 s]
/proc/loadavg: 2.00 2.00 2.02 3/183 22171
/proc/meminfo: memFree=29300792/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1416772 CPUtime=6.29 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 294819 0 0 0 593 36 0 0 20 0 4 0 26167243 1450774528 295629 33554432000 4194304 16246674 140734107576688 140734107558592 12449269 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 354193 295629 844 2943 0 351087 0
[pid=22167/tid=22168] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295629 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295629 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295629 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1416772

[startup+12.7004 s]
/proc/loadavg: 2.08 2.02 2.02 3/183 22171
/proc/meminfo: memFree=29150424/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1416772 CPUtime=12.69 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 294820 0 0 0 1233 36 0 0 20 0 4 0 26167243 1450774528 295630 33554432000 4194304 16246674 140734107576688 140734107558592 12652957 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 354193 295630 845 2943 0 351087 0
[pid=22167/tid=22168] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295630 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295630 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295630 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1416772

[startup+25.5005 s]
/proc/loadavg: 2.06 2.02 2.02 3/183 22171
/proc/meminfo: memFree=29149888/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1416772 CPUtime=25.49 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 294822 0 0 0 2513 36 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140734107558592 12371280 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 354193 295632 846 2943 0 351087 0
[pid=22167/tid=22168] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1416772

[startup+51.1005 s]
/proc/loadavg: 2.04 2.02 2.02 3/183 22171
/proc/meminfo: memFree=29150236/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1416772 CPUtime=51.08 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 294822 0 0 0 5072 36 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140734107558592 13950230 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 354193 295632 846 2943 0 351087 0
[pid=22167/tid=22168] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1416772 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1450774528 295632 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1416772

[startup+102.3 s]
/proc/loadavg: 2.09 2.03 2.02 3/183 22172
/proc/meminfo: memFree=29111652/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=1454660 CPUtime=102.28 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 304294 0 0 0 10191 37 0 0 20 0 4 0 26167243 1489571840 305104 33554432000 4194304 16246674 140734107576688 140734107574528 4225100 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 363665 305104 846 2943 0 360559 0
[pid=22167/tid=22168] ppid=22164 vsize=1454660 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 1489571840 305104 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=1454660 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 1489571840 305104 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=1454660 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 1489571840 305104 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1454660


################
# More data... #
################

/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 3152613376 711392 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=3078724 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 3152613376 711392 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=3078724 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 3152613376 711392 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1302.04
Current children cumulated vsize (KiB) 3078724

[startup+1362.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/183 22447
/proc/meminfo: memFree=15588744/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=3112516 CPUtime=1362.02 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 6086602 0 0 0 135251 951 0 0 20 0 4 0 26167243 3187216384 719841 33554432000 4194304 16246674 140734107576688 140734107574592 4221023 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 778129 719841 853 2943 0 775023 0
[pid=22167/tid=22168] ppid=22164 vsize=3112516 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 3187216384 719841 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=3112516 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 3187216384 719841 33554432000 4194304 16246674 140734107576688 140596671912976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=3112516 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 3187216384 719841 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1362.02
Current children cumulated vsize (KiB) 3112516

[startup+1422.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/183 22448
/proc/meminfo: memFree=22938620/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=2935364 CPUtime=1422.02 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 6086602 0 0 0 141248 954 0 0 20 0 4 0 26167243 3005812736 675553 33554432000 4194304 16246674 140734107576688 140734107575784 4206604 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 733841 675553 853 2943 0 730735 0
[pid=22167/tid=22168] ppid=22164 vsize=2935364 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 3005812736 675553 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=2935364 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 3005812736 675553 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=2935364 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 3005812736 675553 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 2935364

[startup+1482.3 s]
/proc/loadavg: 1.99 2.00 2.00 3/183 22450
/proc/meminfo: memFree=15689212/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=2811460 CPUtime=1481.99 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 6735052 0 0 0 147150 1049 0 0 20 0 4 0 26167243 2878935040 644577 33554432000 4194304 16246674 140734107576688 140734107574592 4220491 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 702865 644577 853 2943 0 699759 0
[pid=22167/tid=22168] ppid=22164 vsize=2811460 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 2878935040 644577 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=2811460 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 2878935040 644577 33554432000 4194304 16246674 140734107576688 140596671912976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=2811460 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 2878935040 644577 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1481.99
Current children cumulated vsize (KiB) 2811460

[startup+1542.31 s]
/proc/loadavg: 2.11 2.03 2.01 3/183 22451
/proc/meminfo: memFree=15685180/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=2815556 CPUtime=1541.98 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 7417551 0 0 0 153041 1157 0 0 20 0 4 0 26167243 2883129344 645602 33554432000 4194304 16246674 140734107576688 140734107574528 4220517 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 703889 645602 853 2943 0 700783 0
[pid=22167/tid=22168] ppid=22164 vsize=2815556 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 2883129344 645602 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=2815556 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 26167243 2883129344 645602 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=2815556 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 2883129344 645602 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1541.98
Current children cumulated vsize (KiB) 2815556

[startup+1602.3 s]
/proc/loadavg: 1.92 1.99 1.99 3/183 22501
/proc/meminfo: memFree=26877976/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=4177476 CPUtime=1601.95 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 8041679 0 0 0 158948 1247 0 0 20 0 4 0 26167243 4277735424 986082 33554432000 4194304 16246674 140734107576688 140734107575784 4220982 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 1044369 986082 853 2943 0 1041263 0
[pid=22167/tid=22168] ppid=22164 vsize=4177476 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 4277735424 986082 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=4177476 CPUtime=0.01 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 26167243 4277735424 986082 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=4177476 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 4277735424 986082 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1601.95
Current children cumulated vsize (KiB) 4177476

[startup+1662.3 s]
/proc/loadavg: 1.97 1.99 1.99 3/184 22505
/proc/meminfo: memFree=17020020/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=4010564 CPUtime=1661.94 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 8675812 0 0 0 164847 1347 0 0 20 0 4 0 26167243 4106817536 944119 33554432000 4194304 16246674 140734107576688 140734107575352 4225154 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 1002641 944127 853 2943 0 999535 0
[pid=22167/tid=22168] ppid=22164 vsize=4010564 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 4106817536 944132 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=4010564 CPUtime=0.01 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 26167243 4106817536 944137 33554432000 4194304 16246674 140734107576688 140596671912976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=4010564 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 4106817536 944144 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1661.94
Current children cumulated vsize (KiB) 4010564

[startup+1722.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/183 22506
/proc/meminfo: memFree=17328316/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=2574916 CPUtime=1721.92 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 9326546 0 0 0 170736 1456 0 0 20 0 4 0 26167243 2636713984 585444 33554432000 4194304 16246674 140734107576688 140734107558592 4220850 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 643729 585444 853 2943 0 640623 0
[pid=22167/tid=22168] ppid=22164 vsize=2574916 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 2636713984 585444 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=2574916 CPUtime=0.01 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 26167243 2636713984 585444 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=2574916 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 2636713984 585444 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1721.92
Current children cumulated vsize (KiB) 2574916

[startup+1782.3 s]
/proc/loadavg: 1.99 1.99 1.99 3/183 22605
/proc/meminfo: memFree=26786312/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=4156996 CPUtime=1781.91 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 9824210 0 0 0 176661 1530 0 0 20 0 4 0 26167243 4256763904 980964 33554432000 4194304 16246674 140734107576688 140734107575784 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 1039249 980964 853 2943 0 1036143 0
[pid=22167/tid=22168] ppid=22164 vsize=4156996 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 4256763904 980964 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=4156996 CPUtime=0.01 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 26167243 4256763904 980964 33554432000 4194304 16246674 140734107576688 140596671913200 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=4156996 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 4256763904 980964 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1781.91
Current children cumulated vsize (KiB) 4156996



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 1.99 1.99 1.99 3/183 22605
/proc/meminfo: memFree=27731100/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=3078724 CPUtime=1800.01 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) R 22164 22167 20760 0 -1 4202496 9824210 0 0 0 178465 1536 0 0 20 0 4 0 26167243 3152613376 711396 33554432000 4194304 16246674 140734107576688 140734107574592 4225334 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 769681 711396 853 2943 0 766575 0
[pid=22167/tid=22168] ppid=22164 vsize=3078724 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22168/stat : 22168 (toysat) S 22164 22167 20760 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 26167243 3152613376 711396 33554432000 4194304 16246674 140734107576688 140596682403056 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=22167/tid=22169] ppid=22164 vsize=3078724 CPUtime=0.01 cores=0,2,4,6
/proc/22167/task/22169/stat : 22169 (toysat) S 22164 22167 20760 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 26167243 3152613376 711396 33554432000 4194304 16246674 140734107576688 140596671912976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=3078724 CPUtime=0 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) S 22164 22167 20760 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 26167243 3152613376 711396 33554432000 4194304 16246674 140734107576688 140596559735984 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 3078724

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 22167 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 1.99 1.99 1.99 3/183 22605
/proc/meminfo: memFree=27731100/32872528 swapFree=163656/177964
[pid=22167] ppid=22164 vsize=0 CPUtime=1800.12 cores=0,2,4,6
/proc/22167/stat : 22167 (toysat) Z 22164 22167 20760 0 -1 4203532 9824210 0 0 0 178465 1547 0 0 20 0 2 0 26167243 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/22167/statm: 0 0 0 0 0 0 0
[pid=22167/tid=22170] ppid=22164 vsize=0 CPUtime=0.08 cores=0,2,4,6
/proc/22167/task/22170/stat : 22170 (toysat) R 22164 22167 20760 0 -1 4203588 1 0 0 0 0 8 0 0 20 0 2 0 26167243 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.55
CPU time (s): 1800.18
CPU user time (s): 1784.66
CPU system time (s): 15.5176
CPU usage (%): 99.9792
Max. virtual memory (cumulated for all children) (KiB): 5639748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1784.66
system time used= 15.5176
maximum resident set size= 5406588
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9824210
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1809
involuntary context switches= 1944

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.24305 second user time and 9.46356 second system time

The end

Launcher Data 

Begin job on node105 at 2016-06-18 11:12:53
IDJOB=4104005
IDBENCH=2530
IDSOLVER=2542
FILE ID=node105/4104005-1466241173
RUNJOBID= node105-1466229502-20776
PBS_JOBID= 19918174
Free space on /tmp= 71716 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-atlanta-ip.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4104005-1466241173/watcher-4104005-1466241173 -o /tmp/evaluation-result-4104005-1466241173/solver-4104005-1466241173 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node105-1466229502-20776 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4104005-1466241173.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3d255cade6c21db991c934cb96648acb
RANDOM SEED=735837949

node105.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.58
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30484372 kB
Buffers:           94668 kB
Cached:           206604 kB
SwapCached:         1664 kB
Active:          1274524 kB
Inactive:         197444 kB
Active(anon):    1168480 kB
Inactive(anon):     4408 kB
Active(file):     106044 kB
Inactive(file):   193036 kB
Unevictable:      177964 kB
Mlocked:          163656 kB
SwapTotal:      67108856 kB
SwapFree:       67097160 kB
Dirty:             23324 kB
Writeback:             0 kB
AnonPages:       1347900 kB
Mapped:            10720 kB
Shmem:                 0 kB
Slab:             603684 kB
SReclaimable:      47488 kB
SUnreclaim:       556196 kB
KernelStack:        1488 kB
PageTables:         6860 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1493020 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:     28672 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71708 MiB
End job on node105 at 2016-06-18 11:42:54