Trace number 4119115

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.02 1800.28

General information on the benchmark

NamePB15eval/normalized-PB15eval/OPT-BIGINT-LIN/
minlplib2-pb-0.1.0/opb/normalized-faclay75.lin.opb
MD5SUM83c48e76d8aaa313629670388a84893b
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark2669211
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables149652
Total number of constraints428803
Number of constraints which are clauses281926
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints146876
Minimum length of a constraint1
Maximum length of a constraint3
Number of terms in the objective function 149651
Biggest coefficient in the objective function 3944708
Number of bits for the biggest coefficient in the objective function 22
Sum of the numbers in the objective function 34212972
Number of bits of the sum of numbers in the objective function 26
Biggest number in a constraint 3944708
Number of bits of the biggest number in a constraint 22
Biggest sum of numbers in a constraint 34212972
Number of bits of the biggest sum of numbers26
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c 2016-06-30T01:10:04+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4119115-1467241804.opb"]
0.00/0.01	c use --random-gen="2726696757 1043741989 1738472277 1208742093 3613680753 1136977747 2778873321 891769165 2165262506 3158844164 1095046263 1721599483 727690156 479019769 2860966700 231535152 1591507990 4049611442 3824831467 2171963191 3133018087 1138387636 2500354560 40118992 91637753 3347893171 1812782059 3693929923 2339029160 4132482815 299093768 1959733721 1943933110 1986185771 4037916214 4207882106 1598135626 1589732853 1955939652 3961766696 3172066459 461836690 3538699999 3897095515 225131047 4186463070 59829430 1876713163 1869829795 1473496108 148677831 3787212054 2958863054 93921886 3667347345 246513354 2908003693 2872490807 1526087199 2550649161 362492749 1122669867 198354925 2118172332 424282235 1868276437 4034998833 2505361763 3644440005 3712850373 738932998 2727736574 597288979 4017158664 1096909699 2652887819 1261759428 504349779 3043744630 3512799162 2093849510 2037687801 3833129254 4167834542 3395559801 2109200952 2536456921 2171133294 1590577194 1471234456 2978712791 616672305 3221296481 499998484 2785438239 3441987342 486350569 2628621144 2167098500 2919149475 1009903377 3358533546 1962290757 2985497425 2460865608 3393761312 2552683385 2761267671 1657291201 473574329 3550383295 509872867 3541593776 3729191268 873119245 1366250279 1162047406 1037426896 1767413608 1432019692 2735162193 3622438077 247135835 1979710395 1330688264 2319349225 3454948054 2620185743 3803782104 3984380505 1528019250 3575539514 3126119465 861075122 621631130 113635767 22242749 4099751597 4039760577 2931485041 2115460747 2823813602 4141440320 771302745 52435760 2974220197 2321269693 2291569359 3814419445 1089335528 1890960262 2281262331 3624303824 411632057 1811042402 2918712010 4293279825 1903446073 3497552030 3792083851 764215312 887886619 2943311668 3459575725 2229508387 2489454889 2295395681 484764050 89895951 1391318302 707211061 4017919947 4158704886 2815272453 3941117111 2991587075 3777155545 2572010031 1849223260 1061720053 2561887493 37544459 1140104442 2815806579 1516919442 1810287840 3866031639 676263143 558185299 3611100936 1166922390 1097360970 94302226 930415751 3879130572 4196426591 2602463238 2648928726 2416173596 452827101 3786579402 4023409742 204667725 609954576 3102651710 3767977083 3130403640 2495513905 219551401 3721051699 1917462648 1249312074 2948772297 3656235829 1423941823 1272147235 2499897168 721277014 2052113448 1349114970 3398126418 2069135592 4202837107 1523942919 245460824 3139146425 3859479876 1320855615 2413059937 15930023 4246801600 1111996542 2064403289 2471287584 1885771105 1943984472 28106634 110013686 2882889419 4224751494 3111912867 924758014 1333475682 86443135 3974448681 3835042373 1708719051 2855321020 903087474 3353763022 3069155258 2998659758 2754810169 2524691987 3234594688 3315930289 255 362436" option to reproduce the execution
2.99/3.06	c #vars 149652
2.99/3.06	c #constraints 428803
10.18/10.28	c BCD2: Hardening is enabled.
10.18/10.28	c BCD2: BiasedSearch is enabled.
10.18/10.28	c Solving starts ...
10.18/10.28	c ============================[ Search Statistics ]============================
10.18/10.28	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
10.18/10.28	c       |         |          |          |    Limit     GC | Var      | Constra 
10.18/10.28	c =============================================================================
10.38/10.40	c  0.0s |       0 |        0 |        0 |   192818      0 |        1 |        0
11.18/11.23	c  0.8s |       0 |     2405 |        0 |   192818      0 |        1 |        0
11.18/11.23	c #cpu_time = 0.727s
11.18/11.23	c #wall_clock_time = 0.729s
11.18/11.23	c #decision = 2405
11.18/11.23	c #random_decision = 5
11.18/11.23	c #conflict = 0
11.18/11.23	c #restart = 0
11.18/11.24	o 3944708

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4119115-1467241804/watcher-4119115-1467241804 -o /tmp/evaluation-result-4119115-1467241804/solver-4119115-1467241804 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1467234598-6496 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4119115-1467241804.opb 

pid=7155
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/244 7158
/proc/meminfo: memFree=29215808/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=680380 CPUtime=0 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 2527 0 0 0 0 0 0 0 20 0 4 0 5286962 696709120 3400 33554432000 4194304 16246674 140737457681504 140737457680928 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 170863 3411 441 2943 0 167757 0
[pid=7158/tid=7159] ppid=7155 vsize=697788 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 714534912 3472 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=702908 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 719777792 3489 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=707004 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 723972096 3507 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100131 s]
/proc/loadavg: 2.00 2.00 2.00 3/244 7158
/proc/meminfo: memFree=29215808/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1301060 CPUtime=0.09 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 29235 0 0 0 6 3 0 0 20 0 4 0 5286962 1332285440 30046 33554432000 4194304 16246674 140737457681504 140737457664496 7371468 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 325265 30064 802 2943 0 322159 0
[pid=7158/tid=7159] ppid=7155 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1332285440 30075 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1332285440 30087 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1332285440 30098 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1301060

[startup+0.200539 s]
/proc/loadavg: 2.00 2.00 2.00 3/244 7158
/proc/meminfo: memFree=29215808/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1314372 CPUtime=0.19 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 46893 0 0 0 13 6 0 0 20 0 4 0 5286962 1345916928 48214 33554432000 4194304 16246674 140737457681504 140737457664496 7378458 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 328593 48214 802 2943 0 325487 0
[pid=7158/tid=7159] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 48214 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 48214 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 48214 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1314372

[startup+0.300472 s]
/proc/loadavg: 2.00 2.00 2.00 3/244 7158
/proc/meminfo: memFree=29215808/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1314372 CPUtime=0.29 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 50843 0 0 0 22 7 0 0 20 0 4 0 5286962 1345916928 52164 33554432000 4194304 16246674 140737457681504 140737457664496 8058576 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 328593 52164 802 2943 0 325487 0
[pid=7158/tid=7159] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 52164 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 52164 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 52164 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.700395 s]
/proc/loadavg: 2.00 2.00 2.00 3/244 7158
/proc/meminfo: memFree=29215808/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1314372 CPUtime=0.69 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 72339 0 0 0 59 10 0 0 20 0 4 0 5286962 1345916928 73660 33554432000 4194304 16246674 140737457681504 140737457664496 4206952 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 328593 73660 804 2943 0 325487 0
[pid=7158/tid=7159] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 73660 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 73660 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 73660 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.50039 s]
/proc/loadavg: 2.00 2.00 2.00 3/248 7162
/proc/meminfo: memFree=28772560/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1314372 CPUtime=1.49 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 94070 0 0 0 136 13 0 0 20 0 4 0 5286962 1345916928 95391 33554432000 4194304 16246674 140737457681504 140737457664496 7383424 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 328593 95391 805 2943 0 325487 0
[pid=7158/tid=7159] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 95391 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 95391 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1345916928 95391 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1314372

[startup+3.10038 s]
/proc/loadavg: 2.00 2.00 2.00 3/247 7162
/proc/meminfo: memFree=28487724/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1338948 CPUtime=3.09 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 131381 0 0 0 290 19 0 0 20 0 4 0 5286962 1371082752 136790 33554432000 4194304 16246674 140737457681504 140737457680600 4220480 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 334737 136790 810 2943 0 331631 0
[pid=7158/tid=7159] ppid=7155 vsize=1338948 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1371082752 136790 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1338948 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1371082752 136790 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1338948 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1371082752 136790 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1338948

[startup+6.30039 s]
/proc/loadavg: 2.00 2.00 2.00 3/247 7162
/proc/meminfo: memFree=27227228/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1369668 CPUtime=6.28 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 276906 0 0 0 589 39 0 0 20 0 4 0 5286962 1402540032 284359 33554432000 4194304 16246674 140737457681504 140737457663424 6760117 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 342417 284359 841 2943 0 339311 0
[pid=7158/tid=7159] ppid=7155 vsize=1369668 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1402540032 284359 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1369668 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1402540032 284359 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1369668 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1402540032 284359 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1369668

[startup+12.7004 s]
/proc/loadavg: 2.00 2.00 2.00 3/248 7163
/proc/meminfo: memFree=27211452/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1394244 CPUtime=12.68 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 283106 0 0 0 1228 40 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 140737457679296 12654395 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 348561 290559 890 2943 0 345455 0
[pid=7158/tid=7159] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1394244

[startup+25.5005 s]
/proc/loadavg: 2.00 2.00 2.00 3/248 7163
/proc/meminfo: memFree=27188076/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1394244 CPUtime=25.49 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 283106 0 0 0 2508 41 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 140737457663424 12654356 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 348561 290559 890 2943 0 345455 0
[pid=7158/tid=7159] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1394244

[startup+51.1005 s]
/proc/loadavg: 2.00 2.00 2.00 3/248 7163
/proc/meminfo: memFree=27188244/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1394244 CPUtime=51.09 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 283106 0 0 0 5068 41 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 140737457663424 12654829 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 348561 290559 890 2943 0 345455 0
[pid=7158/tid=7159] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 1394244

[startup+102.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/247 7164
/proc/meminfo: memFree=26847208/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1394244 CPUtime=102.28 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 283106 0 0 0 10187 41 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 140737457663424 6955371 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 348561 290559 890 2943 0 345455 0
[pid=7158/tid=7159] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1394244 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1427705856 290559 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1394244


################
# More data... #
################

[pid=7158/tid=7161] ppid=7155 vsize=1852996 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1897467904 405247 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1302.15
Current children cumulated vsize (KiB) 1852996

[startup+1362.3 s]
/proc/loadavg: 1.94 1.99 1.99 3/247 7196
/proc/meminfo: memFree=25426648/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1856068 CPUtime=1362.15 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 398562 0 0 0 136142 73 0 0 20 0 4 0 5286962 1900613632 406015 33554432000 4194304 16246674 140737457681504 140737457679296 4220501 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 464017 406015 890 2943 0 460911 0
[pid=7158/tid=7159] ppid=7155 vsize=1856068 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1900613632 406015 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1856068 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1900613632 406015 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1856068 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1900613632 406015 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.15
Current children cumulated vsize (KiB) 1856068

[startup+1422.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/247 7197
/proc/meminfo: memFree=25411948/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1871428 CPUtime=1422.15 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 402402 0 0 0 142140 75 0 0 20 0 4 0 5286962 1916342272 409855 33554432000 4194304 16246674 140737457681504 140737457679296 12371108 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 467857 409855 890 2943 0 464751 0
[pid=7158/tid=7159] ppid=7155 vsize=1871428 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1916342272 409855 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1871428 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1916342272 409855 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1871428 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1916342272 409855 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.15
Current children cumulated vsize (KiB) 1871428

[startup+1482.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/247 7198
/proc/meminfo: memFree=25405536/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1877572 CPUtime=1482.14 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 403938 0 0 0 148137 77 0 0 20 0 4 0 5286962 1922633728 411391 33554432000 4194304 16246674 140737457681504 140737457679360 13880901 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 469393 411391 890 2943 0 466287 0
[pid=7158/tid=7159] ppid=7155 vsize=1877572 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1922633728 411391 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1877572 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1922633728 411391 33554432000 4194304 16246674 140737457681504 139766272072720 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1877572 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1922633728 411391 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.14
Current children cumulated vsize (KiB) 1877572

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/247 7200
/proc/meminfo: memFree=25400364/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1882692 CPUtime=1542.14 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 405218 0 0 0 154136 78 0 0 20 0 4 0 5286962 1927876608 412671 33554432000 4194304 16246674 140737457681504 140737457679296 6958858 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 470673 412671 890 2943 0 467567 0
[pid=7158/tid=7159] ppid=7155 vsize=1882692 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1927876608 412671 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1882692 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1927876608 412671 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1882692 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1927876608 412671 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.14
Current children cumulated vsize (KiB) 1882692

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/247 7201
/proc/meminfo: memFree=25392948/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1889860 CPUtime=1602.13 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 407010 0 0 0 160133 80 0 0 20 0 4 0 5286962 1935216640 414463 33554432000 4194304 16246674 140737457681504 140737457679296 12429736 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 472465 414463 890 2943 0 469359 0
[pid=7158/tid=7159] ppid=7155 vsize=1889860 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1935216640 414463 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1889860 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1935216640 414463 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1889860 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1935216640 414463 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.13
Current children cumulated vsize (KiB) 1889860

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/247 7202
/proc/meminfo: memFree=25389256/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1893956 CPUtime=1662.12 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 408035 0 0 0 166131 81 0 0 20 0 4 0 5286962 1939410944 415490 33554432000 4194304 16246674 140737457681504 140737457679296 4226104 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 473489 415490 890 2943 0 470383 0
[pid=7158/tid=7159] ppid=7155 vsize=1893956 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1939410944 415490 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1893956 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1939410944 415490 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1893956 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1939410944 415490 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662.12
Current children cumulated vsize (KiB) 1893956

[startup+1722.3 s]
/proc/loadavg: 2.14 2.04 2.01 3/247 7203
/proc/meminfo: memFree=25377748/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1905220 CPUtime=1722.12 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 410851 0 0 0 172129 83 0 0 20 0 4 0 5286962 1950945280 418306 33554432000 4194304 16246674 140737457681504 140737457663424 4207010 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 476305 418306 890 2943 0 473199 0
[pid=7158/tid=7159] ppid=7155 vsize=1905220 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1950945280 418306 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1905220 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1950945280 418306 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1905220 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1950945280 418306 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1722.12
Current children cumulated vsize (KiB) 1905220

[startup+1782.3 s]
/proc/loadavg: 2.21 2.08 2.02 3/247 7204
/proc/meminfo: memFree=25363724/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1918532 CPUtime=1782.12 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 414180 0 0 0 178127 85 0 0 20 0 4 0 5286962 1964576768 421634 33554432000 4194304 16246674 140737457681504 140737457679296 4220543 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 479633 421634 890 2943 0 476527 0
[pid=7158/tid=7159] ppid=7155 vsize=1918532 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1964576768 421634 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1918532 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1964576768 421634 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1918532 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1964576768 421634 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1782.12
Current children cumulated vsize (KiB) 1918532



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.2 s]
/proc/loadavg: 2.16 2.08 2.02 3/248 7207
/proc/meminfo: memFree=25361712/32872528 swapFree=189444/189444
[pid=7158] ppid=7155 vsize=1920580 CPUtime=1800.02 cores=1,3,5,7
/proc/7158/stat : 7158 (toysat) R 7155 7158 3947 0 -1 4202496 414692 0 0 0 179917 85 0 0 20 0 4 0 5286962 1966673920 422146 33554432000 4194304 16246674 140737457681504 140737457679296 4206674 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/7158/statm: 480145 422146 890 2943 0 477039 0
[pid=7158/tid=7159] ppid=7155 vsize=1920580 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7159/stat : 7159 (toysat) S 7155 7158 3947 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 5286962 1966673920 422146 33554432000 4194304 16246674 140737457681504 139766282562800 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=7158/tid=7160] ppid=7155 vsize=1920580 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7160/stat : 7160 (toysat) S 7155 7158 3947 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 5286962 1966673920 422146 33554432000 4194304 16246674 140737457681504 139766272072944 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=7158/tid=7161] ppid=7155 vsize=1920580 CPUtime=0 cores=1,3,5,7
/proc/7158/task/7161/stat : 7161 (toysat) S 7155 7158 3947 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 5286962 1966673920 422146 33554432000 4194304 16246674 140737457681504 139766154652848 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 1920580

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 7158 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7158 and gives
#  childrusage.ru_utime.tv_sec=1799
#  childrusage.ru_utime.tv_usec=136489
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=844871
# CPU time returned by wait4() is 1799.98
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.28
CPU time (s): 1800.02
CPU user time (s): 1799.17
CPU system time (s): 0.85
CPU usage (%): 99.9854
Max. virtual memory (cumulated for all children) (KiB): 1920580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.14
system time used= 0.844871
maximum resident set size= 1688584
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 414692
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1018
involuntary context switches= 2060

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.2103 second user time and 17.5073 second system time

The end

Launcher Data

Begin job on node102 at 2016-06-30 01:10:04
IDJOB=4119115
IDBENCH=111655
IDSOLVER=2542
FILE ID=node102/4119115-1467241804
RUNJOBID= node102-1467234598-6496
PBS_JOBID= 19997591
Free space on /tmp= 71660 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB15eval/normalized-PB15eval/OPT-BIGINT-LIN/minlplib2-pb-0.1.0/opb/normalized-faclay75.lin.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4119115-1467241804/watcher-4119115-1467241804 -o /tmp/evaluation-result-4119115-1467241804/solver-4119115-1467241804 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1467234598-6496 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4119115-1467241804.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 83c48e76d8aaa313629670388a84893b
RANDOM SEED=722007837

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29216732 kB
Buffers:          122344 kB
Cached:          2292020 kB
SwapCached:            0 kB
Active:           701868 kB
Inactive:        2018464 kB
Active(anon):     308940 kB
Inactive(anon):        0 kB
Active(file):     392928 kB
Inactive(file):  2018464 kB
Unevictable:      189444 kB
Mlocked:          189444 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             61824 kB
Writeback:             0 kB
AnonPages:        493376 kB
Mapped:            17516 kB
Shmem:               204 kB
Slab:             612500 kB
SReclaimable:      55760 kB
SUnreclaim:       556740 kB
KernelStack:        1920 kB
PageTables:         7084 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1430860 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71644 MiB
End job on node102 at 2016-06-30 01:40:05