Trace number 4110760

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.47 1800.84

General information on the benchmark

Namenormalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/
normalized-single-obj-f53-AC_FC1.seq-B-2-1-abcdeir.opb
MD5SUM6b49372ae14a7b33958e518ad7cedb27
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark34818700097
Best CPU time to get the best result obtained on this benchmark272.778
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables21883
Total number of constraints63749
Number of constraints which are clauses63457
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints292
Minimum length of a constraint1
Maximum length of a constraint74
Number of terms in the objective function 1272
Biggest coefficient in the objective function 135539323520
Number of bits for the biggest coefficient in the objective function 37
Sum of the numbers in the objective function 10029909940479
Number of bits of the sum of numbers in the objective function 44
Biggest number in a constraint 135539323520
Number of bits of the biggest number in a constraint 37
Biggest sum of numbers in a constraint 10029909940479
Number of bits of the biggest sum of numbers44
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-20T03:59:56+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4110760-1466387996.opb"]
0.00/0.01	c use --random-gen="2994041700 818966981 389777890 3672800954 4140805682 1266547221 1667757785 3391011378 3896204978 453546983 2809464407 1874650362 3971109622 602960832 3043098330 2132368618 2585235744 1638415814 700867644 3869446345 3284931975 2971035708 3503808234 4124981379 163672290 3463357698 2451590422 472416146 2663800012 2583378669 3939452766 1769313502 2844924417 1159419778 758631396 1725288757 1639300167 217310428 4277718556 3671991993 2651294835 4183531845 2227966977 156988809 643343074 353300725 3533754036 2980256753 3500804702 368863700 2971734926 3144594496 2323898711 761330514 628857559 1381568449 1822971620 2989379716 2847835925 3776877704 1778533145 3825180505 1351531872 326913700 727449237 2850252202 4135621052 3376377486 810591755 798571197 3086842533 1511979626 3681676147 1533083679 917802740 3038472621 666631632 2410888595 1437059407 985412491 628045072 3898697093 3679238365 595192071 2743199361 2657560472 4078745178 3537373333 3772396585 2329647497 1911431504 3147903314 3409790870 3139582885 109870778 2134152482 4273599137 1337009880 3689543071 270505333 1981901317 3272448724 1088184464 3261659266 4045221555 1631158025 3099554733 3496679164 161062517 898701872 2650630519 3909972138 2283657068 1786426733 2032216101 1529939487 2062884088 2016362988 4136135866 4218136615 1399860986 3014266609 1576649234 346682456 168983806 1483500257 4265349345 1048208601 4294483527 348917117 3107784949 2028178540 1275346076 4282651558 1373441193 4253381344 2447659963 2704093087 1565164122 180521887 1729356566 2637988257 3198828009 836969674 2583817813 4110403706 1624263282 217894461 3116697479 932439686 4148808109 2350713694 734749164 2302044908 1122254706 444700048 4090218021 3730732212 1481436290 3649131860 819155121 1905041572 1426976230 4163025501 2526491462 3166822899 1842743980 3436748948 353924392 519789446 647439339 1858129683 571935379 891649622 100815131 2483647022 2724574039 2131463270 2812371 1367068608 902931966 431013492 2650693919 734561167 2216633144 3056742284 1804415592 819432709 277639159 4007748757 87766912 2978363136 1203015612 3128911765 863615097 2919559921 100797770 1722485333 1670738025 1421300655 2928845006 2054443342 1315229058 1296968245 1429191937 665981827 164863279 2005149904 472794684 2034019284 172805847 1866015458 3370178841 2685396210 1427553340 3434216262 1307444229 2329698655 3786822724 1083475186 1698861495 3265320196 961387069 4220883365 2108625755 1205420771 2975135568 2359419230 1651647466 1747127945 3086862711 1087289875 3856829015 1273498492 2718749851 1173366624 2533146602 2298152483 3106777262 3153409617 3637073091 1336572161 3644116675 518133987 1819505596 1294875246 134112561 2567938182 4017175673 3214572545 378725472 1366265263 1198034178 3004763649 3768920472 1725076503 255 362436" option to reproduce the execution
0.29/0.38	c #vars 21883
0.29/0.38	c #constraints 63749
1.10/1.12	c BCD2: Hardening is enabled.
1.10/1.12	c BCD2: BiasedSearch is enabled.
1.10/1.12	c Solving starts ...
1.10/1.12	c ============================[ Search Statistics ]============================
1.10/1.12	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
1.10/1.12	c       |         |          |          |    Limit     GC | Var      | Constra 
1.10/1.12	c =============================================================================
1.20/1.25	c  0.0s |       0 |        0 |        0 |    27552      0 |      585 |        0
1.29/1.36	c  0.1s |       0 |     1634 |       39 |    27552      0 |      585 |      146
1.29/1.36	c #cpu_time = 0.094s
1.29/1.36	c #wall_clock_time = 0.095s
1.29/1.36	c #decision = 1634
1.29/1.36	c #random_decision = 1
1.29/1.36	c #conflict = 39
1.29/1.36	c #restart = 0
1.29/1.36	o 9894370620179

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4110760-1466387996/watcher-4110760-1466387996 -o /tmp/evaluation-result-4110760-1466387996/solver-4110760-1466387996 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node112-1466384098-27449 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4110760-1466387996.opb 

pid=28143
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.06 2.02 3/179 28146
/proc/meminfo: memFree=17980356/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=727484 CPUtime=0 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 2713 0 0 0 0 0 0 0 20 0 4 0 40848858 744943616 2564 33554432000 4194304 16246674 140734847151040 140734847150464 13880264 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 182383 2574 441 2943 0 179277 0
[pid=28146/tid=28147] ppid=28143 vsize=744892 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 762769408 2631 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=748988 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 766963712 2648 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=753084 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 40848858 771158016 2665 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0

[startup+0.100172 s]
/proc/loadavg: 2.08 2.06 2.02 3/179 28146
/proc/meminfo: memFree=17980356/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1301060 CPUtime=0.09 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 25777 0 0 0 5 4 0 0 20 0 4 0 40848858 1332285440 25565 33554432000 4194304 16246674 140734847151040 140734847150352 7374276 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 325265 25580 799 2943 0 322159 0
[pid=28146/tid=28147] ppid=28143 vsize=1301060 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1332285440 25591 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1301060 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1332285440 25601 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1301060 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1332285440 25613 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1301060

[startup+0.200569 s]
/proc/loadavg: 2.08 2.06 2.02 3/179 28146
/proc/meminfo: memFree=17980356/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1312324 CPUtime=0.19 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 47472 0 0 0 12 7 0 0 20 0 4 0 40848858 1343819776 47771 33554432000 4194304 16246674 140734847151040 140734847132928 7361631 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 328081 47771 800 2943 0 324975 0
[pid=28146/tid=28147] ppid=28143 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1343819776 47771 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1343819776 47771 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1343819776 47771 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1312324

[startup+0.300536 s]
/proc/loadavg: 2.08 2.06 2.02 3/179 28146
/proc/meminfo: memFree=17980356/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1313348 CPUtime=0.29 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 60491 0 0 0 20 9 0 0 20 0 4 0 40848858 1344868352 60790 33554432000 4194304 16246674 140734847151040 140734847132928 7364368 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 328337 60790 800 2943 0 325231 0
[pid=28146/tid=28147] ppid=28143 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1344868352 60790 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1344868352 60790 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1344868352 60790 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1313348

[startup+0.700407 s]
/proc/loadavg: 2.08 2.06 2.02 3/179 28146
/proc/meminfo: memFree=17980356/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1313348 CPUtime=0.69 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 84470 0 0 0 56 13 0 0 20 0 4 0 40848858 1344868352 84770 33554432000 4194304 16246674 140734847151040 140734847132928 7202813 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 328337 84780 833 2943 0 325231 0
[pid=28146/tid=28147] ppid=28143 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1344868352 84785 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1344868352 84790 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1344868352 84795 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1313348

[startup+1.50042 s]
/proc/loadavg: 2.08 2.06 2.02 3/183 28150
/proc/meminfo: memFree=17350292/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1344068 CPUtime=1.49 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 171073 0 0 0 123 26 0 0 20 0 4 0 40848858 1376325632 171372 33554432000 4194304 16246674 140734847151040 140734847132928 12371164 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 336017 171372 895 2943 0 332911 0
[pid=28146/tid=28147] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 171372 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 171372 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 171372 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1344068

[startup+3.10043 s]
/proc/loadavg: 2.08 2.06 2.02 3/183 28150
/proc/meminfo: memFree=16874008/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1344068 CPUtime=3.09 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 276700 0 0 0 270 39 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140734847150352 12449395 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 336017 276999 896 2943 0 332911 0
[pid=28146/tid=28147] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1344068

[startup+6.30045 s]
/proc/loadavg: 2.07 2.06 2.02 3/184 28153
/proc/meminfo: memFree=16876168/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1344068 CPUtime=6.29 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 276700 0 0 0 590 39 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140734847132928 6955280 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 336017 276999 896 2943 0 332911 0
[pid=28146/tid=28147] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 276999 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1344068

[startup+12.7005 s]
/proc/loadavg: 2.07 2.06 2.02 3/184 28153
/proc/meminfo: memFree=16876680/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1344068 CPUtime=12.69 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 276701 0 0 0 1230 39 0 0 20 0 4 0 40848858 1376325632 277000 33554432000 4194304 16246674 140734847151040 140734847132928 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 336017 277000 896 2943 0 332911 0
[pid=28146/tid=28147] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 277000 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 277000 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1344068 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1376325632 277000 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1344068

[startup+25.5005 s]
/proc/loadavg: 2.21 2.09 2.03 3/184 28153
/proc/meminfo: memFree=16865648/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1356356 CPUtime=25.49 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 279773 0 0 0 2509 40 0 0 20 0 4 0 40848858 1388908544 280072 33554432000 4194304 16246674 140734847151040 140734847148864 4206600 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 339089 280072 896 2943 0 335983 0
[pid=28146/tid=28147] ppid=28143 vsize=1356356 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1388908544 280072 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1356356 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1388908544 280072 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1356356 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1388908544 280072 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1356356

[startup+51.1005 s]
/proc/loadavg: 2.13 2.08 2.02 3/184 28153
/proc/meminfo: memFree=16339764/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1625668 CPUtime=51.08 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 347101 0 0 0 5059 49 0 0 20 0 4 0 40848858 1664684032 347400 33554432000 4194304 16246674 140734847151040 140734847150352 12413997 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 406417 347400 896 2943 0 403311 0
[pid=28146/tid=28147] ppid=28143 vsize=1625668 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 1664684032 347400 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1625668 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 1664684032 347400 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1625668 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 1664684032 347400 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1625668

[startup+102.301 s]
/proc/loadavg: 2.11 2.08 2.03 3/184 28177
/proc/meminfo: memFree=15824988/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=1980996 CPUtime=102.29 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 435933 0 0 0 10164 65 0 0 20 0 4 0 40848858 2028539904 436232 33554432000 4194304 16246674 140734847151040 140734847150136 4225171 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 495249 436232 896 2943 0 492143 0
[pid=28146/tid=28147] ppid=28143 vsize=1980996 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 2028539904 436232 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=1980996 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 2028539904 436232 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=1980996 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 2028539904 436232 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 1980996


################
# More data... #
################

/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 7633178624 1804673 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=7454276 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 7633178624 1804677 33554432000 4194304 16246674 140734847151040 140452033436688 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=7454276 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 7633178624 1804682 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1302.03
Current children cumulated vsize (KiB) 7454276

[startup+1362.3 s]
/proc/loadavg: 2.15 2.14 2.09 3/183 28257
/proc/meminfo: memFree=10269192/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=7100996 CPUtime=1362.02 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 11761662 0 0 0 134209 1993 0 0 20 0 4 0 40848858 7271419904 1716501 33554432000 4194304 16246674 140734847151040 140734847148864 4225325 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 1775249 1716501 897 2943 0 1772143 0
[pid=28146/tid=28147] ppid=28143 vsize=7100996 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 7271419904 1716501 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=7100996 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 7271419904 1716501 33554432000 4194304 16246674 140734847151040 140452033436688 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=7100996 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 7271419904 1716501 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1362.02
Current children cumulated vsize (KiB) 7100996

[startup+1422.3 s]
/proc/loadavg: 2.17 2.14 2.09 3/183 28258
/proc/meminfo: memFree=9477784/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=6875716 CPUtime=1422.02 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 12832767 0 0 0 140033 2169 0 0 20 0 4 0 40848858 7040733184 1660182 33554432000 4194304 16246674 140734847151040 140734847150352 14628944 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 1718929 1660182 897 2943 0 1715823 0
[pid=28146/tid=28147] ppid=28143 vsize=6875716 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 7040733184 1660182 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=6875716 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 7040733184 1660182 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=6875716 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 7040733184 1660182 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 6875716

[startup+1482.3 s]
/proc/loadavg: 2.31 2.18 2.11 3/183 28260
/proc/meminfo: memFree=7264408/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=9485892 CPUtime=1482 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 13721198 0 0 0 145906 2294 0 0 20 0 4 0 40848858 9713553408 2312581 33554432000 4194304 16246674 140734847151040 140734847149704 4225154 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 2371473 2312589 897 2943 0 2368367 0
[pid=28146/tid=28147] ppid=28143 vsize=9485892 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 9713553408 2312593 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=9485892 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 9713553408 2312597 33554432000 4194304 16246674 140734847151040 140452033436688 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=9485892 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 9713553408 2312602 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1482
Current children cumulated vsize (KiB) 9485892

[startup+1542.31 s]
/proc/loadavg: 2.23 2.18 2.10 4/183 28309
/proc/meminfo: memFree=19051936/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=9650756 CPUtime=1542 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 14304769 0 0 0 151804 2396 0 0 20 0 4 0 40848858 9882374144 2353944 33554432000 4194304 16246674 140734847151040 140734847148864 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 2412689 2353944 897 2943 0 2409583 0
[pid=28146/tid=28147] ppid=28143 vsize=9650756 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 9882374144 2353944 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=9650756 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 9882374144 2353944 33554432000 4194304 16246674 140734847151040 140452033436688 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=9650756 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 9882374144 2353944 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1542
Current children cumulated vsize (KiB) 9650756

[startup+1602.3 s]
/proc/loadavg: 2.20 2.17 2.10 3/183 28310
/proc/meminfo: memFree=18632416/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=8541764 CPUtime=1601.97 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 14925569 0 0 0 157692 2505 0 0 20 0 4 0 40848858 8746766336 2076696 33554432000 4194304 16246674 140734847151040 140734847150216 12429241 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 2135441 2076696 897 2943 0 2132335 0
[pid=28146/tid=28147] ppid=28143 vsize=8541764 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 8746766336 2076696 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=8541764 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 8746766336 2076696 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=8541764 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 8746766336 2076696 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1601.97
Current children cumulated vsize (KiB) 8541764

[startup+1662.3 s]
/proc/loadavg: 2.13 2.15 2.10 3/183 28311
/proc/meminfo: memFree=15623468/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=10369604 CPUtime=1661.96 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 16140034 0 0 0 163504 2692 0 0 20 0 4 0 40848858 10618474496 2533657 33554432000 4194304 16246674 140734847151040 140734847150216 4225056 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 2592401 2533657 897 2943 0 2589295 0
[pid=28146/tid=28147] ppid=28143 vsize=10369604 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 10618474496 2533657 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=10369604 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 10618474496 2533657 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=10369604 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 10618474496 2533657 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1661.96
Current children cumulated vsize (KiB) 10369604

[startup+1722.3 s]
/proc/loadavg: 2.05 2.12 2.09 3/183 28312
/proc/meminfo: memFree=15992580/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=7801412 CPUtime=1721.94 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 16425475 0 0 0 169434 2760 0 0 20 0 4 0 40848858 7988645888 1891610 33554432000 4194304 16246674 140734847151040 140734847150136 4206664 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 1950353 1891610 897 2943 0 1947247 0
[pid=28146/tid=28147] ppid=28143 vsize=7801412 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 7988645888 1891610 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=7801412 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 7988645888 1891610 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=7801412 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 7988645888 1891610 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1721.94
Current children cumulated vsize (KiB) 7801412

[startup+1782.3 s]
/proc/loadavg: 2.19 2.14 2.10 3/183 28314
/proc/meminfo: memFree=13039276/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=9112132 CPUtime=1781.93 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 17577732 0 0 0 175259 2934 0 0 20 0 4 0 40848858 9330823168 2219291 33554432000 4194304 16246674 140734847151040 140734847150136 4221016 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 2278033 2219291 897 2943 0 2274927 0
[pid=28146/tid=28147] ppid=28143 vsize=9112132 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 9330823168 2219291 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=9112132 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 9330823168 2219291 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=9112132 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 9330823168 2219291 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1781.93
Current children cumulated vsize (KiB) 9112132



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.06 2.12 2.09 3/183 28315
/proc/meminfo: memFree=11890148/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=8374852 CPUtime=1800.01 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) R 28143 28146 27433 0 -1 4202496 17938697 0 0 0 177004 2997 0 0 20 0 4 0 40848858 8575848448 2034971 33554432000 4194304 16246674 140734847151040 140734847150216 12449088 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 2093713 2034971 897 2943 0 2090607 0
[pid=28146/tid=28147] ppid=28143 vsize=8374852 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28147/stat : 28147 (toysat) S 28143 28146 27433 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 40848858 8575848448 2034971 33554432000 4194304 16246674 140734847151040 140452043926768 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=8374852 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) S 28143 28146 27433 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 40848858 8575848448 2034971 33554432000 4194304 16246674 140734847151040 140452033436912 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=28146/tid=28149] ppid=28143 vsize=8374852 CPUtime=0 cores=0,2,4,6
/proc/28146/task/28149/stat : 28149 (toysat) S 28143 28146 27433 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 40848858 8575848448 2034971 33554432000 4194304 16246674 140734847151040 140452022963376 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 8374852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 28146 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.81 s]
/proc/loadavg: 2.06 2.12 2.09 3/181 28315
/proc/meminfo: memFree=18050656/32872528 swapFree=682476/737664
[pid=28146] ppid=28143 vsize=0 CPUtime=1800.42 cores=0,2,4,6
/proc/28146/stat : 28146 (toysat) Z 28143 28146 27433 0 -1 4203532 17938697 0 0 0 177005 3037 0 0 20 0 2 0 40848858 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/28146/statm: 0 0 0 0 0 0 0
[pid=28146/tid=28148] ppid=28143 vsize=0 CPUtime=0.4 cores=0,2,4,6
/proc/28146/task/28148/stat : 28148 (toysat) R 28143 28146 27433 0 -1 4203588 8 0 0 0 0 40 0 0 20 0 2 0 40848858 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.42
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.84
CPU time (s): 1800.47
CPU user time (s): 1770.06
CPU system time (s): 30.4154
CPU usage (%): 99.9794
Max. virtual memory (cumulated for all children) (KiB): 10710596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1770.06
system time used= 30.4154
maximum resident set size= 10475628
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17938697
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1364
involuntary context switches= 1817

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.72067 second user time and 18.6602 second system time

The end

Launcher Data 

Begin job on node112 at 2016-06-20 03:59:56
IDJOB=4110760
IDBENCH=108372
IDSOLVER=2542
FILE ID=node112/4110760-1466387996
RUNJOBID= node112-1466384098-27449
PBS_JOBID= 19923269
Free space on /tmp= 71696 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB16/normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/normalized-single-obj-f53-AC_FC1.seq-B-2-1-abcdeir.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4110760-1466387996/watcher-4110760-1466387996 -o /tmp/evaluation-result-4110760-1466387996/solver-4110760-1466387996 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node112-1466384098-27449 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4110760-1466387996.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b49372ae14a7b33958e518ad7cedb27
RANDOM SEED=1759446809

node112.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.46
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5321.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.734
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        17980620 kB
Buffers:           42692 kB
Cached:            81596 kB
SwapCached:          948 kB
Active:         13339132 kB
Inactive:          53968 kB
Active(anon):   13269320 kB
Inactive(anon):     1332 kB
Active(file):      69812 kB
Inactive(file):    52636 kB
Unevictable:      737664 kB
Mlocked:          682476 kB
SwapTotal:      67108856 kB
SwapFree:       67097688 kB
Dirty:             18240 kB
Writeback:             0 kB
AnonPages:      14027440 kB
Mapped:            10772 kB
Shmem:                 0 kB
Slab:             599268 kB
SReclaimable:      43040 kB
SUnreclaim:       556228 kB
KernelStack:        1504 kB
PageTables:        31540 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:   14150560 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    278528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71680 MiB
End job on node112 at 2016-06-20 04:29:57