Trace number 4079189

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.3 1800.61

General information on the benchmark

Name/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/
random/rand.biglist/normalized-randb87834.cudf.trendy.opb
MD5SUM0943b182df2e177c3d79717513972d5f
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark36760393453
Best CPU time to get the best result obtained on this benchmark6.38303
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables7662
Total number of constraints32098
Number of constraints which are clauses31783
Number of constraints which are cardinality constraints (but not clauses)315
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint553
Number of terms in the objective function 3648
Biggest coefficient in the objective function 6088387976
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 3360783495473
Number of bits of the sum of numbers in the objective function 42
Biggest number in a constraint 6088387976
Number of bits of the biggest number in a constraint 33
Biggest sum of numbers in a constraint 3360783495473
Number of bits of the biggest sum of numbers42
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c 2016-06-07T05:48:40+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4079189-1465271320.opb"]
0.00/0.01	c use --random-gen="3643106381 830465678 471140241 722804264 2237181472 2116784575 1180695039 610240197 1418163108 1674653673 4019837007 3648315004 1186612359 3823547765 2250010279 3422875037 2913585061 421074501 878128586 3618967479 686500251 1688030111 2408770160 2027982385 3255965458 1408550057 1537817683 3539709790 2052408222 261751954 3910538499 2393481292 3354036497 1112019442 890576947 3569781929 639319048 1107413102 2911986768 597987788 637505604 4083639490 71837715 2149465508 228844227 3970636115 2769209386 2825834657 1700827875 1056419788 3672555796 3680305494 3640353326 3905947089 3123895718 2123275013 1299348989 3839151720 622384835 3300926189 4193792311 4226242370 2766543959 367409893 1055090290 2482265182 2864824611 2722838267 876841374 835321202 232600491 3530152635 4205798306 1360584379 244021526 1011191925 664093264 3065911932 80495651 1119304106 764594985 2811825066 16616151 3711765029 2333968304 63709260 3189820175 2014268141 815392409 2117852534 2440197207 1287059427 2358181091 3399559050 3151579760 2137775726 298113586 2448200594 2215048119 2104793469 2964266369 2342715270 2255024208 2017373538 1871443235 2659323458 1930044524 1640364367 3480722566 665029492 546818826 2639531958 1992337399 3662496602 3726355125 1517985848 1721351335 158779220 2093885624 2218987846 1068703546 3933778391 1230770471 2077177046 4230495066 785511023 3251271626 1148632428 2824336757 1692972461 1062827187 3318909916 577877862 840689158 1872538247 2271554742 1005925028 2070450941 945856281 2045358817 2999901442 1319981550 2856307277 692483571 541818374 262956929 2049192180 619765132 422319465 2833660306 1154556688 2557968547 997189301 1185405510 1629345666 2800508364 3616777120 1720661073 3924887198 4226339501 3887843076 1857324200 3583660282 2821381772 1844202816 908907419 3339534661 2404897981 1668862721 3806180582 2539018182 1205299375 1724376952 4268819583 4089500848 2250154443 1350356544 3986113221 2101817211 117048673 2208843617 3487948355 1831222612 1778342588 4214580868 2259491974 302070822 3201004601 1056273580 3191814324 1027977854 4104784781 2916797993 654731628 3323251087 2875509408 2248469756 3703033884 2242899199 2940674172 2243675486 766869522 697050442 1454203681 2553828644 3734738525 2112997251 1973426783 1046007745 1776321798 2748412681 623253756 2556095291 744276284 3909928896 3217623338 2943344900 577348668 1025818946 2648486203 3633115469 801714052 3038812964 2806085865 2764189022 1887441612 3937451653 2933317518 2035331312 1786110934 1893134922 3862413694 724936440 1225917320 1442715278 3350388462 2810646112 2949255408 3556685607 2740161904 2755963393 1806909690 349390019 1747397022 443092376 3037202359 3791235847 926035787 1473124266 415139209 1838645890 842941511 2930443525 1826976317 2446100554 731018180 255 362436" option to reproduce the execution
0.19/0.23	c #vars 7662
0.19/0.23	c #constraints 32098
0.59/0.65	c BCD2: Hardening is enabled.
0.59/0.65	c BCD2: BiasedSearch is enabled.
0.59/0.65	c Solving starts ...
0.59/0.65	c ============================[ Search Statistics ]============================
0.59/0.65	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
0.59/0.65	c       |         |          |          |    Limit     GC | Var      | Constra 
0.59/0.65	c =============================================================================
0.59/0.65	c  0.0s |       0 |        0 |        0 |    12738      0 |     1171 |        0
0.89/0.99	c  0.3s |       0 |    29500 |       83 |    12738      0 |     1192 |     6152
0.89/0.99	c #cpu_time = 0.336s
0.89/0.99	c #wall_clock_time = 0.337s
0.89/0.99	c #decision = 29500
0.89/0.99	c #random_decision = 87
0.89/0.99	c #conflict = 83
0.89/0.99	c #restart = 0
0.89/0.99	o 526362147614
1342.35/1342.64	c BCD2: updating upper bound: 3360783495473 -> 526362147613

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4079189-1465271320/watcher-4079189-1465271320 -o /tmp/evaluation-result-4079189-1465271320/solver-4079189-1465271320 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node136-1465261284-9910 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079189-1465271320.opb 

pid=11326
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.30 2.26 2.21 3/179 11329
/proc/meminfo: memFree=29045552/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=827972 CPUtime=0 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 3112 0 0 0 0 0 0 0 20 0 4 0 109065352 847843328 2962 33554432000 4194304 16246674 140736489097360 140736489096784 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 207761 2970 442 2943 0 204655 0
[pid=11329/tid=11330] ppid=11326 vsize=845380 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 865669120 3030 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=849476 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 869863424 3046 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=854596 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109065352 875106304 3066 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100167 s]
/proc/loadavg: 2.30 2.26 2.21 3/179 11329
/proc/meminfo: memFree=29045552/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1221188 CPUtime=0.09 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 28910 0 0 0 6 3 0 0 20 0 4 0 109065352 1250496512 28698 33554432000 4194304 16246674 140736489097360 140736489096672 4221016 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 305297 28705 801 2943 0 302191 0
[pid=11329/tid=11330] ppid=11326 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1250496512 28709 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1250496512 28714 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1250496512 28718 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1221188

[startup+0.20051 s]
/proc/loadavg: 2.30 2.26 2.21 3/179 11329
/proc/meminfo: memFree=29045552/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1313348 CPUtime=0.19 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 51575 0 0 0 13 6 0 0 20 0 4 0 109065352 1344868352 51874 33554432000 4194304 16246674 140736489097360 140736489096024 4221016 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328337 51874 801 2943 0 325231 0
[pid=11329/tid=11330] ppid=11326 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1344868352 51874 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1344868352 51874 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1344868352 51874 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1313348

[startup+0.300461 s]
/proc/loadavg: 2.30 2.26 2.21 3/179 11329
/proc/meminfo: memFree=29045552/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1314372 CPUtime=0.29 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 51666 0 0 0 23 6 0 0 20 0 4 0 109065352 1345916928 51965 33554432000 4194304 16246674 140736489097360 140736489096024 6757339 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328593 51965 835 2943 0 325487 0
[pid=11329/tid=11330] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 51965 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 51965 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 51965 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.700403 s]
/proc/loadavg: 2.30 2.26 2.21 3/179 11329
/proc/meminfo: memFree=29045552/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1314372 CPUtime=0.69 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 109936 0 0 0 54 15 0 0 20 0 4 0 109065352 1345916928 110235 33554432000 4194304 16246674 140736489097360 140736489096024 5532301 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328593 110242 889 2943 0 325487 0
[pid=11329/tid=11330] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 110249 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 110255 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 110260 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.50041 s]
/proc/loadavg: 2.30 2.26 2.21 4/183 11333
/proc/meminfo: memFree=28303944/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1314372 CPUtime=1.49 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 269280 0 0 0 113 36 0 0 20 0 4 0 109065352 1345916928 269579 33554432000 4194304 16246674 140736489097360 140736489096672 13950188 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328593 269579 899 2943 0 325487 0
[pid=11329/tid=11330] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269579 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269579 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269579 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1314372

[startup+3.10041 s]
/proc/loadavg: 2.30 2.26 2.21 4/183 11333
/proc/meminfo: memFree=27968028/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1314372 CPUtime=3.09 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 269283 0 0 0 273 36 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140736489079232 12371212 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328593 269582 899 2943 0 325487 0
[pid=11329/tid=11330] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1314372

[startup+6.30041 s]
/proc/loadavg: 2.27 2.26 2.21 4/183 11333
/proc/meminfo: memFree=27967668/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1314372 CPUtime=6.29 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 269283 0 0 0 593 36 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140736489079232 12654426 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328593 269582 899 2943 0 325487 0
[pid=11329/tid=11330] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1314372

[startup+12.7004 s]
/proc/loadavg: 2.25 2.25 2.20 3/183 11333
/proc/meminfo: memFree=27967864/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1314372 CPUtime=12.69 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 269283 0 0 0 1233 36 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140736489079232 12371164 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328593 269582 899 2943 0 325487 0
[pid=11329/tid=11330] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1345916928 269582 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1314372

[startup+25.5005 s]
/proc/loadavg: 2.34 2.27 2.21 4/183 11333
/proc/meminfo: memFree=27967700/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1315396 CPUtime=25.48 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 269539 0 0 0 2512 36 0 0 20 0 4 0 109065352 1346965504 269838 33554432000 4194304 16246674 140736489097360 140736489079232 12449395 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 328849 269838 899 2943 0 325743 0
[pid=11329/tid=11330] ppid=11326 vsize=1315396 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1346965504 269838 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1315396 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1346965504 269838 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1315396 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1346965504 269838 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1315396

[startup+51.1005 s]
/proc/loadavg: 2.22 2.25 2.20 3/183 11333
/proc/meminfo: memFree=27893248/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=1390148 CPUtime=51.08 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 288227 0 0 0 5070 38 0 0 20 0 4 0 109065352 1423511552 288526 33554432000 4194304 16246674 140736489097360 140736489079232 4220507 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 347537 288526 899 2943 0 344431 0
[pid=11329/tid=11330] ppid=11326 vsize=1390148 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 1423511552 288526 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=1390148 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 1423511552 288526 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=1390148 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 1423511552 288526 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1390148

[startup+102.3 s]
/proc/loadavg: 2.19 2.24 2.20 3/184 11337
/proc/meminfo: memFree=26920516/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=2360900 CPUtime=102.28 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 581859 0 0 0 10151 77 0 0 20 0 4 0 109065352 2417561600 531214 33554432000 4194304 16246674 140736489097360 140736489095232 13901579 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 590225 531214 899 2943 0 587119 0
[pid=11329/tid=11330] ppid=11326 vsize=2360900 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 2417561600 531214 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=2360900 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 2417561600 531214 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=2360900 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 2417561600 531214 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2360900


################
# More data... #
################

/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 9607647232 2286871 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=9382468 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 9607647232 2286871 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=9382468 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 9607647232 2286871 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1302.06
Current children cumulated vsize (KiB) 9382468

[startup+1362.3 s]
/proc/loadavg: 2.11 2.18 2.18 4/183 11440
/proc/meminfo: memFree=26584456/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=2636356 CPUtime=1362.05 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 8450041 0 0 0 134783 1422 0 0 20 0 4 0 109065352 2699628544 600347 33554432000 4194304 16246674 140736489097360 140736489095168 12371171 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 659089 600347 903 2943 0 655983 0
[pid=11329/tid=11330] ppid=11326 vsize=2636356 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 2699628544 600347 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=2636356 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 2699628544 600347 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=2636356 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 2699628544 600347 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1362.05
Current children cumulated vsize (KiB) 2636356

[startup+1422.3 s]
/proc/loadavg: 2.23 2.19 2.18 3/183 11441
/proc/meminfo: memFree=27210228/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=2013764 CPUtime=1422.04 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 8450047 0 0 0 140778 1426 0 0 20 0 4 0 109065352 2062094336 444699 33554432000 4194304 16246674 140736489097360 140736489096456 4220880 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 503441 444699 903 2943 0 500335 0
[pid=11329/tid=11330] ppid=11326 vsize=2013764 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 2062094336 444699 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=2013764 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 2062094336 444699 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=2013764 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 2062094336 444699 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1422.04
Current children cumulated vsize (KiB) 2013764

[startup+1482.3 s]
/proc/loadavg: 2.22 2.20 2.18 3/183 11442
/proc/meminfo: memFree=26624984/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=2598468 CPUtime=1482.02 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 8596224 0 0 0 146755 1447 0 0 20 0 4 0 109065352 2660831232 590875 33554432000 4194304 16246674 140736489097360 140736489096456 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 649617 590875 903 2943 0 646511 0
[pid=11329/tid=11330] ppid=11326 vsize=2598468 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 2660831232 590875 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=2598468 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 2660831232 590875 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=2598468 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 2660831232 590875 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 2598468

[startup+1542.31 s]
/proc/loadavg: 2.16 2.19 2.18 3/183 11444
/proc/meminfo: memFree=26189416/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=3032644 CPUtime=1542.02 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 8704768 0 0 0 152736 1466 0 0 20 0 4 0 109065352 3105427456 699419 33554432000 4194304 16246674 140736489097360 140736489095168 4206671 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 758161 699419 903 2943 0 755055 0
[pid=11329/tid=11330] ppid=11326 vsize=3032644 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 3105427456 699419 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=3032644 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 3105427456 699419 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=3032644 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 3105427456 699419 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 3032644

[startup+1602.3 s]
/proc/loadavg: 2.16 2.18 2.18 3/183 11445
/proc/meminfo: memFree=25622700/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=3495492 CPUtime=1602 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 8820480 0 0 0 158714 1486 0 0 20 0 4 0 109065352 3579383808 815131 33554432000 4194304 16246674 140736489097360 140736489096456 15015658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 873873 815131 903 2943 0 870767 0
[pid=11329/tid=11330] ppid=11326 vsize=3495492 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 3579383808 815131 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=3495492 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 3579383808 815131 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=3495492 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 3579383808 815131 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 3495492

[startup+1662.3 s]
/proc/loadavg: 2.16 2.18 2.18 4/183 11446
/proc/meminfo: memFree=25264744/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=3838532 CPUtime=1662 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 8906241 0 0 0 164697 1503 0 0 20 0 4 0 109065352 3930656768 900891 33554432000 4194304 16246674 140736489097360 140736489096672 15015658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 959633 900891 903 2943 0 956527 0
[pid=11329/tid=11330] ppid=11326 vsize=3838532 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 3930656768 900891 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=3838532 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 3930656768 900891 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=3838532 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 3930656768 900891 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1662
Current children cumulated vsize (KiB) 3838532

[startup+1722.3 s]
/proc/loadavg: 2.17 2.17 2.17 3/183 11447
/proc/meminfo: memFree=25092380/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=4005444 CPUtime=1721.99 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 9053698 0 0 0 170666 1533 0 0 20 0 4 0 109065352 4101574656 942619 33554432000 4194304 16246674 140736489097360 140736489095168 4206964 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 1001361 942619 903 2943 0 998255 0
[pid=11329/tid=11330] ppid=11326 vsize=4005444 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 4101574656 942619 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=4005444 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 4101574656 942619 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=4005444 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 4101574656 942619 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1721.99
Current children cumulated vsize (KiB) 4005444

[startup+1782.3 s]
/proc/loadavg: 2.34 2.23 2.19 3/183 11448
/proc/meminfo: memFree=24944692/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=4143684 CPUtime=1781.97 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 9183748 0 0 0 176639 1558 0 0 20 0 4 0 109065352 4243132416 977179 33554432000 4194304 16246674 140736489097360 140736489096456 15015658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 1035921 977179 903 2943 0 1032815 0
[pid=11329/tid=11330] ppid=11326 vsize=4143684 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 4243132416 977179 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=4143684 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 4243132416 977179 33554432000 4194304 16246674 140736489097360 140303552978160 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=4143684 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 4243132416 977179 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1781.97
Current children cumulated vsize (KiB) 4143684



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.27 2.22 2.19 4/183 11449
/proc/meminfo: memFree=24846604/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=4241988 CPUtime=1800.07 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) R 11326 11329 9894 0 -1 4202496 9264900 0 0 0 178433 1574 0 0 20 0 4 0 109065352 4343795712 1001755 33554432000 4194304 16246674 140736489097360 140736489095232 4220936 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 1060497 1001755 903 2943 0 1057391 0
[pid=11329/tid=11330] ppid=11326 vsize=4241988 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) S 11326 11329 9894 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109065352 4343795712 1001755 33554432000 4194304 16246674 140736489097360 140303563468016 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=11329/tid=11331] ppid=11326 vsize=4241988 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11331/stat : 11331 (toysat) S 11326 11329 9894 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109065352 4343795712 1001755 33554432000 4194304 16246674 140736489097360 140303552977936 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11329/tid=11332] ppid=11326 vsize=4241988 CPUtime=0 cores=0,2,4,6
/proc/11329/task/11332/stat : 11332 (toysat) S 11326 11329 9894 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109065352 4343795712 1001755 33554432000 4194304 16246674 140736489097360 140303542504624 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 4241988

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 11329 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.27 2.22 2.19 4/183 11449
/proc/meminfo: memFree=24846604/32872528 swapFree=15272/1656604
[pid=11329] ppid=11326 vsize=0 CPUtime=1800.28 cores=0,2,4,6
/proc/11329/stat : 11329 (toysat) Z 11326 11329 9894 0 -1 4203532 9264900 0 0 0 178434 1594 0 0 20 0 2 0 109065352 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11329/statm: 0 0 0 0 0 0 0
[pid=11329/tid=11330] ppid=11326 vsize=0 CPUtime=0.18 cores=0,2,4,6
/proc/11329/task/11330/stat : 11330 (toysat) R 11326 11329 9894 0 -1 4203588 10 0 0 0 0 18 0 0 20 0 2 0 109065352 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1800.28
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.61
CPU time (s): 1800.3
CPU user time (s): 1784.35
CPU system time (s): 15.9476
CPU usage (%): 99.9825
Max. virtual memory (cumulated for all children) (KiB): 9446980

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1784.35
system time used= 15.9476
maximum resident set size= 9212012
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9264900
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1390
involuntary context switches= 1921

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.50432 second user time and 6.96894 second system time

The end

Launcher Data

Begin job on node136 at 2016-06-07 05:48:40
IDJOB=4079189
IDBENCH=72355
IDSOLVER=2542
FILE ID=node136/4079189-1465271320
RUNJOBID= node136-1465261284-9910
PBS_JOBID= 19843291
Free space on /tmp= 71716 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/rand.biglist/normalized-randb87834.cudf.trendy.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4079189-1465271320/watcher-4079189-1465271320 -o /tmp/evaluation-result-4079189-1465271320/solver-4079189-1465271320 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node136-1465261284-9910 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079189-1465271320.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0943b182df2e177c3d79717513972d5f
RANDOM SEED=80404903

node136.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.959
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29045972 kB
Buffers:          105692 kB
Cached:           200632 kB
SwapCached:          812 kB
Active:          1246992 kB
Inactive:         187016 kB
Active(anon):    1128580 kB
Inactive(anon):     1256 kB
Active(file):     118412 kB
Inactive(file):   185760 kB
Unevictable:     1656604 kB
Mlocked:           15272 kB
SwapTotal:      67108856 kB
SwapFree:       67099384 kB
Dirty:             17644 kB
Writeback:             0 kB
AnonPages:       2789628 kB
Mapped:            11028 kB
Shmem:                 0 kB
Slab:             600284 kB
SReclaimable:      44092 kB
SUnreclaim:       556192 kB
KernelStack:        1520 kB
PageTables:         9932 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2925340 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2768896 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71700 MiB
End job on node136 at 2016-06-07 06:18:41