Trace number 4111396

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 1007.51 1007.7

General information on the benchmark

Namenormalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/
normalized-single-obj-f16-DCdoubleLoss.seq-B-2-1-irabcde.opb
MD5SUMd130aed09bd9937f5b9369dbe6a318a0
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark63597122513
Best CPU time to get the best result obtained on this benchmark1800.02
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6719
Total number of constraints20516
Number of constraints which are clauses20372
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints144
Minimum length of a constraint1
Maximum length of a constraint37
Number of terms in the objective function 552
Biggest coefficient in the objective function 416063742
Number of bits for the biggest coefficient in the objective function 29
Sum of the numbers in the objective function 153111457055
Number of bits of the sum of numbers in the objective function 38
Biggest number in a constraint 416063742
Number of bits of the biggest number in a constraint 29
Biggest sum of numbers in a constraint 153111457055
Number of bits of the biggest sum of numbers38
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c 2016-06-20T08:29:39+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4111396-1466404179.opb"]
0.00/0.01	c use --random-gen="2964256915 2067864384 1417261651 1230431996 117828992 2814033271 3475606515 3589699752 3106111259 2347449767 1722416295 3855437007 2489251282 1872641286 4210145078 1982974284 1470023141 2358195507 1774197030 1126795916 597787696 1051465094 2300339929 13932184 4231203572 2537774539 1888038 1474251068 1038944347 1202010000 708284890 4069504719 4192401548 867916051 677196885 4000276908 25096598 272617996 2653760050 1914703263 624580793 1520313424 3448508624 135262465 2175847674 1778654183 2617220279 3486828095 1885969479 4108560048 1650549267 1319148286 181248181 1274373322 275962433 3514215699 3609692512 3933540217 4202968692 3446567861 2374330655 4062838806 2484071642 3371634699 453330957 2208271937 667555162 1464125845 3059066119 1801920511 3416461699 1901699090 2101723042 1659284360 958841160 1118540095 2929303948 3882833013 855131336 1095966093 1551010639 2770428542 3913212486 405595697 4160485516 1022371600 3679004054 2353178856 4267990179 4255799476 282048698 2579552787 3280906271 3294290718 375328675 1611506539 754292298 256689219 2998077340 2984549799 2198344794 1516034551 1251219503 844624226 3036120890 1632956572 3455109941 3048364119 3265771105 351976250 752982940 2923947771 2819178871 1076314949 1980763097 3330069876 3652465878 3328035052 2735015165 2749771500 3873760494 4224310702 409031203 3142600691 305325158 3298321521 1139788022 187149920 25511384 303982999 102325986 4269380304 1485463970 3074529964 2879065136 3481419831 955629001 964753139 204643167 970848966 1767267595 672294719 2899958748 1710681692 1778321683 1984188771 3383179660 626372304 517272566 2447149746 4142151981 1592892381 1887864722 909954428 2488977324 602688482 323731030 2778212494 3793317959 531624639 1389807362 1084316869 3979520847 1488329031 18158583 3495509768 168908371 3295089802 3446267933 2763147267 2941426510 3195947355 4119684625 3743305533 2275706343 1297767086 3046856627 411704126 2296532358 3372674663 2030703843 4126136611 3108684017 1612151047 857387680 3568727958 3306488999 4211586053 4200701495 341071936 2661418256 3014291393 3008067636 334323564 3089493101 2664478287 353323187 2602016212 2729272746 1894526218 246047347 1079517060 2630005092 1104695524 4103304593 3473673204 3219376441 1516531325 1197860425 2855935862 3806285712 1637467498 3076267136 3085901551 312231739 986745811 1219525150 2119545753 1779088975 1156841829 677101244 501850394 1914528126 2289447907 2251892498 3238387546 591632722 1485459681 2077011962 816547854 3783420163 186810727 3528965327 1927176101 414174165 1925457960 1043532106 3051987533 2709223700 415321831 3251754079 294284339 2611586360 1003236669 1029257363 321819596 933153653 4137539812 2648973849 287978890 3537447138 1467866892 683400711 1834747598 3895517910 2103921702 255 362436" option to reproduce the execution
0.09/0.15	c #vars 6719
0.09/0.15	c #constraints 20516
0.29/0.37	c BCD2: Hardening is enabled.
0.29/0.37	c BCD2: BiasedSearch is enabled.
0.29/0.37	c Solving starts ...
0.29/0.37	c ============================[ Search Statistics ]============================
0.29/0.37	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
0.29/0.37	c       |         |          |          |    Limit     GC | Var      | Constra 
0.29/0.37	c =============================================================================
0.39/0.40	c  0.0s |       0 |        0 |        0 |     8184      0 |     1049 |        0
0.39/0.43	c  0.1s |       0 |      582 |       16 |     8184      0 |     1049 |     1032
0.39/0.43	c #cpu_time = 0.057s
0.39/0.43	c #wall_clock_time = 0.057s
0.39/0.43	c #decision = 582
0.39/0.43	c #random_decision = 2
0.39/0.43	c #conflict = 16
0.39/0.43	c #restart = 0
0.39/0.43	o 114831718631
0.39/0.44	c BCD2: updating upper bound: 153111457055 -> 114831718630

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4111396-1466404179/watcher-4111396-1466404179 -o /tmp/evaluation-result-4111396-1466404179/solver-4111396-1466404179 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node134-1466401273-1080 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4111396-1466404179.opb 

pid=1509
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.23 2.20 2.27 3/181 1512
/proc/meminfo: memFree=18974692/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=390588 CPUtime=0 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 1395 0 0 0 0 0 0 0 20 0 4 0 42464345 399962112 1756 33554432000 4194304 16246674 140734309850224 140734309849160 13880264 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 98159 1766 441 2943 0 95053 0
[pid=1512/tid=1513] ppid=1509 vsize=583100 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 597094400 2511 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=588220 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 602337280 2528 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=592316 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 42464346 606531584 2547 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0

[startup+0.100153 s]
/proc/loadavg: 2.23 2.20 2.27 3/181 1512
/proc/meminfo: memFree=18974692/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1221188 CPUtime=0.09 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 25447 0 0 0 6 3 0 0 20 0 4 0 42464345 1250496512 25745 33554432000 4194304 16246674 140734309850224 140734309849536 4221129 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 305297 25745 798 2943 0 302191 0
[pid=1512/tid=1513] ppid=1509 vsize=1221188 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1250496512 25745 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1221188 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1250496512 25745 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1221188 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1250496512 25745 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1221188

[startup+0.200537 s]
/proc/loadavg: 2.23 2.20 2.27 3/181 1512
/proc/meminfo: memFree=18974692/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1302084 CPUtime=0.19 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 45507 0 0 0 12 7 0 0 20 0 4 0 42464345 1333334016 45805 33554432000 4194304 16246674 140734309850224 140734309849536 13759547 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 325521 45805 834 2943 0 322415 0
[pid=1512/tid=1513] ppid=1509 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1333334016 45805 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1333334016 45805 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1333334016 45805 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1302084

[startup+0.300488 s]
/proc/loadavg: 2.23 2.20 2.27 3/181 1512
/proc/meminfo: memFree=18974692/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1302084 CPUtime=0.29 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 59648 0 0 0 20 9 0 0 20 0 4 0 42464345 1333334016 59946 33554432000 4194304 16246674 140734309850224 140734309832128 12874965 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 325521 59955 834 2943 0 322415 0
[pid=1512/tid=1513] ppid=1509 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1333334016 59960 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1333334016 59965 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1333334016 59970 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1302084

[startup+0.700407 s]
/proc/loadavg: 2.23 2.20 2.27 3/181 1512
/proc/meminfo: memFree=18974692/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1313348 CPUtime=0.69 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 112574 0 0 0 52 17 0 0 20 0 4 0 42464345 1344868352 112872 33554432000 4194304 16246674 140734309850224 140734309849536 12655109 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 328337 112886 899 2943 0 325231 0
[pid=1512/tid=1513] ppid=1509 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1344868352 112894 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1344868352 112902 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1344868352 112909 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1313348

[startup+1.5004 s]
/proc/loadavg: 2.23 2.20 2.27 3/185 1516
/proc/meminfo: memFree=18111912/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1368644 CPUtime=1.49 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 283336 0 0 0 111 38 0 0 20 0 4 0 42464345 1401491456 283634 33554432000 4194304 16246674 140734309850224 140734309832128 12371191 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 342161 283634 899 2943 0 339055 0
[pid=1512/tid=1513] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283634 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283634 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283634 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1368644

[startup+3.10041 s]
/proc/loadavg: 2.29 2.21 2.27 3/185 1516
/proc/meminfo: memFree=17841228/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1368644 CPUtime=3.09 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 283358 0 0 0 271 38 0 0 20 0 4 0 42464345 1401491456 283656 33554432000 4194304 16246674 140734309850224 140734309832128 12654434 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 342161 283656 899 2943 0 339055 0
[pid=1512/tid=1513] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283656 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283656 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283656 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1368644

[startup+6.30042 s]
/proc/loadavg: 2.29 2.21 2.27 3/185 1516
/proc/meminfo: memFree=17841256/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1368644 CPUtime=6.29 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 283358 0 0 0 591 38 0 0 20 0 4 0 42464345 1401491456 283656 33554432000 4194304 16246674 140734309850224 140734309848064 12429162 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 342161 283656 899 2943 0 339055 0
[pid=1512/tid=1513] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283656 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283656 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1401491456 283656 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1368644

[startup+12.7004 s]
/proc/loadavg: 2.25 2.21 2.27 3/185 1516
/proc/meminfo: memFree=19483568/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=1598020 CPUtime=12.69 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 340702 0 0 0 1225 44 0 0 20 0 4 0 42464345 1636372480 341000 33554432000 4194304 16246674 140734309850224 140734309849536 4220897 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 399505 341000 899 2943 0 396399 0
[pid=1512/tid=1513] ppid=1509 vsize=1598020 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 1636372480 341000 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=1598020 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 1636372480 341000 33554432000 4194304 16246674 140734309850224 140581460220944 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=1598020 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 1636372480 341000 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1598020

[startup+25.5004 s]
/proc/loadavg: 2.21 2.20 2.27 4/186 1519
/proc/meminfo: memFree=19024192/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=2093636 CPUtime=25.48 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 464428 0 0 0 2488 60 0 0 20 0 4 0 42464345 2143883264 464726 33554432000 4194304 16246674 140734309850224 140734309848064 4221016 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 523409 464734 900 2943 0 520303 0
[pid=1512/tid=1513] ppid=1509 vsize=2093636 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 2143883264 464737 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=2093636 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 2143883264 464744 33554432000 4194304 16246674 140734309850224 140581460220944 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=2093636 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 2143883264 464748 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 2093636

[startup+51.1004 s]
/proc/loadavg: 2.34 2.23 2.28 3/186 1519
/proc/meminfo: memFree=14800248/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=3002948 CPUtime=51.08 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 691936 0 0 0 5013 95 0 0 20 0 4 0 42464345 3075018752 692234 33554432000 4194304 16246674 140734309850224 140734309849536 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 750737 692234 900 2943 0 747631 0
[pid=1512/tid=1513] ppid=1509 vsize=3002948 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 3075018752 692234 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=3002948 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 3075018752 692234 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=3002948 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 3075018752 692234 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 3002948

[startup+102.301 s]
/proc/loadavg: 2.22 2.22 2.27 3/185 1521
/proc/meminfo: memFree=12354288/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=4842052 CPUtime=102.28 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 1151712 0 0 0 10068 160 0 0 20 0 4 0 42464345 4958261248 1152010 33554432000 4194304 16246674 140734309850224 140734309849320 4206587 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 1210513 1152010 900 2943 0 1207407 0
[pid=1512/tid=1513] ppid=1509 vsize=4842052 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 4958261248 1152010 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=4842052 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 4958261248 1152010 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=4842052 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 4958261248 1152010 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 4842052


################
# More data... #
################

/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 3997417 0 0 0 57598 622 0 0 20 0 4 0 42464345 14208798720 3410450 33554432000 4194304 16246674 140734309850224 140734309848192 14013898 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3468945 3410450 904 2943 0 3465839 0
[pid=1512/tid=1513] ppid=1509 vsize=13875780 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 14208798720 3410450 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=13875780 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 14208798720 3410450 33554432000 4194304 16246674 140734309850224 140581460220944 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=13875780 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 14208798720 3410450 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 13875780

[startup+642.3 s]
/proc/loadavg: 2.21 2.21 2.23 3/186 1591
/proc/meminfo: memFree=9833232/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=13732420 CPUtime=642.19 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 3997417 0 0 0 63591 628 0 0 20 0 4 0 42464345 14061998080 3374610 33554432000 4194304 16246674 140734309850224 140734309849320 14628944 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3433105 3374610 904 2943 0 3429999 0
[pid=1512/tid=1513] ppid=1509 vsize=13732420 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 14061998080 3374610 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=13732420 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 14061998080 3374610 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=13732420 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 14061998080 3374610 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 642.19
Current children cumulated vsize (KiB) 13732420

[startup+702.3 s]
/proc/loadavg: 2.30 2.24 2.24 4/185 1593
/proc/meminfo: memFree=7384064/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=14051908 CPUtime=702.18 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 4077289 0 0 0 69572 646 0 0 20 0 4 0 42464345 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140734309848128 13899725 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3512977 3454482 904 2943 0 3509871 0
[pid=1512/tid=1513] ppid=1509 vsize=14051908 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=14051908 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140581460220944 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=14051908 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 702.18
Current children cumulated vsize (KiB) 14051908

[startup+762.3 s]
/proc/loadavg: 2.39 2.27 2.25 4/185 1594
/proc/meminfo: memFree=5535632/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=14051908 CPUtime=762.17 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 4077292 0 0 0 75568 649 0 0 20 0 4 0 42464345 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140734309849320 14628944 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3512977 3454482 904 2943 0 3509871 0
[pid=1512/tid=1513] ppid=1509 vsize=14051908 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=14051908 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=14051908 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 14389153792 3454482 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 762.17
Current children cumulated vsize (KiB) 14051908

[startup+822.3 s]
/proc/loadavg: 2.28 2.26 2.24 3/185 1595
/proc/meminfo: memFree=3324488/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=14748228 CPUtime=822.15 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 4196512 0 0 0 81542 673 0 0 20 0 4 0 42464345 15102185472 3628379 33554432000 4194304 16246674 140734309850224 140734309848064 14006482 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3687057 3628379 904 2943 0 3683951 0
[pid=1512/tid=1513] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628379 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628379 33554432000 4194304 16246674 140734309850224 140581460220944 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628379 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 822.15
Current children cumulated vsize (KiB) 14748228

[startup+882.308 s]
/proc/loadavg: 2.22 2.25 2.24 4/185 1596
/proc/meminfo: memFree=2491684/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=14748228 CPUtime=882.15 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 4196695 0 0 0 87536 679 0 0 20 0 4 0 42464345 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140734309849320 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3687057 3628562 904 2943 0 3683951 0
[pid=1512/tid=1513] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 882.15
Current children cumulated vsize (KiB) 14748228

[startup+942.3 s]
/proc/loadavg: 2.29 2.27 2.25 3/185 1597
/proc/meminfo: memFree=1977896/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=14748228 CPUtime=942.13 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 4196698 0 0 0 93531 682 0 0 20 0 4 0 42464345 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140734309848192 14013920 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3687057 3628562 904 2943 0 3683951 0
[pid=1512/tid=1513] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581460220944 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 942.13
Current children cumulated vsize (KiB) 14748228

[startup+1002.3 s]
/proc/loadavg: 2.24 2.26 2.24 4/185 1600
/proc/meminfo: memFree=1977440/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=14748228 CPUtime=1002.12 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 4196698 0 0 0 99526 686 0 0 20 0 4 0 42464345 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140734309849400 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3687057 3628562 904 2943 0 3683951 0
[pid=1512/tid=1513] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=14748228 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 15102185472 3628562 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1002.12
Current children cumulated vsize (KiB) 14748228



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1006.9 s]
/proc/loadavg: 2.24 2.26 2.24 3/185 1600
/proc/meminfo: memFree=1013944/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=15872580 CPUtime=1006.72 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) R 1509 1512 26903 0 -1 4202496 4477668 0 0 0 99943 729 0 0 20 0 4 0 42464345 16253521920 3909532 33554432000 4194304 16246674 140734309850224 140734309849400 4221016 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 3968145 3909542 904 2943 0 3965039 0
[pid=1512/tid=1513] ppid=1509 vsize=15872580 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1513/stat : 1513 (toysat) S 1509 1512 26903 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 42464346 16253521920 3909547 33554432000 4194304 16246674 140734309850224 140581470711024 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 1 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=15872580 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) S 1509 1512 26903 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 42464346 16253521920 3909551 33554432000 4194304 16246674 140734309850224 140581460221168 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=1512/tid=1515] ppid=1509 vsize=15872580 CPUtime=0 cores=1,3,5,7
/proc/1512/task/1515/stat : 1515 (toysat) S 1509 1512 26903 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 42464346 16253521920 3909556 33554432000 4194304 16246674 140734309850224 140581449747632 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1006.72
Current children cumulated vsize (KiB) 15872580

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 1512 sig 9
??? kill -1512 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1007.2 s]
/proc/loadavg: 2.24 2.26 2.24 3/185 1600
/proc/meminfo: memFree=1013944/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=0 CPUtime=1007.02 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) Z 1509 1512 26903 0 -1 4203532 4478145 0 0 0 99943 759 0 0 20 0 2 0 42464345 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 0 0 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=0 CPUtime=0.28 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) R 1509 1512 26903 0 -1 4203588 8 0 0 0 0 28 0 0 20 0 2 0 42464346 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1007.02
Current children cumulated vsize (KiB) 0

[startup+1007.6 s]
/proc/loadavg: 2.22 2.25 2.24 3/183 1600
/proc/meminfo: memFree=14540916/32872528 swapFree=1482636/1662508
[pid=1512] ppid=1509 vsize=0 CPUtime=1007.42 cores=1,3,5,7
/proc/1512/stat : 1512 (toysat) Z 1509 1512 26903 0 -1 4203532 4478145 0 0 0 99943 799 0 0 20 0 2 0 42464345 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/1512/statm: 0 0 0 0 0 0 0
[pid=1512/tid=1514] ppid=1509 vsize=0 CPUtime=0.69 cores=1,3,5,7
/proc/1512/task/1514/stat : 1514 (toysat) R 1509 1512 26903 0 -1 4203588 8 0 0 0 0 69 0 0 20 0 2 0 42464346 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1007.42
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1007.7
CPU time (s): 1007.51
CPU user time (s): 999.432
CPU system time (s): 8.08277
CPU usage (%): 99.9821
Max. virtual memory (cumulated for all children) (KiB): 15872580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 999.432
system time used= 8.08277
maximum resident set size= 15640036
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4478145
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 319
involuntary context switches= 1019

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 2.50162 second user time and 3.9204 second system time

The end

Launcher Data

Begin job on node134 at 2016-06-20 08:29:39
IDJOB=4111396
IDBENCH=109230
IDSOLVER=2542
FILE ID=node134/4111396-1466404179
RUNJOBID= node134-1466401273-1080
PBS_JOBID= 19923272
Free space on /tmp= 71704 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB16/normalized-PB16/OPT-BIGINT-LIN/lion9-single-obj/normalized-single-obj-f16-DCdoubleLoss.seq-B-2-1-irabcde.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4111396-1466404179/watcher-4111396-1466404179 -o /tmp/evaluation-result-4111396-1466404179/solver-4111396-1466404179 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node134-1466401273-1080 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4111396-1466404179.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d130aed09bd9937f5b9369dbe6a318a0
RANDOM SEED=597643946

node134.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 7358.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.020
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        18975932 kB
Buffers:           12272 kB
Cached:            71620 kB
SwapCached:          652 kB
Active:         11445756 kB
Inactive:          24920 kB
Active(anon):   11389036 kB
Inactive(anon):      776 kB
Active(file):      56720 kB
Inactive(file):    24144 kB
Unevictable:     1662508 kB
Mlocked:         1482636 kB
SwapTotal:      67108856 kB
SwapFree:       67098196 kB
Dirty:             17096 kB
Writeback:             0 kB
AnonPages:      13049044 kB
Mapped:             9664 kB
Shmem:                 0 kB
Slab:             605412 kB
SReclaimable:      49244 kB
SUnreclaim:       556168 kB
KernelStack:        1496 kB
PageTables:        30132 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:   13194836 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341987908 kB
HardwareCorrupted:     0 kB
AnonHugePages:    182272 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71688 MiB
End job on node134 at 2016-06-20 08:46:27