Trace number 4118038

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.14 1800.44

General information on the benchmark

NamePB15eval/normalized-PB15eval/OPT-BIGINT-NLC/
minlplib2-pb-0.1.0/opb/normalized-pb302075.opb
MD5SUM9b53703f0e50c3178451cfce8ff13bb7
Bench CategoryOPT-BIGINT-NLC (optimisation, big integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark4628361
Best CPU time to get the best result obtained on this benchmark1800.08
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables600
Total number of constraints50
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)30
Number of constraints which are nor clauses,nor cardinality constraints20
Minimum length of a constraint20
Maximum length of a constraint30
Number of terms in the objective function 165900
Biggest coefficient in the objective function 299670
Number of bits for the biggest coefficient in the objective function 19
Sum of the numbers in the objective function 1773948224
Number of bits of the sum of numbers in the objective function 31
Biggest number in a constraint 299670
Number of bits of the biggest number in a constraint 19
Biggest sum of numbers in a constraint 1773948224
Number of bits of the biggest sum of numbers31
Number of products (including duplicates)165300
Sum of products size (including duplicates)330600
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-29T18:36:32+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4118038-1467218191.opb"]
0.00/0.01	c use --random-gen="2084750102 3870113760 2535998577 2406582865 4176123167 1184867901 1773870053 1600203325 4115653266 475326431 2005219002 483180893 1819360807 3213537226 657157827 1490160845 2758079313 1052314419 3891016547 1382178662 2122095808 1877495973 2570558596 4214781623 409090156 440785049 150732244 867168491 3523742012 158448790 2600759697 2521446515 2757769414 3012053219 297250890 3074563372 522805591 627469897 3622981666 1128110299 2748267697 1025352712 2199792758 173129956 2093280562 2347635700 1515194260 3830939653 2885376498 1665367299 408158699 971033224 1192231397 1444789041 2832609520 3367092879 20149279 1435370926 787971761 3960654629 1867269639 2271864990 4103504456 1053806174 1264227899 167618313 4294379354 3636207945 2798935009 376478040 3857261821 4013832021 3689219779 260540867 62207209 2742621733 871620763 204885338 3277682651 4011668769 106358662 1658689670 3798968242 1858074446 806214531 1534106651 908540435 253700775 2091418332 3959395619 3719930841 1180831131 2610082425 239671109 457039269 2818928381 3131102344 2172610766 185821983 2416474870 3771367307 3889148924 201358285 3827577509 1156683668 3354358985 2389358079 1473596205 2057009845 223639663 291743549 1244465126 468987562 4247195131 3036464456 3197277848 4023598822 1580910292 2802829588 1543733225 1475179628 4252341320 2099399489 3898273321 1092565379 4181994026 1761853247 3825704298 2108313183 3662256950 2962841958 831431059 2363921329 2882736309 1268372491 301425890 1766164724 4225048793 1669771504 3297019610 1890351055 2584048405 31621156 3343623907 4130563331 1821448055 1945822445 2222128276 2902607223 1330575101 1150862679 4048418548 368819947 748849501 4079107610 4281696231 65344005 3793465715 3013801744 2294848115 896555480 1789409703 1891105351 587085720 1578353859 4116331132 4257764270 4160113283 895463903 2122464812 3180708854 1514148714 3873746212 4087941779 1987386420 2943464164 378853843 1628097771 1108306488 3457818928 1071498484 2236615162 151098261 2677103283 3378570077 2885061509 2683670686 2632853016 4106968809 2063349237 2561835794 1958870030 4029321915 1019076697 804410490 3009404229 1777656524 1287116061 452680271 3796601440 242135191 2298974092 76384489 1653085919 111801319 3609786713 889068511 234496330 2036953204 2493536828 4231060954 881672967 87134979 2559618321 2468701020 3242015591 318692531 2566849354 1468871161 403366264 800056885 2205330951 832243669 3303814112 1721700727 2274511514 1826590756 1230780049 4153155844 19579098 1662700951 4121463824 753678825 1188926196 4005449593 1961030216 1497522121 3995671062 1884352423 971270964 2369232005 2460528271 2015287016 695552408 2614416385 1176574887 4286315101 2539054759 35435162 2973026895 1802660919 1410563289 3778034259 218221823 1727738296 1238456084 255 362436" option to reproduce the execution
0.39/0.44	c #vars 600
0.39/0.44	c #constraints 50
3.09/3.32	c BCD2: Hardening is enabled.
3.09/3.32	c BCD2: BiasedSearch is enabled.
3.09/3.32	c Solving starts ...
3.09/3.32	c ============================[ Search Statistics ]============================
3.09/3.32	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
3.09/3.32	c       |         |          |          |    Limit     GC | Var      | Constra 
3.09/3.32	c =============================================================================
3.49/3.54	c  0.0s |       0 |        0 |        0 |   100531      0 |       56 |        0
4.19/4.21	c  0.7s |       0 |   165324 |        0 |   100531      0 |       56 |        0
4.19/4.21	c #cpu_time = 0.586s
4.19/4.21	c #wall_clock_time = 0.586s
4.19/4.21	c #decision = 165324
4.19/4.21	c #random_decision = 803
4.19/4.21	c #conflict = 0
4.19/4.21	c #restart = 0
4.19/4.21	o 8612871

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4118038-1467218191/watcher-4118038-1467218191 -o /tmp/evaluation-result-4118038-1467218191/solver-4118038-1467218191 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node119-1467209132-3988 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4118038-1467218191.opb 

pid=5112
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.23 2.21 2.18 3/179 5115
/proc/meminfo: memFree=24186032/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=784828 CPUtime=0 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 2940 0 0 0 0 0 0 0 20 0 4 0 2779993 803663872 3301 33554432000 4194304 16246674 140733693231808 140733693231232 15002730 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 196975 3310 441 2943 0 193869 0
[pid=5115/tid=5116] ppid=5112 vsize=803260 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 822538240 3373 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=808380 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 827781120 3392 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=812476 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2779993 831975424 3409 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100151 s]
/proc/loadavg: 2.23 2.21 2.18 3/179 5115
/proc/meminfo: memFree=24186032/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1301060 CPUtime=0.09 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 28240 0 0 0 6 3 0 0 20 0 4 0 2779993 1332285440 28540 33554432000 4194304 16246674 140733693231808 140733693231120 7364033 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 325265 28553 797 2943 0 322159 0
[pid=5115/tid=5116] ppid=5112 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1332285440 28563 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1332285440 28575 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1332285440 28587 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1301060

[startup+0.200476 s]
/proc/loadavg: 2.23 2.21 2.18 3/179 5115
/proc/meminfo: memFree=24186032/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1315396 CPUtime=0.19 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 45017 0 0 0 14 5 0 0 20 0 4 0 2779993 1346965504 45827 33554432000 4194304 16246674 140733693231808 140733693231120 13750945 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 328849 45827 798 2943 0 325743 0
[pid=5115/tid=5116] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 45827 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 45827 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 45827 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1315396

[startup+0.300464 s]
/proc/loadavg: 2.23 2.21 2.18 3/179 5115
/proc/meminfo: memFree=24186032/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1315396 CPUtime=0.29 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 50907 0 0 0 23 6 0 0 20 0 4 0 2779993 1346965504 51717 33554432000 4194304 16246674 140733693231808 140733693231120 7377468 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 328849 51717 798 2943 0 325743 0
[pid=5115/tid=5116] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 51717 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 51717 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 51717 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1315396

[startup+0.700336 s]
/proc/loadavg: 2.23 2.21 2.18 3/179 5115
/proc/meminfo: memFree=24186032/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1315396 CPUtime=0.69 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 56397 0 0 0 63 6 0 0 20 0 4 0 2779993 1346965504 57207 33554432000 4194304 16246674 140733693231808 140733693231120 13820656 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 328849 57207 847 2943 0 325743 0
[pid=5115/tid=5116] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 57207 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 57207 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 57207 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1315396

[startup+1.50033 s]
/proc/loadavg: 2.21 2.21 2.18 3/183 5119
/proc/meminfo: memFree=23166708/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1315396 CPUtime=1.49 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 89744 0 0 0 138 11 0 0 20 0 4 0 2779993 1346965504 90554 33554432000 4194304 16246674 140733693231808 140733693213696 13955792 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 328849 90554 847 2943 0 325743 0
[pid=5115/tid=5116] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 90554 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 90554 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1346965504 90554 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1315396

[startup+3.1004 s]
/proc/loadavg: 2.21 2.21 2.18 3/183 5119
/proc/meminfo: memFree=22902020/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1347140 CPUtime=3.09 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 205316 0 0 0 282 27 0 0 20 0 4 0 2779993 1379471360 206126 33554432000 4194304 16246674 140733693231808 140733693213696 13962196 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 336785 206126 847 2943 0 333679 0
[pid=5115/tid=5116] ppid=5112 vsize=1347140 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1379471360 206126 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1347140 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1379471360 206126 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1347140 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1379471360 206126 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1347140

[startup+6.30042 s]
/proc/loadavg: 2.21 2.21 2.18 3/183 5119
/proc/meminfo: memFree=22254604/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1393220 CPUtime=6.29 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 288984 0 0 0 590 39 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140733693213696 6955130 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 348305 289794 891 2943 0 345199 0
[pid=5115/tid=5116] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1393220

[startup+12.7004 s]
/proc/loadavg: 2.18 2.20 2.18 3/183 5119
/proc/meminfo: memFree=22250388/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1393220 CPUtime=12.69 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 288984 0 0 0 1230 39 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140733693213696 12656213 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 348305 289794 891 2943 0 345199 0
[pid=5115/tid=5116] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1393220

[startup+25.5077 s]
/proc/loadavg: 2.15 2.19 2.18 3/183 5119
/proc/meminfo: memFree=22250740/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1393220 CPUtime=25.5 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 288984 0 0 0 2511 39 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140733693213696 13878738 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 348305 289794 891 2943 0 345199 0
[pid=5115/tid=5116] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 1393220

[startup+51.1003 s]
/proc/loadavg: 2.22 2.20 2.18 3/183 5120
/proc/meminfo: memFree=22250156/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1393220 CPUtime=51.08 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 288984 0 0 0 5069 39 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140733693229632 12414096 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 348305 289794 891 2943 0 345199 0
[pid=5115/tid=5116] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1393220 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1426657280 289794 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1393220

[startup+102.3 s]
/proc/loadavg: 2.21 2.20 2.18 3/183 5121
/proc/meminfo: memFree=22068100/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=1574468 CPUtime=102.27 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 334296 0 0 0 10180 47 0 0 20 0 4 0 2779993 1612255232 335106 33554432000 4194304 16246674 140733693231808 140733693231120 12654399 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 393617 335106 891 2943 0 390511 0
[pid=5115/tid=5116] ppid=5112 vsize=1574468 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 1612255232 335106 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=1574468 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2779993 1612255232 335106 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=1574468 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 1612255232 335106 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 1574468


################
# More data... #
################

/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2563313664 567301 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1302.05
Current children cumulated vsize (KiB) 2503236

[startup+1362.3 s]
/proc/loadavg: 2.34 2.28 2.20 3/183 5152
/proc/meminfo: memFree=20813176/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2519620 CPUtime=1362.04 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570598 0 0 0 136071 133 0 0 20 0 4 0 2779993 2580090880 571397 33554432000 4194304 16246674 140733693231808 140733693230984 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 629905 571397 891 2943 0 626799 0
[pid=5115/tid=5116] ppid=5112 vsize=2519620 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2580090880 571397 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2519620 CPUtime=0.01 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 1 0 0 0 20 0 4 0 2779993 2580090880 571397 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2519620 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2580090880 571397 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.04
Current children cumulated vsize (KiB) 2519620

[startup+1422.3 s]
/proc/loadavg: 2.40 2.32 2.22 3/184 5156
/proc/meminfo: memFree=20807004/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1422.03 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570859 0 0 0 142066 137 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693229632 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.01 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 1 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 2520644

[startup+1482.3 s]
/proc/loadavg: 2.28 2.30 2.22 3/184 5180
/proc/meminfo: memFree=20796992/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1482.02 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570859 0 0 0 148059 143 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693230904 4220489 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 2520644

[startup+1542.3 s]
/proc/loadavg: 2.20 2.27 2.21 3/182 5181
/proc/meminfo: memFree=20782668/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1542.02 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570859 0 0 0 154054 148 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693229632 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 2520644

[startup+1602.3 s]
/proc/loadavg: 2.22 2.26 2.21 3/183 5183
/proc/meminfo: memFree=20782816/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1602 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570859 0 0 0 160048 152 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693230904 13885029 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 2520644

[startup+1662.31 s]
/proc/loadavg: 2.18 2.25 2.20 3/183 5184
/proc/meminfo: memFree=20738948/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1662 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570863 0 0 0 166044 156 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693231120 12429241 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662
Current children cumulated vsize (KiB) 2520644

[startup+1722.3 s]
/proc/loadavg: 2.32 2.26 2.20 3/183 5185
/proc/meminfo: memFree=20737984/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1721.98 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570863 0 0 0 172038 160 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693230904 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1721.98
Current children cumulated vsize (KiB) 2520644

[startup+1782.3 s]
/proc/loadavg: 2.13 2.21 2.19 3/183 5186
/proc/meminfo: memFree=20737280/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1781.97 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570864 0 0 0 178032 165 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693230984 4221116 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412343824 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1781.97
Current children cumulated vsize (KiB) 2520644



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.10 2.20 2.18 3/183 5235
/proc/meminfo: memFree=22079576/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1800.06 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570864 0 0 0 179840 166 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693230984 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 2520644

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 5115 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.10 2.20 2.18 3/183 5235
/proc/meminfo: memFree=22079576/32872528 swapFree=1253612/1390560
[pid=5115] ppid=5112 vsize=2520644 CPUtime=1800.06 cores=1,3,5,7
/proc/5115/stat : 5115 (toysat) R 5112 5115 3971 0 -1 4202496 570864 0 0 0 179840 166 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140733693230984 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5115/statm: 630161 571653 891 2943 0 627055 0
[pid=5115/tid=5116] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5116/stat : 5116 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275422833904 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5115/tid=5117] ppid=5112 vsize=2520644 CPUtime=0.02 cores=1,3,5,7
/proc/5115/task/5117/stat : 5117 (toysat) S 5112 5115 3971 0 -1 4202560 9 0 0 0 2 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275412344048 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5115/tid=5118] ppid=5112 vsize=2520644 CPUtime=0 cores=1,3,5,7
/proc/5115/task/5118/stat : 5118 (toysat) S 5112 5115 3971 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 2779993 2581139456 571653 33554432000 4194304 16246674 140733693231808 140275401870512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 2520644

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.44
CPU time (s): 1800.14
CPU user time (s): 1798.43
CPU system time (s): 1.70674
CPU usage (%): 99.9832
Max. virtual memory (cumulated for all children) (KiB): 2520644

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.43
system time used= 1.70674
maximum resident set size= 2286612
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 570864
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2387
involuntary context switches= 1855

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.93849 second user time and 11.3973 second system time

The end

Launcher Data 

Begin job on node119 at 2016-06-29 18:36:32
IDJOB=4118038
IDBENCH=111435
IDSOLVER=2542
FILE ID=node119/4118038-1467218191
RUNJOBID= node119-1467209132-3988
PBS_JOBID= 19997583
Free space on /tmp= 71708 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB15eval/normalized-PB15eval/OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/normalized-pb302075.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4118038-1467218191/watcher-4118038-1467218191 -o /tmp/evaluation-result-4118038-1467218191/solver-4118038-1467218191 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node119-1467209132-3988 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4118038-1467218191.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9b53703f0e50c3178451cfce8ff13bb7
RANDOM SEED=1132498221

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.444
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        24186676 kB
Buffers:          145584 kB
Cached:          5988516 kB
SwapCached:            0 kB
Active:          4364720 kB
Inactive:        2162552 kB
Active(anon):     395644 kB
Inactive(anon):        0 kB
Active(file):    3969076 kB
Inactive(file):  2162552 kB
Unevictable:     1390560 kB
Mlocked:         1253612 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             42224 kB
Writeback:             0 kB
AnonPages:       1783400 kB
Mapped:            17140 kB
Shmem:               204 kB
Slab:             628260 kB
SReclaimable:      71908 kB
SUnreclaim:       556352 kB
KernelStack:        1464 kB
PageTables:         8996 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2632200 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    147456 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71700 MiB
End job on node119 at 2016-06-29 19:06:32