Trace number 4117982

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.11 1800.41

General information on the benchmark

NamePB15eval/normalized-PB15eval/OPT-BIGINT-NLC/
minlplib2-pb-0.1.0/opb/normalized-autocorr_bern55-55.opb
MD5SUM0395181bafd11622ffe28572d513f5d3
Bench CategoryOPT-BIGINT-NLC (optimisation, big integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-56529
Best CPU time to get the best result obtained on this benchmark1800.09
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables0
Total number of constraints0
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint-1
Maximum length of a constraint0
Number of terms in the objective function 40402
Biggest coefficient in the objective function 10142
Number of bits for the biggest coefficient in the objective function 14
Sum of the numbers in the objective function 4450356
Number of bits of the sum of numbers in the objective function 23
Biggest number in a constraint 10142
Number of bits of the biggest number in a constraint 14
Biggest sum of numbers in a constraint 4450356
Number of bits of the biggest sum of numbers23
Number of products (including duplicates)40347
Sum of products size (including duplicates)132309
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-29T18:05:21+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4117982-1467216321.opb"]
0.00/0.01	c use --random-gen="991561086 1186569056 878513007 232303203 1610632866 1245131044 1683727692 3663659185 2514246942 3686904551 1732874092 2177550496 2983657540 3637361407 2550203378 3099216988 1868184392 2898979188 2115566194 330595199 4292369831 966260746 4196594203 2082211641 4119380014 3788994923 2473925828 2853497843 1555811816 2665359132 189770484 2223301960 3209360939 1461717264 1889723606 2575320560 784311482 2660838820 3845899526 276745658 1620160262 308284080 2755941761 2512268779 2915746505 1786393140 108440310 3494857118 3575830001 3923930696 1301696469 3866467601 1215167548 2941824672 2764202274 239046072 523483775 2529996635 2638181673 3044000454 1348093421 4229176749 1733426712 181346832 2785325255 3184528906 232919871 3886068485 3578475216 4144065237 2686626306 3614378670 416056867 2038655122 1163476981 3815087639 878231743 2333080611 261291342 3380858265 2831082839 1431701642 4267194611 474576514 4210414821 3458528451 2003674499 2288037539 3068615538 3252693175 438255009 1606803183 1065709838 586344329 1157206601 130922287 4224828202 862901061 4285525528 1536860522 585345570 1193494224 3058230292 4138259666 2742849856 1218676015 3425467056 491624347 154923560 53190151 1526087819 666572184 71055340 3715223057 3022841397 2244135054 914536504 383744231 1117689034 4187296154 2464932015 1255927272 3925298002 2353128892 3852547151 1970019398 387779960 1311804527 3021279940 4175735067 1735175077 2764693506 2823823831 3343473664 2302508610 1362483755 1968010588 1137818931 1953378442 2262932574 1994044484 480959687 2682445584 3296467718 30036114 1680835720 2107457410 4269247116 169661608 383824543 2882472762 3673293562 2670428394 711202310 1327338379 1738579410 2033908011 4217428614 3198432863 1116391501 1267811639 3960136417 3099652777 1100826132 4127895815 607808296 3984356037 3020143078 4263703604 2795854151 332190059 1560477216 1441624844 811254070 4102950380 418628025 2528883329 2682922189 2324470559 366289890 1771278710 2469511125 100752782 3062822135 1967904058 1104583368 1834320826 2717046148 3524151603 3137349177 1456001214 3128162182 4176429234 1200319817 3381435027 2378178015 834608499 1777276170 2862363433 3900396706 2851227065 4176957920 3312524190 576035743 1696758654 48362058 764607242 2538678607 2532955819 3617658358 2051054640 188192545 1035398808 1910342758 2668324293 4164301963 2249316571 1823769683 3900738645 4178456481 1776448022 3156719851 3322253985 511323725 1880453627 588735734 73321771 964512787 2230205396 3189846219 49554976 2970901448 474183735 4245330960 3682591564 1012833980 1006747611 932819289 1368097875 3685188912 3786401594 2364193831 1181387927 3242127119 2557829444 634255375 3660734288 3060397652 611436968 2708897381 1123288304 1399743674 3860165206 4247843303 4203762891 2812381041 255 362436" option to reproduce the execution
0.09/0.15	c #vars 55
0.09/0.15	c #constraints 0
1.10/1.11	c BCD2: Hardening is enabled.
1.10/1.11	c BCD2: BiasedSearch is enabled.
1.10/1.11	c Solving starts ...
1.10/1.11	c ============================[ Search Statistics ]============================
1.10/1.11	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
1.10/1.11	c       |         |          |          |    Limit     GC | Var      | Constra 
1.10/1.11	c =============================================================================
1.10/1.17	c  0.0s |       0 |        0 |        0 |    44322      0 |        0 |        0
1.29/1.33	c  0.2s |       0 |    27531 |        0 |    44322      0 |        0 |        0
1.29/1.33	c #cpu_time = 0.132s
1.29/1.33	c #wall_clock_time = 0.132s
1.29/1.33	c #decision = 27531
1.29/1.33	c #random_decision = 79
1.29/1.33	c #conflict = 0
1.29/1.33	c #restart = 0
1.29/1.33	o 0

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4117982-1467216321/watcher-4117982-1467216321 -o /tmp/evaluation-result-4117982-1467216321/solver-4117982-1467216321 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node106-1467209087-5470 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4117982-1467216321.opb 

pid=6112
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.11 2.10 2.09 3/180 6115
/proc/meminfo: memFree=29318496/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=691644 CPUtime=0 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 2574 0 0 0 0 0 0 0 20 0 4 0 2528227 708243456 3446 33554432000 4194304 16246674 140733948671200 140733948670624 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 173423 3455 441 2943 0 170317 0
[pid=6115/tid=6116] ppid=6112 vsize=709052 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 726069248 3515 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=714172 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 731312128 3535 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=718268 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 735506432 3551 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100175 s]
/proc/loadavg: 2.11 2.10 2.09 3/180 6115
/proc/meminfo: memFree=29318496/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1301060 CPUtime=0.09 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 27936 0 0 0 6 3 0 0 20 0 4 0 2528227 1332285440 28746 33554432000 4194304 16246674 140733948671200 140733948670512 13780501 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 325265 28762 798 2943 0 322159 0
[pid=6115/tid=6116] ppid=6112 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1332285440 28773 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1332285440 28785 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1332285440 28797 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1301060

[startup+0.200536 s]
/proc/loadavg: 2.11 2.10 2.09 3/180 6115
/proc/meminfo: memFree=29318496/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1308228 CPUtime=0.19 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 51038 0 0 0 12 7 0 0 20 0 4 0 2528227 1339625472 51847 33554432000 4194304 16246674 140733948671200 140733948670512 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 327313 51854 828 2943 0 324207 0
[pid=6115/tid=6116] ppid=6112 vsize=1309252 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1340674048 51856 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1309252 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1340674048 51859 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1309252 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1340674048 51861 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1308228

[startup+0.300491 s]
/proc/loadavg: 2.11 2.10 2.09 3/180 6115
/proc/meminfo: memFree=29318496/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1313348 CPUtime=0.29 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 52165 0 0 0 22 7 0 0 20 0 4 0 2528227 1344868352 52974 33554432000 4194304 16246674 140733948671200 140733948670512 6860444 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 328337 52974 828 2943 0 325231 0
[pid=6115/tid=6116] ppid=6112 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1344868352 52974 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1344868352 52974 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1344868352 52974 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1313348

[startup+0.70042 s]
/proc/loadavg: 2.11 2.10 2.09 3/180 6115
/proc/meminfo: memFree=29318496/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1313348 CPUtime=0.69 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 69423 0 0 0 60 9 0 0 20 0 4 0 2528227 1344868352 70232 33554432000 4194304 16246674 140733948671200 140733948653120 4220897 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 328337 70232 828 2943 0 325231 0
[pid=6115/tid=6116] ppid=6112 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1344868352 70232 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1344868352 70232 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1344868352 70232 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1313348

[startup+1.50042 s]
/proc/loadavg: 2.11 2.10 2.09 3/184 6119
/proc/meminfo: memFree=28895836/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1328708 CPUtime=1.49 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 107646 0 0 0 135 14 0 0 20 0 4 0 2528227 1360596992 108455 33554432000 4194304 16246674 140733948671200 140733948669056 4220480 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 332177 108455 874 2943 0 329071 0
[pid=6115/tid=6116] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 108455 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 108455 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 108455 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1328708

[startup+3.10043 s]
/proc/loadavg: 2.11 2.10 2.09 3/184 6119
/proc/meminfo: memFree=28223508/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1328708 CPUtime=3.09 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 273108 0 0 0 272 37 0 0 20 0 4 0 2528227 1360596992 273917 33554432000 4194304 16246674 140733948671200 140733948653120 12371230 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 332177 273917 884 2943 0 329071 0
[pid=6115/tid=6116] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1328708

[startup+6.30043 s]
/proc/loadavg: 2.10 2.10 2.09 3/184 6119
/proc/meminfo: memFree=28222888/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1328708 CPUtime=6.29 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 273108 0 0 0 592 37 0 0 20 0 4 0 2528227 1360596992 273917 33554432000 4194304 16246674 140733948671200 140733948653120 13966199 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 332177 273917 884 2943 0 329071 0
[pid=6115/tid=6116] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1328708

[startup+12.7004 s]
/proc/loadavg: 2.09 2.09 2.09 3/183 6119
/proc/meminfo: memFree=28223324/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1328708 CPUtime=12.69 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 273108 0 0 0 1232 37 0 0 20 0 4 0 2528227 1360596992 273917 33554432000 4194304 16246674 140733948671200 140733948653120 12413848 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 332177 273917 884 2943 0 329071 0
[pid=6115/tid=6116] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1328708

[startup+25.5005 s]
/proc/loadavg: 2.07 2.09 2.08 3/183 6119
/proc/meminfo: memFree=28224040/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1328708 CPUtime=25.48 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 273108 0 0 0 2511 37 0 0 20 0 4 0 2528227 1360596992 273917 33554432000 4194304 16246674 140733948671200 140733948653120 12429087 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 332177 273917 884 2943 0 329071 0
[pid=6115/tid=6116] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1328708

[startup+51.1005 s]
/proc/loadavg: 2.05 2.08 2.08 3/183 6168
/proc/meminfo: memFree=28200984/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1328708 CPUtime=51.08 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 273108 0 0 0 5071 37 0 0 20 0 4 0 2528227 1360596992 273917 33554432000 4194304 16246674 140733948671200 140733948653120 12371171 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 332177 273917 884 2943 0 329071 0
[pid=6115/tid=6116] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1328708

[startup+102.3 s]
/proc/loadavg: 2.07 2.08 2.08 3/183 6169
/proc/meminfo: memFree=28200500/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1328708 CPUtime=102.28 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 273108 0 0 0 10191 37 0 0 20 0 4 0 2528227 1360596992 273917 33554432000 4194304 16246674 140733948671200 140733948653120 12449318 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 332177 273917 884 2943 0 329071 0
[pid=6115/tid=6116] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1328708 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1360596992 273917 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1328708


################
# More data... #
################

/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1242.07
Current children cumulated vsize (KiB) 1346116

[startup+1302.3 s]
/proc/loadavg: 2.02 2.03 2.02 3/183 6198
/proc/meminfo: memFree=28090088/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1302.06 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277764 0 0 0 130166 40 0 0 20 0 4 0 2528227 1378422784 278520 33554432000 4194304 16246674 140733948671200 140733948653120 12449269 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278520 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1302.06
Current children cumulated vsize (KiB) 1346116

[startup+1362.3 s]
/proc/loadavg: 2.00 2.02 2.01 3/183 6199
/proc/meminfo: memFree=28079700/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1362.06 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277764 0 0 0 136165 41 0 0 20 0 4 0 2528227 1378422784 278520 33554432000 4194304 16246674 140733948671200 140733948653120 12429241 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278520 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.06
Current children cumulated vsize (KiB) 1346116

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/183 6201
/proc/meminfo: memFree=28029564/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1422.06 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277764 0 0 0 142165 41 0 0 20 0 4 0 2528227 1378422784 278520 33554432000 4194304 16246674 140733948671200 140733948653120 12656213 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278520 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 1346116

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/184 6205
/proc/meminfo: memFree=27977464/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1482.04 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277764 0 0 0 148163 41 0 0 20 0 4 0 2528227 1378422784 278520 33554432000 4194304 16246674 140733948671200 140733948653120 12653056 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278520 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 1346116

[startup+1542.31 s]
/proc/loadavg: 2.04 2.02 2.00 3/183 6206
/proc/meminfo: memFree=27956596/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1542.04 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277764 0 0 0 154163 41 0 0 20 0 4 0 2528227 1378422784 278520 33554432000 4194304 16246674 140733948671200 140733948653120 12654409 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278520 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 1346116

[startup+1602.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/183 6207
/proc/meminfo: memFree=27956544/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1602.03 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277764 0 0 0 160162 41 0 0 20 0 4 0 2528227 1378422784 278520 33554432000 4194304 16246674 140733948671200 140733948653120 12414073 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278520 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278520 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 1346116

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 6208
/proc/meminfo: memFree=27942148/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1662.02 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277765 0 0 0 166161 41 0 0 20 0 4 0 2528227 1378422784 278523 33554432000 4194304 16246674 140733948671200 140733948653120 12413997 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278523 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 1346116

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 6210
/proc/meminfo: memFree=27942024/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1722 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277765 0 0 0 172159 41 0 0 20 0 4 0 2528227 1378422784 278523 33554432000 4194304 16246674 140733948671200 140733948653120 12656213 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278523 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1722
Current children cumulated vsize (KiB) 1346116

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 6211
/proc/meminfo: memFree=27940036/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1781.99 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277765 0 0 0 178158 41 0 0 20 0 4 0 2528227 1378422784 278523 33554432000 4194304 16246674 140733948671200 140733948668992 12449269 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278523 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1781.99
Current children cumulated vsize (KiB) 1346116



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 6212
/proc/meminfo: memFree=27938048/32872528 swapFree=7620/7620
[pid=6115] ppid=6112 vsize=1346116 CPUtime=1800.09 cores=1,3,5,7
/proc/6115/stat : 6115 (toysat) R 6112 6115 5453 0 -1 4202496 277765 0 0 0 179968 41 0 0 20 0 4 0 2528227 1378422784 278523 33554432000 4194304 16246674 140733948671200 140733948653120 12653056 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6115/statm: 336529 278523 884 2943 0 333423 0
[pid=6115/tid=6116] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6116/stat : 6116 (toysat) S 6112 6115 5453 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086857411824 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6115/tid=6117] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6117/stat : 6117 (toysat) S 6112 6115 5453 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086846921968 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6115/tid=6118] ppid=6112 vsize=1346116 CPUtime=0 cores=1,3,5,7
/proc/6115/task/6118/stat : 6118 (toysat) S 6112 6115 5453 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 2528228 1378422784 278523 33554432000 4194304 16246674 140733948671200 140086733696176 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 1346116

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6115 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.41
CPU time (s): 1800.11
CPU user time (s): 1799.69
CPU system time (s): 0.416936
CPU usage (%): 99.9832
Max. virtual memory (cumulated for all children) (KiB): 1346116

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.69
system time used= 0.416936
maximum resident set size= 1114092
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 277765
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 69
involuntary context switches= 1863

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.66414 second user time and 7.71183 second system time

The end

Launcher Data 

Begin job on node106 at 2016-06-29 18:05:21
IDJOB=4117982
IDBENCH=111421
IDSOLVER=2542
FILE ID=node106/4117982-1467216321
RUNJOBID= node106-1467209087-5470
PBS_JOBID= 19997588
Free space on /tmp= 71732 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB15eval/normalized-PB15eval/OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/normalized-autocorr_bern55-55.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4117982-1467216321/watcher-4117982-1467216321 -o /tmp/evaluation-result-4117982-1467216321/solver-4117982-1467216321 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node106-1467209087-5470 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4117982-1467216321.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0395181bafd11622ffe28572d513f5d3
RANDOM SEED=1636399844

node106.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.99
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.495
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29318876 kB
Buffers:          103628 kB
Cached:          1597216 kB
SwapCached:            0 kB
Active:          2218184 kB
Inactive:         570720 kB
Active(anon):    1090240 kB
Inactive(anon):        0 kB
Active(file):    1127944 kB
Inactive(file):   570720 kB
Unevictable:        7620 kB
Mlocked:            7620 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             17096 kB
Writeback:             0 kB
AnonPages:       1170932 kB
Mapped:            18876 kB
Shmem:               204 kB
Slab:             625868 kB
SReclaimable:      69240 kB
SUnreclaim:       556628 kB
KernelStack:        1528 kB
PageTables:         5644 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1226276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1148928 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71716 MiB
End job on node106 at 2016-06-29 18:35:22