Trace number 4093209

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.38 1800.66

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/pedigree/
normalized-sheep4r-4-2_wcsp.wbo
MD5SUM4279ee44886a475273bf158c4a05b4f8
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark47.8277
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables22540
Total number of constraints1101088
Number of soft constraints1098834
Number of constraints which are clauses1098834
Number of constraints which are cardinality constraints (but not clauses)2254
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint10
Top cost 899
Min constraint cost 1
Max constraint cost 899
Sum of constraints costs 980594130
Biggest number in a constraint 2
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 11
Number of bits of the biggest sum of numbers4
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-16T22:56:57+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--wbo","--search=bcd2","HOME/instance-4093209-1466110616.wbo"]
0.00/0.01	c use --random-gen="1218472562 3524427831 1516026158 3569736818 132503479 2032327647 227534280 4190939692 1484025143 2737861777 533920642 2626605847 629423681 1598928340 1587622238 3181553232 2053267110 841890399 3599571083 4179483761 4127151035 2977171565 778574140 2377468876 242764664 2370598338 692149082 1901707692 299643273 804280461 1579413209 4187238007 1846192580 1840114160 2334732997 1413908027 2752008550 3064408275 40148303 1300570564 3050505228 3239576037 1719681356 464297525 3087364557 380738500 3147657177 1962780246 2457223269 1681888512 1468286190 646857883 58933563 4157119521 2286446975 255851233 448398628 82258468 613918057 168948203 481462309 767103638 4288956082 3410917099 2487228312 1613575812 1690793522 69018372 3501237384 1252729239 1596246326 1817883087 223411729 2771379802 495863394 469189071 1610748860 2845183899 3102401840 1811593417 1731044137 192451648 3281648542 3995953558 3542648625 1412135636 3921011149 2170173645 2772766882 2885591519 2730354784 3688077180 457923459 2289357544 1940282396 3797828089 3633673882 742715214 1745187224 3347324236 4063873551 2637185686 1645236616 2193792892 847988878 4127068864 1227797230 1558341584 1046640485 2321316808 515566298 363711705 2110005906 1284664300 1483802697 1314912048 3346893107 28897221 1163223932 2399470386 1023842439 1139440787 2102847376 2556997898 2096231364 683322333 1644072123 35768321 2812185494 3495039233 2730022471 1066675554 2421987051 562088517 320987315 1466027506 144991192 3411116847 303282133 3049134841 3190434424 47205741 1313564524 2724145106 2789581043 934911456 3868943257 2165897792 3586011575 2710801319 3996981299 2127762686 580518501 1987221113 1766639902 3272455426 2495896372 381532876 3851213571 2848112984 3443997256 2651288381 3965039822 2315028394 4093479022 3891728407 2417384345 2424633323 930176619 3747567827 12003613 3913739223 276289103 4172002971 2056433693 4163910707 2466314103 1469382121 2221468818 3372898035 476586268 4226600619 996277050 615824597 2391311256 2823447028 204186193 1603131929 3681136337 953780049 1346393370 749433202 4103519623 1608102369 2391441520 2283912117 3903902889 840141358 2455464503 2550239833 3880582212 4207934873 4286222754 2186758274 3968734393 1697753795 1155604169 3954909904 1871654092 188747975 2280547599 663152715 4234033261 4227995758 1268364224 798356370 168996004 4002427719 4023114185 1353608179 273924375 584551022 2669471386 4135581912 1878002008 788919174 523134056 4274165598 971004019 2964504355 2944391464 995524108 2467295175 3479461046 762105547 4255236387 1810326043 2719340106 1931618075 3762385555 773344684 3918354769 3774209421 479277327 1521294687 1431730764 1161777646 2740479347 725412727 552694487 4251458496 1416339786 277515215 3407549210 2339195882 504015950 255 362436" option to reproduce the execution

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4093209-1466110616/watcher-4093209-1466110616 -o /tmp/evaluation-result-4093209-1466110616/solver-4093209-1466110616 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node140-1466103409-1688 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093209-1466110616.wbo 

pid=2350
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.28 2.26 2.23 2/179 2353
/proc/meminfo: memFree=30104512/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=693692 CPUtime=0 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 2579 0 0 0 0 0 0 0 20 0 4 0 13106921 710340608 2941 33554432000 4194304 16246674 140736288943536 140736288942960 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 173935 2951 441 2943 0 170829 0
[pid=2353/tid=2354] ppid=2350 vsize=728508 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 745992192 3077 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=732604 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 750186496 3095 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=737724 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 13106921 755429376 3112 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100169 s]
/proc/loadavg: 2.28 2.26 2.23 2/179 2353
/proc/meminfo: memFree=30104512/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1301060 CPUtime=0.09 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 28499 0 0 0 4 5 0 0 20 0 4 0 13106921 1332285440 28800 33554432000 4194304 16246674 140736288943536 140736288942848 7410953 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 325265 28815 802 2943 0 322159 0
[pid=2353/tid=2354] ppid=2350 vsize=1301060 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1332285440 28826 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1301060 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1332285440 28837 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1301060 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1332285440 28846 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1301060

[startup+0.200566 s]
/proc/loadavg: 2.28 2.26 2.23 2/179 2353
/proc/meminfo: memFree=30104512/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1314372 CPUtime=0.19 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 50437 0 0 0 10 9 0 0 20 0 4 0 13106921 1345916928 51249 33554432000 4194304 16246674 140736288943536 140736288942848 8058600 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 328593 51249 802 2943 0 325487 0
[pid=2353/tid=2354] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 51249 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 51249 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 51249 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1314372

[startup+0.30053 s]
/proc/loadavg: 2.28 2.26 2.23 2/179 2353
/proc/meminfo: memFree=30104512/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1314372 CPUtime=0.29 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 62127 0 0 0 19 10 0 0 20 0 4 0 13106921 1345916928 62939 33554432000 4194304 16246674 140736288943536 140736288942848 7918818 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 328593 62939 802 2943 0 325487 0
[pid=2353/tid=2354] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 62939 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 62939 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 62939 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.700417 s]
/proc/loadavg: 2.28 2.26 2.23 2/179 2353
/proc/meminfo: memFree=30104512/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1314372 CPUtime=0.69 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 72722 0 0 0 57 12 0 0 20 0 4 0 13106921 1345916928 73534 33554432000 4194304 16246674 140736288943536 140736288926528 8055417 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 328593 73534 802 2943 0 325487 0
[pid=2353/tid=2354] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 73534 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 73534 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 73534 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.50041 s]
/proc/loadavg: 2.28 2.26 2.23 3/183 2357
/proc/meminfo: memFree=29574144/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1314372 CPUtime=1.49 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 99098 0 0 0 134 15 0 0 20 0 4 0 13106921 1345916928 99910 33554432000 4194304 16246674 140736288943536 140736288941376 8058822 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 328593 99910 803 2943 0 325487 0
[pid=2353/tid=2354] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 99910 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 99910 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1345916928 99910 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1314372

[startup+3.10041 s]
/proc/loadavg: 2.26 2.26 2.23 3/183 2357
/proc/meminfo: memFree=29135160/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1338948 CPUtime=3.08 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 145167 0 0 0 287 21 0 0 20 0 4 0 13106921 1371082752 150067 33554432000 4194304 16246674 140736288943536 140736288941376 7361600 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 334737 150067 803 2943 0 331631 0
[pid=2353/tid=2354] ppid=2350 vsize=1338948 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1371082752 150067 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1338948 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1371082752 150067 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1338948 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1371082752 150067 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 1338948

[startup+6.30037 s]
/proc/loadavg: 2.26 2.26 2.23 4/183 2357
/proc/meminfo: memFree=28499840/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1388100 CPUtime=6.29 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 211690 0 0 0 597 32 0 0 20 0 4 0 13106921 1421414400 226299 33554432000 4194304 16246674 140736288943536 140736288925440 14073329 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 347025 226299 803 2943 0 343919 0
[pid=2353/tid=2354] ppid=2350 vsize=1388100 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1421414400 226299 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1388100 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1421414400 226299 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1388100 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1421414400 226299 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1388100

[startup+12.7004 s]
/proc/loadavg: 2.29 2.27 2.23 3/183 2357
/proc/meminfo: memFree=28003736/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=1388100 CPUtime=12.68 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 270008 0 0 0 1228 40 0 0 20 0 4 0 13106921 1421414400 287683 33554432000 4194304 16246674 140736288943536 140736288925440 13950184 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 347025 287683 835 2943 0 343919 0
[pid=2353/tid=2354] ppid=2350 vsize=1388100 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 1421414400 287683 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=1388100 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 1421414400 287683 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=1388100 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 1421414400 287683 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1388100

[startup+25.5005 s]
/proc/loadavg: 2.33 2.27 2.23 3/183 2357
/proc/meminfo: memFree=25180232/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=2794052 CPUtime=25.49 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 621248 0 0 0 2460 89 0 0 20 0 4 0 13106921 2861109248 639945 33554432000 4194304 16246674 140736288943536 140736288942632 12875683 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 698513 639945 838 2943 0 695407 0
[pid=2353/tid=2354] ppid=2350 vsize=2794052 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 2861109248 639945 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=2794052 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 2861109248 639945 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=2794052 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 2861109248 639945 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 2794052

[startup+51.1004 s]
/proc/loadavg: 2.29 2.27 2.23 4/183 2357
/proc/meminfo: memFree=23299260/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=3733060 CPUtime=51.08 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 856000 0 0 0 4988 120 0 0 20 0 4 0 13106921 3822653440 874697 33554432000 4194304 16246674 140736288943536 140736288942712 13774072 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 933265 874697 838 2943 0 930159 0
[pid=2353/tid=2354] ppid=2350 vsize=3733060 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 3822653440 874697 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=3733060 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 3822653440 874697 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=3733060 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 3822653440 874697 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 3733060

[startup+102.3 s]
/proc/loadavg: 2.36 2.28 2.24 4/183 2358
/proc/meminfo: memFree=20915916/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=4922948 CPUtime=102.28 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1153225 0 0 0 10068 160 0 0 20 0 4 0 13106921 5041098752 1171922 33554432000 4194304 16246674 140736288943536 140736288925440 6132452 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1230737 1171922 839 2943 0 1227631 0
[pid=2353/tid=2354] ppid=2350 vsize=4922948 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 5041098752 1171922 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=4922948 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 5041098752 1171922 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=4922948 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 5041098752 1171922 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 4922948


################
# More data... #
################

[pid=2353] ppid=2350 vsize=6107716 CPUtime=1362.08 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 135994 214 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 6132452 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 6107716

[startup+1422.3 s]
/proc/loadavg: 2.14 2.14 2.17 3/184 2416
/proc/meminfo: memFree=18538436/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1422.08 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 141993 215 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13807598 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1422.08
Current children cumulated vsize (KiB) 6107716

[startup+1482.3 s]
/proc/loadavg: 2.15 2.15 2.17 3/183 2417
/proc/meminfo: memFree=18539116/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1482.07 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 147992 215 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13809344 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1482.07
Current children cumulated vsize (KiB) 6107716

[startup+1542.31 s]
/proc/loadavg: 2.10 2.13 2.17 4/183 2419
/proc/meminfo: memFree=18538728/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1542.06 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 153991 215 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13774084 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1542.06
Current children cumulated vsize (KiB) 6107716

[startup+1602.3 s]
/proc/loadavg: 2.13 2.14 2.16 3/183 2420
/proc/meminfo: memFree=18539272/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1602.04 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 159989 215 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13809400 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 6107716

[startup+1662.3 s]
/proc/loadavg: 2.19 2.15 2.17 4/183 2421
/proc/meminfo: memFree=18538880/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1662.04 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 165988 216 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13809352 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1662.04
Current children cumulated vsize (KiB) 6107716

[startup+1722.3 s]
/proc/loadavg: 2.17 2.15 2.17 4/183 2422
/proc/meminfo: memFree=18539384/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1722.02 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 171986 216 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13774072 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 6107716

[startup+1782.3 s]
/proc/loadavg: 2.32 2.20 2.18 3/183 2423
/proc/meminfo: memFree=18538348/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1782.02 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 177985 217 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13809242 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1782.02
Current children cumulated vsize (KiB) 6107716



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.23 2.18 2.18 3/183 2423
/proc/meminfo: memFree=18538632/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=6107716 CPUtime=1800.02 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) R 2350 2353 29546 0 -1 4202496 1449659 0 0 0 179785 217 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140736288925440 13774229 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 1526929 1468356 839 2943 0 1523823 0
[pid=2353/tid=2354] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2354/stat : 2354 (toysat) S 2350 2353 29546 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407050579184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) S 2350 2353 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407040089328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2353/tid=2356] ppid=2350 vsize=6107716 CPUtime=0 cores=0,2,4,6
/proc/2353/task/2356/stat : 2356 (toysat) S 2350 2353 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 13106921 6254301184 1468356 33554432000 4194304 16246674 140736288943536 140407029615792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 6107716

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 2353 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.23 2.18 2.18 3/183 2423
/proc/meminfo: memFree=18538632/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=0 CPUtime=1800.12 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) Z 2350 2353 29546 0 -1 4203532 1449659 0 0 0 179785 227 0 0 20 0 2 0 13106921 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 0 0 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=0 CPUtime=0.08 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) R 2350 2353 29546 0 -1 4203588 8 0 0 0 0 8 0 0 20 0 2 0 13106921 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 0

[startup+1800.6 s]
/proc/loadavg: 2.23 2.18 2.18 3/183 2423
/proc/meminfo: memFree=18538632/32872528 swapFree=1399392/1569044
[pid=2353] ppid=2350 vsize=0 CPUtime=1800.31 cores=0,2,4,6
/proc/2353/stat : 2353 (toysat) Z 2350 2353 29546 0 -1 4203532 1449659 0 0 0 179785 246 0 0 20 0 2 0 13106921 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2353/statm: 0 0 0 0 0 0 0
[pid=2353/tid=2355] ppid=2350 vsize=0 CPUtime=0.28 cores=0,2,4,6
/proc/2353/task/2355/stat : 2355 (toysat) R 2350 2353 29546 0 -1 4203588 8 0 0 0 0 28 0 0 20 0 2 0 13106921 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.31
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.66
CPU time (s): 1800.38
CPU user time (s): 1797.86
CPU system time (s): 2.52262
CPU usage (%): 99.9845
Max. virtual memory (cumulated for all children) (KiB): 6107716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1797.86
system time used= 2.52262
maximum resident set size= 5873424
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1449659
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37
involuntary context switches= 1860

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.18421 second user time and 7.46686 second system time

The end

Launcher Data 

Begin job on node140 at 2016-06-16 22:56:57
IDJOB=4093209
IDBENCH=79620
IDSOLVER=2553
FILE ID=node140/4093209-1466110616
RUNJOBID= node140-1466103409-1688
PBS_JOBID= 19904032
Free space on /tmp= 71640 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/pedigree/normalized-sheep4r-4-2_wcsp.wbo
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --wbo --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4093209-1466110616/watcher-4093209-1466110616 -o /tmp/evaluation-result-4093209-1466110616/solver-4093209-1466110616 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node140-1466103409-1688 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093209-1466110616.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4279ee44886a475273bf158c4a05b4f8
RANDOM SEED=1504351269

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.42
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30108576 kB
Buffers:           56944 kB
Cached:           228856 kB
SwapCached:         2564 kB
Active:           385112 kB
Inactive:          94576 kB
Active(anon):     194404 kB
Inactive(anon):     1792 kB
Active(file):     190708 kB
Inactive(file):    92784 kB
Unevictable:     1569044 kB
Mlocked:         1399392 kB
SwapTotal:      67108856 kB
SwapFree:       67096820 kB
Dirty:            122436 kB
Writeback:             0 kB
AnonPages:       1761952 kB
Mapped:            10040 kB
Shmem:                 0 kB
Slab:             577344 kB
SReclaimable:      20852 kB
SUnreclaim:       556492 kB
KernelStack:        1424 kB
PageTables:         8968 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2781580 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    172032 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71624 MiB
End job on node140 at 2016-06-16 23:26:58