Trace number 4110578

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.15 1800.45

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/warehouse/
normalized-capa_wcsp.wbo
MD5SUM143d76bff22b6cbc85097a85314f53ce
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmark
Best cost obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables100200
Total number of constraints201200
Number of soft constraints200100
Number of constraints which are clauses200100
Number of constraints which are cardinality constraints (but not clauses)1100
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint100
Top cost 238092768
Min constraint cost 1
Max constraint cost 238092768
Sum of constraints costs 23812436850104
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 101
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-19T16:33:06+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--wbo","--search=bcd2","HOME/instance-4110578-1466346786.wbo"]
0.00/0.01	c use --random-gen="3150048279 4041455612 4243137675 2438425447 3848163921 1262183541 1898103193 3315483147 3418465858 3898532573 3319974685 1481886597 3784515514 4280173605 2363353747 3322798483 4172034054 2587354666 1655228052 3976298475 659745490 3899520007 3730450562 3062371868 3581526839 786232595 402902980 879052540 1805302140 55129305 540572526 317141485 786807672 1752031045 2908571264 3331949733 3267194332 903894171 376565848 1885104746 3112475783 3739898248 1057825083 1618617298 2850673034 3150235502 1751010962 566818532 1944318795 1529967901 2549676419 3957744026 3858834288 188772056 2016345427 363595692 1000518991 1430183151 2451946302 1648567883 1559928811 1379747157 2455288010 3349704077 2704107369 3911539072 3871590128 475352252 2541708556 2991554885 1719598678 1188986936 3008658668 1478319863 2450292066 2244388429 652689824 669858199 1332151050 2786412886 527787887 2599413999 1242190323 1705235932 2785484537 1151055432 1454015838 3111929061 2151643232 3953292019 847734879 1143159572 3229598629 1098925236 3733814192 168575289 2274887261 990816629 4287789552 4110302002 2348399590 472073100 2071118740 53061674 3525254137 2781722466 91527345 3083205750 3546802251 124942397 3766328571 2007623421 85797922 3514459954 4238034225 2211335002 131469028 2702920887 3634780286 1052325416 2633324362 2900338505 3788889739 3068978001 3697912711 2518370891 4155423559 3397182806 344899030 1266778231 1442219191 4165503028 3776686310 1327469902 3646281802 3035739554 2148094137 2358780235 2612468564 1417349423 60937061 2913469091 2900750953 2974157777 3065915874 1928218728 555668727 3218120203 2842077131 159327978 1241425050 3999902540 3833661538 3294048084 703743003 3837823101 571010066 2842148101 2814315889 4057511068 4208672344 214648162 2554902867 425998589 3104297617 3070981623 2427448828 3703687154 3791763185 1352811043 3564005096 4291348562 1426053819 3126792675 181923530 3135640159 454206878 3713790668 3293828803 3551214530 1491888321 1666171178 2060739752 1123039363 1223961768 3230481930 652706217 3641340454 1074375453 1843114182 1555778001 3485861396 2015546495 2165371839 2523943397 3207642475 64410870 1258605503 685699716 1705023060 3586487738 772475465 3396376351 1833658371 122777965 822737507 3004948147 2906967255 3814016702 3196021044 220504909 1090238513 538567441 1105164029 2592426363 538375854 3584663037 2857731368 2434690201 3607646746 875254293 3375374933 3928907654 1453330863 3654215860 3533411391 2865771921 3029137890 3653903989 3813340900 323402616 1701047524 2465402254 3269847526 364033686 1574971463 2356005391 1947716866 459326642 140808766 3496624861 1445637749 1326134670 331021802 1638833969 1964440093 3921109002 757637139 4248007569 331925069 2809157537 3235853981 721611931 3330913837 2069839173 72790808 255 362436" option to reproduce the execution

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4110578-1466346786/watcher-4110578-1466346786 -o /tmp/evaluation-result-4110578-1466346786/solver-4110578-1466346786 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node133-1466341813-849 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4110578-1466346786.wbo 

pid=2492
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 1.98 3/182 2495
/proc/meminfo: memFree=28472216/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=800188 CPUtime=0 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 2998 0 0 0 0 0 0 0 20 0 4 0 36724518 819392512 3359 33554432000 4194304 16246674 140733606206160 140733606205584 13880264 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 200559 3367 441 2943 0 197453 0
[pid=2495/tid=2496] ppid=2492 vsize=817596 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 837218304 3427 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=822716 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 842461184 3446 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=826812 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 36724518 846655488 3462 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0

[startup+0.100179 s]
/proc/loadavg: 2.00 2.01 1.98 3/182 2495
/proc/meminfo: memFree=28472216/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1302084 CPUtime=0.09 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 28842 0 0 0 6 3 0 0 20 0 4 0 36724518 1333334016 29142 33554432000 4194304 16246674 140733606206160 140733606205472 8056990 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 325521 29157 800 2943 0 322415 0
[pid=2495/tid=2496] ppid=2492 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1333334016 29168 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1333334016 29179 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1333334016 29191 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1302084

[startup+0.200519 s]
/proc/loadavg: 2.00 2.01 1.98 3/182 2495
/proc/meminfo: memFree=28472216/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1313348 CPUtime=0.19 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 44847 0 0 0 14 5 0 0 20 0 4 0 36724518 1344868352 45658 33554432000 4194304 16246674 140733606206160 140733606205472 12752387 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 328337 45658 801 2943 0 325231 0
[pid=2495/tid=2496] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 45658 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 45658 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 45658 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1313348

[startup+0.300489 s]
/proc/loadavg: 2.00 2.01 1.98 3/182 2495
/proc/meminfo: memFree=28472216/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1313348 CPUtime=0.29 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 51827 0 0 0 23 6 0 0 20 0 4 0 36724518 1344868352 52638 33554432000 4194304 16246674 140733606206160 140733606205472 8058488 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 328337 52638 802 2943 0 325231 0
[pid=2495/tid=2496] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 52638 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 52638 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 52638 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1313348

[startup+0.700403 s]
/proc/loadavg: 2.00 2.01 1.98 3/182 2495
/proc/meminfo: memFree=28472216/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1313348 CPUtime=0.69 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 64666 0 0 0 61 8 0 0 20 0 4 0 36724518 1344868352 65477 33554432000 4194304 16246674 140733606206160 140733606204032 14628944 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 328337 65477 803 2943 0 325231 0
[pid=2495/tid=2496] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 65477 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 65477 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 65477 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1313348

[startup+1.5004 s]
/proc/loadavg: 2.00 2.01 1.98 3/186 2499
/proc/meminfo: memFree=28178656/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1313348 CPUtime=1.48 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 133315 0 0 0 130 18 0 0 20 0 4 0 36724518 1344868352 134126 33554432000 4194304 16246674 140733606206160 140733606203968 12459048 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 328337 134135 830 2943 0 325231 0
[pid=2495/tid=2496] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 134139 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 134144 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1344868352 134151 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1313348

[startup+3.1004 s]
/proc/loadavg: 2.00 2.01 1.98 3/186 2499
/proc/meminfo: memFree=27381832/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1335876 CPUtime=3.09 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 274579 0 0 0 272 37 0 0 20 0 4 0 36724518 1367937024 275390 33554432000 4194304 16246674 140733606206160 140733606188032 6132605 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 333969 275390 834 2943 0 330863 0
[pid=2495/tid=2496] ppid=2492 vsize=1335876 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1367937024 275390 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1335876 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1367937024 275390 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1335876 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1367937024 275390 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1335876

[startup+6.30041 s]
/proc/loadavg: 2.00 2.01 1.98 3/186 2499
/proc/meminfo: memFree=26449068/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1335876 CPUtime=6.29 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 274589 0 0 0 592 37 0 0 20 0 4 0 36724518 1367937024 275400 33554432000 4194304 16246674 140733606206160 140733606203968 12500687 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 333969 275400 838 2943 0 330863 0
[pid=2495/tid=2496] ppid=2492 vsize=1335876 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1367937024 275400 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1335876 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1367937024 275400 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1335876 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1367937024 275400 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1335876

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 1.98 3/186 2499
/proc/meminfo: memFree=26154744/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1429060 CPUtime=12.69 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 297892 0 0 0 1230 39 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 140733606188032 13809312 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 357265 298703 844 2943 0 354159 0
[pid=2495/tid=2496] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1429060

[startup+25.5005 s]
/proc/loadavg: 2.00 2.00 1.98 3/186 2499
/proc/meminfo: memFree=26154924/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1429060 CPUtime=25.48 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 297892 0 0 0 2509 39 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 140733606188032 13809356 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 357265 298703 844 2943 0 354159 0
[pid=2495/tid=2496] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1429060

[startup+51.1004 s]
/proc/loadavg: 2.00 2.00 1.98 3/185 2499
/proc/meminfo: memFree=26155212/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1429060 CPUtime=51.08 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 297892 0 0 0 5069 39 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 140733606188032 13943729 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 357265 298703 844 2943 0 354159 0
[pid=2495/tid=2496] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1429060

[startup+102.3 s]
/proc/loadavg: 2.06 2.02 1.99 3/185 2501
/proc/meminfo: memFree=25139764/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=1429060 CPUtime=102.28 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 297892 0 0 0 10189 39 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 140733606188032 13923665 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 357265 298703 844 2943 0 354159 0
[pid=2495/tid=2496] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=1429060 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 1463357440 298703 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1429060


################
# More data... #
################

/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 2631236

[startup+1362.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/185 2532
/proc/meminfo: memFree=15984768/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=2631236 CPUtime=1362.07 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 598436 0 0 0 136126 81 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 140733606188032 6132605 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 657809 599247 844 2943 0 654703 0
[pid=2495/tid=2496] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 2631236

[startup+1422.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/185 2533
/proc/meminfo: memFree=15984788/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=2631236 CPUtime=1422.07 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 598436 0 0 0 142125 82 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 140733606188032 13807598 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 657809 599247 844 2943 0 654703 0
[pid=2495/tid=2496] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 2631236

[startup+1482.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/185 2534
/proc/meminfo: memFree=15984536/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=2631236 CPUtime=1482.06 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 598436 0 0 0 148124 82 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 140733606188032 6132432 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 657809 599247 844 2943 0 654703 0
[pid=2495/tid=2496] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=2631236 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 2694385664 599247 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 2631236

[startup+1542.31 s]
/proc/loadavg: 1.61 1.93 1.97 2/175 2566
/proc/meminfo: memFree=29185388/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=2813508 CPUtime=1542.05 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 643953 0 0 0 154117 88 0 0 20 0 4 0 36724518 2881032192 644766 33554432000 4194304 16246674 140733606206160 140733606204824 4221016 0 2 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 703377 644776 844 2943 0 700271 0
[pid=2495/tid=2496] ppid=2492 vsize=2813508 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 2881032192 644781 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=2813508 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 2881032192 644786 33554432000 4194304 16246674 140733606206160 139918533696528 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=2813508 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 2881032192 644790 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 2813508

[startup+1602.3 s]
/proc/loadavg: 1.22 1.76 1.90 2/175 2568
/proc/meminfo: memFree=28568080/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=3376708 CPUtime=1602.03 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 784807 0 0 0 160092 111 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 140733606188032 6132584 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 844177 785620 845 2943 0 841071 0
[pid=2495/tid=2496] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 3376708

[startup+1662.3 s]
/proc/loadavg: 1.08 1.62 1.84 2/176 2572
/proc/meminfo: memFree=28567884/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=3376708 CPUtime=1662.02 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 784808 0 0 0 166091 111 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 140733606188032 13955776 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 844177 785620 845 2943 0 841071 0
[pid=2495/tid=2496] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 3376708

[startup+1722.3 s]
/proc/loadavg: 1.03 1.50 1.79 2/176 2596
/proc/meminfo: memFree=28567908/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=3376708 CPUtime=1722.01 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 784808 0 0 0 172090 111 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 140733606188032 13807598 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 844177 785620 845 2943 0 841071 0
[pid=2495/tid=2496] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 3376708

[startup+1782.3 s]
/proc/loadavg: 1.05 1.42 1.74 2/175 2597
/proc/meminfo: memFree=28567416/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=3376708 CPUtime=1782 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 784808 0 0 0 178089 111 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 140733606188032 13809400 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 844177 785620 845 2943 0 841071 0
[pid=2495/tid=2496] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 3376708



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 1.03 1.39 1.72 2/175 2597
/proc/meminfo: memFree=28567660/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=3376708 CPUtime=1800 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) R 2492 2495 832 0 -1 4202496 784808 0 0 0 179889 111 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 140733606188032 13807608 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 844177 785620 845 2943 0 841071 0
[pid=2495/tid=2496] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2496/stat : 2496 (toysat) S 2492 2495 832 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918544186608 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 3 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) S 2492 2495 832 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918533696752 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 5 0 0 0 0 0
[pid=2495/tid=2498] ppid=2492 vsize=3376708 CPUtime=0 cores=1,3,5,7
/proc/2495/task/2498/stat : 2498 (toysat) S 2492 2495 832 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36724518 3457748992 785620 33554432000 4194304 16246674 140733606206160 139918523223216 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 3376708

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 2495 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 1.03 1.39 1.72 2/175 2597
/proc/meminfo: memFree=28567660/32872528 swapFree=8804/8804
[pid=2495] ppid=2492 vsize=0 CPUtime=1800.1 cores=1,3,5,7
/proc/2495/stat : 2495 (toysat) Z 2492 2495 832 0 -1 4203532 784808 0 0 0 179889 121 0 0 20 0 2 0 36724518 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/2495/statm: 0 0 0 0 0 0 0
[pid=2495/tid=2497] ppid=2492 vsize=0 CPUtime=0.08 cores=1,3,5,7
/proc/2495/task/2497/stat : 2497 (toysat) R 2492 2495 832 0 -1 4203588 8 0 0 0 0 8 0 0 20 0 2 0 36724518 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.45
CPU time (s): 1800.15
CPU user time (s): 1798.9
CPU system time (s): 1.25581
CPU usage (%): 99.9835
Max. virtual memory (cumulated for all children) (KiB): 3376708

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.9
system time used= 1.25581
maximum resident set size= 3142480
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 784808
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 49
involuntary context switches= 4535

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.08923 second user time and 6.68098 second system time

The end

Launcher Data 

Begin job on node133 at 2016-06-19 16:33:06
IDJOB=4110578
IDBENCH=79533
IDSOLVER=2553
FILE ID=node133/4110578-1466346786
RUNJOBID= node133-1466341813-849
PBS_JOBID= 19922020
Free space on /tmp= 71692 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/warehouse/normalized-capa_wcsp.wbo
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --wbo --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4110578-1466346786/watcher-4110578-1466346786 -o /tmp/evaluation-result-4110578-1466346786/solver-4110578-1466346786 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node133-1466341813-849 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4110578-1466346786.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 143d76bff22b6cbc85097a85314f53ce
RANDOM SEED=1660154615

node133.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.256
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28473124 kB
Buffers:          167548 kB
Cached:           332680 kB
SwapCached:         1408 kB
Active:          3298784 kB
Inactive:         344624 kB
Active(anon):    3143284 kB
Inactive(anon):     2060 kB
Active(file):     155500 kB
Inactive(file):   342564 kB
Unevictable:        8804 kB
Mlocked:            8804 kB
SwapTotal:      67108856 kB
SwapFree:       67100048 kB
Dirty:             23348 kB
Writeback:             0 kB
AnonPages:       3150868 kB
Mapped:            11624 kB
Shmem:                 0 kB
Slab:             611112 kB
SReclaimable:      54580 kB
SUnreclaim:       556532 kB
KernelStack:        1504 kB
PageTables:         9700 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3294252 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341987908 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71692 MiB
End job on node133 at 2016-06-19 17:03:07