Trace number 4093141

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.53 1800.81

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/celar/
normalized-celar7-sub2_wcsp.wbo
MD5SUM2dd7369dce38347df0a942929e2a998a
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmark
Best cost obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables688
Total number of constraints292466
Number of soft constraints292450
Number of constraints which are clauses292450
Number of constraints which are cardinality constraints (but not clauses)16
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint44
Top cost 41497095
Min constraint cost 1
Max constraint cost 1000000
Sum of constraints costs 19773833908
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 45
Number of bits of the biggest sum of numbers6
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-16T21:56:52+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--wbo","--search=bcd2","HOME/instance-4093141-1466107011.wbo"]
0.00/0.01	c use --random-gen="2323436031 2544279999 37109878 214323269 2900815 891834133 1348471678 1796414179 662100455 244314463 528656345 564956008 817156759 2247006181 2033128733 2796451175 1150989085 284082831 3324827008 3715789835 3812939524 2982512512 583267316 4036227267 2434931770 1450289385 3618105785 931352573 500039685 1605346812 947205227 1777114911 1642436456 980118139 1640034577 2124084239 3699498200 2713219899 50935681 2019610296 4124054043 2166867477 3589423534 3940707132 1106353273 3124881912 1339524177 860625913 2640800046 2436560173 204748864 350329053 4148101748 2112816733 1035010984 1585342340 4184080394 721702828 783426489 3749583724 84970334 1993933189 1368327998 1115629067 3575482065 1981935264 1014165785 874185295 1512133883 262915530 1745847755 2168443131 3849979722 1520184239 3820560439 2199775947 2553842531 711114390 3904825199 372253836 1749665635 1501431128 424424242 3351607824 1254740234 4084879867 2971300877 801168649 526567602 1113732430 2990836788 2994091849 3043445985 702655936 1313754954 275214995 1122996323 1738580161 1571388605 377885875 346755933 3549029053 545123032 3247628422 1681962792 1637468087 1013254163 3862595517 2355755396 906058470 1761322618 3183548720 1438435756 3797497042 3159119249 14675429 87467764 2826541626 1869556479 1647754310 3915975275 2564994700 2202991512 1783254893 151539509 705216985 3588938025 2152234507 20031567 1399358905 403547360 1742360983 3943703426 1750152429 64410347 3857767769 2430299555 4062356943 3572649292 1135937456 3355498878 248433255 2586843102 1330508247 4130375689 1824477730 143498583 154317247 3668881134 1294777754 3466915240 2427643478 3797759648 2857169964 286923373 2041164065 4077701245 33331656 1170998841 1637692564 878658782 2256437390 2014468184 2161539977 3586042545 2205078678 2731654164 4223521976 2841757222 3883768770 2541487673 2957650158 2732181831 2158057158 426086357 1503206978 93034213 1305460650 1622010230 2591866590 3398781195 3312464754 529976463 3967044049 1556081351 3412579082 3659234433 2036136356 1415522180 3839900382 1196837080 567080088 2234474253 2805422468 3485632821 1197848518 561641946 2878851207 2970692065 1748587165 726047671 48935492 3922378754 2202677096 4043137957 2187802409 1295350373 4159521759 1970568611 3541655638 3957049157 3222263132 1316272377 1615963187 948508691 2832643648 3599890538 3735325355 760300192 3786658 3904035147 405391189 974871019 3522910434 3353551811 458301334 86899720 910658951 4098122514 2178056190 2877981663 1662494194 1510447948 187117989 3185798093 2091823579 3688589390 3834622742 1777325586 2049402849 622500271 3346519035 2186417546 2867343437 745452890 3254826132 1387346370 695023410 4063331250 1080666310 2160031814 994825962 3036613294 2719805123 68535499 3992571574 255 362436" option to reproduce the execution

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4093141-1466107011/watcher-4093141-1466107011 -o /tmp/evaluation-result-4093141-1466107011/solver-4093141-1466107011 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node140-1466103409-1688 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093141-1466107011.wbo 

pid=2042
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.13 2.16 2.12 3/179 2045
/proc/meminfo: memFree=30297248/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=788924 CPUtime=0 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 2958 0 0 0 0 0 0 0 20 0 4 0 12746398 807858176 2808 33554432000 4194304 16246674 140734834524816 140734834524240 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 197999 2818 441 2943 0 194893 0
[pid=2045/tid=2046] ppid=2042 vsize=823740 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 843509760 2943 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=828860 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 848752640 2961 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=832956 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 12746398 852946944 2979 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100173 s]
/proc/loadavg: 2.13 2.16 2.12 3/179 2045
/proc/meminfo: memFree=30297248/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1220164 CPUtime=0.09 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 29914 0 0 0 6 3 0 0 20 0 4 0 12746398 1249447936 29704 33554432000 4194304 16246674 140734834524816 140734834524128 4221105 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 305041 29704 802 2943 0 301935 0
[pid=2045/tid=2046] ppid=2042 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1249447936 29704 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1249447936 29704 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1249447936 29704 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1220164

[startup+0.200503 s]
/proc/loadavg: 2.13 2.16 2.12 3/179 2045
/proc/meminfo: memFree=30297248/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1309252 CPUtime=0.19 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 51364 0 0 0 12 7 0 0 20 0 4 0 12746398 1340674048 51666 33554432000 4194304 16246674 140734834524816 140734834524128 4221105 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 327313 51673 802 2943 0 324207 0
[pid=2045/tid=2046] ppid=2042 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1340674048 51678 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1340674048 51683 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1340674048 51688 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1309252

[startup+0.3005 s]
/proc/loadavg: 2.13 2.16 2.12 3/179 2045
/proc/meminfo: memFree=30297248/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1314372 CPUtime=0.29 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 65859 0 0 0 20 9 0 0 20 0 4 0 12746398 1345916928 66160 33554432000 4194304 16246674 140734834524816 140734834524128 4223718 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 328593 66160 802 2943 0 325487 0
[pid=2045/tid=2046] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 66160 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 66160 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 66160 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.700446 s]
/proc/loadavg: 2.13 2.16 2.12 3/179 2045
/proc/meminfo: memFree=30297248/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1314372 CPUtime=0.69 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 73935 0 0 0 59 10 0 0 20 0 4 0 12746398 1345916928 74236 33554432000 4194304 16246674 140734834524816 140734834524128 4225100 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 328593 74236 802 2943 0 325487 0
[pid=2045/tid=2046] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 74236 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 74236 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 74236 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.50041 s]
/proc/loadavg: 2.13 2.16 2.12 3/183 2049
/proc/meminfo: memFree=29737724/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1314372 CPUtime=1.48 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 85003 0 0 0 137 11 0 0 20 0 4 0 12746398 1345916928 85304 33554432000 4194304 16246674 140734834524816 140734834522624 8057043 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 328593 85304 803 2943 0 325487 0
[pid=2045/tid=2046] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 85304 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 85304 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 85304 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1314372

[startup+3.10044 s]
/proc/loadavg: 2.20 2.18 2.12 3/183 2049
/proc/meminfo: memFree=29606532/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1314372 CPUtime=3.09 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 99977 0 0 0 295 14 0 0 20 0 4 0 12746398 1345916928 100278 33554432000 4194304 16246674 140734834524816 140734834506688 12855428 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 328593 100278 833 2943 0 325487 0
[pid=2045/tid=2046] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 100278 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 100278 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1345916928 100278 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1314372

[startup+6.30038 s]
/proc/loadavg: 2.20 2.18 2.12 3/183 2049
/proc/meminfo: memFree=28066028/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1395268 CPUtime=6.29 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 289439 0 0 0 590 39 0 0 20 0 4 0 12746398 1428754432 289740 33554432000 4194304 16246674 140734834524816 140734834506688 12368819 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 348817 289740 836 2943 0 345711 0
[pid=2045/tid=2046] ppid=2042 vsize=1395268 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1428754432 289740 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1395268 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1428754432 289740 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1395268 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1428754432 289740 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1395268

[startup+12.7003 s]
/proc/loadavg: 2.32 2.20 2.13 4/183 2049
/proc/meminfo: memFree=27849272/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1503812 CPUtime=12.69 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 316581 0 0 0 1227 42 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 140734834506688 13950218 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 375953 316882 842 2943 0 372847 0
[pid=2045/tid=2046] ppid=2042 vsize=1503812 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1503812 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1503812 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1503812

[startup+25.5006 s]
/proc/loadavg: 2.27 2.20 2.13 3/183 2049
/proc/meminfo: memFree=27851096/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=1503812 CPUtime=25.49 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 316581 0 0 0 2507 42 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 140734834522688 4220936 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 375953 316882 842 2943 0 372847 0
[pid=2045/tid=2046] ppid=2042 vsize=1503812 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=1503812 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=1503812 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 1539903488 316882 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1503812

[startup+51.1005 s]
/proc/loadavg: 2.33 2.21 2.14 3/183 2049
/proc/meminfo: memFree=25880992/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=2486852 CPUtime=51.08 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 562343 0 0 0 5032 76 0 0 20 0 4 0 12746398 2546536448 562644 33554432000 4194304 16246674 140734834524816 140734834522624 4220897 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 621713 562644 843 2943 0 618607 0
[pid=2045/tid=2046] ppid=2042 vsize=2486852 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 2546536448 562644 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=2486852 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 2546536448 562644 33554432000 4194304 16246674 140734834524816 139799831747600 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=2486852 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 2546536448 562644 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 2486852

[startup+102.3 s]
/proc/loadavg: 2.34 2.24 2.15 4/183 2050
/proc/meminfo: memFree=23541280/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=3654212 CPUtime=102.28 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 854183 0 0 0 10108 120 0 0 20 0 4 0 12746398 3741913088 854484 33554432000 4194304 16246674 140734834524816 140734834523912 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 913553 854484 843 2943 0 910447 0
[pid=2045/tid=2046] ppid=2042 vsize=3654212 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 3741913088 854484 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=3654212 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 3741913088 854484 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=3654212 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 3741913088 854484 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 3654212


################
# More data... #
################

[pid=2045] ppid=2042 vsize=9510468 CPUtime=1362.08 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 135695 513 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 13955814 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 9510468

[startup+1422.3 s]
/proc/loadavg: 2.17 2.21 2.18 3/184 2107
/proc/meminfo: memFree=11804028/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1422.08 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 141695 513 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 13955806 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1422.08
Current children cumulated vsize (KiB) 9510468

[startup+1482.3 s]
/proc/loadavg: 2.28 2.23 2.19 3/183 2109
/proc/meminfo: memFree=11804136/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1482.06 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 147693 513 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834523992 13774216 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 9510468

[startup+1542.31 s]
/proc/loadavg: 2.21 2.22 2.18 4/183 2110
/proc/meminfo: memFree=11804140/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1542.07 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 153693 514 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 6132652 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1542.07
Current children cumulated vsize (KiB) 9510468

[startup+1602.3 s]
/proc/loadavg: 2.34 2.25 2.19 3/183 2111
/proc/meminfo: memFree=11804164/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1602.05 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 159691 514 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 13807738 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1602.05
Current children cumulated vsize (KiB) 9510468

[startup+1662.3 s]
/proc/loadavg: 2.32 2.27 2.20 3/183 2112
/proc/meminfo: memFree=11804172/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1662.04 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 165690 514 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 13807544 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1662.04
Current children cumulated vsize (KiB) 9510468

[startup+1722.3 s]
/proc/loadavg: 2.27 2.27 2.20 4/183 2113
/proc/meminfo: memFree=11804260/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1722.03 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 171689 514 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 13809305 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1722.03
Current children cumulated vsize (KiB) 9510468

[startup+1782.3 s]
/proc/loadavg: 2.29 2.27 2.20 3/183 2115
/proc/meminfo: memFree=11803548/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1782.02 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 177688 514 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 13807488 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1782.02
Current children cumulated vsize (KiB) 9510468



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.30 2.28 2.20 4/183 2115
/proc/meminfo: memFree=11804012/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=9510468 CPUtime=1800.02 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) R 2042 2045 29546 0 -1 4202496 3219884 0 0 0 179488 514 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 140734834506688 13943729 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 2377617 2318553 845 2943 0 2374511 0
[pid=2045/tid=2046] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2046/stat : 2046 (toysat) S 2042 2045 29546 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799842237680 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=2045/tid=2047] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2047/stat : 2047 (toysat) S 2042 2045 29546 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799831747824 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 2 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=9510468 CPUtime=0 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) S 2042 2045 29546 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12746398 9738719232 2318553 33554432000 4194304 16246674 140734834524816 139799821274288 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 9510468

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 2045 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.30 2.28 2.20 4/183 2115
/proc/meminfo: memFree=11804012/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=0 CPUtime=1800.12 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) Z 2042 2045 29546 0 -1 4203532 3219884 0 0 0 179488 524 0 0 20 0 2 0 12746398 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 0 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=0 CPUtime=0.08 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) R 2042 2045 29546 0 -1 4203588 2 0 0 0 0 8 0 0 20 0 2 0 12746398 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 0

[startup+1800.81 s]
/proc/loadavg: 2.30 2.28 2.20 3/176 2115
/proc/meminfo: memFree=28365180/32872528 swapFree=1399392/1569044
[pid=2045] ppid=2042 vsize=0 CPUtime=1800.51 cores=0,2,4,6
/proc/2045/stat : 2045 (toysat) Z 2042 2045 29546 0 -1 4203532 3219884 0 0 0 179488 563 0 0 20 0 2 0 12746398 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/2045/statm: 0 0 0 0 0 0 0
[pid=2045/tid=2048] ppid=2042 vsize=0 CPUtime=0.48 cores=0,2,4,6
/proc/2045/task/2048/stat : 2048 (toysat) R 2042 2045 29546 0 -1 4203588 2 0 0 0 0 48 0 0 20 0 2 0 12746398 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.51
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.81
CPU time (s): 1800.53
CPU user time (s): 1794.89
CPU system time (s): 5.64114
CPU usage (%): 99.9842
Max. virtual memory (cumulated for all children) (KiB): 9510468

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.89
system time used= 5.64114
maximum resident set size= 9274212
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3219884
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 490
involuntary context switches= 2297

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.53755 second user time and 17.1814 second system time

The end

Launcher Data 

Begin job on node140 at 2016-06-16 21:56:52
IDJOB=4093141
IDBENCH=79557
IDSOLVER=2553
FILE ID=node140/4093141-1466107011
RUNJOBID= node140-1466103409-1688
PBS_JOBID= 19904032
Free space on /tmp= 71708 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/celar/normalized-celar7-sub2_wcsp.wbo
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --wbo --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4093141-1466107011/watcher-4093141-1466107011 -o /tmp/evaluation-result-4093141-1466107011/solver-4093141-1466107011 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node140-1466103409-1688 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093141-1466107011.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2dd7369dce38347df0a942929e2a998a
RANDOM SEED=1024621274

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.42
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30310316 kB
Buffers:           55224 kB
Cached:           148536 kB
SwapCached:         2564 kB
Active:           191744 kB
Inactive:          92472 kB
Active(anon):      80692 kB
Inactive(anon):     1792 kB
Active(file):     111052 kB
Inactive(file):    90680 kB
Unevictable:     1569044 kB
Mlocked:         1399392 kB
SwapTotal:      67108856 kB
SwapFree:       67096820 kB
Dirty:             49604 kB
Writeback:             0 kB
AnonPages:       1644216 kB
Mapped:            10136 kB
Shmem:                 0 kB
Slab:             572140 kB
SReclaimable:      15740 kB
SUnreclaim:       556400 kB
KernelStack:        1392 kB
PageTables:         8852 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2699660 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    169984 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71692 MiB
End job on node140 at 2016-06-16 22:26:53