Trace number 4110546

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.59 1800.89

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/warehouse/
normalized-cap121_wcsp.wbo
MD5SUM4ad1347278976f19411afc1ab6eea52f
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmarkMSAT
Best cost obtained on this benchmark16519919
Best CPU time to get the best result obtained on this benchmark1800.13
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables2600
Total number of constraints5148
Number of soft constraints5048
Number of constraints which are clauses5048
Number of constraints which are cardinality constraints (but not clauses)100
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint50
Top cost 61306436
Min constraint cost 1
Max constraint cost 61306436
Sum of constraints costs 154547346300
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 51
Number of bits of the biggest sum of numbers6
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-19T16:15:20+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--wbo","--search=bcd2","HOME/instance-4110546-1466345720.wbo"]
0.00/0.01	c use --random-gen="530915652 844744677 3073958366 3321476519 1162689503 4185250398 1517079384 2385137172 1451570256 2099925331 901371227 709260626 1346499483 2455963279 112418934 767296876 1310521907 3858206777 3024909294 2943478408 3383641881 1819940935 286442583 845896914 673182396 753313551 1516922305 2811811188 4210556415 3003103846 3033059954 4262702776 138982410 1404689624 1476728286 2727269319 3492834940 891600466 1937090730 1610644011 802403092 804773645 2924049901 1277480091 3150601624 2999449484 4242878276 1766429369 3563542443 2761802930 1965146816 2198687959 2937588125 3904358741 299165125 1368886890 897333934 3301485351 3716716773 1457856744 3076333681 466289016 2870230037 536130722 392178633 4064430919 4086547049 2188378631 2897262747 3064602525 2849927620 2955204330 3064867463 2751916394 3101911434 1787263477 85924205 3833184796 3662649337 1790741667 1113702110 2594377114 2213827695 2615267026 261162709 1676601090 1440400982 2552109371 251772556 452239422 2064573127 1631819994 814083087 2005448137 2373371363 600933944 1118692232 2709402582 712543739 1606091950 3774955317 1059526230 1717739219 1611045770 672934207 2139874186 1133245918 481423054 852715850 2960862265 1526691965 1136136913 2130737200 266060028 3292158052 2101405701 1540378992 4230926224 2763274487 2800222103 764363281 201716856 1663582617 1076536125 2147012586 1194793365 1606411218 3057172971 713797970 2477603644 506665081 3039514654 3890001813 2134539114 1425828020 81801409 423786306 546291934 2504961735 2760628140 1647318944 643396447 895995300 1983138146 3206705638 2071680115 1606999287 3282706735 1100440847 4217892405 168257446 1436325526 2776339207 3115913423 1296998186 1341363631 2475987997 172084540 2236723274 1472636858 855818450 1651016877 2837483408 4083317823 113952070 2627791359 385688755 53966669 2869758555 2434677304 375592061 1782592063 2721490188 1217679475 1032644001 3851615562 1543271361 1366556888 4188931798 507134784 216900421 354828377 2008759229 4075013866 731898549 2388414592 1671771074 179130090 458154134 1723039953 1728444523 200983095 1823309010 1212938816 1201934221 2037496192 879385946 793311562 2081385334 1958790936 2267021913 834444381 317620190 3551990544 1651960369 944967103 2775336048 3337555249 1984706263 1126344657 898743550 1765619232 1150637862 4144589426 940412760 2190407634 671949415 600748036 620877423 3956648034 1458217768 2362300502 3706346800 826183129 744196033 1296776939 3322971932 3043802805 2685605763 3056522762 1659494353 3490743461 3121765155 910019919 2939913821 1534810582 2583506465 107762345 3443588399 2253639021 376114185 3466351286 3363765322 2920703963 1920808551 2313693459 3152649900 3352498990 3798689219 2313821877 1238938836 2796904023 3431684552 951542995 2993235535 2095324595 255 362436" option to reproduce the execution

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4110546-1466345720/watcher-4110546-1466345720 -o /tmp/evaluation-result-4110546-1466345720/solver-4110546-1466345720 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node105-1466341824-4861 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4110546-1466345720.wbo 

pid=6274
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.07 2.07 2.00 3/179 6277
/proc/meminfo: memFree=29213540/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=798140 CPUtime=0 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2991 0 0 0 0 0 0 0 20 0 4 0 36621970 817295360 2841 33554432000 4194304 16246674 140735363574448 140735363573872 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 200047 2850 441 2943 0 196941 0
[pid=6277/tid=6278] ppid=6274 vsize=815548 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 835121152 2909 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=819644 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 839315456 2924 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=823740 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 36621971 843509760 2941 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100149 s]
/proc/loadavg: 2.07 2.07 2.00 3/179 6277
/proc/meminfo: memFree=29213540/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1221188 CPUtime=0.09 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 20573 0 0 0 7 2 0 0 20 0 4 0 36621970 1250496512 20362 33554432000 4194304 16246674 140735363574448 140735363573760 6197796 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 305297 20369 827 2943 0 302191 0
[pid=6277/tid=6278] ppid=6274 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1250496512 20374 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1250496512 20380 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36621971 1250496512 20386 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1221188

[startup+0.200493 s]
/proc/loadavg: 2.07 2.07 2.00 3/179 6277
/proc/meminfo: memFree=29213540/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1222212 CPUtime=0.19 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 40013 0 0 0 14 5 0 0 20 0 4 0 36621970 1251545088 39802 33554432000 4194304 16246674 140735363574448 140735363573760 4221016 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 305553 39805 832 2943 0 302447 0
[pid=6277/tid=6278] ppid=6274 vsize=1222212 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1251545088 39807 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1222212 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1251545088 39809 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1222212 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36621971 1251545088 39811 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1222212

[startup+0.300459 s]
/proc/loadavg: 2.07 2.07 2.00 3/179 6277
/proc/meminfo: memFree=29213540/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1307204 CPUtime=0.29 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 49176 0 0 0 23 6 0 0 20 0 4 0 36621970 1338576896 48965 33554432000 4194304 16246674 140735363574448 140735363573760 6136820 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 326801 48965 838 2943 0 323695 0
[pid=6277/tid=6278] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 48965 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 48965 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 48965 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1307204

[startup+0.700401 s]
/proc/loadavg: 2.07 2.07 2.00 3/179 6277
/proc/meminfo: memFree=29213540/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1307204 CPUtime=0.69 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 49178 0 0 0 63 6 0 0 20 0 4 0 36621970 1338576896 48967 33554432000 4194304 16246674 140735363574448 140735363573760 13774000 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 326801 48967 840 2943 0 323695 0
[pid=6277/tid=6278] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 48967 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 48967 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 48967 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1307204

[startup+1.5004 s]
/proc/loadavg: 2.07 2.07 2.00 3/183 6281
/proc/meminfo: memFree=29018968/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1307204 CPUtime=1.49 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 53560 0 0 0 142 7 0 0 20 0 4 0 36621970 1338576896 53349 33554432000 4194304 16246674 140735363574448 140735363556352 6187993 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 326801 53349 840 2943 0 323695 0
[pid=6277/tid=6278] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 53349 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 53349 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 53349 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1307204

[startup+3.10039 s]
/proc/loadavg: 2.07 2.07 2.00 3/183 6281
/proc/meminfo: memFree=28978420/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1307204 CPUtime=3.09 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 61159 0 0 0 301 8 0 0 20 0 4 0 36621970 1338576896 60948 33554432000 4194304 16246674 140735363574448 140735363556352 13807640 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 326801 60948 840 2943 0 323695 0
[pid=6277/tid=6278] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 60948 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 60948 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1338576896 60948 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1307204

[startup+6.30039 s]
/proc/loadavg: 2.06 2.06 2.00 3/183 6281
/proc/meminfo: memFree=28968420/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1308228 CPUtime=6.29 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 61578 0 0 0 621 8 0 0 20 0 4 0 36621970 1339625472 61367 33554432000 4194304 16246674 140735363574448 140735363556352 13927401 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 327057 61367 840 2943 0 323951 0
[pid=6277/tid=6278] ppid=6274 vsize=1308228 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1339625472 61367 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1308228 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1339625472 61367 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1308228 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1339625472 61367 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1308228

[startup+12.7004 s]
/proc/loadavg: 2.06 2.06 2.00 3/183 6281
/proc/meminfo: memFree=28954896/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1309252 CPUtime=12.69 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 61834 0 0 0 1261 8 0 0 20 0 4 0 36621970 1340674048 61623 33554432000 4194304 16246674 140735363574448 140735363556352 13874569 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 327313 61623 840 2943 0 324207 0
[pid=6277/tid=6278] ppid=6274 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1340674048 61623 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1340674048 61623 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1340674048 61623 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1309252

[startup+25.5004 s]
/proc/loadavg: 2.04 2.06 2.00 3/183 6281
/proc/meminfo: memFree=28934592/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1310276 CPUtime=25.49 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 63933 0 0 0 2540 9 0 0 20 0 4 0 36621970 1341722624 63722 33554432000 4194304 16246674 140735363574448 140735363556352 13807758 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 327569 63722 840 2943 0 324463 0
[pid=6277/tid=6278] ppid=6274 vsize=1310276 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1341722624 63722 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1310276 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1341722624 63722 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1310276 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1341722624 63722 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1310276

[startup+51.1004 s]
/proc/loadavg: 2.03 2.05 2.00 3/183 6281
/proc/meminfo: memFree=28807324/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1311300 CPUtime=51.09 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 89202 0 0 0 5096 13 0 0 20 0 4 0 36621970 1342771200 88991 33554432000 4194304 16246674 140735363574448 140735363556352 13774072 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 327825 88991 840 2943 0 324719 0
[pid=6277/tid=6278] ppid=6274 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1342771200 88991 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36621971 1342771200 88991 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1342771200 88991 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 1311300

[startup+102.3 s]
/proc/loadavg: 2.06 2.06 2.00 3/183 6282
/proc/meminfo: memFree=28262472/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=1312324 CPUtime=102.28 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 214759 0 0 0 10199 29 0 0 20 0 4 0 36621970 1343819776 214548 33554432000 4194304 16246674 140735363574448 140735363556352 13923640 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 328081 214548 840 2943 0 324975 0
[pid=6277/tid=6278] ppid=6274 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1343819776 214548 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 1343819776 214548 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 1343819776 214548 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1312324


################
# More data... #
################

[pid=6277] ppid=6274 vsize=9439812 CPUtime=1362.07 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2301114 0 0 0 135831 376 0 0 20 0 4 0 36621970 9666367488 2301134 33554432000 4194304 16246674 140735363574448 140735363573624 13809400 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 2359953 2301134 841 2943 0 2356847 0
[pid=6277/tid=6278] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 9439812

[startup+1422.3 s]
/proc/loadavg: 2.10 2.09 2.01 3/183 6363
/proc/meminfo: memFree=16801176/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=9439812 CPUtime=1422.07 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2301117 0 0 0 141828 379 0 0 20 0 4 0 36621970 9666367488 2301134 33554432000 4194304 16246674 140735363574448 140735363573624 13807774 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 2359953 2301134 841 2943 0 2356847 0
[pid=6277/tid=6278] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 9439812

[startup+1482.3 s]
/proc/loadavg: 2.08 2.08 2.01 3/184 6367
/proc/meminfo: memFree=16800768/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=9439812 CPUtime=1482.05 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2301117 0 0 0 147823 382 0 0 20 0 4 0 36621970 9666367488 2301134 33554432000 4194304 16246674 140735363574448 140735363573624 6132467 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 2359953 2301134 841 2943 0 2356847 0
[pid=6277/tid=6278] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=9439812 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 9666367488 2301134 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 9439812

[startup+1542.31 s]
/proc/loadavg: 2.06 2.08 2.01 3/183 6369
/proc/meminfo: memFree=12507332/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=12100164 CPUtime=1542.04 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2966206 0 0 0 153734 470 0 0 20 0 4 0 36621970 12390567936 2966223 33554432000 4194304 16246674 140735363574448 140735363573624 6132671 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 3025041 2966223 841 2943 0 3021935 0
[pid=6277/tid=6278] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966223 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966223 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966223 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 12100164

[startup+1602.3 s]
/proc/loadavg: 2.02 2.06 2.01 3/183 6370
/proc/meminfo: memFree=12507472/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=12100164 CPUtime=1602.03 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2966206 0 0 0 159729 474 0 0 20 0 4 0 36621970 12390567936 2966223 33554432000 4194304 16246674 140735363574448 140735363573624 15015658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 3025041 2966223 841 2943 0 3021935 0
[pid=6277/tid=6278] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966223 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966223 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966223 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 12100164

[startup+1662.3 s]
/proc/loadavg: 2.08 2.06 2.00 3/183 6371
/proc/meminfo: memFree=12507000/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=12100164 CPUtime=1662.02 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2966210 0 0 0 165725 477 0 0 20 0 4 0 36621970 12390567936 2966227 33554432000 4194304 16246674 140735363574448 140735363573624 13807696 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 3025041 2966227 841 2943 0 3021935 0
[pid=6277/tid=6278] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 12100164

[startup+1722.3 s]
/proc/loadavg: 2.03 2.05 2.00 3/183 6372
/proc/meminfo: memFree=12507272/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=12100164 CPUtime=1722.01 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2966210 0 0 0 171722 479 0 0 20 0 4 0 36621970 12390567936 2966227 33554432000 4194304 16246674 140735363574448 140735363573624 13807488 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 3025041 2966227 841 2943 0 3021935 0
[pid=6277/tid=6278] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 12100164

[startup+1782.3 s]
/proc/loadavg: 2.01 2.04 2.00 3/183 6373
/proc/meminfo: memFree=12507040/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=12100164 CPUtime=1782 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2966210 0 0 0 177718 482 0 0 20 0 4 0 36621970 12390567936 2966227 33554432000 4194304 16246674 140735363574448 140735363573624 6132432 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 3025041 2966227 841 2943 0 3021935 0
[pid=6277/tid=6278] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 12100164



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.00 2.04 2.00 3/183 6374
/proc/meminfo: memFree=12507148/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=12100164 CPUtime=1800 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) R 6274 6277 4845 0 -1 4202496 2966210 0 0 0 179517 483 0 0 20 0 4 0 36621970 12390567936 2966227 33554432000 4194304 16246674 140735363574448 140735363573624 13955776 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 3025041 2966227 841 2943 0 3021935 0
[pid=6277/tid=6278] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6278/stat : 6278 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880144284912 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) S 6274 6277 4845 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880133795056 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=6277/tid=6280] ppid=6274 vsize=12100164 CPUtime=0 cores=0,2,4,6
/proc/6277/task/6280/stat : 6280 (toysat) S 6274 6277 4845 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36621971 12390567936 2966227 33554432000 4194304 16246674 140735363574448 139880123321520 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 12100164

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6277 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.00 2.04 2.00 3/183 6374
/proc/meminfo: memFree=12507148/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=0 CPUtime=1800.1 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) Z 6274 6277 4845 0 -1 4203532 2966210 0 0 0 179517 493 0 0 20 0 2 0 36621970 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 0 0 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=0 CPUtime=0.08 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) R 6274 6277 4845 0 -1 4203588 10 0 0 0 0 8 0 0 20 0 2 0 36621971 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 0

[startup+1800.81 s]
/proc/loadavg: 2.00 2.04 2.00 3/181 6374
/proc/meminfo: memFree=21073064/32872528 swapFree=163656/177964
[pid=6277] ppid=6274 vsize=0 CPUtime=1800.51 cores=0,2,4,6
/proc/6277/stat : 6277 (toysat) Z 6274 6277 4845 0 -1 4203532 2966210 0 0 0 179517 534 0 0 20 0 2 0 36621970 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6277/statm: 0 0 0 0 0 0 0
[pid=6277/tid=6279] ppid=6274 vsize=0 CPUtime=0.49 cores=0,2,4,6
/proc/6277/task/6279/stat : 6279 (toysat) R 6274 6277 4845 0 -1 4203588 10 0 0 0 0 49 0 0 20 0 2 0 36621971 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.51
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.89
CPU time (s): 1800.59
CPU user time (s): 1795.17
CPU system time (s): 5.41818
CPU usage (%): 99.9833
Max. virtual memory (cumulated for all children) (KiB): 12100164

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.17
system time used= 5.41818
maximum resident set size= 11864908
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2966210
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 87
involuntary context switches= 1867

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.33519 second user time and 7.15391 second system time

The end

Launcher Data 

Begin job on node105 at 2016-06-19 16:15:20
IDJOB=4110546
IDBENCH=79514
IDSOLVER=2553
FILE ID=node105/4110546-1466345720
RUNJOBID= node105-1466341824-4861
PBS_JOBID= 19922043
Free space on /tmp= 71732 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/warehouse/normalized-cap121_wcsp.wbo
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --wbo --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4110546-1466345720/watcher-4110546-1466345720 -o /tmp/evaluation-result-4110546-1466345720/solver-4110546-1466345720 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node105-1466341824-4861 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4110546-1466345720.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4ad1347278976f19411afc1ab6eea52f
RANDOM SEED=359279213

node105.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.561
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.58
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29214216 kB
Buffers:          129580 kB
Cached:           349336 kB
SwapCached:         1696 kB
Active:          2406304 kB
Inactive:         326988 kB
Active(anon):    2253548 kB
Inactive(anon):     3096 kB
Active(file):     152756 kB
Inactive(file):   323892 kB
Unevictable:      177964 kB
Mlocked:          163656 kB
SwapTotal:      67108856 kB
SwapFree:       67099304 kB
Dirty:             16324 kB
Writeback:             0 kB
AnonPages:       2419228 kB
Mapped:            10836 kB
Shmem:                 0 kB
Slab:             609464 kB
SReclaimable:      53172 kB
SUnreclaim:       556292 kB
KernelStack:        1520 kB
PageTables:         8852 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2577948 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1628160 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71716 MiB
End job on node105 at 2016-06-19 16:45:21