Trace number 4107614

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.59 1800.87

General information on the benchmark

Name/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/
random/rand.biglist/normalized-randee102b.cudf.trendy.opb
MD5SUMf44321f7dd3856af726fb72089a277a8
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark56868381951
Best CPU time to get the best result obtained on this benchmark6.93194
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables8400
Total number of constraints35486
Number of constraints which are clauses35117
Number of constraints which are cardinality constraints (but not clauses)369
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint553
Number of terms in the objective function 4014
Biggest coefficient in the objective function 8108486729
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 4475876603702
Number of bits of the sum of numbers in the objective function 43
Biggest number in a constraint 8108486729
Number of bits of the biggest number in a constraint 33
Biggest sum of numbers in a constraint 4475876603702
Number of bits of the biggest sum of numbers43
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-19T00:07:24+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4107614-1466287643.opb"]
0.00/0.01	c use --random-gen="2022324410 3996187506 1721447787 2728863481 1587081003 575865032 2737273154 466705695 3843619181 2761569465 1299251741 804287271 3124122501 2651212874 3116563599 3001994360 3794720368 2975942293 1561855910 980102136 954147592 746741840 3612274331 128288452 189374698 1380437616 1800232922 735067443 837579994 119392654 2084321931 1679469976 512498749 3457346997 2681060672 3368457192 3139332066 2424585635 3323670435 654735612 2776699761 3169229360 2065021919 1951871222 1547176203 320839862 1562895694 1830422514 3650707367 3336620028 3822286531 597771354 4257319463 4293190426 2375240859 1725454167 3394366170 1030399347 3387336453 3734169870 719676961 2940135940 1264520307 3229656137 1823816014 1427727669 3886268817 4139285533 3334115230 855033538 3348825068 4197493819 2170882637 3165608899 315795273 3524010108 262325377 430241438 1194938424 1642513216 3896754960 79330557 2469738736 3305224093 620858773 4055226797 897858181 3096723195 1066288797 3807409929 3247019474 2153584534 2767915510 180281699 644344257 1817102807 1668033824 3929989463 3455454605 3678546247 2374772936 326995799 3035184672 2619108434 1157421819 1121200652 1228873339 643415425 1161156741 3430384575 952735906 569834755 2481120340 4193955837 1684283872 327062039 733958126 2788768483 1275306238 722358898 2246365196 2977021616 1623979775 470647068 1283539073 1163590405 4104555901 1153419455 2508466218 3140314064 3108327614 1581107209 3516581011 763853860 3783252015 4204175031 2318029915 1769371120 2064952324 208183436 4229422512 1592133470 3971886488 4051015553 2698140247 1809683193 2792119889 444782737 1173448291 3125501408 21899722 541500197 1039320920 365705737 4260599533 2103753030 3941575503 1547096798 322416813 461760377 3475000533 1778827447 4220471733 68305271 728817733 431735050 3041601750 2740603978 3066375770 3600974544 964425106 4288672648 590534174 3397971587 2857283840 2408879619 1311909479 2485583939 1409557633 1637688093 2353801889 792656938 3037666892 2026213174 2445976833 2809406449 1005101241 3975847886 2611691694 714106672 37084588 2191219411 3962568138 1297026640 3827523335 2059259440 911795814 963818173 911572344 1170198411 2608087532 712765192 1332360719 612232706 2246154669 1544894383 4288218016 2558627942 3495652738 577383620 918656913 2593995225 3665329406 18613304 2841833138 4224817014 2948774550 3854739285 135695545 316767131 2617058178 1433972427 3544055459 1480750716 3167921086 614446021 3176939817 2509319431 3977033691 1137357156 3061577549 108011845 2793115571 2010702133 1860416524 3809970486 258828349 2909166347 2996912393 3159233848 4181090284 4156304884 905711581 1099823560 721058084 3816657143 934433745 3814471926 2131053418 3275561753 1386060086 3650912181 118168125 2975648395 2199444949 141476254 255 362436" option to reproduce the execution
0.19/0.24	c #vars 8400
0.19/0.24	c #constraints 35486
0.69/0.70	c BCD2: Hardening is enabled.
0.69/0.70	c BCD2: BiasedSearch is enabled.
0.69/0.70	c Solving starts ...
0.69/0.70	c ============================[ Search Statistics ]============================
0.69/0.70	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
0.69/0.70	c       |         |          |          |    Limit     GC | Var      | Constra 
0.69/0.70	c =============================================================================
0.69/0.70	c  0.0s |       0 |        0 |        0 |    13993      0 |     1422 |        0
1.10/1.18	c  0.5s |       0 |    36260 |       94 |    13993      0 |     1457 |     7933
1.10/1.18	c #cpu_time = 0.472s
1.10/1.18	c #wall_clock_time = 0.473s
1.10/1.18	c #decision = 36260
1.10/1.18	c #random_decision = 75
1.10/1.18	c #conflict = 94
1.10/1.18	c #restart = 0
1.10/1.18	o 644150456749

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4107614-1466287643/watcher-4107614-1466287643 -o /tmp/evaluation-result-4107614-1466287643/solver-4107614-1466287643 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node123-1466275608-10489 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4107614-1466287643.opb 

pid=12089
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.31 2.29 2.22 3/179 12092
/proc/meminfo: memFree=25457988/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=858556 CPUtime=0 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 3227 0 0 0 0 0 0 0 20 0 4 0 30811479 879161344 3076 33554432000 4194304 16246674 140735341496672 140735341496096 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 215151 3084 441 2943 0 212045 0
[pid=12092/tid=12093] ppid=12089 vsize=875964 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 896987136 3146 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=881084 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 902230016 3164 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=885180 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30811479 906424320 3181 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100181 s]
/proc/loadavg: 2.31 2.29 2.22 3/179 12092
/proc/meminfo: memFree=25457988/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1302084 CPUtime=0.09 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 29103 0 0 0 4 5 0 0 20 0 4 0 30811479 1333334016 28891 33554432000 4194304 16246674 140735341496672 140735341495984 12752373 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 325521 28907 800 2943 0 322415 0
[pid=12092/tid=12093] ppid=12089 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1333334016 28919 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1333334016 28930 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1333334016 28941 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1302084

[startup+0.200628 s]
/proc/loadavg: 2.31 2.29 2.22 3/179 12092
/proc/meminfo: memFree=25457988/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1314372 CPUtime=0.19 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 50488 0 0 0 12 7 0 0 20 0 4 0 30811479 1345916928 50786 33554432000 4194304 16246674 140735341496672 140735341495984 8058488 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328593 50786 800 2943 0 325487 0
[pid=12092/tid=12093] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 50786 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 50786 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 50786 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1314372

[startup+0.300512 s]
/proc/loadavg: 2.31 2.29 2.22 3/179 12092
/proc/meminfo: memFree=25457988/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1314372 CPUtime=0.29 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 50737 0 0 0 22 7 0 0 20 0 4 0 30811479 1345916928 51035 33554432000 4194304 16246674 140735341496672 140735341495984 13905298 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328593 51035 834 2943 0 325487 0
[pid=12092/tid=12093] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 51035 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 51035 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 51035 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.700421 s]
/proc/loadavg: 2.31 2.29 2.22 3/179 12092
/proc/meminfo: memFree=25457988/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1314372 CPUtime=0.69 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 111374 0 0 0 52 17 0 0 20 0 4 0 30811479 1345916928 111672 33554432000 4194304 16246674 140735341496672 140735341495984 5590097 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328593 111681 840 2943 0 325487 0
[pid=12092/tid=12093] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 111686 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 111692 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 111697 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.50039 s]
/proc/loadavg: 2.31 2.29 2.22 3/183 12096
/proc/meminfo: memFree=24781836/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1314372 CPUtime=1.48 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 181206 0 0 0 122 26 0 0 20 0 4 0 30811479 1345916928 181504 33554432000 4194304 16246674 140735341496672 140735341495984 13966199 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328593 181504 898 2943 0 325487 0
[pid=12092/tid=12093] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 181504 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 181504 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 181504 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1314372

[startup+3.10044 s]
/proc/loadavg: 2.29 2.28 2.22 3/183 12096
/proc/meminfo: memFree=24380448/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1314372 CPUtime=3.09 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 269280 0 0 0 270 39 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 140735341478592 12656008 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328593 269578 898 2943 0 325487 0
[pid=12092/tid=12093] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1314372

[startup+6.30044 s]
/proc/loadavg: 2.29 2.28 2.22 3/183 12096
/proc/meminfo: memFree=24380392/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1314372 CPUtime=6.29 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 269280 0 0 0 590 39 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 140735341478592 12371230 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328593 269578 898 2943 0 325487 0
[pid=12092/tid=12093] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1314372

[startup+12.7004 s]
/proc/loadavg: 2.32 2.29 2.22 3/183 12096
/proc/meminfo: memFree=24346448/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1314372 CPUtime=12.69 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 269280 0 0 0 1230 39 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 140735341478592 12371101 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328593 269578 898 2943 0 325487 0
[pid=12092/tid=12093] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1345916928 269578 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1314372

[startup+25.5005 s]
/proc/loadavg: 2.27 2.28 2.22 3/183 12096
/proc/meminfo: memFree=24389416/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1315396 CPUtime=25.49 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 269455 0 0 0 2510 39 0 0 20 0 4 0 30811479 1346965504 269753 33554432000 4194304 16246674 140735341496672 140735341478592 12371164 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 328849 269753 898 2943 0 325743 0
[pid=12092/tid=12093] ppid=12089 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1346965504 269753 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1346965504 269753 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1315396 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1346965504 269753 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1315396

[startup+51.1005 s]
/proc/loadavg: 2.24 2.27 2.22 3/183 12097
/proc/meminfo: memFree=24244552/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=1352260 CPUtime=51.09 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 278752 0 0 0 5068 41 0 0 20 0 4 0 30811479 1384714240 279050 33554432000 4194304 16246674 140735341496672 140735341494464 4220897 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 338065 279050 898 2943 0 334959 0
[pid=12092/tid=12093] ppid=12089 vsize=1352260 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 1384714240 279050 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=1352260 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 1384714240 279050 33554432000 4194304 16246674 140735341496672 139883426323472 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=1352260 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 1384714240 279050 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 1352260

[startup+102.301 s]
/proc/loadavg: 2.15 2.24 2.21 3/183 12098
/proc/meminfo: memFree=23089956/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=2346564 CPUtime=102.28 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 527328 0 0 0 10152 76 0 0 20 0 4 0 30811479 2402881536 527626 33554432000 4194304 16246674 140735341496672 140735341478592 4206942 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 586641 527626 898 2943 0 583535 0
[pid=12092/tid=12093] ppid=12089 vsize=2346564 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 2402881536 527626 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=2346564 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 2402881536 527626 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=2346564 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 2402881536 527626 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2346564


################
# More data... #
################

[pid=12092] ppid=12089 vsize=8018500 CPUtime=1362.08 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 7617513 0 0 0 134919 1289 0 0 20 0 4 0 30811479 8210944000 1945619 33554432000 4194304 16246674 140735341496672 140735341495768 4226064 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2004625 1945619 899 2943 0 2001519 0
[pid=12092/tid=12093] ppid=12089 vsize=8018500 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 8210944000 1945619 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=8018500 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 8210944000 1945619 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=8018500 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 8210944000 1945619 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 8018500

[startup+1422.3 s]
/proc/loadavg: 2.30 2.30 2.24 3/183 12181
/proc/meminfo: memFree=19749672/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=9472580 CPUtime=1422.07 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 8471787 0 0 0 140784 1423 0 0 20 0 4 0 30811479 9699921920 2309396 33554432000 4194304 16246674 140735341496672 140735341495768 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2368145 2309396 899 2943 0 2365039 0
[pid=12092/tid=12093] ppid=12089 vsize=9472580 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 9699921920 2309396 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=9472580 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 9699921920 2309396 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=9472580 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 9699921920 2309396 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 9472580

[startup+1482.3 s]
/proc/loadavg: 2.26 2.29 2.24 3/183 12182
/proc/meminfo: memFree=19478432/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=9740868 CPUtime=1482.06 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 8597484 0 0 0 146755 1451 0 0 20 0 4 0 30811479 9974648832 2376468 33554432000 4194304 16246674 140735341496672 140735341495848 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2435217 2376468 899 2943 0 2432111 0
[pid=12092/tid=12093] ppid=12089 vsize=9740868 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 9974648832 2376468 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=9740868 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 9974648832 2376468 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=9740868 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 9974648832 2376468 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 9740868

[startup+1542.31 s]
/proc/loadavg: 2.17 2.26 2.23 3/183 12183
/proc/meminfo: memFree=19955772/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=9266756 CPUtime=1542.06 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 8819692 0 0 0 152709 1497 0 0 20 0 4 0 30811479 9489158144 2257940 33554432000 4194304 16246674 140735341496672 140735341495768 4225301 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2316689 2257940 899 2943 0 2313583 0
[pid=12092/tid=12093] ppid=12089 vsize=9266756 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 9489158144 2257940 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=9266756 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 9489158144 2257940 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=9266756 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 9489158144 2257940 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.06
Current children cumulated vsize (KiB) 9266756

[startup+1602.3 s]
/proc/loadavg: 2.15 2.25 2.23 3/183 12185
/proc/meminfo: memFree=19768312/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=9439812 CPUtime=1602.04 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 9311469 0 0 0 158624 1580 0 0 20 0 4 0 30811479 9666367488 2301205 33554432000 4194304 16246674 140735341496672 140735341495768 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2359953 2301205 899 2943 0 2356847 0
[pid=12092/tid=12093] ppid=12089 vsize=9439812 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 9666367488 2301205 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=9439812 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 9666367488 2301205 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=9439812 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 9666367488 2301205 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 9439812

[startup+1662.3 s]
/proc/loadavg: 2.23 2.24 2.22 3/183 12186
/proc/meminfo: memFree=20972788/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=8235588 CPUtime=1662.03 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 9657837 0 0 0 164555 1648 0 0 20 0 4 0 30811479 8433242112 2000149 33554432000 4194304 16246674 140735341496672 140735341495768 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2058897 2000149 899 2943 0 2055791 0
[pid=12092/tid=12093] ppid=12089 vsize=8235588 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 8433242112 2000149 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=8235588 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 8433242112 2000149 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=8235588 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 8433242112 2000149 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 8235588

[startup+1722.3 s]
/proc/loadavg: 2.24 2.24 2.22 3/183 12187
/proc/meminfo: memFree=18056584/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=11148868 CPUtime=1722.02 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 10530798 0 0 0 170435 1767 0 0 20 0 4 0 30811479 11416440832 2728470 33554432000 4194304 16246674 140735341496672 140735341495848 4220850 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2787217 2728470 899 2943 0 2784111 0
[pid=12092/tid=12093] ppid=12089 vsize=11148868 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 11416440832 2728470 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=11148868 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 11416440832 2728470 33554432000 4194304 16246674 140735341496672 139883426323696 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=11148868 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 11416440832 2728470 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 11148868

[startup+1782.3 s]
/proc/loadavg: 2.18 2.22 2.22 4/183 12188
/proc/meminfo: memFree=18795024/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=10631748 CPUtime=1782.01 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 11042679 0 0 0 176344 1857 0 0 20 0 4 0 30811479 10886909952 2599068 33554432000 4194304 16246674 140735341496672 140735341495336 4225154 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2657937 2599079 899 2943 0 2654831 0
[pid=12092/tid=12093] ppid=12089 vsize=10631748 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 10886909952 2599085 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=10631748 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 10886909952 2599090 33554432000 4194304 16246674 140735341496672 139883426323472 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=10631748 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 10886909952 2599096 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 10631748



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.19 2.23 2.22 4/183 12189
/proc/meminfo: memFree=18932764/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=10791492 CPUtime=1800 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) R 12089 12092 10472 0 -1 4202496 11189178 0 0 0 178117 1883 0 0 20 0 4 0 30811479 11050487808 2639071 33554432000 4194304 16246674 140735341496672 140735341495336 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 2697873 2639080 899 2943 0 2694767 0
[pid=12092/tid=12093] ppid=12089 vsize=10791492 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) S 12089 12092 10472 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 30811479 11050487808 2639086 33554432000 4194304 16246674 140735341496672 139883436813552 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=12092/tid=12094] ppid=12089 vsize=10791492 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12094/stat : 12094 (toysat) S 12089 12092 10472 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30811479 11050487808 2639093 33554432000 4194304 16246674 140735341496672 139883426323472 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=12092/tid=12095] ppid=12089 vsize=10791492 CPUtime=0 cores=1,3,5,7
/proc/12092/task/12095/stat : 12095 (toysat) S 12089 12092 10472 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 30811479 11050487808 2639098 33554432000 4194304 16246674 140735341496672 139883415850160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 10791492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 12092 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.19 2.23 2.22 4/183 12189
/proc/meminfo: memFree=18932764/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=0 CPUtime=1800.12 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) Z 12089 12092 10472 0 -1 4203532 11190021 0 0 0 178118 1894 0 0 20 0 2 0 30811479 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 0 0 0 0 0 0 0
[pid=12092/tid=12093] ppid=12089 vsize=0 CPUtime=0.08 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) R 12089 12092 10472 0 -1 4203588 10 0 0 0 0 8 0 0 20 0 2 0 30811479 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 0

[startup+1800.81 s]
/proc/loadavg: 2.19 2.23 2.22 3/181 12189
/proc/meminfo: memFree=25798044/32872528 swapFree=17888/1798212
[pid=12092] ppid=12089 vsize=0 CPUtime=1800.52 cores=1,3,5,7
/proc/12092/stat : 12092 (toysat) Z 12089 12092 10472 0 -1 4203532 11190021 0 0 0 178118 1934 0 0 20 0 2 0 30811479 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/12092/statm: 0 0 0 0 0 0 0
[pid=12092/tid=12093] ppid=12089 vsize=0 CPUtime=0.49 cores=1,3,5,7
/proc/12092/task/12093/stat : 12093 (toysat) R 12089 12092 10472 0 -1 4203588 10 0 0 0 0 49 0 0 20 0 2 0 30811479 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.52
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.87
CPU time (s): 1800.59
CPU user time (s): 1781.19
CPU system time (s): 19.4011
CPU usage (%): 99.9843
Max. virtual memory (cumulated for all children) (KiB): 11148868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1781.19
system time used= 19.4011
maximum resident set size= 10913880
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11190021
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1272
involuntary context switches= 3105

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.5332 second user time and 17.3294 second system time

The end

Launcher Data 

Begin job on node123 at 2016-06-19 00:07:23
IDJOB=4107614
IDBENCH=72365
IDSOLVER=2542
FILE ID=node123/4107614-1466287643
RUNJOBID= node123-1466275608-10489
PBS_JOBID= 19918249
Free space on /tmp= 71616 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/rand.biglist/normalized-randee102b.cudf.trendy.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4107614-1466287643/watcher-4107614-1466287643 -o /tmp/evaluation-result-4107614-1466287643/solver-4107614-1466287643 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node123-1466275608-10489 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4107614-1466287643.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f44321f7dd3856af726fb72089a277a8
RANDOM SEED=1364588292

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.58
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        25458160 kB
Buffers:           78104 kB
Cached:           146176 kB
SwapCached:         1604 kB
Active:          4717408 kB
Inactive:         151656 kB
Active(anon):    4643900 kB
Inactive(anon):     3076 kB
Active(file):      73508 kB
Inactive(file):   148580 kB
Unevictable:     1798212 kB
Mlocked:           17888 kB
SwapTotal:      67108856 kB
SwapFree:       67099320 kB
Dirty:             17428 kB
Writeback:             0 kB
AnonPages:       6444324 kB
Mapped:            10784 kB
Shmem:                 0 kB
Slab:             602732 kB
SReclaimable:      46568 kB
SUnreclaim:       556164 kB
KernelStack:        1456 kB
PageTables:        16772 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    6583596 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1808384 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71600 MiB
End job on node123 at 2016-06-19 00:37:24