Trace number 4118058

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.1 1800.41

General information on the benchmark

NamePB15eval/normalized-PB15eval/OPT-BIGINT-NLC/
minlplib2-pb-0.1.0/opb/normalized-autocorr_bern55-41.opb
MD5SUM1829fd9dd9ff0bce901a022db20a6d74
Bench CategoryOPT-BIGINT-NLC (optimisation, big integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-82163
Best CPU time to get the best result obtained on this benchmark1800.08
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables0
Total number of constraints0
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint-1
Maximum length of a constraint0
Number of terms in the objective function 33318
Biggest coefficient in the objective function 17543
Number of bits for the biggest coefficient in the objective function 15
Sum of the numbers in the objective function 6339040
Number of bits of the sum of numbers in the objective function 23
Biggest number in a constraint 17543
Number of bits of the biggest number in a constraint 15
Biggest sum of numbers in a constraint 6339040
Number of bits of the biggest sum of numbers23
Number of products (including duplicates)33263
Sum of products size (including duplicates)108859
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-29T18:55:16+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4118058-1467219315.opb"]
0.00/0.01	c use --random-gen="1257575355 708088491 2942740725 3425094944 1483492176 2053075653 221609806 1059912268 1553800477 950349739 2926311356 1000339245 2538553389 4004503665 3976002734 1034523026 756192166 3563265663 1028227730 204388309 1573571095 4253160908 283451149 2056227112 2182339482 1037206616 174668416 3101021724 3507384019 3363827983 1079747629 1710046307 3739417662 3949158736 1317101806 2574672834 1013257588 1101558548 3785472026 2407681424 3590200934 2317747260 1457074209 929347776 135633883 4291943437 2266330401 1615679699 835527308 173910591 2755548495 1053818032 1742386534 70007504 1756341333 627961610 875955893 2192275675 1547279134 2357685531 2699960984 1509402726 891871045 3572092886 3177265694 2383993244 2032921647 76964879 3756557418 3182834822 1859382727 1178394262 1302512840 3959804089 3962017819 2022957206 662334296 3820943830 1476396236 2841059878 3498799934 3849999241 3978566153 1150201198 2858080591 1018800845 52916980 357206635 818217205 2252938630 430298364 3958922609 2079374170 2689399452 3603054440 2067442076 2780390039 3905136422 1702107380 90006715 3759433851 3558625176 2546943673 3954570096 3910234797 3766829861 1972322610 1717543298 1831338002 408682933 1610676089 2475316762 3663223491 4276590328 4007131307 3947869461 106672024 313823888 1658614494 2887386857 1256152271 3452388470 1245308005 499572600 2895344243 884745799 2696682916 1425561187 2906958730 3145663917 4275868489 1415428238 3033398708 2677871076 2585075539 1620385187 1126998970 1840491791 1351613118 3441866426 1974210165 2502402060 1669158094 1986764552 1906555224 3139081712 3680603276 1760520985 14184327 2999976278 1874473123 3412563186 1139606302 754919063 1085217785 4231667164 4142589827 2447372690 551032958 4267592583 1639029285 62764061 2565346606 1523140737 120877650 1650067316 980736267 1983914174 1907352532 4181265614 3750709850 773511054 3028087253 1956001680 2272058630 650248647 3337608133 935797070 3420506527 1941800129 3661766615 252945164 3126150332 1857360340 2682159882 1772450186 1488071900 2049617098 4098167363 1794727421 2686074993 3489602636 297351073 1362059456 586089623 3580255066 593394420 2308491292 1139533538 1089924482 2682577023 2843543096 2645079634 237553686 2191909625 1482510977 1580247015 1419129423 2674275798 3711124450 1905493526 1188170495 2964689794 1081953589 2841601787 2389216293 1103844854 1478214168 3163321709 3803669157 2322385346 2930795949 2730839705 356410060 3254131151 2404547286 41873672 439507663 2209842210 1051320813 2174240636 1812183145 2797000189 4103033132 2552844117 1489986514 4007837441 1436270718 3584608442 2633977005 1868891755 3762745912 902709581 1358437069 3196470859 1446225745 2082993417 4259638845 2208366949 1804569467 1976143434 3951742836 2739932522 2136406018 1256728916 4157154899 255 362436" option to reproduce the execution
0.09/0.14	c #vars 55
0.09/0.14	c #constraints 0
0.79/0.81	c BCD2: Hardening is enabled.
0.79/0.81	c BCD2: BiasedSearch is enabled.
0.79/0.81	c Solving starts ...
0.79/0.81	c ============================[ Search Statistics ]============================
0.79/0.81	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
0.79/0.81	c       |         |          |          |    Limit     GC | Var      | Constra 
0.79/0.81	c =============================================================================
0.79/0.89	c  0.0s |       0 |        0 |        0 |    36482      0 |        0 |        0
0.99/1.09	c  0.2s |       0 |    22815 |        0 |    36482      0 |        0 |        0
0.99/1.09	c #cpu_time = 0.186s
0.99/1.09	c #wall_clock_time = 0.187s
0.99/1.09	c #decision = 22815
0.99/1.09	c #random_decision = 61
0.99/1.09	c #conflict = 0
0.99/1.09	c #restart = 0
0.99/1.09	o 0

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4118058-1467219315/watcher-4118058-1467219315 -o /tmp/evaluation-result-4118058-1467219315/solver-4118058-1467219315 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1467210309-2001 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4118058-1467219315.opb 

pid=2978
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.19 2.20 2.18 3/179 2981
/proc/meminfo: memFree=28382536/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=593340 CPUtime=0 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 2190 0 0 0 0 0 0 0 20 0 4 0 959168 607580160 3061 33554432000 4194304 16246674 140734801435056 140734801434480 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 149103 3069 441 2943 0 145997 0
[pid=2981/tid=2982] ppid=2978 vsize=610748 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 625405952 3129 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=615868 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 630648832 3146 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=619964 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 634843136 3161 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100177 s]
/proc/loadavg: 2.19 2.20 2.18 3/179 2981
/proc/meminfo: memFree=28382536/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1301060 CPUtime=0.09 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 27900 0 0 0 6 3 0 0 20 0 4 0 959168 1332285440 28710 33554432000 4194304 16246674 140734801435056 140734801434368 7364033 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 325265 28726 798 2943 0 322159 0
[pid=2981/tid=2982] ppid=2978 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1332285440 28738 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1332285440 28749 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1332285440 28760 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1301060

[startup+0.200496 s]
/proc/loadavg: 2.19 2.20 2.18 3/179 2981
/proc/meminfo: memFree=28382536/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1312324 CPUtime=0.19 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 46641 0 0 0 14 5 0 0 20 0 4 0 959168 1343819776 47450 33554432000 4194304 16246674 140734801435056 140734801434368 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 328081 47454 828 2943 0 324975 0
[pid=2981/tid=2982] ppid=2978 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1343819776 47456 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1343819776 47459 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1343819776 47461 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1312324

[startup+0.30049 s]
/proc/loadavg: 2.19 2.20 2.18 3/179 2981
/proc/meminfo: memFree=28382536/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1312324 CPUtime=0.29 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 53792 0 0 0 23 6 0 0 20 0 4 0 959168 1343819776 54601 33554432000 4194304 16246674 140734801435056 140734801434368 4221142 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 328081 54601 828 2943 0 324975 0
[pid=2981/tid=2982] ppid=2978 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1343819776 54601 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1343819776 54601 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1343819776 54601 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1312324

[startup+0.70042 s]
/proc/loadavg: 2.19 2.20 2.18 3/179 2981
/proc/meminfo: memFree=28382536/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1316420 CPUtime=0.68 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 69038 0 0 0 60 8 0 0 20 0 4 0 959168 1348014080 69847 33554432000 4194304 16246674 140734801435056 140734801434368 7203531 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 329105 69847 828 2943 0 325999 0
[pid=2981/tid=2982] ppid=2978 vsize=1316420 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1348014080 69847 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1316420 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1348014080 69847 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1316420 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1348014080 69847 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 1316420

[startup+1.50042 s]
/proc/loadavg: 2.17 2.19 2.18 3/183 2985
/proc/meminfo: memFree=27471596/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1324612 CPUtime=1.49 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 167676 0 0 0 126 23 0 0 20 0 4 0 959168 1356402688 168485 33554432000 4194304 16246674 140734801435056 140734801432896 12449399 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 331153 168502 878 2943 0 328047 0
[pid=2981/tid=2982] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 168513 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 168522 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 168532 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1324612

[startup+3.10045 s]
/proc/loadavg: 2.17 2.19 2.18 3/183 2985
/proc/meminfo: memFree=26493112/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1324612 CPUtime=3.09 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 272327 0 0 0 273 36 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 140734801416960 12371164 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 331153 273136 878 2943 0 328047 0
[pid=2981/tid=2982] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1324612

[startup+6.30044 s]
/proc/loadavg: 2.16 2.19 2.18 3/183 2985
/proc/meminfo: memFree=26492512/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1324612 CPUtime=6.29 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 272327 0 0 0 593 36 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 140734801416960 12371212 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2981/statm: 331153 273136 878 2943 0 328047 0
[pid=2981/tid=2982] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1324612

[startup+12.7004 s]
/proc/loadavg: 2.23 2.20 2.18 4/183 2985
/proc/meminfo: memFree=26489988/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1324612 CPUtime=12.68 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 272327 0 0 0 1232 36 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 140734801416960 12652957 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2981/statm: 331153 273136 878 2943 0 328047 0
[pid=2981/tid=2982] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1324612

[startup+25.5005 s]
/proc/loadavg: 2.32 2.22 2.19 3/183 2985
/proc/meminfo: memFree=26489412/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1324612 CPUtime=25.48 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 272327 0 0 0 2512 36 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 140734801416960 12653060 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2981/statm: 331153 273136 878 2943 0 328047 0
[pid=2981/tid=2982] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1324612

[startup+51.1005 s]
/proc/loadavg: 2.27 2.22 2.19 3/183 2985
/proc/meminfo: memFree=26487520/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1324612 CPUtime=51.08 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 272327 0 0 0 5072 36 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 140734801416960 12371164 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2981/statm: 331153 273136 878 2943 0 328047 0
[pid=2981/tid=2982] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1324612

[startup+102.301 s]
/proc/loadavg: 2.28 2.23 2.19 4/183 2986
/proc/meminfo: memFree=26482256/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1324612 CPUtime=102.28 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 272327 0 0 0 10192 36 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 140734801416960 12655228 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2981/statm: 331153 273136 878 2943 0 328047 0
[pid=2981/tid=2982] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1356402688 273136 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1324612


################
# More data... #
################

/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1242.08
Current children cumulated vsize (KiB) 1368644

[startup+1302.3 s]
/proc/loadavg: 2.23 2.24 2.22 3/183 3039
/proc/meminfo: memFree=26425044/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1302.06 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283364 0 0 0 130164 42 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 12414096 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1302.06
Current children cumulated vsize (KiB) 1368644

[startup+1362.3 s]
/proc/loadavg: 2.39 2.28 2.24 4/183 3041
/proc/meminfo: memFree=26424956/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1362.05 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283376 0 0 0 136163 42 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 13950222 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.05
Current children cumulated vsize (KiB) 1368644

[startup+1422.3 s]
/proc/loadavg: 2.35 2.29 2.24 3/183 3042
/proc/meminfo: memFree=26425492/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1422.05 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 142162 43 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 13007941 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.05
Current children cumulated vsize (KiB) 1368644

[startup+1482.3 s]
/proc/loadavg: 2.28 2.28 2.24 3/183 3043
/proc/meminfo: memFree=26425740/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1482.03 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 148160 43 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 4220897 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.03
Current children cumulated vsize (KiB) 1368644

[startup+1542.31 s]
/proc/loadavg: 2.38 2.30 2.25 4/184 3047
/proc/meminfo: memFree=26425968/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1542.02 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 154159 43 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 12449344 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 1368644

[startup+1602.3 s]
/proc/loadavg: 2.23 2.27 2.24 3/183 3048
/proc/meminfo: memFree=26425620/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1602.01 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 160158 43 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801432896 12656213 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.01
Current children cumulated vsize (KiB) 1368644

[startup+1662.3 s]
/proc/loadavg: 2.24 2.27 2.24 3/183 3050
/proc/meminfo: memFree=26425988/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1662 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 166156 44 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 12653056 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662
Current children cumulated vsize (KiB) 1368644

[startup+1722.3 s]
/proc/loadavg: 2.32 2.28 2.25 4/183 3051
/proc/meminfo: memFree=26425820/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1721.99 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 172155 44 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801432960 12429241 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1721.99
Current children cumulated vsize (KiB) 1368644

[startup+1782.3 s]
/proc/loadavg: 2.22 2.25 2.24 3/183 3052
/proc/meminfo: memFree=26425324/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1781.99 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 178154 45 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 6955540 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1781.99
Current children cumulated vsize (KiB) 1368644



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.25 2.26 2.24 4/183 3052
/proc/meminfo: memFree=26425700/32872528 swapFree=1553660/1717180
[pid=2981] ppid=2978 vsize=1368644 CPUtime=1800.08 cores=1,3,5,7
/proc/2981/stat : 2981 (toysat) R 2978 2981 1984 0 -1 4202496 283381 0 0 0 179963 45 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 140734801416960 6955336 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2981/statm: 342161 284147 878 2943 0 339055 0
[pid=2981/tid=2982] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2982/stat : 2982 (toysat) S 2978 2981 1984 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871775599856 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2981/tid=2983] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2983/stat : 2983 (toysat) S 2978 2981 1984 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871765110000 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2981/tid=2984] ppid=2978 vsize=1368644 CPUtime=0 cores=1,3,5,7
/proc/2981/task/2984/stat : 2984 (toysat) S 2978 2981 1984 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 959168 1401491456 284147 33554432000 4194304 16246674 140734801435056 139871649787056 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 1368644

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 2981 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.41
CPU time (s): 1800.1
CPU user time (s): 1799.64
CPU system time (s): 0.452931
CPU usage (%): 99.9825
Max. virtual memory (cumulated for all children) (KiB): 1368644

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.64
system time used= 0.452931
maximum resident set size= 1136588
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 283381
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 128
involuntary context switches= 1944

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.76982 second user time and 20.3759 second system time

The end

Launcher Data 

Begin job on node117 at 2016-06-29 18:55:15
IDJOB=4118058
IDBENCH=111440
IDSOLVER=2542
FILE ID=node117/4118058-1467219315
RUNJOBID= node117-1467210309-2001
PBS_JOBID= 19997597
Free space on /tmp= 71608 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB15eval/normalized-PB15eval/OPT-BIGINT-NLC/minlplib2-pb-0.1.0/opb/normalized-autocorr_bern55-41.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4118058-1467219315/watcher-4118058-1467219315 -o /tmp/evaluation-result-4118058-1467219315/solver-4118058-1467219315 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1467210309-2001 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4118058-1467219315.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1829fd9dd9ff0bce901a022db20a6d74
RANDOM SEED=686888906

node117.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.42
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28383048 kB
Buffers:           42772 kB
Cached:          1726812 kB
SwapCached:            0 kB
Active:           403424 kB
Inactive:        1653320 kB
Active(anon):     289612 kB
Inactive(anon):        4 kB
Active(file):     113812 kB
Inactive(file):  1653316 kB
Unevictable:     1717180 kB
Mlocked:         1553660 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             33036 kB
Writeback:             0 kB
AnonPages:       1949416 kB
Mapped:            17260 kB
Shmem:               204 kB
Slab:             580616 kB
SReclaimable:      25168 kB
SUnreclaim:       555448 kB
KernelStack:        1520 kB
PageTables:         8652 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2937404 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    110592 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71592 MiB
End job on node117 at 2016-06-29 19:25:16