Trace number 4107546

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.39 1800.7

General information on the benchmark

Name/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/
random/rand.newlist/normalized-rand27da90.cudf.trendy.opb
MD5SUM1db531ec7fbea38dd353f31b0fba98ed
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark27562740203
Best CPU time to get the best result obtained on this benchmark2.37464
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6757
Total number of constraints28229
Number of constraints which are clauses27934
Number of constraints which are cardinality constraints (but not clauses)295
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint553
Number of terms in the objective function 3152
Biggest coefficient in the objective function 3929352552
Number of bits for the biggest coefficient in the objective function 32
Sum of the numbers in the objective function 2168997629561
Number of bits of the sum of numbers in the objective function 41
Biggest number in a constraint 3929352552
Number of bits of the biggest number in a constraint 32
Biggest sum of numbers in a constraint 2168997629561
Number of bits of the biggest sum of numbers41
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T23:51:04+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4107546-1466286663.opb"]
0.00/0.01	c use --random-gen="2245997712 3981753024 1364135605 834153335 3483328621 694099677 1274845745 56665813 902388289 3485785259 2879048018 1736652997 2430023008 3818818654 905885696 2320812805 2871543315 3172932650 2468106928 1023134127 2784037051 3939192172 576400955 862599680 516642821 1992994030 90943605 3839371219 725547294 1481589325 1486240659 2395980318 1300742145 515696525 2119077604 1482944870 2698336471 1660964314 1144271936 3563277551 2432227769 2579405488 2933475130 1995141919 3712615053 2399811786 1827810734 1960454806 1674661275 3116648877 607951099 1974491878 2275840477 1740114602 3674260509 4247024557 2280024370 2059574682 2799702218 443237667 2438204155 1467437868 2429781 3779338677 1621864928 1559256016 2000457103 1300625551 3638933829 1710665976 2721835351 4215346882 3894852016 3897671065 271354456 3017747854 2849977391 1154922746 2472357034 762871467 3124776897 1843471514 2037232719 518132387 4056792800 1061695895 509924536 2516153098 3361965116 2263014391 1264832482 1399834181 2953160040 110604768 598165460 2174769348 2444211286 2798576944 3181343311 1527451668 3983841307 2770788197 17523222 266371243 3440989457 3272435916 3765208201 346953164 665191313 1268449121 2567203738 2287775194 1075453108 1109518285 1631259696 1807378923 512017722 2600907965 3672745179 2106261708 3386110704 377613402 817508538 1147970912 2155573767 3951856263 3544231696 1334036153 265923100 505089667 3429196707 3074926111 285321255 3627308047 179661079 2965284278 1106093896 3435558265 684205080 3934745252 299202703 772724586 279632395 2605674780 1385955576 1624433936 373744373 3273874919 3217929409 2884961779 704831945 2901117375 1550819446 1571567829 539671640 1161644759 603497470 4249840738 76159751 3695284707 4148788070 3147665838 3330635975 507782876 2356940939 2227523962 3125795298 2767203035 1300808218 3900221303 4184351940 830586778 1260136873 804901874 1410829999 4034124738 1958993942 2829120733 2574790534 3502615269 2939023701 3131553451 2323733404 255503819 3321400012 730942195 293905094 1967551092 692224509 287368101 310007803 307413181 1136974222 145580350 726956902 90365587 57156142 2629131590 1764600807 1146207051 954722596 1678133839 1649260818 3930911598 2199202558 3639453945 1668279936 446949755 753138095 587331767 3250326241 3903697294 974421527 1180711215 311147368 3779571094 3412707935 4140501432 1447946171 1718270677 2640284202 2982795036 2931209848 85741742 3354267015 4042623207 759817529 234727601 3847871164 2285414513 4129949925 905005767 1116278377 568226550 345295623 966785881 2964916254 871618191 2097145672 3892334910 2049014374 431096402 3853208678 2509132101 181074893 805371390 4260630447 1326508221 826762784 122508367 3420624977 1622024390 1808447004 4204912359 2444466662 4006617609 255 362436" option to reproduce the execution
0.19/0.21	c #vars 6757
0.19/0.21	c #constraints 28229
0.48/0.59	c BCD2: Hardening is enabled.
0.48/0.59	c BCD2: BiasedSearch is enabled.
0.48/0.59	c Solving starts ...
0.48/0.59	c ============================[ Search Statistics ]============================
0.48/0.59	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
0.48/0.59	c       |         |          |          |    Limit     GC | Var      | Constra 
0.48/0.59	c =============================================================================
0.59/0.60	c  0.0s |       0 |        0 |        0 |    11298      0 |      886 |        0
0.99/1.00	c  0.4s |       0 |    30342 |       92 |    11298      0 |      908 |     5175
0.99/1.00	c #cpu_time = 0.400s
0.99/1.00	c #wall_clock_time = 0.399s
0.99/1.00	c #decision = 30342
0.99/1.00	c #random_decision = 84
0.99/1.00	c #conflict = 92
0.99/1.00	c #restart = 0
0.99/1.00	o 308317221629
818.85/819.00	c BCD2: updating upper bound: 2168997629561 -> 308317221628
1225.08/1225.39	c BCD2: 0 <= obj <= 308317221628
1225.08/1225.39	c BCD2: #cores=0, #unrelaxed=3152, #relaxed=0, #hardened=0
1225.08/1225.39	c BCD2: #sat=1 #unsat=1 bias=1/2
1225.08/1225.39	c Solving starts ...
1225.08/1225.39	c ============================[ Search Statistics ]============================
1225.08/1225.39	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
1225.08/1225.39	c       |         |          |          |    Limit     GC | Var      | Constra 
1225.08/1225.39	c =============================================================================
1225.08/1225.39	c  0.0s |       0 |        0 |        0 |    11298      0 |      908 |     5175
1225.19/1225.41	c  0.0s |       0 |        5 |        1 |    11298      0 |      909 |     5177
1225.19/1225.41	c #cpu_time = 0.021s
1225.19/1225.41	c #wall_clock_time = 0.021s
1225.19/1225.41	c #decision = 5
1225.19/1225.41	c #random_decision = 0
1225.19/1225.41	c #conflict = 1
1225.19/1225.41	c #restart = 0
1225.19/1225.41	c BCD2: found a new core of size 1: cost of the new core is >=1
1225.19/1225.41	c lower bound updated to 1

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4107546-1466286663/watcher-4107546-1466286663 -o /tmp/evaluation-result-4107546-1466286663/solver-4107546-1466286663 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node139-1466274546-28141 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4107546-1466286663.opb 

pid=29568
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.38 2.29 2.20 2/179 29571
/proc/meminfo: memFree=29101876/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=642492 CPUtime=0 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 2383 0 0 0 0 0 0 0 20 0 4 0 30712091 657911808 3254 33554432000 4194304 16246674 140733809907328 140733809906752 13880264 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 161135 3261 441 2943 0 158029 0
[pid=29571/tid=29572] ppid=29568 vsize=659900 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 675737600 3321 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=665020 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 680980480 3340 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=668092 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 684126208 3355 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0

[startup+0.100171 s]
/proc/loadavg: 2.38 2.29 2.20 2/179 29571
/proc/meminfo: memFree=29101876/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1302084 CPUtime=0.08 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 25361 0 0 0 5 3 0 0 20 0 4 0 30712091 1333334016 26171 33554432000 4194304 16246674 140733809907328 140733809906640 7368729 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 325521 26185 799 2943 0 322415 0
[pid=29571/tid=29572] ppid=29568 vsize=1302084 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1333334016 26195 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1302084 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1333334016 26207 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1302084 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1333334016 26216 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 1302084

[startup+0.200522 s]
/proc/loadavg: 2.38 2.29 2.20 2/179 29571
/proc/meminfo: memFree=29101876/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1313348 CPUtime=0.19 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 46954 0 0 0 13 6 0 0 20 0 4 0 30712091 1344868352 48274 33554432000 4194304 16246674 140733809907328 140733809906640 7928848 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 328337 48274 800 2943 0 325231 0
[pid=29571/tid=29572] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 48274 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 48274 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 48274 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1313348

[startup+0.300502 s]
/proc/loadavg: 2.38 2.29 2.20 2/179 29571
/proc/meminfo: memFree=29101876/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1313348 CPUtime=0.29 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 51602 0 0 0 22 7 0 0 20 0 4 0 30712091 1344868352 52922 33554432000 4194304 16246674 140733809907328 140733809906640 6760209 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 328337 52932 837 2943 0 325231 0
[pid=29571/tid=29572] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 52938 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 52944 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 52949 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1313348

[startup+0.700342 s]
/proc/loadavg: 2.38 2.29 2.20 2/179 29571
/proc/meminfo: memFree=29101876/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1313348 CPUtime=0.69 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 120908 0 0 0 49 20 0 0 20 0 4 0 30712091 1344868352 122228 33554432000 4194304 16246674 140733809907328 140733809906640 5532301 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 328337 122234 886 2943 0 325231 0
[pid=29571/tid=29572] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 122238 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 122242 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1344868352 122246 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1313348

[startup+1.5004 s]
/proc/loadavg: 2.35 2.29 2.20 3/183 29575
/proc/meminfo: memFree=28474948/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1323588 CPUtime=1.49 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 223007 0 0 0 116 33 0 0 20 0 4 0 30712091 1355354112 224328 33554432000 4194304 16246674 140733809907328 140733809889216 12414100 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 330897 224337 897 2943 0 327791 0
[pid=29571/tid=29572] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 224340 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 224343 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 224346 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1323588

[startup+3.10043 s]
/proc/loadavg: 2.35 2.29 2.20 3/183 29575
/proc/meminfo: memFree=28011196/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1323588 CPUtime=3.09 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 271581 0 0 0 268 41 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140733809889216 12654241 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 330897 272901 898 2943 0 327791 0
[pid=29571/tid=29572] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1323588

[startup+6.30042 s]
/proc/loadavg: 2.35 2.29 2.20 4/183 29575
/proc/meminfo: memFree=28010892/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1323588 CPUtime=6.29 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 271581 0 0 0 588 41 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140733809889216 12449395 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 330897 272901 898 2943 0 327791 0
[pid=29571/tid=29572] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1323588

[startup+12.7004 s]
/proc/loadavg: 2.45 2.31 2.21 3/183 29575
/proc/meminfo: memFree=28011236/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1323588 CPUtime=12.69 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 271581 0 0 0 1228 41 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140733809889216 12429241 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 330897 272901 898 2943 0 327791 0
[pid=29571/tid=29572] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1323588

[startup+25.5005 s]
/proc/loadavg: 2.46 2.31 2.21 3/183 29575
/proc/meminfo: memFree=28011852/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=1323588 CPUtime=25.49 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 271581 0 0 0 2508 41 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140733809889216 6955355 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 330897 272901 898 2943 0 327791 0
[pid=29571/tid=29572] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1323588 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1355354112 272901 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1323588

[startup+51.1005 s]
/proc/loadavg: 2.36 2.30 2.21 4/183 29575
/proc/meminfo: memFree=27696256/32872528 swapFree=1402780/1580608
[pid=29571] ppid=29568 vsize=1638980 CPUtime=51.08 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 350430 0 0 0 5056 52 0 0 20 0 4 0 30712091 1678315520 351750 33554432000 4194304 16246674 140733809907328 140733809905152 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 409745 351750 898 2943 0 406639 0
[pid=29571/tid=29572] ppid=29568 vsize=1638980 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 1678315520 351750 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=1638980 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 1678315520 351750 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=1638980 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 1678315520 351750 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1638980

[startup+102.301 s]
/proc/loadavg: 2.39 2.31 2.22 3/183 29576
/proc/meminfo: memFree=26979412/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=2354756 CPUtime=102.28 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 652766 0 0 0 10131 97 0 0 20 0 4 0 30712091 2411270144 530694 33554432000 4194304 16246674 140733809907328 140733809905104 4206688 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 588689 530694 898 2943 0 585583 0
[pid=29571/tid=29572] ppid=29568 vsize=2354756 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 2411270144 530694 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=2354756 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 2411270144 530694 33554432000 4194304 16246674 140733809907328 140678719839248 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=2354756 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 2411270144 530694 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2354756


################
# More data... #
################

/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 2179534848 474140 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=2128452 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 2179534848 474140 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=2128452 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 2179534848 474140 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1302.07
Current children cumulated vsize (KiB) 2128452

[startup+1362.3 s]
/proc/loadavg: 2.26 2.25 2.22 4/183 29690
/proc/meminfo: memFree=20693400/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=2766404 CPUtime=1362.05 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 4777739 0 0 0 135359 846 0 0 20 0 4 0 30712091 2832797696 633628 33554432000 4194304 16246674 140733809907328 140733809906424 4220536 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 691601 633628 915 2943 0 688495 0
[pid=29571/tid=29572] ppid=29568 vsize=2766404 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 2832797696 633628 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=2766404 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 2832797696 633628 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=2766404 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 2832797696 633628 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1362.05
Current children cumulated vsize (KiB) 2766404

[startup+1422.3 s]
/proc/loadavg: 2.36 2.28 2.23 3/183 29692
/proc/meminfo: memFree=19556844/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=3412548 CPUtime=1422.05 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 4939276 0 0 0 141333 872 0 0 20 0 4 0 30712091 3494449152 795165 33554432000 4194304 16246674 140733809907328 140733809906424 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 853137 795165 915 2943 0 850031 0
[pid=29571/tid=29572] ppid=29568 vsize=3412548 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 3494449152 795165 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=3412548 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 3494449152 795165 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=3412548 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 3494449152 795165 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1422.05
Current children cumulated vsize (KiB) 3412548

[startup+1482.3 s]
/proc/loadavg: 2.33 2.29 2.24 4/183 29693
/proc/meminfo: memFree=19862028/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=3714628 CPUtime=1482.04 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 5014796 0 0 0 147315 889 0 0 20 0 4 0 30712091 3803779072 870685 33554432000 4194304 16246674 140733809907328 140733809905168 4220894 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 928657 870685 915 2943 0 925551 0
[pid=29571/tid=29572] ppid=29568 vsize=3714628 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 3803779072 870685 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=3714628 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 3803779072 870685 33554432000 4194304 16246674 140733809907328 140678719839248 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=3714628 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 3803779072 870685 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 3714628

[startup+1542.31 s]
/proc/loadavg: 2.28 2.28 2.23 4/183 29694
/proc/meminfo: memFree=19127848/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=4010564 CPUtime=1542.04 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 5088780 0 0 0 153300 904 0 0 20 0 4 0 30712091 4106817536 944669 33554432000 4194304 16246674 140733809907328 140733809906424 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 1002641 944669 915 2943 0 999535 0
[pid=29571/tid=29572] ppid=29568 vsize=4010564 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 4106817536 944669 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=4010564 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 4106817536 944669 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=4010564 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 4106817536 944669 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 4010564

[startup+1602.3 s]
/proc/loadavg: 2.26 2.27 2.23 3/183 29695
/proc/meminfo: memFree=19871272/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=4624964 CPUtime=1602.02 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 5347852 0 0 0 159256 946 0 0 20 0 4 0 30712091 4735963136 1098269 33554432000 4194304 16246674 140733809907328 140733809906544 14628944 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 1156241 1098269 915 2943 0 1153135 0
[pid=29571/tid=29572] ppid=29568 vsize=4624964 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 4735963136 1098269 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=4624964 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 4735963136 1098269 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=4624964 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 4735963136 1098269 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1602.02
Current children cumulated vsize (KiB) 4624964

[startup+1662.3 s]
/proc/loadavg: 2.32 2.28 2.24 3/183 29696
/proc/meminfo: memFree=23596796/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=4295236 CPUtime=1662.01 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 5618700 0 0 0 165206 995 0 0 20 0 4 0 30712091 4398321664 1015837 33554432000 4194304 16246674 140733809907328 140733809906424 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 1073809 1015837 915 2943 0 1070703 0
[pid=29571/tid=29572] ppid=29568 vsize=4295236 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 4398321664 1015837 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=4295236 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 4398321664 1015837 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=4295236 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 4398321664 1015837 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1662.01
Current children cumulated vsize (KiB) 4295236

[startup+1722.3 s]
/proc/loadavg: 2.28 2.27 2.24 4/183 29698
/proc/meminfo: memFree=23320776/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=5169732 CPUtime=1722 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 6044943 0 0 0 171136 1064 0 0 20 0 4 0 30712091 5293805568 1234462 33554432000 4194304 16246674 140733809907328 140733809906424 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 1292433 1234462 915 2943 0 1289327 0
[pid=29571/tid=29572] ppid=29568 vsize=5169732 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 5293805568 1234462 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=5169732 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 5293805568 1234462 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=5169732 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 5293805568 1234462 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1722
Current children cumulated vsize (KiB) 5169732

[startup+1782.3 s]
/proc/loadavg: 2.28 2.27 2.23 3/184 29702
/proc/meminfo: memFree=23102160/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=4969028 CPUtime=1781.98 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 6595343 0 0 0 177041 1157 0 0 20 0 4 0 30712091 5088284672 1184286 33554432000 4194304 16246674 140733809907328 140733809906424 4207001 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 1242257 1184286 915 2943 0 1239151 0
[pid=29571/tid=29572] ppid=29568 vsize=4969028 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 5088284672 1184286 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=4969028 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 5088284672 1184286 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=4969028 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 5088284672 1184286 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1781.98
Current children cumulated vsize (KiB) 4969028



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.28 2.27 2.24 3/183 29702
/proc/meminfo: memFree=22479188/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=5626436 CPUtime=1800.08 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) R 29568 29571 28125 0 -1 4202496 6873359 0 0 0 178808 1200 0 0 20 0 4 0 30712091 5761470464 1348638 33554432000 4194304 16246674 140733809907328 140733809906544 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 1406609 1348638 915 2943 0 1403503 0
[pid=29571/tid=29572] ppid=29568 vsize=5626436 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) S 29568 29571 28125 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 30712091 5761470464 1348638 33554432000 4194304 16246674 140733809907328 140678730329328 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=29571/tid=29573] ppid=29568 vsize=5626436 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29573/stat : 29573 (toysat) S 29568 29571 28125 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 30712091 5761470464 1348638 33554432000 4194304 16246674 140733809907328 140678719839472 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=29571/tid=29574] ppid=29568 vsize=5626436 CPUtime=0 cores=0,2,4,6
/proc/29571/task/29574/stat : 29574 (toysat) S 29568 29571 28125 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 30712091 5761470464 1348638 33554432000 4194304 16246674 140733809907328 140678633876656 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 5626436

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 29571 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.28 2.27 2.24 3/183 29702
/proc/meminfo: memFree=22479188/32872528 swapFree=1402776/1580604
[pid=29571] ppid=29568 vsize=0 CPUtime=1800.28 cores=0,2,4,6
/proc/29571/stat : 29571 (toysat) Z 29568 29571 28125 0 -1 4203532 6873359 0 0 0 178808 1220 0 0 20 0 2 0 30712091 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/29571/statm: 0 0 0 0 0 0 0
[pid=29571/tid=29572] ppid=29568 vsize=0 CPUtime=0.18 cores=0,2,4,6
/proc/29571/task/29572/stat : 29572 (toysat) R 29568 29571 28125 0 -1 4203588 9 0 0 0 0 18 0 0 20 0 2 0 30712091 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.28
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.7
CPU time (s): 1800.39
CPU user time (s): 1788.09
CPU system time (s): 12.2981
CPU usage (%): 99.9827
Max. virtual memory (cumulated for all children) (KiB): 6562372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1788.09
system time used= 12.2981
maximum resident set size= 6330416
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6873359
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2343
involuntary context switches= 4128

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.64829 second user time and 7.01693 second system time

The end

Launcher Data 

Begin job on node139 at 2016-06-18 23:51:04
IDJOB=4107546
IDBENCH=72299
IDSOLVER=2542
FILE ID=node139/4107546-1466286663
RUNJOBID= node139-1466274546-28141
PBS_JOBID= 19918239
Free space on /tmp= 71576 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/rand.newlist/normalized-rand27da90.cudf.trendy.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4107546-1466286663/watcher-4107546-1466286663 -o /tmp/evaluation-result-4107546-1466286663/solver-4107546-1466286663 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node139-1466274546-28141 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4107546-1466286663.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1db531ec7fbea38dd353f31b0fba98ed
RANDOM SEED=1882686750

node139.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.500
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29102040 kB
Buffers:          143916 kB
Cached:           175624 kB
SwapCached:         1832 kB
Active:          1220412 kB
Inactive:         222544 kB
Active(anon):    1123348 kB
Inactive(anon):     2540 kB
Active(file):      97064 kB
Inactive(file):   220004 kB
Unevictable:     1580604 kB
Mlocked:         1402776 kB
SwapTotal:      67108856 kB
SwapFree:       67099484 kB
Dirty:             16980 kB
Writeback:             0 kB
AnonPages:       2703504 kB
Mapped:            10872 kB
Shmem:                 0 kB
Slab:             610528 kB
SReclaimable:      54188 kB
SUnreclaim:       556340 kB
KernelStack:        1488 kB
PageTables:         9496 kB
NFS_Unstable:          4 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2847968 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1148928 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71560 MiB
End job on node139 at 2016-06-19 00:21:04