Trace number 4079190

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.13 1800.41

General information on the benchmark

Name/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/
random/rand.biglist/normalized-randd1cab2.cudf.trendy.opb
MD5SUM128970b85b6efe83a3eeaa76631470ff
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark52432601474
Best CPU time to get the best result obtained on this benchmark3.07353
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables7810
Total number of constraints32627
Number of constraints which are clauses32310
Number of constraints which are cardinality constraints (but not clauses)317
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint553
Number of terms in the objective function 3738
Biggest coefficient in the objective function 6549699311
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 3615427019708
Number of bits of the sum of numbers in the objective function 42
Biggest number in a constraint 6549699311
Number of bits of the biggest number in a constraint 33
Biggest sum of numbers in a constraint 3615427019708
Number of bits of the biggest sum of numbers42
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-07T05:50:49+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4079190-1465271449.opb"]
0.00/0.01	c use --random-gen="2948546188 43281845 2230046919 4053306464 3169305593 3836964304 3950564527 1448293814 3578143688 3047710835 2666174179 3624279299 699313612 3795624967 1820967211 2666418265 890220223 39730864 1926536207 1367952749 421888912 1256626964 3642887438 1228070275 1303360823 463602747 699720173 1233616202 1313562924 1416537896 1483340146 810574864 1047014158 2878126192 4264725721 1826842630 3989211663 2751394815 3042856963 3052929655 2617982128 2761781325 920403654 608476415 3243568658 1046156850 3415118487 3560248672 4203747705 1072180460 3549499312 3761821310 1674320317 380722526 3541556060 3687107137 720823893 3583290351 1208079917 1144634080 38196799 421372443 3545882634 821484611 4262214907 3010521770 400572582 170128645 2445097086 2637991536 722072333 1569671607 2095198094 2695213035 3904389364 443478072 1049430998 1089124306 886106519 2334972629 1331083072 4269639182 2404477921 3511987312 1464687383 38282337 1406462165 2250567466 3124426716 3505640434 2891237777 2480294477 2551515215 981019004 1861547375 372187628 2957094063 2934716740 3889502059 474348212 2569079614 1312215554 374754586 3485162673 1152481868 1964796541 1407631609 1702908728 2877333340 1510204003 1207006937 2404724343 1585258339 4158699520 3353312352 277196652 1312462432 4119624774 1579071417 3920709501 2625856290 1331522754 1947054175 1636792527 1015882147 2459040630 1723755005 365708073 2758493842 1000221377 1872211894 3984068645 3453859642 1585869160 3649036078 1661698769 1288256566 3407990950 4200453995 2090591585 2330607398 4227668484 2011590638 3998286917 1602665058 287375674 1389448182 269163956 620368417 1231500694 1865956806 497578405 975731495 2696689981 2739556705 2686227475 3840759241 587144787 1606841827 4244422218 712216822 900334673 2832446154 1973814583 4024754012 3826057173 2119249114 2393274467 2821523099 849402128 1000501326 3420002535 1459910670 1245427613 3609489392 1867657032 681347687 2223148516 2060295798 980609235 1249820087 2405965604 690977869 1625236439 1093457117 108890073 235623557 2454083469 3560570137 2259976857 3646058458 2473003517 1432046985 2464075353 2717943798 1606707073 97182191 2656832916 3269135013 54412393 2238409357 3576487484 847566560 1955476420 2042911058 2157138036 206135028 415278709 928134128 2578704160 4172413021 1531518633 693620914 1226857197 2547335208 3916109119 40658350 948666428 2311864805 2825988175 4063860794 1314737017 2218098987 2366994059 1055467180 3495825558 824234610 1319313899 3004170101 4222409264 3153612209 3554627485 909324877 2694048829 392108501 3602271061 3981386443 1047163664 4048375897 1933874665 941752879 2769886943 2564935956 4122024985 484594138 1343749683 3856455275 1021146237 1347758327 539431517 1589985076 2808519044 1622018726 3022272225 3852772357 2907234887 255 362436" option to reproduce the execution
0.19/0.23	c #vars 7810
0.19/0.23	c #constraints 32627
0.59/0.66	c BCD2: Hardening is enabled.
0.59/0.66	c BCD2: BiasedSearch is enabled.
0.59/0.66	c Solving starts ...
0.59/0.66	c ============================[ Search Statistics ]============================
0.59/0.66	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
0.59/0.66	c       |         |          |          |    Limit     GC | Var      | Constra 
0.59/0.66	c =============================================================================
0.59/0.66	c  0.0s |       0 |        0 |        0 |    12992      0 |     1150 |        0
0.99/1.09	c  0.4s |       0 |    35463 |       80 |    12992      0 |     1194 |     6691
0.99/1.09	c #cpu_time = 0.428s
0.99/1.09	c #wall_clock_time = 0.428s
0.99/1.09	c #decision = 35463
0.99/1.09	c #random_decision = 100
0.99/1.09	c #conflict = 80
0.99/1.09	c #restart = 0
0.99/1.09	o 500742191761
1166.81/1167.03	c BCD2: updating upper bound: 3615427019708 -> 500742191760
1694.53/1694.86	c BCD2: 0 <= obj <= 500742191760
1694.53/1694.86	c BCD2: #cores=0, #unrelaxed=3738, #relaxed=0, #hardened=0
1694.53/1694.86	c BCD2: #sat=1 #unsat=1 bias=1/2
1694.53/1694.86	c Solving starts ...
1694.53/1694.86	c ============================[ Search Statistics ]============================
1694.53/1694.86	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
1694.53/1694.86	c       |         |          |          |    Limit     GC | Var      | Constra 
1694.53/1694.86	c =============================================================================
1694.53/1694.86	c  0.0s |       0 |        0 |        0 |    12992      0 |     1194 |     6691
1694.53/1694.88	c  0.0s |       0 |       37 |        1 |    12992      0 |     1195 |     6693
1694.53/1694.88	c #cpu_time = 0.022s
1694.53/1694.88	c #wall_clock_time = 0.022s
1694.53/1694.88	c #decision = 37
1694.53/1694.88	c #random_decision = 0
1694.53/1694.88	c #conflict = 1
1694.53/1694.88	c #restart = 0
1694.53/1694.88	c BCD2: found a new core of size 1: cost of the new core is >=1
1694.53/1694.88	c lower bound updated to 1

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4079190-1465271449/watcher-4079190-1465271449 -o /tmp/evaluation-result-4079190-1465271449/solver-4079190-1465271449 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node120-1465256721-4331 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079190-1465271449.opb 

pid=6729
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.24 2.22 2.19 4/180 6732
/proc/meminfo: memFree=25337568/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=752060 CPUtime=0 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 2807 0 0 0 0 0 0 0 20 0 4 0 109078494 770109440 3680 33554432000 4194304 16246674 140735060379520 140735060378944 13880264 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 188527 3690 441 2943 0 185421 0
[pid=6732/tid=6733] ppid=6729 vsize=769468 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 787935232 3748 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=773564 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 792129536 3764 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=777660 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109078494 796323840 3782 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0

[startup+0.100126 s]
/proc/loadavg: 2.24 2.22 2.19 4/180 6732
/proc/meminfo: memFree=25337568/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1221188 CPUtime=0.09 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 28714 0 0 0 5 4 0 0 20 0 4 0 109078494 1250496512 29524 33554432000 4194304 16246674 140735060379520 140735060378832 4221016 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 305297 29530 800 2943 0 302191 0
[pid=6732/tid=6733] ppid=6729 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1250496512 29534 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1250496512 29538 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1250496512 29542 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1221188

[startup+0.200547 s]
/proc/loadavg: 2.24 2.22 2.19 4/180 6732
/proc/meminfo: memFree=25337568/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1313348 CPUtime=0.19 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 51325 0 0 0 12 7 0 0 20 0 4 0 109078494 1344868352 52646 33554432000 4194304 16246674 140735060379520 140735060378832 7373301 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328337 52646 800 2943 0 325231 0
[pid=6732/tid=6733] ppid=6729 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1344868352 52646 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1344868352 52646 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1313348 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1344868352 52646 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1313348

[startup+0.300478 s]
/proc/loadavg: 2.24 2.22 2.19 4/180 6732
/proc/meminfo: memFree=25337568/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1314372 CPUtime=0.29 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 51600 0 0 0 22 7 0 0 20 0 4 0 109078494 1345916928 52921 33554432000 4194304 16246674 140735060379520 140735060378832 5657561 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328593 52921 834 2943 0 325487 0
[pid=6732/tid=6733] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 52921 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 52921 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 52921 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.7004 s]
/proc/loadavg: 2.24 2.22 2.19 4/180 6732
/proc/meminfo: memFree=25337568/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1314372 CPUtime=0.69 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 110514 0 0 0 53 16 0 0 20 0 4 0 109078494 1345916928 111835 33554432000 4194304 16246674 140735060379520 140735060378832 5589685 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328593 111843 871 2943 0 325487 0
[pid=6732/tid=6733] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 111848 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 111852 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 111858 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.5004 s]
/proc/loadavg: 2.24 2.22 2.19 3/184 6736
/proc/meminfo: memFree=24667356/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1314372 CPUtime=1.49 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 269274 0 0 0 113 36 0 0 20 0 4 0 109078494 1345916928 270595 33554432000 4194304 16246674 140735060379520 140735060378832 12655212 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328593 270595 896 2943 0 325487 0
[pid=6732/tid=6733] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270595 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270595 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270595 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1314372

[startup+3.10041 s]
/proc/loadavg: 2.24 2.22 2.19 3/184 6736
/proc/meminfo: memFree=24255800/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1314372 CPUtime=3.09 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 269275 0 0 0 273 36 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140735060361408 12654296 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328593 270596 896 2943 0 325487 0
[pid=6732/tid=6733] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1314372

[startup+6.30042 s]
/proc/loadavg: 2.22 2.22 2.19 3/184 6736
/proc/meminfo: memFree=24255828/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1314372 CPUtime=6.29 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 269275 0 0 0 593 36 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140735060361408 6955595 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328593 270596 896 2943 0 325487 0
[pid=6732/tid=6733] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1314372

[startup+12.7004 s]
/proc/loadavg: 2.28 2.23 2.19 3/183 6736
/proc/meminfo: memFree=23698128/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1314372 CPUtime=12.69 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 269275 0 0 0 1233 36 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140735060361408 4225128 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328593 270596 896 2943 0 325487 0
[pid=6732/tid=6733] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1314372

[startup+25.5005 s]
/proc/loadavg: 2.29 2.23 2.19 3/183 6736
/proc/meminfo: memFree=23576364/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1314372 CPUtime=25.49 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 269275 0 0 0 2513 36 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140735060361408 12371164 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 328593 270596 896 2943 0 325487 0
[pid=6732/tid=6733] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1345916928 270596 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1314372

[startup+51.1005 s]
/proc/loadavg: 2.26 2.23 2.19 3/183 6736
/proc/meminfo: memFree=23307892/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=1564228 CPUtime=51.08 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 331739 0 0 0 5063 45 0 0 20 0 4 0 109078494 1601769472 333060 33554432000 4194304 16246674 140735060379520 140735060377344 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 391057 333060 896 2943 0 387951 0
[pid=6732/tid=6733] ppid=6729 vsize=1564228 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 1601769472 333060 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=1564228 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 1601769472 333060 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=1564228 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 1601769472 333060 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1564228

[startup+102.3 s]
/proc/loadavg: 2.22 2.22 2.18 3/183 6737
/proc/meminfo: memFree=23198012/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=2284100 CPUtime=102.28 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 511707 0 0 0 10156 72 0 0 20 0 4 0 109078494 2338918400 513028 33554432000 4194304 16246674 140735060379520 140735060378736 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 571025 513028 896 2943 0 567919 0
[pid=6732/tid=6733] ppid=6729 vsize=2284100 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 2338918400 513028 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=2284100 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 2338918400 513028 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=2284100 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 2338918400 513028 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2284100


################
# More data... #
################

/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 2537099264 561425 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=2477636 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 2537099264 561425 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=2477636 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 2537099264 561425 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 2477636

[startup+1362.3 s]
/proc/loadavg: 2.28 2.27 2.20 3/183 6839
/proc/meminfo: memFree=26327908/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=2932292 CPUtime=1362.08 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7391466 0 0 0 134947 1261 0 0 20 0 4 0 109078494 3002667008 675089 33554432000 4194304 16246674 140735060379520 140735060378616 4220520 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 733073 675089 901 2943 0 729967 0
[pid=6732/tid=6733] ppid=6729 vsize=2932292 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 3002667008 675089 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=2932292 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 3002667008 675089 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=2932292 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 3002667008 675089 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 2932292

[startup+1422.3 s]
/proc/loadavg: 2.19 2.25 2.19 3/183 6840
/proc/meminfo: memFree=26029592/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=3230276 CPUtime=1422.08 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7465962 0 0 0 140933 1275 0 0 20 0 4 0 109078494 3307802624 749585 33554432000 4194304 16246674 140735060379520 140735060378696 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 807569 749585 901 2943 0 804463 0
[pid=6732/tid=6733] ppid=6729 vsize=3230276 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 3307802624 749585 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=3230276 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 3307802624 749585 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=3230276 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 3307802624 749585 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1422.08
Current children cumulated vsize (KiB) 3230276

[startup+1482.3 s]
/proc/loadavg: 2.11 2.21 2.18 3/183 6842
/proc/meminfo: memFree=25685916/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=3573316 CPUtime=1482.06 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7551722 0 0 0 146912 1294 0 0 20 0 4 0 109078494 3659075584 835345 33554432000 4194304 16246674 140735060379520 140735060377296 4225210 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 893329 835345 901 2943 0 890223 0
[pid=6732/tid=6733] ppid=6729 vsize=3573316 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 3659075584 835345 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=3573316 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 3659075584 835345 33554432000 4194304 16246674 140735060379520 140176122686480 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=3573316 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 3659075584 835345 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 3573316

[startup+1542.31 s]
/proc/loadavg: 2.29 2.25 2.19 3/183 6843
/proc/meminfo: memFree=25448788/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=3796548 CPUtime=1542.07 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7610346 0 0 0 152898 1309 0 0 20 0 4 0 109078494 3887665152 891153 33554432000 4194304 16246674 140735060379520 140735060377344 4220807 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 949137 891153 901 2943 0 946031 0
[pid=6732/tid=6733] ppid=6729 vsize=3796548 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 3887665152 891153 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=3796548 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 3887665152 891153 33554432000 4194304 16246674 140735060379520 140176122686480 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=3796548 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 3887665152 891153 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1542.07
Current children cumulated vsize (KiB) 3796548

[startup+1602.3 s]
/proc/loadavg: 2.30 2.25 2.19 3/183 6844
/proc/meminfo: memFree=25214564/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=4028996 CPUtime=1602.05 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7696106 0 0 0 158879 1326 0 0 20 0 4 0 109078494 4125691904 949265 33554432000 4194304 16246674 140735060379520 140735060377296 4220880 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 1007249 949265 901 2943 0 1004143 0
[pid=6732/tid=6733] ppid=6729 vsize=4028996 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 4125691904 949265 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=4028996 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 4125691904 949265 33554432000 4194304 16246674 140735060379520 140176122686480 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=4028996 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 4125691904 949265 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1602.05
Current children cumulated vsize (KiB) 4028996

[startup+1662.3 s]
/proc/loadavg: 2.26 2.24 2.19 3/183 6845
/proc/meminfo: memFree=25210144/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=4033092 CPUtime=1662.03 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7825902 0 0 0 164851 1352 0 0 20 0 4 0 109078494 4129886208 950289 33554432000 4194304 16246674 140735060379520 140735060378696 15015658 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 1008273 950289 901 2943 0 1005167 0
[pid=6732/tid=6733] ppid=6729 vsize=4033092 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 4129886208 950289 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=4033092 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 4129886208 950289 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=4033092 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 4129886208 950289 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 4033092

[startup+1722.3 s]
/proc/loadavg: 2.26 2.24 2.19 4/183 6846
/proc/meminfo: memFree=25320360/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=3922500 CPUtime=1722.02 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7932412 0 0 0 170830 1372 0 0 20 0 4 0 109078494 4016640000 922653 33554432000 4194304 16246674 140735060379520 140735060361408 12429162 0 0 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 980625 922653 913 2943 0 977519 0
[pid=6732/tid=6733] ppid=6729 vsize=3922500 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 4016640000 922653 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=3922500 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 4016640000 922653 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=3922500 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 4016640000 922653 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 3922500

[startup+1782.3 s]
/proc/loadavg: 2.31 2.26 2.19 4/184 6851
/proc/meminfo: memFree=27129816/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=2117188 CPUtime=1782.01 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 7972607 0 0 0 176813 1388 0 0 20 0 4 0 109078494 2168000512 471325 33554432000 4194304 16246674 140735060379520 140735060377344 4220543 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 529297 471325 913 2943 0 526191 0
[pid=6732/tid=6733] ppid=6729 vsize=2117188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 2168000512 471325 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=2117188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 2168000512 471325 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=2117188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 2168000512 471325 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 2117188



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.29 2.26 2.19 4/184 6851
/proc/meminfo: memFree=27001712/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=2245188 CPUtime=1800.01 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) R 6729 6732 4315 0 -1 4202496 8004607 0 0 0 178609 1392 0 0 20 0 4 0 109078494 2299072512 503325 33554432000 4194304 16246674 140735060379520 140735060377344 4225120 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 561297 503325 913 2943 0 558191 0
[pid=6732/tid=6733] ppid=6729 vsize=2245188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) S 6729 6732 4315 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109078494 2299072512 503325 33554432000 4194304 16246674 140735060379520 140176204475632 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 2 0 0 0 0 0
[pid=6732/tid=6734] ppid=6729 vsize=2245188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6734/stat : 6734 (toysat) S 6729 6732 4315 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109078494 2299072512 503325 33554432000 4194304 16246674 140735060379520 140176122686704 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=6732/tid=6735] ppid=6729 vsize=2245188 CPUtime=0 cores=0,2,4,6
/proc/6732/task/6735/stat : 6735 (toysat) S 6729 6732 4315 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109078494 2299072512 503325 33554432000 4194304 16246674 140735060379520 140176112213168 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 2245188

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6732 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.29 2.26 2.19 4/184 6851
/proc/meminfo: memFree=27001712/32872528 swapFree=15644/1722384
[pid=6732] ppid=6729 vsize=0 CPUtime=1800.12 cores=0,2,4,6
/proc/6732/stat : 6732 (toysat) Z 6729 6732 4315 0 -1 4203532 8004607 0 0 0 178609 1403 0 0 20 0 2 0 109078494 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/6732/statm: 0 0 0 0 0 0 0
[pid=6732/tid=6733] ppid=6729 vsize=0 CPUtime=0.08 cores=0,2,4,6
/proc/6732/task/6733/stat : 6733 (toysat) R 6729 6732 4315 0 -1 4203588 8 0 0 0 0 8 0 0 20 0 2 0 109078494 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.41
CPU time (s): 1800.13
CPU user time (s): 1786.1
CPU system time (s): 14.0349
CPU usage (%): 99.9845
Max. virtual memory (cumulated for all children) (KiB): 8301124

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1786.1
system time used= 14.0349
maximum resident set size= 8069168
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8004607
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2072
involuntary context switches= 3901

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.8162 second user time and 16.2515 second system time

The end

Launcher Data 

Begin job on node120 at 2016-06-07 05:50:49
IDJOB=4079190
IDBENCH=72357
IDSOLVER=2542
FILE ID=node120/4079190-1465271449
RUNJOBID= node120-1465256721-4331
PBS_JOBID= 19843284
Free space on /tmp= 71720 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/rand.biglist/normalized-randd1cab2.cudf.trendy.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4079190-1465271449/watcher-4079190-1465271449 -o /tmp/evaluation-result-4079190-1465271449/solver-4079190-1465271449 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node120-1465256721-4331 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079190-1465271449.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 128970b85b6efe83a3eeaa76631470ff
RANDOM SEED=1464376771

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.85
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.425
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        25337220 kB
Buffers:          101888 kB
Cached:           128548 kB
SwapCached:         1476 kB
Active:          4938288 kB
Inactive:         113148 kB
Active(anon):    4820636 kB
Inactive(anon):     3252 kB
Active(file):     117652 kB
Inactive(file):   109896 kB
Unevictable:     1722384 kB
Mlocked:           15644 kB
SwapTotal:      67108856 kB
SwapFree:       67099668 kB
Dirty:             17136 kB
Writeback:             0 kB
AnonPages:       6544892 kB
Mapped:            11760 kB
Shmem:                 0 kB
Slab:             615172 kB
SReclaimable:      59092 kB
SUnreclaim:       556080 kB
KernelStack:        1496 kB
PageTables:        17400 kB
NFS_Unstable:          4 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    6687004 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1730560 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71708 MiB
End job on node120 at 2016-06-07 06:20:50