Trace number 4079178

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.14 1800.45

General information on the benchmark

Name/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/datasets/
9orless/normalized-mono-gac.cudf.trendy.opb
MD5SUMaecff64161ca76fae524b50cd0e11fc3
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2624366011833
Best CPU time to get the best result obtained on this benchmark102.087
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables21101
Total number of constraints100032
Number of constraints which are clauses98467
Number of constraints which are cardinality constraints (but not clauses)1565
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint2962
Number of terms in the objective function 8586
Biggest coefficient in the objective function 79229972375
Number of bits for the biggest coefficient in the objective function 37
Sum of the numbers in the objective function 234599911309658
Number of bits of the sum of numbers in the objective function 48
Biggest number in a constraint 79229972375
Number of bits of the biggest number in a constraint 37
Biggest sum of numbers in a constraint 234599911309658
Number of bits of the biggest sum of numbers48
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-07T05:56:09+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4079178-1465271768.opb"]
0.00/0.01	c use --random-gen="1647802234 453115541 3859616602 3059624425 2733364225 1803602481 1475455477 145014057 177094748 2251688844 2041266560 613200183 2327201126 4111303640 1385821487 3421793634 1174041090 3062951456 1928342140 3370865399 1426326246 1419350641 2952898989 673892900 1776893855 2367751041 2065321312 2673240914 2079701439 435301109 1157759176 38718462 681799882 3761447444 631708723 898916276 118898 3784073573 865406232 1555179625 2431455208 4238254588 1030356407 1409272991 3444660729 3102152137 3728165124 4048175144 2525595592 3298417844 2602631504 881495554 2382187612 2345382893 2315438904 2555502773 1934059037 408002219 2486861390 2325319535 2021404800 2973416136 2713218467 336955005 3695203148 910994049 538000399 1242265326 1515958595 3647740934 1305309044 2831319691 2026764316 2105213168 3186535336 2276814602 3490015172 1129388436 1443047268 1371759810 2004985755 3621966961 1953252028 3013445330 3250269104 801203978 2012504694 3738759297 1452299697 3803958403 251531177 2163064075 1091774932 2318294253 2253003569 445633351 3517644536 2036640728 2698788701 488226640 509601894 177300662 3627350519 2681291192 2252982071 2992300532 667690930 1139093346 1537731692 654799115 2284269516 3267914359 891891385 1266218098 1554042409 1714062528 652283511 2825762532 2258959035 3490596144 1138023409 2685689121 1653999840 43385935 1587654838 2575514767 3118604427 495504523 2006004488 2533814818 631322337 189312849 3837739170 4004317536 1387498523 1200842552 209896995 4184509644 2421707635 3628044907 2231514156 3833399815 327322574 3973853156 2948341841 2040482306 1453629814 1810384671 4029257564 130633275 1155066165 1303430301 3448516347 871176008 3770305275 378820319 1048006946 3617998736 3870403361 4039443382 4130572123 2303230186 2713889741 3148172173 40499654 15453656 1201107211 525150566 2840812432 2442119264 200174699 864851332 3331112079 1478893926 1821335071 1304003276 2761026331 250912968 628130123 1990468686 1841247316 150324088 2043674799 872068262 1289476384 787500672 1729176864 2858882516 1875290452 374323244 2621529754 156957852 240162698 2375062265 2050851677 1517800892 2891579374 3282229350 1722972362 2118529273 3211913713 2867801331 1353120312 3858635016 1516341162 2859351325 3602002582 2997964647 2335992915 1238653992 3186917933 3954375538 3234450300 544296771 1482295017 1959949319 106225515 1808000078 3041007804 1412124897 1406570678 1023179449 2870369850 1467803348 1028993224 3013472312 1879416320 3474475412 4228228229 1294152594 2516498186 1392362560 2696700686 3175605493 1329653874 3160215745 575843002 2085095496 3981706010 2291544397 1281115731 977748352 2189012409 3684977301 998474211 115668750 2843721618 3765047 2482466843 1951491351 2552887551 1294979746 1330747603 1096771945 2448106885 390007943 255 362436" option to reproduce the execution
0.69/0.72	c #vars 21101
0.69/0.72	c #constraints 100032
2.20/2.29	c BCD2: Hardening is enabled.
2.20/2.29	c BCD2: BiasedSearch is enabled.
2.20/2.29	c Solving starts ...
2.20/2.29	c ============================[ Search Statistics ]============================
2.20/2.29	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
2.20/2.29	c       |         |          |          |    Limit     GC | Var      | Constra 
2.20/2.29	c =============================================================================
2.20/2.29	c  0.0s |       0 |        0 |        0 |    39935      0 |     1202 |        0
2.99/3.01	c  0.7s |       1 |    82066 |      100 |    39935      0 |     1202 |     1291
4.69/4.75	c  2.5s |       2 |   280474 |      250 |    43929      0 |     1202 |     1291
5.79/5.84	c  3.6s |       2 |   414278 |      352 |    48322      0 |     1202 |     1291
5.79/5.84	c #cpu_time = 3.533s
5.79/5.84	c #wall_clock_time = 3.542s
5.79/5.84	c #decision = 414278
5.79/5.84	c #random_decision = 1208
5.79/5.84	c #conflict = 352
5.79/5.85	c #restart = 2
5.79/5.85	o 50036337810026

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4079178-1465271768/watcher-4079178-1465271768 -o /tmp/evaluation-result-4079178-1465271768/solver-4079178-1465271768 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1465262703-3573 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079178-1465271768.opb 

pid=4807
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.36 2.27 2.20 3/179 4810
/proc/meminfo: memFree=29065896/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=675260 CPUtime=0 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 2509 0 0 0 0 0 0 0 20 0 4 0 109110006 691466240 3380 33554432000 4194304 16246674 140736508422992 140736508422416 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 169327 3389 441 2943 0 166221 0
[pid=4810/tid=4811] ppid=4807 vsize=693692 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 710340608 3449 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=697788 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 714534912 3468 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=701884 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 718729216 3482 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.10018 s]
/proc/loadavg: 2.36 2.27 2.20 3/179 4810
/proc/meminfo: memFree=29065896/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1303108 CPUtime=0.09 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 31041 0 0 0 6 3 0 0 20 0 4 0 109110006 1334382592 31851 33554432000 4194304 16246674 140736508422992 140736508422304 7368729 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 325777 31867 800 2943 0 322671 0
[pid=4810/tid=4811] ppid=4807 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1334382592 31878 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1334382592 31888 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1334382592 31899 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200593 s]
/proc/loadavg: 2.36 2.27 2.20 3/179 4810
/proc/meminfo: memFree=29065896/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1313348 CPUtime=0.19 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 51658 0 0 0 13 6 0 0 20 0 4 0 109110006 1344868352 52978 33554432000 4194304 16246674 140736508422992 140736508422304 7369380 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 328337 52978 800 2943 0 325231 0
[pid=4810/tid=4811] ppid=4807 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1344868352 52978 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1344868352 52978 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1344868352 52978 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1313348

[startup+0.30052 s]
/proc/loadavg: 2.36 2.27 2.20 3/179 4810
/proc/meminfo: memFree=29065896/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1313348 CPUtime=0.29 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 63864 0 0 0 22 7 0 0 20 0 4 0 109110006 1344868352 65184 33554432000 4194304 16246674 140736508422992 140736508422304 7363272 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 328337 65184 801 2943 0 325231 0
[pid=4810/tid=4811] ppid=4807 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1344868352 65184 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1344868352 65184 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1344868352 65184 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1313348

[startup+0.700438 s]
/proc/loadavg: 2.36 2.27 2.20 3/179 4810
/proc/meminfo: memFree=29065896/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1319492 CPUtime=0.69 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 75313 0 0 0 61 8 0 0 20 0 4 0 109110006 1351159808 77655 33554432000 4194304 16246674 140736508422992 140736508405752 4220897 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 329873 77655 802 2943 0 326767 0
[pid=4810/tid=4811] ppid=4807 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1351159808 77655 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1351159808 77655 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1351159808 77655 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1319492

[startup+1.50043 s]
/proc/loadavg: 2.36 2.27 2.20 3/183 4814
/proc/meminfo: memFree=28603512/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1319492 CPUtime=1.49 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 193663 0 0 0 125 24 0 0 20 0 4 0 109110006 1351159808 196005 33554432000 4194304 16246674 140736508422992 140736508405752 12370013 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 329873 196017 839 2943 0 326767 0
[pid=4810/tid=4811] ppid=4807 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1351159808 196023 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1351159808 196029 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1351159808 196036 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1319492

[startup+3.10045 s]
/proc/loadavg: 2.36 2.27 2.20 3/183 4814
/proc/meminfo: memFree=27962664/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1337924 CPUtime=3.09 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 273563 0 0 0 273 36 0 0 20 0 4 0 109110006 1370034176 275905 33554432000 4194304 16246674 140736508422992 140736508404864 5822484 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 334481 275905 890 2943 0 331375 0
[pid=4810/tid=4811] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 275905 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 275905 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 275905 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1337924

[startup+6.30045 s]
/proc/loadavg: 2.33 2.26 2.19 3/183 4814
/proc/meminfo: memFree=27959660/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1337924 CPUtime=6.29 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 273637 0 0 0 593 36 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140736508404864 12449269 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 334481 276490 904 2943 0 331375 0
[pid=4810/tid=4811] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1337924

[startup+12.7004 s]
/proc/loadavg: 2.31 2.26 2.19 4/183 4814
/proc/meminfo: memFree=27959824/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1337924 CPUtime=12.69 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 273637 0 0 0 1233 36 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140736508404864 4220543 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 334481 276490 904 2943 0 331375 0
[pid=4810/tid=4811] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1337924

[startup+25.5005 s]
/proc/loadavg: 2.24 2.24 2.19 3/183 4814
/proc/meminfo: memFree=27960560/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1337924 CPUtime=25.49 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 273637 0 0 0 2513 36 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140736508404864 12449395 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 334481 276490 904 2943 0 331375 0
[pid=4810/tid=4811] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1337924

[startup+51.1005 s]
/proc/loadavg: 2.22 2.24 2.19 4/183 4814
/proc/meminfo: memFree=27960064/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1337924 CPUtime=51.08 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 273637 0 0 0 5072 36 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140736508404864 12429241 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 334481 276490 904 2943 0 331375 0
[pid=4810/tid=4811] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276490 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1337924

[startup+102.301 s]
/proc/loadavg: 2.21 2.23 2.18 3/183 4816
/proc/meminfo: memFree=27960156/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1337924 CPUtime=102.28 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 273638 0 0 0 10192 36 0 0 20 0 4 0 109110006 1370034176 276491 33554432000 4194304 16246674 140736508422992 140736508404864 12371164 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 334481 276491 904 2943 0 331375 0
[pid=4810/tid=4811] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276491 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276491 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1337924 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1370034176 276491 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1337924


################
# More data... #
################

/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1454968832 297227 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 1420868

[startup+1302.3 s]
/proc/loadavg: 2.22 2.20 2.18 3/183 4869
/proc/meminfo: memFree=27652160/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1498692 CPUtime=1302.08 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 313830 0 0 0 130162 46 0 0 20 0 4 0 109110006 1534660608 316683 33554432000 4194304 16246674 140736508422992 140736508422304 12654547 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 374673 316683 904 2943 0 371567 0
[pid=4810/tid=4811] ppid=4807 vsize=1498692 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1534660608 316683 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1498692 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1534660608 316683 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1498692 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1534660608 316683 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 1498692

[startup+1362.3 s]
/proc/loadavg: 2.19 2.19 2.18 3/183 4871
/proc/meminfo: memFree=27577920/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1536580 CPUtime=1362.07 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 323302 0 0 0 136160 47 0 0 20 0 4 0 109110006 1573457920 326155 33554432000 4194304 16246674 140736508422992 140736508420800 4220527 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 384145 326155 904 2943 0 381039 0
[pid=4810/tid=4811] ppid=4807 vsize=1536580 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1573457920 326155 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1536580 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1573457920 326155 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1536580 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1573457920 326155 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 1536580

[startup+1422.3 s]
/proc/loadavg: 2.25 2.21 2.18 3/183 4872
/proc/meminfo: memFree=27552272/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1542724 CPUtime=1422.06 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 324838 0 0 0 142159 47 0 0 20 0 4 0 109110006 1579749376 327691 33554432000 4194304 16246674 140736508422992 140736508422304 12654162 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 385681 327691 904 2943 0 382575 0
[pid=4810/tid=4811] ppid=4807 vsize=1542724 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1579749376 327691 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1542724 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1579749376 327691 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1542724 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1579749376 327691 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 1542724

[startup+1482.3 s]
/proc/loadavg: 2.30 2.23 2.19 3/184 4876
/proc/meminfo: memFree=27536864/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1550916 CPUtime=1482.05 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 326886 0 0 0 148157 48 0 0 20 0 4 0 109110006 1588137984 329739 33554432000 4194304 16246674 140736508422992 140736508420800 4207700 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 387729 329739 904 2943 0 384623 0
[pid=4810/tid=4811] ppid=4807 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1588137984 329739 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109110006 1588137984 329739 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1588137984 329739 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 1550916

[startup+1542.31 s]
/proc/loadavg: 2.29 2.25 2.19 3/183 4877
/proc/meminfo: memFree=27537104/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1550916 CPUtime=1542.04 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 326887 0 0 0 154156 48 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140736508422304 4206607 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 387729 329742 904 2943 0 384623 0
[pid=4810/tid=4811] ppid=4807 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1550916 CPUtime=0.01 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 1 0 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 1550916

[startup+1602.3 s]
/proc/loadavg: 2.31 2.26 2.20 4/183 4878
/proc/meminfo: memFree=27537132/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1550916 CPUtime=1602.02 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 326889 0 0 0 160154 48 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140736508422304 6955397 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 387729 329742 904 2943 0 384623 0
[pid=4810/tid=4811] ppid=4807 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1550916 CPUtime=0.01 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 1 0 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1550916 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1588137984 329742 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.02
Current children cumulated vsize (KiB) 1550916

[startup+1662.3 s]
/proc/loadavg: 2.27 2.25 2.20 4/183 4880
/proc/meminfo: memFree=27513108/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1570372 CPUtime=1662.01 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 331753 0 0 0 166152 49 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140736508420800 4220897 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 392593 334606 904 2943 0 389487 0
[pid=4810/tid=4811] ppid=4807 vsize=1570372 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1570372 CPUtime=0.01 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 1 0 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1570372 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662.01
Current children cumulated vsize (KiB) 1570372

[startup+1722.3 s]
/proc/loadavg: 2.29 2.25 2.19 3/183 4881
/proc/meminfo: memFree=27511644/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1570372 CPUtime=1722 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 331754 0 0 0 172151 49 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140736508420800 4225116 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 392593 334606 904 2943 0 389487 0
[pid=4810/tid=4811] ppid=4807 vsize=1570372 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1570372 CPUtime=0.01 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 1 0 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1570372 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1608060928 334606 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1722
Current children cumulated vsize (KiB) 1570372

[startup+1782.3 s]
/proc/loadavg: 2.16 2.22 2.18 3/183 5421
/proc/meminfo: memFree=27749424/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1572420 CPUtime=1781.98 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 332267 0 0 0 178149 49 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140736508422304 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 393105 335118 904 2943 0 389999 0
[pid=4810/tid=4811] ppid=4807 vsize=1572420 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1572420 CPUtime=0.01 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 1 0 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1572420 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1781.98
Current children cumulated vsize (KiB) 1572420



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.19 2.22 2.18 3/183 5421
/proc/meminfo: memFree=27749784/32872528 swapFree=17892/1720544
[pid=4810] ppid=4807 vsize=1572420 CPUtime=1800.08 cores=1,3,5,7
/proc/4810/stat : 4810 (toysat) R 4807 4810 3556 0 -1 4202496 332267 0 0 0 179959 49 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140736508422304 12371164 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/4810/statm: 393105 335118 904 2943 0 389999 0
[pid=4810/tid=4811] ppid=4807 vsize=1572420 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4811/stat : 4811 (toysat) S 4807 4810 3556 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140646587280624 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=4810/tid=4812] ppid=4807 vsize=1572420 CPUtime=0.01 cores=1,3,5,7
/proc/4810/task/4812/stat : 4812 (toysat) S 4807 4810 3556 0 -1 4202560 8 0 0 0 1 0 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140646576790768 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=4810/tid=4813] ppid=4807 vsize=1572420 CPUtime=0 cores=1,3,5,7
/proc/4810/task/4813/stat : 4813 (toysat) S 4807 4810 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109110006 1610158080 335118 33554432000 4194304 16246674 140736508422992 140646488730800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 1572420

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 4810 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.45
CPU time (s): 1800.14
CPU user time (s): 1799.61
CPU system time (s): 0.536918
CPU usage (%): 99.9828
Max. virtual memory (cumulated for all children) (KiB): 1572420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.61
system time used= 0.536918
maximum resident set size= 1340472
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 332267
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1744
involuntary context switches= 1893

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 11.7232 second user time and 15.7786 second system time

The end

Launcher Data 

Begin job on node117 at 2016-06-07 05:56:08
IDJOB=4079178
IDBENCH=72453
IDSOLVER=2542
FILE ID=node117/4079178-1465271768
RUNJOBID= node117-1465262703-3573
PBS_JOBID= 19843298
Free space on /tmp= 71716 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/datasets/9orless/normalized-mono-gac.cudf.trendy.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4079178-1465271768/watcher-4079178-1465271768 -o /tmp/evaluation-result-4079178-1465271768/solver-4079178-1465271768 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1465262703-3573 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079178-1465271768.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= aecff64161ca76fae524b50cd0e11fc3
RANDOM SEED=1889655245

node117.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29066160 kB
Buffers:           81632 kB
Cached:           109540 kB
SwapCached:        55388 kB
Active:          1189024 kB
Inactive:         163080 kB
Active(anon):    1108164 kB
Inactive(anon):    54760 kB
Active(file):      80860 kB
Inactive(file):   108320 kB
Unevictable:     1720544 kB
Mlocked:           17892 kB
SwapTotal:      67108856 kB
SwapFree:       67045084 kB
Dirty:             19776 kB
Writeback:             0 kB
AnonPages:       2826912 kB
Mapped:            10720 kB
Shmem:                 0 kB
Slab:             598768 kB
SReclaimable:      42724 kB
SUnreclaim:       556044 kB
KernelStack:        1440 kB
PageTables:         9476 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2968808 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1712128 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71704 MiB
End job on node117 at 2016-06-07 06:26:09