Trace number 4245542

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
R1: Concrete 3.4? (TO) 2405.49 2304.14

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-07-350-100.xml
MD5SUMcd1777af07bd314664d86e97c163b75e
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark22
Best CPU time to get the best result obtained on this benchmark19965.9
Satisfiable
(Un)Satisfiability was proved
Number of variables2451
Number of constraints29
Number of domains2
Minimum domain size2
Maximum domain size334
Distribution of domain sizes[{"size":2,"count":2450},{"size":334,"count":1}]
Minimum variable degree8
Maximum variable degree22
Distribution of variable degrees[{"degree":8,"count":2450},{"degree":22,"count":1}]
Minimum constraint arity350
Maximum constraint arity2450
Distribution of constraint arities[{"arity":350,"count":7},{"arity":701,"count":21},{"arity":2450,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":28}]
Optimization problemYES
Type of objectivemin VAR

Solver Data

3.61/2.14	c Concrete v3.4 running
2405.37/2304.11	java.util.concurrent.TimeoutException
2405.37/2304.11		at concrete.MAC.mac(MAC.scala:74)
2405.37/2304.11		at concrete.MAC.$anonfun$oneRun$1(MAC.scala:145)
2405.37/2304.11		at scala.util.Try$.apply(Try.scala:209)
2405.37/2304.11		at cspom.StatisticsManager$.$anonfun$measure$1(StatisticsManager.scala:194)
2405.37/2304.11		at cspom.StatisticsManager$.$anonfun$measureTry$1(StatisticsManager.scala:182)
2405.37/2304.11		at scala.runtime.java8.JFunction0$mcZ$sp.apply(JFunction0$mcZ$sp.java:12)
2405.37/2304.11		at org.scalameter.MeasureBuilder.$anonfun$measure$1(MeasureBuilder.scala:61)
2405.37/2304.11		at org.scalameter.Measurer$Default.measure(Measurer.scala:131)
2405.37/2304.11		at org.scalameter.MeasureBuilder.measureWith(MeasureBuilder.scala:51)
2405.37/2304.11		at org.scalameter.MeasureBuilder.measure(MeasureBuilder.scala:61)
2405.37/2304.11		at cspom.StatisticsManager$.measureTry(StatisticsManager.scala:181)
2405.37/2304.11		at cspom.StatisticsManager$.measure(StatisticsManager.scala:194)
2405.37/2304.11		at concrete.MAC.oneRun(MAC.scala:146)
2405.37/2304.11		at concrete.MAC.nextSolution(MAC.scala:166)
2405.37/2304.11		at concrete.MAC.$anonfun$nextSolution$2(MAC.scala:196)
2405.37/2304.11		at concrete.ProblemState.map(ProblemState.scala:203)
2405.37/2304.11		at concrete.ProblemState.map(ProblemState.scala:188)
2405.37/2304.11		at concrete.MAC.nextSolution(MAC.scala:195)
2405.37/2304.11		at concrete.Solver.hasNext(Solver.scala:202)
2405.37/2304.11		at scala.collection.Iterator.toStream(Iterator.scala:1403)
2405.37/2304.11		at scala.collection.Iterator.toStream$(Iterator.scala:1402)
2405.37/2304.11		at concrete.Solver.toStream(Solver.scala:73)
2405.37/2304.11		at scala.collection.TraversableOnce.toIterable(TraversableOnce.scala:296)
2405.37/2304.11		at scala.collection.TraversableOnce.toIterable$(TraversableOnce.scala:296)
2405.37/2304.11		at concrete.Solver.toIterable(Solver.scala:73)
2405.37/2304.11		at concrete.runner.ConcreteRunner.$anonfun$run$10(ConcreteRunner.scala:157)
2405.37/2304.11		at scala.util.Success.$anonfun$map$1(Try.scala:251)
2405.37/2304.11		at scala.util.Success.map(Try.scala:209)
2405.37/2304.11		at concrete.runner.ConcreteRunner.run(ConcreteRunner.scala:154)
2405.37/2304.11		at concrete.runner.ConcreteRunner.run$(ConcreteRunner.scala:72)
2405.37/2304.11		at concrete.runner.XCSP3Concrete$.run(XCSP3Concrete.scala:17)
2405.37/2304.11		at concrete.runner.XCSP3Concrete$.delayedEndpoint$concrete$runner$XCSP3Concrete$1(XCSP3Concrete.scala:119)
2405.37/2304.11		at concrete.runner.XCSP3Concrete$delayedInit$body.apply(XCSP3Concrete.scala:17)
2405.37/2304.11		at scala.Function0.apply$mcV$sp(Function0.scala:34)
2405.37/2304.11		at scala.Function0.apply$mcV$sp$(Function0.scala:34)
2405.37/2304.11		at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)
2405.37/2304.11		at scala.App.$anonfun$main$1$adapted(App.scala:76)
2405.37/2304.11		at scala.collection.immutable.List.foreach(List.scala:389)
2405.37/2304.11		at scala.App.main(App.scala:76)
2405.37/2304.11		at scala.App.main$(App.scala:74)
2405.37/2304.11		at concrete.runner.XCSP3Concrete$.main(XCSP3Concrete.scala:17)
2405.37/2304.11		at concrete.runner.XCSP3Concrete.main(XCSP3Concrete.scala)
2405.37/2304.12	s UNKNOWN

Verifier Data


Watcher Data

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4245542-1500704313/watcher-4245542-1500704313 -o /tmp/evaluation-result-4245542-1500704313/solver-4245542-1500704313 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node145-1500697238-13814 --watchdog 2560 bin/concrete HOME/instance-4245542-1500704313.xml 

pid=16025
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 1.82 1.75 1.61 3/261 16028
/proc/meminfo: memFree=30747688/32770624 swapFree=5784/144588
[pid=16028] ppid=16025 vsize=9508 CPUtime=0 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (bash) S 16025 16028 15196 0 -1 4202496 686 1532 0 0 0 0 0 0 20 0 1 0 5696426 9736192 351 33554432000 4194304 5098028 140730180822592 140730180820232 139689324252160 0 0 4100 65536 18446744071580971376 0 0 17 13 0 0 0 0 0 7196144 7232144 21622784 140730180826382 140730180826467 140730180826467 140730180829166 0
/proc/16028/statm: 2377 351 278 221 0 86 0

[startup+0.100158 s]
/proc/loadavg: 1.82 1.75 1.61 3/261 16028
/proc/meminfo: memFree=30747688/32770624 swapFree=5784/144588
[pid=16028] ppid=16025 vsize=9640 CPUtime=0.01 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (bash) S 16025 16028 15196 0 -1 4202496 884 6413 0 0 0 0 0 1 20 0 1 0 5696426 9871360 378 33554432000 4194304 5098028 140730180822592 140730180816600 139689324252160 0 0 4100 65536 18446744071580971376 0 0 17 13 0 0 0 0 0 7196144 7232144 21622784 140730180826382 140730180826467 140730180826467 140730180829166 0
/proc/16028/statm: 2410 378 296 221 0 119 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 9640

[startup+0.200317 s]
/proc/loadavg: 1.82 1.75 1.61 3/261 16028
/proc/meminfo: memFree=30747688/32770624 swapFree=5784/144588
[pid=16028] ppid=16025 vsize=10503452 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 4908 12671 0 0 6 2 8 3 20 0 15 0 5696426 10755534848 5242 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2625863 5242 2170 1 0 2614301 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 10503452

[startup+0.300327 s]
/proc/loadavg: 1.82 1.75 1.61 3/261 16028
/proc/meminfo: memFree=30747688/32770624 swapFree=5784/144588
[pid=16028] ppid=16025 vsize=10902292 CPUtime=0.36 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 7758 12671 0 0 23 2 8 3 20 0 20 0 5696426 11163947008 9493 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2725573 9493 2929 1 0 2713890 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 10902292

[startup+0.700207 s]
/proc/loadavg: 1.82 1.75 1.61 3/261 16028
/proc/meminfo: memFree=30747688/32770624 swapFree=5784/144588
[pid=16028] ppid=16025 vsize=10902720 CPUtime=0.97 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 12828 12671 0 0 81 5 8 3 20 0 20 0 5696426 11164385280 16103 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2725680 16103 3203 1 0 2713890 0
Current children cumulated CPU time (s) 0.97
Current children cumulated vsize (KiB) 10902720

[startup+1.5008 s]
/proc/loadavg: 1.82 1.75 1.61 3/281 16101
/proc/meminfo: memFree=30643792/32770624 swapFree=5784/144952
[pid=16028] ppid=16025 vsize=10913344 CPUtime=2.29 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 27218 12671 0 0 204 14 8 3 20 0 20 0 5696426 11175264256 44093 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2728336 44093 3406 1 0 2716450 0
[pid=16028/tid=16083] ppid=16025 vsize=10913344 CPUtime=1.42 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16083/stat : 16083 (java) R 16025 16028 15196 0 -1 4202560 19509 12671 0 0 125 6 8 3 20 0 20 0 5696438 11175264256 44093 33554432000 4194304 4196468 140733581284240 140412266013344 140411896046330 0 4 0 16800975 0 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16084] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16084/stat : 16084 (java) S 16025 16028 15196 0 -1 1077944384 120 12671 0 0 0 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140412214405776 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16085] ppid=16025 vsize=10913344 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16085/stat : 16085 (java) S 16025 16028 15196 0 -1 1077944384 29 12671 0 0 1 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140412213352976 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16086] ppid=16025 vsize=10913344 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16086/stat : 16086 (java) S 16025 16028 15196 0 -1 1077944384 39 12671 0 0 1 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411866372496 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16087] ppid=16025 vsize=10913344 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16087/stat : 16087 (java) S 16025 16028 15196 0 -1 1077944384 54 12671 0 0 1 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411865319696 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16088] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16088/stat : 16088 (java) S 16025 16028 15196 0 -1 1077944384 14 12671 0 0 0 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411864267920 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16089] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16089/stat : 16089 (java) S 16025 16028 15196 0 -1 1077944384 14 12671 0 0 0 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411863215120 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16090] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16090/stat : 16090 (java) S 16025 16028 15196 0 -1 1077944384 25 12671 0 0 0 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411862162320 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16091] ppid=16025 vsize=10913344 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16091/stat : 16091 (java) S 16025 16028 15196 0 -1 1077944384 25 12671 0 0 1 0 8 3 20 0 20 0 5696439 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411861109520 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16092] ppid=16025 vsize=10913344 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16092/stat : 16092 (java) S 16025 16028 15196 0 -1 1077944384 1519 12671 0 0 1 0 8 3 20 0 20 0 5696441 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411735607664 140412261796482 0 0 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16093] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16093/stat : 16093 (java) S 16025 16028 15196 0 -1 1077944384 55 12671 0 0 0 0 8 3 20 0 20 0 5696441 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411734553696 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16094] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16094/stat : 16094 (java) S 16025 16028 15196 0 -1 1077944384 42 12671 0 0 0 0 8 3 20 0 20 0 5696442 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411733500800 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16095] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16095/stat : 16095 (java) S 16025 16028 15196 0 -1 1077944384 1 12671 0 0 0 0 8 3 20 0 20 0 5696446 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411732449104 140412261803931 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16096] ppid=16025 vsize=10913344 CPUtime=0.27 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16096/stat : 16096 (java) R 16025 16028 15196 0 -1 1077944384 1138 12671 0 0 16 0 8 3 20 0 20 0 5696446 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411731397488 140412261796482 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16097] ppid=16025 vsize=10913344 CPUtime=0.25 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16097/stat : 16097 (java) S 16025 16028 15196 0 -1 1077944384 649 12671 0 0 14 0 8 3 20 0 20 0 5696446 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411730344688 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16098] ppid=16025 vsize=10913344 CPUtime=0.21 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16098/stat : 16098 (java) S 16025 16028 15196 0 -1 1077944384 556 12671 0 0 10 0 8 3 20 0 20 0 5696446 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411729291888 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16099] ppid=16025 vsize=10913344 CPUtime=0.37 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16099/stat : 16099 (java) R 16025 16028 15196 0 -1 4202560 1292 12671 0 0 26 0 8 3 20 0 20 0 5696446 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411728239088 140412261806682 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16100] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16100/stat : 16100 (java) S 16025 16028 15196 0 -1 1077944384 3 12671 0 0 0 0 8 3 20 0 20 0 5696446 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411727186528 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16101] ppid=16025 vsize=10913344 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16101/stat : 16101 (java) S 16025 16028 15196 0 -1 1077944384 3 12671 0 0 0 0 8 3 20 0 20 0 5696446 11175264256 44093 33554432000 4194304 4196468 140733581284240 140411726133808 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
Current children cumulated CPU time (s) 2.29
Current children cumulated vsize (KiB) 10913344

[startup+3.10124 s]
/proc/loadavg: 1.76 1.74 1.61 3/281 16101
/proc/meminfo: memFree=30573216/32770624 swapFree=5784/144952
[pid=16028] ppid=16025 vsize=10925820 CPUtime=6.72 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 38836 12671 0 0 637 24 8 3 20 0 20 0 5696426 11188039680 71957 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2731455 71957 3480 1 0 2719010 0
[pid=16028/tid=16083] ppid=16025 vsize=10925820 CPUtime=3 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16083/stat : 16083 (java) R 16025 16028 15196 0 -1 4202560 26285 12671 0 0 279 10 8 3 20 0 20 0 5696438 11188039680 71957 33554432000 4194304 4196468 140733581284240 140412266013640 140411902638542 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16084] ppid=16025 vsize=10925820 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16084/stat : 16084 (java) S 16025 16028 15196 0 -1 1077944384 130 12671 0 0 1 0 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140412214405776 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16085] ppid=16025 vsize=10925820 CPUtime=0.13 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16085/stat : 16085 (java) S 16025 16028 15196 0 -1 1077944384 106 12671 0 0 1 1 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140412213352976 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16086] ppid=16025 vsize=10925820 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16086/stat : 16086 (java) S 16025 16028 15196 0 -1 1077944384 42 12671 0 0 1 0 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411866372496 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16087] ppid=16025 vsize=10925820 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16087/stat : 16087 (java) S 16025 16028 15196 0 -1 1077944384 58 12671 0 0 1 0 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411865319696 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16088] ppid=16025 vsize=10925820 CPUtime=0.13 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16088/stat : 16088 (java) S 16025 16028 15196 0 -1 1077944384 37 12671 0 0 1 1 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411864267920 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16089] ppid=16025 vsize=10925820 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16089/stat : 16089 (java) S 16025 16028 15196 0 -1 1077944384 141 12671 0 0 1 0 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411863215120 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16090] ppid=16025 vsize=10925820 CPUtime=0.13 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16090/stat : 16090 (java) S 16025 16028 15196 0 -1 1077944384 30 12671 0 0 1 1 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411862162320 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16091] ppid=16025 vsize=10925820 CPUtime=0.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16091/stat : 16091 (java) S 16025 16028 15196 0 -1 1077944384 32 12671 0 0 1 0 8 3 20 0 20 0 5696439 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411861109520 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16092] ppid=16025 vsize=10925820 CPUtime=0.13 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16092/stat : 16092 (java) S 16025 16028 15196 0 -1 1077944384 1575 12671 0 0 2 0 8 3 20 0 20 0 5696441 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411735607664 140412261796482 0 0 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16093] ppid=16025 vsize=10925820 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16093/stat : 16093 (java) S 16025 16028 15196 0 -1 1077944384 57 12671 0 0 0 0 8 3 20 0 20 0 5696441 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411734553696 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16094] ppid=16025 vsize=10925820 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16094/stat : 16094 (java) S 16025 16028 15196 0 -1 1077944384 45 12671 0 0 0 0 8 3 20 0 20 0 5696442 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411733500800 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16095] ppid=16025 vsize=10925820 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16095/stat : 16095 (java) S 16025 16028 15196 0 -1 1077944384 1 12671 0 0 0 0 8 3 20 0 20 0 5696446 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411732449104 140412261803931 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16096] ppid=16025 vsize=10925820 CPUtime=0.94 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16096/stat : 16096 (java) R 16025 16028 15196 0 -1 4202560 1999 12671 0 0 82 1 8 3 20 0 20 0 5696446 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411731388064 140412245690079 0 4 0 16800975 0 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16097] ppid=16025 vsize=10925820 CPUtime=0.93 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16097/stat : 16097 (java) R 16025 16028 15196 0 -1 4202560 1600 12671 0 0 81 1 8 3 20 0 20 0 5696446 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411730331120 140412243329298 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16098] ppid=16025 vsize=10925820 CPUtime=0.93 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16098/stat : 16098 (java) R 16025 16028 15196 0 -1 4202560 1480 12671 0 0 82 0 8 3 20 0 20 0 5696446 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411729273768 140412245282169 0 4 0 16800975 0 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16099] ppid=16025 vsize=10925820 CPUtime=1.05 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16099/stat : 16099 (java) S 16025 16028 15196 0 -1 1077944384 3078 12671 0 0 93 1 8 3 20 0 20 0 5696446 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411728239088 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16100] ppid=16025 vsize=10925820 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16100/stat : 16100 (java) S 16025 16028 15196 0 -1 1077944384 3 12671 0 0 0 0 8 3 20 0 20 0 5696446 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411727186528 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16101] ppid=16025 vsize=10925820 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16101/stat : 16101 (java) S 16025 16028 15196 0 -1 1077944384 5 12671 0 0 0 0 8 3 20 0 20 0 5696446 11188039680 71957 33554432000 4194304 4196468 140733581284240 140411726133808 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
Current children cumulated CPU time (s) 6.72
Current children cumulated vsize (KiB) 10925820

[startup+6.30089 s]
/proc/loadavg: 1.76 1.74 1.61 3/281 16101
/proc/meminfo: memFree=30415984/32770624 swapFree=5784/144952
[pid=16028] ppid=16025 vsize=10927868 CPUtime=13.52 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 49674 12671 0 0 1300 41 8 3 20 0 20 0 5696426 11190136832 95860 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2731967 95860 3490 1 0 2719522 0
[pid=16028/tid=16083] ppid=16025 vsize=10927868 CPUtime=6.12 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16083/stat : 16083 (java) R 16025 16028 15196 0 -1 4202560 27240 12671 0 0 590 11 8 3 20 0 20 0 5696438 11190136832 95860 33554432000 4194304 4196468 140733581284240 140412266016344 140411906388238 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16084] ppid=16025 vsize=10927868 CPUtime=0.17 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16084/stat : 16084 (java) S 16025 16028 15196 0 -1 1077944384 144 12671 0 0 4 2 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140412214405776 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16085] ppid=16025 vsize=10927868 CPUtime=0.17 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16085/stat : 16085 (java) S 16025 16028 15196 0 -1 1077944384 122 12671 0 0 4 2 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140412213352976 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16086] ppid=16025 vsize=10927868 CPUtime=0.17 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16086/stat : 16086 (java) S 16025 16028 15196 0 -1 1077944384 70 12671 0 0 4 2 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411866372496 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16087] ppid=16025 vsize=10927868 CPUtime=0.16 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16087/stat : 16087 (java) S 16025 16028 15196 0 -1 1077944384 72 12671 0 0 3 2 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411865319696 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16088] ppid=16025 vsize=10927868 CPUtime=0.18 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16088/stat : 16088 (java) S 16025 16028 15196 0 -1 1077944384 61 12671 0 0 5 2 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411864267920 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16089] ppid=16025 vsize=10927868 CPUtime=0.17 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16089/stat : 16089 (java) S 16025 16028 15196 0 -1 1077944384 169 12671 0 0 4 2 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411863215120 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16090] ppid=16025 vsize=10927868 CPUtime=0.17 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16090/stat : 16090 (java) S 16025 16028 15196 0 -1 1077944384 49 12671 0 0 4 2 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411862162320 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16091] ppid=16025 vsize=10927868 CPUtime=0.18 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16091/stat : 16091 (java) S 16025 16028 15196 0 -1 1077944384 57 12671 0 0 4 3 8 3 20 0 20 0 5696439 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411861109520 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16092] ppid=16025 vsize=10927868 CPUtime=0.14 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16092/stat : 16092 (java) S 16025 16028 15196 0 -1 1077944384 1825 12671 0 0 3 0 8 3 20 0 20 0 5696441 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411735607664 140412261796482 0 0 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16093] ppid=16025 vsize=10927868 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16093/stat : 16093 (java) S 16025 16028 15196 0 -1 1077944384 57 12671 0 0 0 0 8 3 20 0 20 0 5696441 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411734553696 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16094] ppid=16025 vsize=10927868 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16094/stat : 16094 (java) S 16025 16028 15196 0 -1 1077944384 45 12671 0 0 0 0 8 3 20 0 20 0 5696442 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411733500800 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16095] ppid=16025 vsize=10927868 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16095/stat : 16095 (java) S 16025 16028 15196 0 -1 1077944384 1 12671 0 0 0 0 8 3 20 0 20 0 5696446 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411732449104 140412261803931 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16096] ppid=16025 vsize=10927868 CPUtime=1.78 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16096/stat : 16096 (java) S 16025 16028 15196 0 -1 1077944384 4162 12671 0 0 165 2 8 3 20 0 20 0 5696446 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411731397488 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16097] ppid=16025 vsize=10927868 CPUtime=1.98 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16097/stat : 16097 (java) S 16025 16028 15196 0 -1 1077944384 4397 12671 0 0 186 1 8 3 20 0 20 0 5696446 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411730344688 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16098] ppid=16025 vsize=10927868 CPUtime=1.8 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16098/stat : 16098 (java) S 16025 16028 15196 0 -1 1077944384 3317 12671 0 0 168 1 8 3 20 0 20 0 5696446 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411729291888 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16099] ppid=16025 vsize=10927868 CPUtime=1.61 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16099/stat : 16099 (java) S 16025 16028 15196 0 -1 1077944384 5686 12671 0 0 148 2 8 3 20 0 20 0 5696446 11190136832 95860 33554432000 4194304 4196468 140733581284240 140411728239088 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16100] ppid=16025 vsize=10927868 CPUtime=0.11 cores=1,3,5,7,9,11,13,15

################
# More data... #
################

[pid=16028/tid=16101] ppid=16025 vsize=10931964 CPUtime=1.34 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16101/stat : 16101 (java) S 16025 16028 15196 0 -1 1077944384 1871 12671 0 0 55 68 8 3 20 0 20 0 5696446 11194331136 673611 33554432000 4194304 4196468 140733581284240 140411726133808 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
Current children cumulated CPU time (s) 2400.07
Current children cumulated vsize (KiB) 10931964

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 16028 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2303.6 s]
/proc/loadavg: 1.27 1.40 1.46 10/283 16313
/proc/meminfo: memFree=27888680/32770624 swapFree=5784/147120
[pid=16028] ppid=16025 vsize=11065092 CPUtime=2402.01 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 460140 12671 0 0 239649 541 8 3 20 0 22 0 5696426 11330654208 675386 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2766273 675386 3516 1 0 2753828 0
[pid=16028/tid=16083] ppid=16025 vsize=11065092 CPUtime=2284.8 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16083/stat : 16083 (java) S 16025 16028 15196 0 -1 1077944384 123652 12671 0 0 228405 64 8 3 20 0 22 0 5696438 11330654208 675386 33554432000 4194304 4196468 140733581284240 140412266022992 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16084] ppid=16025 vsize=11065092 CPUtime=10.27 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16084/stat : 16084 (java) R 16025 16028 15196 0 -1 4202560 18760 12671 0 0 968 48 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140412214405896 140412254413543 0 4 0 16800975 0 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16085] ppid=16025 vsize=11065092 CPUtime=10.24 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16085/stat : 16085 (java) R 16025 16028 15196 0 -1 4202560 19529 12671 0 0 968 45 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140412213352784 140412254413543 0 4 0 16800975 0 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16086] ppid=16025 vsize=11065092 CPUtime=10.33 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16086/stat : 16086 (java) R 16025 16028 15196 0 -1 4202560 18850 12671 0 0 975 47 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411866372616 140412245168370 0 4 0 16800975 0 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16087] ppid=16025 vsize=11065092 CPUtime=10.18 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16087/stat : 16087 (java) R 16025 16028 15196 0 -1 4202560 18573 12671 0 0 960 47 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411865319504 140412254413543 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16088] ppid=16025 vsize=11065092 CPUtime=10.32 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16088/stat : 16088 (java) R 16025 16028 15196 0 -1 4202560 22385 12671 0 0 975 46 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411864268040 140412254413543 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16089] ppid=16025 vsize=11065092 CPUtime=10.36 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16089/stat : 16089 (java) R 16025 16028 15196 0 -1 4202560 23173 12671 0 0 974 51 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411863215240 140412254413543 0 4 0 16800975 0 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16090] ppid=16025 vsize=11065092 CPUtime=10.18 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16090/stat : 16090 (java) R 16025 16028 15196 0 -1 4202560 13442 12671 0 0 961 46 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411862162520 140412246242957 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16091] ppid=16025 vsize=11065092 CPUtime=10.1 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16091/stat : 16091 (java) R 16025 16028 15196 0 -1 4202560 20949 12671 0 0 954 45 8 3 20 0 22 0 5696439 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411861109640 140412254413543 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16092] ppid=16025 vsize=11065092 CPUtime=5.03 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16092/stat : 16092 (java) S 16025 16028 15196 0 -1 1077944384 44792 12671 0 0 457 35 8 3 20 0 22 0 5696441 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411735606288 140412261795541 0 0 0 16800975 18446744071579849748 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16093] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16093/stat : 16093 (java) S 16025 16028 15196 0 -1 1077944384 62 12671 0 0 0 0 8 3 20 0 22 0 5696441 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411734553696 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16094] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16094/stat : 16094 (java) S 16025 16028 15196 0 -1 1077944384 50 12671 0 0 0 0 8 3 20 0 22 0 5696442 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411733500800 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16095] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16095/stat : 16095 (java) S 16025 16028 15196 0 -1 1077944384 249 12671 0 0 0 0 8 3 20 0 22 0 5696446 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411732449104 140412261803931 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16096] ppid=16025 vsize=11065092 CPUtime=9 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16096/stat : 16096 (java) S 16025 16028 15196 0 -1 1077944384 34510 12671 0 0 881 8 8 3 20 0 22 0 5696446 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411731397488 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16097] ppid=16025 vsize=11065092 CPUtime=8.53 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16097/stat : 16097 (java) S 16025 16028 15196 0 -1 1077944384 26755 12671 0 0 833 9 8 3 20 0 22 0 5696446 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411730344688 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16098] ppid=16025 vsize=11065092 CPUtime=8.48 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16098/stat : 16098 (java) S 16025 16028 15196 0 -1 1077944384 35288 12671 0 0 830 7 8 3 20 0 22 0 5696446 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411729291888 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16099] ppid=16025 vsize=11065092 CPUtime=4.25 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16099/stat : 16099 (java) S 16025 16028 15196 0 -1 1077944384 34763 12671 0 0 406 8 8 3 20 0 22 0 5696446 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411728239088 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16100] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16100/stat : 16100 (java) S 16025 16028 15196 0 -1 1077944384 3 12671 0 0 0 0 8 3 20 0 22 0 5696446 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411727186528 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16101] ppid=16025 vsize=11065092 CPUtime=1.34 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16101/stat : 16101 (java) S 16025 16028 15196 0 -1 1077944384 1871 12671 0 0 55 68 8 3 20 0 22 0 5696446 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411726133808 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16312] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16312/stat : 16312 (java) S 16025 16028 15196 0 -1 1077944384 321 12671 0 0 0 0 8 3 20 0 22 0 5926756 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411697373296 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16313] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16313/stat : 16313 (java) S 16025 16028 15196 0 -1 1077944384 30 12671 0 0 0 0 8 3 20 0 22 0 5926756 11330654208 675386 33554432000 4194304 4196468 140733581284240 140411696321216 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
Current children cumulated CPU time (s) 2402.01
Current children cumulated vsize (KiB) 11065092

[startup+2304 s]
/proc/loadavg: 1.27 1.40 1.46 10/283 16313
/proc/meminfo: memFree=27888680/32770624 swapFree=5784/147120
[pid=16028] ppid=16025 vsize=11065092 CPUtime=2404.71 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 460400 12671 0 0 239918 542 8 3 20 0 22 0 5696426 11330654208 675430 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2766273 675430 3516 1 0 2753828 0
[pid=16028/tid=16083] ppid=16025 vsize=11065092 CPUtime=2284.8 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16083/stat : 16083 (java) S 16025 16028 15196 0 -1 1077944384 123652 12671 0 0 228405 64 8 3 20 0 22 0 5696438 11330654208 675430 33554432000 4194304 4196468 140733581284240 140412266022992 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16084] ppid=16025 vsize=11065092 CPUtime=10.6 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16084/stat : 16084 (java) R 16025 16028 15196 0 -1 4202560 18763 12671 0 0 1001 48 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140412214405976 140412246242957 0 4 0 16800975 0 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16085] ppid=16025 vsize=11065092 CPUtime=10.56 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16085/stat : 16085 (java) R 16025 16028 15196 0 -1 4202560 19540 12671 0 0 1000 45 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140412213353176 140412246781923 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16086] ppid=16025 vsize=11065092 CPUtime=10.67 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16086/stat : 16086 (java) R 16025 16028 15196 0 -1 4202560 18862 12671 0 0 1009 47 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411866372384 140412243395081 0 4 0 16800975 0 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16087] ppid=16025 vsize=11065092 CPUtime=10.51 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16087/stat : 16087 (java) R 16025 16028 15196 0 -1 4202560 18578 12671 0 0 993 47 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411865319896 140412246781844 0 4 0 16800975 0 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16088] ppid=16025 vsize=11065092 CPUtime=10.64 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16088/stat : 16088 (java) R 16025 16028 15196 0 -1 4202560 22386 12671 0 0 1007 46 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411864268120 140412246274256 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16089] ppid=16025 vsize=11065092 CPUtime=10.69 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16089/stat : 16089 (java) R 16025 16028 15196 0 -1 4202560 23183 12671 0 0 1007 51 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411863215320 140412246242957 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16090] ppid=16025 vsize=11065092 CPUtime=10.52 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16090/stat : 16090 (java) R 16025 16028 15196 0 -1 4202560 13446 12671 0 0 995 46 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411862162520 140412243338586 0 4 0 16800975 0 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16091] ppid=16025 vsize=11065092 CPUtime=10.42 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16091/stat : 16091 (java) R 16025 16028 15196 0 -1 4202560 20956 12671 0 0 986 45 8 3 20 0 22 0 5696439 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411861109720 140412246781997 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16092] ppid=16025 vsize=11065092 CPUtime=5.09 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16092/stat : 16092 (java) S 16025 16028 15196 0 -1 1077944384 44994 12671 0 0 463 35 8 3 20 0 22 0 5696441 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411735606288 140412261795541 0 0 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16093] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16093/stat : 16093 (java) S 16025 16028 15196 0 -1 1077944384 65 12671 0 0 0 0 8 3 20 0 22 0 5696441 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411734553328 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16094] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16094/stat : 16094 (java) S 16025 16028 15196 0 -1 1077944384 50 12671 0 0 0 0 8 3 20 0 22 0 5696442 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411733500800 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16095] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16095/stat : 16095 (java) S 16025 16028 15196 0 -1 1077944384 249 12671 0 0 0 0 8 3 20 0 22 0 5696446 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411732449104 140412261803931 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16096] ppid=16025 vsize=11065092 CPUtime=9 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16096/stat : 16096 (java) S 16025 16028 15196 0 -1 1077944384 34510 12671 0 0 881 8 8 3 20 0 22 0 5696446 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411731397488 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16097] ppid=16025 vsize=11065092 CPUtime=8.53 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16097/stat : 16097 (java) S 16025 16028 15196 0 -1 1077944384 26755 12671 0 0 833 9 8 3 20 0 22 0 5696446 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411730344688 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16098] ppid=16025 vsize=11065092 CPUtime=8.48 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16098/stat : 16098 (java) S 16025 16028 15196 0 -1 1077944384 35288 12671 0 0 830 7 8 3 20 0 22 0 5696446 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411729291888 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16099] ppid=16025 vsize=11065092 CPUtime=4.25 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16099/stat : 16099 (java) S 16025 16028 15196 0 -1 1077944384 34763 12671 0 0 406 8 8 3 20 0 22 0 5696446 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411728239088 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16100] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16100/stat : 16100 (java) S 16025 16028 15196 0 -1 1077944384 3 12671 0 0 0 0 8 3 20 0 22 0 5696446 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411727186528 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16101] ppid=16025 vsize=11065092 CPUtime=1.34 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16101/stat : 16101 (java) S 16025 16028 15196 0 -1 1077944384 1871 12671 0 0 55 68 8 3 20 0 22 0 5696446 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411726133808 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16312] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16312/stat : 16312 (java) S 16025 16028 15196 0 -1 1077944384 321 12671 0 0 0 0 8 3 20 0 22 0 5926756 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411697373296 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16313] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16313/stat : 16313 (java) S 16025 16028 15196 0 -1 1077944384 32 12671 0 0 0 0 8 3 20 0 22 0 5926756 11330654208 675430 33554432000 4194304 4196468 140733581284240 140411696321216 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
Current children cumulated CPU time (s) 2404.71
Current children cumulated vsize (KiB) 11065092

[startup+2304.1 s]
/proc/loadavg: 1.27 1.40 1.46 10/283 16313
/proc/meminfo: memFree=27888680/32770624 swapFree=5784/147120
[pid=16028] ppid=16025 vsize=11065092 CPUtime=2405.37 cores=1,3,5,7,9,11,13,15
/proc/16028/stat : 16028 (java) S 16025 16028 15196 0 -1 1077944320 460417 12671 0 0 239984 542 8 3 20 0 22 0 5696426 11330654208 675464 33554432000 4194304 4196468 140733581284240 140733581266784 140412261785335 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
/proc/16028/statm: 2766273 675464 3523 1 0 2753828 0
[pid=16028/tid=16083] ppid=16025 vsize=11065092 CPUtime=2284.8 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16083/stat : 16083 (java) S 16025 16028 15196 0 -1 1077944384 123652 12671 0 0 228405 64 8 3 20 0 22 0 5696438 11330654208 675464 33554432000 4194304 4196468 140733581284240 140412266022992 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16084] ppid=16025 vsize=11065092 CPUtime=10.68 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16084/stat : 16084 (java) R 16025 16028 15196 0 -1 4202560 18764 12671 0 0 1009 48 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140412214405896 140412254413543 0 4 0 16800975 0 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16085] ppid=16025 vsize=11065092 CPUtime=10.64 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16085/stat : 16085 (java) R 16025 16028 15196 0 -1 4202560 19544 12671 0 0 1008 45 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140412213353176 140412254413543 0 4 0 16800975 0 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16086] ppid=16025 vsize=11065092 CPUtime=10.74 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16086/stat : 16086 (java) R 16025 16028 15196 0 -1 4202560 18862 12671 0 0 1016 47 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411866372696 140412254413543 0 4 0 16800975 0 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16087] ppid=16025 vsize=11065092 CPUtime=10.6 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16087/stat : 16087 (java) R 16025 16028 15196 0 -1 4202560 18579 12671 0 0 1002 47 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411865319584 140412254413543 0 4 0 16800975 0 0 0 -1 11 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16088] ppid=16025 vsize=11065092 CPUtime=10.72 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16088/stat : 16088 (java) R 16025 16028 15196 0 -1 4202560 22388 12671 0 0 1015 46 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411864268120 140412254413543 0 4 0 16800975 0 0 0 -1 5 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16089] ppid=16025 vsize=11065092 CPUtime=10.77 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16089/stat : 16089 (java) R 16025 16028 15196 0 -1 4202560 23185 12671 0 0 1015 51 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411863215320 140412254413543 0 4 0 16800975 0 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16090] ppid=16025 vsize=11065092 CPUtime=10.6 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16090/stat : 16090 (java) R 16025 16028 15196 0 -1 4202560 13448 12671 0 0 1003 46 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411862162520 140412246781720 0 4 0 16800975 0 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16091] ppid=16025 vsize=11065092 CPUtime=10.5 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16091/stat : 16091 (java) R 16025 16028 15196 0 -1 4202560 20956 12671 0 0 994 45 8 3 20 0 22 0 5696439 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411861109640 140412245168370 0 4 0 16800975 0 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16092] ppid=16025 vsize=11065092 CPUtime=5.1 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16092/stat : 16092 (java) S 16025 16028 15196 0 -1 1077944384 44994 12671 0 0 464 35 8 3 20 0 22 0 5696441 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411735606288 140412261795541 0 0 0 16800975 18446744071579849748 0 0 -1 3 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16093] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16093/stat : 16093 (java) S 16025 16028 15196 0 -1 1077944384 68 12671 0 0 0 0 8 3 20 0 22 0 5696441 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411734553232 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16094] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16094/stat : 16094 (java) S 16025 16028 15196 0 -1 1077944384 52 12671 0 0 0 0 8 3 20 0 22 0 5696442 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411733500400 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16095] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16095/stat : 16095 (java) S 16025 16028 15196 0 -1 1077944384 249 12671 0 0 0 0 8 3 20 0 22 0 5696446 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411732449104 140412261803931 0 4 0 16800975 18446744071579849748 0 0 -1 15 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16096] ppid=16025 vsize=11065092 CPUtime=9 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16096/stat : 16096 (java) S 16025 16028 15196 0 -1 1077944384 34510 12671 0 0 881 8 8 3 20 0 22 0 5696446 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411731397488 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16097] ppid=16025 vsize=11065092 CPUtime=8.53 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16097/stat : 16097 (java) S 16025 16028 15196 0 -1 1077944384 26755 12671 0 0 833 9 8 3 20 0 22 0 5696446 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411730344688 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16098] ppid=16025 vsize=11065092 CPUtime=8.48 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16098/stat : 16098 (java) S 16025 16028 15196 0 -1 1077944384 35288 12671 0 0 830 7 8 3 20 0 22 0 5696446 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411729291888 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 13 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16099] ppid=16025 vsize=11065092 CPUtime=4.25 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16099/stat : 16099 (java) S 16025 16028 15196 0 -1 1077944384 34763 12671 0 0 406 8 8 3 20 0 22 0 5696446 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411728239088 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16100] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16100/stat : 16100 (java) S 16025 16028 15196 0 -1 1077944384 3 12671 0 0 0 0 8 3 20 0 22 0 5696446 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411727186528 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16101] ppid=16025 vsize=11065092 CPUtime=1.34 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16101/stat : 16101 (java) S 16025 16028 15196 0 -1 1077944384 1871 12671 0 0 55 68 8 3 20 0 22 0 5696446 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411726133808 140412261796482 0 4 0 16800975 18446744071579849748 0 0 -1 1 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16312] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16312/stat : 16312 (java) S 16025 16028 15196 0 -1 1077944384 321 12671 0 0 0 0 8 3 20 0 22 0 5926756 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411697373296 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 9 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
[pid=16028/tid=16313] ppid=16025 vsize=11065092 CPUtime=0.11 cores=1,3,5,7,9,11,13,15
/proc/16028/task/16313/stat : 16313 (java) S 16025 16028 15196 0 -1 1077944384 32 12671 0 0 0 0 8 3 20 0 22 0 5926756 11330654208 675464 33554432000 4194304 4196468 140733581284240 140411696321216 140412261795541 0 4 0 16800975 18446744071579849748 0 0 -1 7 0 0 0 0 0 6293624 6294260 28131328 140733581286081 140733581288855 140733581288855 140733581291471 0
Current children cumulated CPU time (s) 2405.37
Current children cumulated vsize (KiB) 11065092

Child status: 143
Real time (s): 2304.14
CPU time (s): 2405.49
CPU user time (s): 2400
CPU system time (s): 5.48408
CPU usage (%): 104.398
Max. virtual memory (cumulated for all children) (KiB): 11065092

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400
system time used= 5.48408
maximum resident set size= 2870528
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 473527
page faults= 0
swaps= 0
block input operations= 0
block output operations= 2760
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 220749
involuntary context switches= 163659

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 19.6415 second user time and 16.3917 second system time

The end

Launcher Data

Begin job on node145 at 2017-07-22 08:18:33
IDJOB=4245542
IDBENCH=122949
IDSOLVER=2630
FILE ID=node145/4245542-1500704313
RUNJOBID= node145-1500697238-13814
PBS_JOBID= 20623333
Free space on /tmp= 61840 MiB

SOLVER NAME= Concrete 3.4
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-07-350-100.xml
COMMAND LINE= bin/concrete BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4245542-1500704313/watcher-4245542-1500704313 -o /tmp/evaluation-result-4245542-1500704313/solver-4245542-1500704313 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node145-1500697238-13814 --watchdog 2560  bin/concrete HOME/instance-4245542-1500704313.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= cd1777af07bd314664d86e97c163b75e
RANDOM SEED=431479791

node145.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2267.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2000.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2267.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30748092 kB
MemAvailable:   30906644 kB
Buffers:          146944 kB
Cached:           283428 kB
SwapCached:            0 kB
Active:          1354652 kB
Inactive:         212444 kB
Active(anon):    1080576 kB
Inactive(anon):    67856 kB
Active(file):     274076 kB
Inactive(file):   144588 kB
Unevictable:        5784 kB
Mlocked:            5784 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:             24272 kB
Writeback:             0 kB
AnonPages:       1299880 kB
Mapped:            44540 kB
Shmem:              8852 kB
Slab:             145408 kB
SReclaimable:     111448 kB
SUnreclaim:        33960 kB
KernelStack:        4864 kB
PageTables:         7312 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    1936192 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1069056 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      136576 kB
DirectMap2M:    33409024 kB

Free space on /tmp at the end= 61816 MiB
End job on node145 at 2017-07-22 08:56:57