Trace number 3394036

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)SAT 35725.1 4485.02

General information on the benchmark

NameCRAFTED/modcircuits/
mod3block_2vars_11gates_u2_autoenc.cnf
MD5SUM36c3169a5cad0483dd15befcefc4323e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1540.75
Satisfiable
(Un)Satisfiability was proved
Number of variables526
Number of clauses146535
Sum of the clauses size858954
Maximum clause length14
Minimum clause length1
Number of clauses of size 164
Number of clauses of size 22476
Number of clauses of size 34
Number of clauses of size 41387
Number of clauses of size 57328
Number of clauses of size over 5135276

Solver Data

35725.03/4485.01	s SATISFIABLE
35725.03/4485.01	v -1 2 -3 -4 -5 -6 7
35725.03/4485.01	v -8 -9 10 -11 -12 -13 -14 -15
35725.03/4485.01	v -16 17 -18 -19 -20 -21 22 -23
35725.03/4485.01	v -24 -25 -26 -27 -28 29 -30 -31
35725.03/4485.01	v 32 -33 -34 -35 -36 -37 -38 -39
35725.03/4485.01	v 40 -41 -42 -43 -44 -45 -46 -47
35725.03/4485.01	v -48 -49 -50 51 -52 -53 -54 -55
35725.03/4485.01	v -56 -57 -58 -59 60 61 -62 -63
35725.03/4485.01	v -64 -65 -66 -67 -68 -69 -70 -71
35725.03/4485.01	v -72 -73 -74 -75 -76 -77 78 -79
35725.03/4485.01	v -80 -81 -82 -83 84 -85 -86 -87
35725.03/4485.01	v -88 -89 -90 -91 -92 -93 -94 95
35725.03/4485.01	v -96 -97 -98 99 -100 -101 -102 -103
35725.03/4485.01	v -104 -105 -106 -107 -108 -109 -110 -111
35725.03/4485.01	v -112 -113 -114 -115 -116 -117 -118 -119
35725.03/4485.01	v 120 -121 -122 -123 -124 -125 -126 -127
35725.03/4485.01	v -128 -129 130 -131 -132 -133 -134 -135
35725.03/4485.01	v -136 -137 -138 -139 -140 -141 -142 143
35725.03/4485.01	v -144 145 -146 -147 -148 -149 -150 -151
35725.03/4485.01	v -152 -153 -154 -155 -156 -157 -158 -159
35725.03/4485.01	v -160 -161 -162 -163 -164 -165 166 -167
35725.03/4485.01	v -168 -169 -170 -171 -172 -173 -174 -175
35725.03/4485.01	v -176 -177 -178 -179 -180 -181 182 -183
35725.03/4485.01	v -184 -185 -186 -187 -188 -189 -190 -191
35725.03/4485.01	v -192 -193 -194 -195 -196 -197 198 -199
35725.03/4485.01	v -200 -201 202 203 204 205 -206 207
35725.03/4485.01	v -208 -209 -210 -211 212 213 214 215
35725.03/4485.01	v 216 217 -218 219 -220 221 222 -223
35725.03/4485.01	v -224 225 -226 -227 228 229 230 -231
35725.03/4485.01	v -232 233 -234 -235 -236 -237 238 -239
35725.03/4485.01	v -240 241 -242 -243 -244 -245 -246 -247
35725.03/4485.01	v -248 -249 -250 -251 -252 -253 -254 -255
35725.03/4485.01	v -256 -257 258 -259 -260 -261 -262 -263
35725.03/4485.01	v -264 265 -266 -267 268 -269 270 -271
35725.03/4485.01	v -272 -273 -274 -275 276 -277 278 -279
35725.03/4485.01	v -280 281 -282 -283 284 285 286 -287
35725.03/4485.01	v 288 289 290 291 -292 -293 -294 -295
35725.03/4485.01	v -296 297 298 -299 -300 -301 302 -303
35725.03/4485.01	v -304 305 -306 307 308 -309 310 -311
35725.03/4485.01	v 312 -313 -314 -315 316 317 318 -319
35725.03/4485.01	v -320 321 322 -323 324 325 326 327
35725.03/4485.01	v 328 329 330 331 332 333 334 335
35725.03/4485.01	v 336 337 338 339 340 341 342 -343
35725.03/4485.01	v -344 345 346 -347 -348 349 350 351
35725.03/4485.01	v 352 353 354 -355 -356 -357 -358 -359
35725.03/4485.01	v -360 -361 -362 -363 -364 -365 -366 367
35725.03/4485.01	v 368 369 370 371 372 -373 -374 375
35725.03/4485.01	v 376 377 378 379 380 381 382 -383
35725.03/4485.01	v -384 -385 -386 387 388 389 390 391
35725.03/4485.01	v 392 393 394 395 396 -397 398 399
35725.03/4485.01	v 400 401 402 -403 404 -405 406 -407
35725.03/4485.01	v 408 -409 410 -411 412 -413 -414 -415
35725.03/4485.01	v -416 -417 -418 419 420 421 422 -423
35725.03/4485.01	v -424 425 426 -427 -428 -429 430 -431
35725.03/4485.01	v 432 -433 434 435 436 437 438 -439
35725.03/4485.01	v 440 441 442 -443 444 -445 446 447
35725.03/4485.01	v 448 449 450 -451 -452 -453 -454 -455
35725.03/4485.01	v 456 -457 -458 -459 460 -461 462 -463
35725.03/4485.01	v -464 -465 -466 -467 468 -469 470 -471
35725.03/4485.01	v 472 -473 474 -475 476 -477 -478 -479
35725.03/4485.01	v 480 -481 482 483 -484 485 -486 -487
35725.03/4485.01	v -488 489 -490 -491 -492 -493 -494 -495
35725.03/4485.01	v -496 -497 -498 -499 -500 501 -502 -503
35725.03/4485.01	v -504 -505 -506 -507 -508 -509 -510 -511
35725.03/4485.01	v -512 -513 514 -515 516 -517 -518 -519
35725.03/4485.01	v -520 521 522 523 -524 -525 -526
35725.03/4485.01	v 0

Verifier Data

OK

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394036-1306079748/watcher-3394036-1306079748 -o /tmp/evaluation-result-3394036-1306079748/solver-3394036-1306079748 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394036-1306079748.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.09 8.01 2/481 3343
/proc/meminfo: memFree=16958144/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=9000 CPUtime=0 cores=0-7
/proc/3343/stat : 3343 (plingeling) R 3341 3343 3316 0 -1 4202496 320 1251 0 0 0 0 0 0 25 0 1 0 452166081 9216000 251 33554432000 4194304 4417452 140733321698880 18446744073709551615 268660356072 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/3343/statm: 2250 251 146 55 0 136 0

[startup+0.10911 s]
/proc/loadavg: 8.12 8.09 8.01 2/481 3343
/proc/meminfo: memFree=16958144/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=34288 CPUtime=0.09 cores=0-7
/proc/3343/stat : 3343 (plingeling) R 3341 3343 3316 0 -1 4202496 6768 1251 0 0 9 0 0 0 25 0 1 0 452166081 35110912 6595 33554432000 4194304 4417452 140733321698880 18446744073709551615 268660280918 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/3343/statm: 8572 6595 148 55 0 6458 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34288

[startup+0.201095 s]
/proc/loadavg: 8.12 8.09 8.01 2/481 3343
/proc/meminfo: memFree=16958144/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=50672 CPUtime=0.19 cores=0-7
/proc/3343/stat : 3343 (plingeling) R 3341 3343 3316 0 -1 4202496 10850 1251 0 0 18 1 0 0 25 0 1 0 452166081 51888128 10677 33554432000 4194304 4417452 140733321698880 18446744073709551615 268660356189 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/3343/statm: 12668 10691 148 55 0 10554 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 50672

[startup+0.301089 s]
/proc/loadavg: 8.12 8.09 8.01 2/481 3343
/proc/meminfo: memFree=16958144/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=75248 CPUtime=0.29 cores=0-7
/proc/3343/stat : 3343 (plingeling) R 3341 3343 3316 0 -1 4202496 17008 1251 0 0 28 1 0 0 25 0 1 0 452166081 77053952 16835 33554432000 4194304 4417452 140733321698880 18446744073709551615 4231480 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/3343/statm: 18812 16835 148 55 0 16698 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 75248

[startup+0.700974 s]
/proc/loadavg: 8.12 8.09 8.01 2/481 3343
/proc/meminfo: memFree=16958144/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=226080 CPUtime=2.84 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 18607 1251 0 0 282 2 0 0 19 0 9 0 452166081 231505920 17721 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 56520 17721 175 55 0 54406 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 226080

[startup+1.50083 s]
/proc/loadavg: 8.12 8.09 8.01 9/490 3358
/proc/meminfo: memFree=16858748/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=250784 CPUtime=9.22 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 30835 1251 0 0 917 5 0 0 19 0 9 0 452166081 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 62696 23895 180 55 0 60582 0
[pid=3343/tid=3351] ppid=3341 vsize=250784 CPUtime=1.1 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 1675 1251 0 0 110 0 0 0 25 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=250784 CPUtime=1.07 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 1652 1251 0 0 107 0 0 0 25 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=250784 CPUtime=1.1 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 1198 1251 0 0 110 0 0 0 25 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=250784 CPUtime=1.1 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 3170 1251 0 0 110 0 0 0 22 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=250784 CPUtime=1.1 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 1638 1251 0 0 110 0 0 0 19 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=250784 CPUtime=1.1 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 1633 1251 0 0 110 0 0 0 24 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=250784 CPUtime=1.1 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 1205 1251 0 0 110 0 0 0 25 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=250784 CPUtime=1.1 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 1638 1251 0 0 110 0 0 0 24 0 9 0 452166120 256802816 23895 33554432000 4194304 4417452 140733321698880 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.22
Current children cumulated vsize (KiB) 250784

[startup+3.10055 s]
/proc/loadavg: 8.12 8.09 8.01 10/491 3359
/proc/meminfo: memFree=16867792/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=241004 CPUtime=21.96 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 39486 1251 0 0 2190 6 0 0 19 0 9 0 452166081 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 60251 21549 180 55 0 58137 0
[pid=3343/tid=3351] ppid=3341 vsize=241004 CPUtime=2.7 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 2456 1251 0 0 270 0 0 0 25 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=241004 CPUtime=2.62 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 2296 1251 0 0 262 0 0 0 19 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=241004 CPUtime=2.7 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 1783 1251 0 0 270 0 0 0 25 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4199451 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=241004 CPUtime=2.7 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 6404 1251 0 0 269 1 0 0 25 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=241004 CPUtime=2.7 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 2601 1251 0 0 270 0 0 0 23 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=241004 CPUtime=2.7 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 2841 1251 0 0 270 0 0 0 25 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4246384 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=241004 CPUtime=2.69 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 1838 1251 0 0 269 0 0 0 25 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=241004 CPUtime=2.7 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 2241 1251 0 0 270 0 0 0 25 0 9 0 452166120 246788096 21549 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 21.96
Current children cumulated vsize (KiB) 241004

[startup+6.30099 s]
/proc/loadavg: 8.19 8.10 8.02 11/491 3359
/proc/meminfo: memFree=16857508/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=246352 CPUtime=47.4 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 64951 1251 0 0 4729 11 0 0 19 0 9 0 452166081 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 61588 22828 180 55 0 59474 0
[pid=3343/tid=3351] ppid=3341 vsize=246352 CPUtime=5.9 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 5067 1251 0 0 590 0 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4235614 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=246352 CPUtime=5.66 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 5007 1251 0 0 566 0 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=246352 CPUtime=5.9 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 3906 1251 0 0 590 0 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=246352 CPUtime=5.9 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 12958 1251 0 0 588 2 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=246352 CPUtime=5.89 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 5542 1251 0 0 588 1 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=246352 CPUtime=5.9 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 6895 1251 0 0 589 1 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4366391 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=246352 CPUtime=5.89 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 3257 1251 0 0 589 0 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4251063 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=246352 CPUtime=5.89 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 5293 1251 0 0 589 0 0 0 25 0 9 0 452166120 252264448 22828 33554432000 4194304 4417452 140733321698880 18446744073709551615 4265443 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 47.4
Current children cumulated vsize (KiB) 246352

[startup+12.7009 s]
/proc/loadavg: 8.26 8.12 8.02 10/491 3359
/proc/meminfo: memFree=16831644/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=275340 CPUtime=98.25 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 111287 1251 0 0 9804 21 0 0 19 0 9 0 452166081 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 68835 30047 180 55 0 66721 0
[pid=3343/tid=3351] ppid=3341 vsize=275340 CPUtime=12.3 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 10362 1251 0 0 1229 1 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=275340 CPUtime=11.95 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 9048 1251 0 0 1194 1 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=275340 CPUtime=12.3 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 8143 1251 0 0 1229 1 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=275340 CPUtime=12.31 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 22973 1251 0 0 1227 4 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=275340 CPUtime=12.04 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 12565 1251 0 0 1202 2 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=275340 CPUtime=12.3 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 12019 1251 0 0 1228 2 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4353572 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=275340 CPUtime=12.3 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 9351 1251 0 0 1228 2 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=275340 CPUtime=12.3 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 9800 1251 0 0 1228 2 0 0 25 0 9 0 452166120 281948160 30047 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 98.25
Current children cumulated vsize (KiB) 275340

[startup+25.5006 s]
/proc/loadavg: 8.34 8.14 8.03 9/490 3359
/proc/meminfo: memFree=16799328/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=310932 CPUtime=200 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 181300 1251 0 0 19964 36 0 0 19 0 9 0 452166081 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 77733 38945 180 55 0 75619 0
[pid=3343/tid=3351] ppid=3341 vsize=310932 CPUtime=24.72 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 17162 1251 0 0 2470 2 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=310932 CPUtime=24.53 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 14371 1251 0 0 2451 2 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=310932 CPUtime=25.09 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 11553 1251 0 0 2507 2 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=310932 CPUtime=25.1 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 32376 1251 0 0 2504 6 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=310932 CPUtime=24.81 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 29428 1251 0 0 2476 5 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=310932 CPUtime=25.1 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 18751 1251 0 0 2506 4 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=310932 CPUtime=25.09 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 20692 1251 0 0 2504 5 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=310932 CPUtime=25.09 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 19941 1251 0 0 2505 4 0 0 25 0 9 0 452166120 318394368 38945 33554432000 4194304 4417452 140733321698880 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 200
Current children cumulated vsize (KiB) 310932

[startup+51.1011 s]
/proc/loadavg: 8.22 8.13 8.03 9/490 3360
/proc/meminfo: memFree=16666240/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=448540 CPUtime=404.39 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 253926 1251 0 0 40387 52 0 0 19 0 9 0 452166081 459304960 73347 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 112135 73347 180 55 0 110021 0
[pid=3343/tid=3351] ppid=3341 vsize=448540 CPUtime=50.33 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 25644 1251 0 0 5028 5 0 0 25 0 9 0 452166120 459304960 73347 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=448540 CPUtime=49.72 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 21073 1251 0 0 4969 3 0 0 25 0 9 0 452166120 459304960 73347 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=448540 CPUtime=50.69 cores=0-7

################
# More data... #
################

/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 510783 1251 0 0 411222 111 0 0 25 0 9 0 452166120 3982561280 933984 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=3889220 CPUtime=4180.91 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 324483 1251 0 0 418017 74 0 0 25 0 9 0 452166120 3982561280 933984 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=3889220 CPUtime=4182 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 605990 1251 0 0 418046 154 0 0 25 0 9 0 452166120 3982561280 933984 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=3889220 CPUtime=4181.7 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 665804 1251 0 0 418044 126 0 0 25 0 9 0 452166120 3982561280 933984 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=3889220 CPUtime=4181.86 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 636093 1251 0 0 418048 138 0 0 25 0 9 0 452166120 3982561280 933984 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=3889220 CPUtime=4182.01 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 622308 1251 0 0 418088 113 0 0 25 0 9 0 452166120 3982561280 933984 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=3889220 CPUtime=4182 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 403095 1251 0 0 418109 91 0 0 25 0 9 0 452166120 3982561280 933984 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 33385.1
Current children cumulated vsize (KiB) 3889220

[startup+4242.3 s]
/proc/loadavg: 8.08 8.10 8.04 9/490 3504
/proc/meminfo: memFree=13075924/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=4028344 CPUtime=33864 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4556728 1251 0 0 3385446 956 0 0 19 0 9 0 452166081 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 1007086 968765 180 55 0 1004972 0
[pid=3343/tid=3351] ppid=3341 vsize=4028344 CPUtime=4240.85 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 687337 1251 0 0 423954 131 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=4028344 CPUtime=4172.34 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 510783 1251 0 0 417123 111 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=4028344 CPUtime=4240.88 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 324483 1251 0 0 424014 74 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=4028344 CPUtime=4241.98 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 605990 1251 0 0 424044 154 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=4028344 CPUtime=4241.69 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 665804 1251 0 0 424043 126 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364903 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=4028344 CPUtime=4241.84 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 703518 1251 0 0 424036 148 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=4028344 CPUtime=4242 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 424085 115 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=4028344 CPUtime=4241.98 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 403095 1251 0 0 424107 91 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 33864
Current children cumulated vsize (KiB) 4028344

[startup+4302.3 s]
/proc/loadavg: 8.06 8.09 8.04 9/490 3505
/proc/meminfo: memFree=13075884/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=4028344 CPUtime=34343 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4556728 1251 0 0 3433346 956 0 0 19 0 9 0 452166081 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 1007086 968765 180 55 0 1004972 0
[pid=3343/tid=3351] ppid=3341 vsize=4028344 CPUtime=4300.85 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 687337 1251 0 0 429954 131 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=4028344 CPUtime=4231.35 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 510783 1251 0 0 423024 111 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=4028344 CPUtime=4300.86 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 324483 1251 0 0 430012 74 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=4028344 CPUtime=4301.98 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 605990 1251 0 0 430044 154 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=4028344 CPUtime=4301.69 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 665804 1251 0 0 430043 126 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=4028344 CPUtime=4301.84 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 703518 1251 0 0 430036 148 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=4028344 CPUtime=4302 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 430085 115 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=4028344 CPUtime=4301.98 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 403095 1251 0 0 430107 91 0 0 25 0 9 0 452166120 4125024256 968765 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 34343
Current children cumulated vsize (KiB) 4028344

[startup+4362.3 s]
/proc/loadavg: 8.06 8.09 8.04 9/490 3507
/proc/meminfo: memFree=13023272/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=4080840 CPUtime=34822 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4569852 1251 0 0 3481246 957 0 0 19 0 9 0 452166081 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 1020210 981889 180 55 0 1018096 0
[pid=3343/tid=3351] ppid=3341 vsize=4080840 CPUtime=4360.85 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 687337 1251 0 0 435954 131 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=4080840 CPUtime=4290.38 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 510783 1251 0 0 428927 111 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=4080840 CPUtime=4360.85 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 324483 1251 0 0 436011 74 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=4080840 CPUtime=4361.98 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 605990 1251 0 0 436044 154 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=4080840 CPUtime=4361.69 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 665804 1251 0 0 436043 126 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=4080840 CPUtime=4361.84 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 703518 1251 0 0 436036 148 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=4080840 CPUtime=4362 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 436085 115 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=4080840 CPUtime=4361.99 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 416219 1251 0 0 436106 93 0 0 25 0 9 0 452166120 4178780160 981889 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 34822
Current children cumulated vsize (KiB) 4080840

[startup+4422.3 s]
/proc/loadavg: 8.19 8.11 8.05 9/490 3509
/proc/meminfo: memFree=12958012/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=4146376 CPUtime=35301.1 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4586236 1251 0 0 3529142 963 0 0 19 0 9 0 452166081 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 1036594 998273 180 55 0 1034480 0
[pid=3343/tid=3351] ppid=3341 vsize=4146376 CPUtime=4420.85 cores=0-7
/proc/3343/task/3351/stat : 3351 (plingeling) R 3341 3343 3316 0 -1 4202560 687337 1251 0 0 441954 131 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3343/tid=3352] ppid=3341 vsize=4146376 CPUtime=4349.4 cores=0-7
/proc/3343/task/3352/stat : 3352 (plingeling) R 3341 3343 3316 0 -1 4202560 510783 1251 0 0 434829 111 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3343/tid=3353] ppid=3341 vsize=4146376 CPUtime=4420.84 cores=0-7
/proc/3343/task/3353/stat : 3353 (plingeling) R 3341 3343 3316 0 -1 4202560 324483 1251 0 0 442010 74 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3343/tid=3354] ppid=3341 vsize=4146376 CPUtime=4421.98 cores=0-7
/proc/3343/task/3354/stat : 3354 (plingeling) R 3341 3343 3316 0 -1 4202560 605990 1251 0 0 442044 154 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3343/tid=3355] ppid=3341 vsize=4146376 CPUtime=4421.7 cores=0-7
/proc/3343/task/3355/stat : 3355 (plingeling) R 3341 3343 3316 0 -1 4202560 682188 1251 0 0 442038 132 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3343/tid=3356] ppid=3341 vsize=4146376 CPUtime=4421.84 cores=0-7
/proc/3343/task/3356/stat : 3356 (plingeling) R 3341 3343 3316 0 -1 4202560 703518 1251 0 0 442036 148 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3343/tid=3357] ppid=3341 vsize=4146376 CPUtime=4422 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 442085 115 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3343/tid=3358] ppid=3341 vsize=4146376 CPUtime=4421.99 cores=0-7
/proc/3343/task/3358/stat : 3358 (plingeling) R 3341 3343 3316 0 -1 4202560 416219 1251 0 0 442106 93 0 0 25 0 9 0 452166120 4245889024 998273 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 35301.1
Current children cumulated vsize (KiB) 4146376

[startup+4482.3 s]
/proc/loadavg: 7.67 8.01 8.02 2/483 3510
/proc/meminfo: memFree=13165116/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=3908468 CPUtime=35722.3 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4659052 1251 0 0 3571254 980 0 0 18 0 2 0 452166081 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 977117 946442 181 55 0 975003 0
[pid=3343/tid=3357] ppid=3341 vsize=3908468 CPUtime=4482 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 448085 115 0 0 25 0 2 0 452166120 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 35722.3
Current children cumulated vsize (KiB) 3908468

Solver just ended. Dumping a history of the last processes samples

[startup+4483.2 s]
/proc/loadavg: 7.14 7.89 7.98 2/483 3510
/proc/meminfo: memFree=13165236/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=3908468 CPUtime=35723.2 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4659052 1251 0 0 3571344 980 0 0 18 0 2 0 452166081 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 977117 946442 181 55 0 975003 0
[pid=3343/tid=3357] ppid=3341 vsize=3908468 CPUtime=4482.9 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 448175 115 0 0 25 0 2 0 452166120 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 35723.2
Current children cumulated vsize (KiB) 3908468

[startup+4484 s]
/proc/loadavg: 7.14 7.89 7.98 2/483 3510
/proc/meminfo: memFree=13165236/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=3908468 CPUtime=35724 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4659052 1251 0 0 3571424 980 0 0 18 0 2 0 452166081 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 977117 946442 181 55 0 975003 0
[pid=3343/tid=3357] ppid=3341 vsize=3908468 CPUtime=4483.7 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 448255 115 0 0 25 0 2 0 452166120 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 35724
Current children cumulated vsize (KiB) 3908468

[startup+4484.82 s]
/proc/loadavg: 7.14 7.89 7.98 2/483 3510
/proc/meminfo: memFree=13165236/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=3908468 CPUtime=35724.9 cores=0-7
/proc/3343/stat : 3343 (plingeling) S 3341 3343 3316 0 -1 4202496 4659052 1251 0 0 3571505 980 0 0 18 0 2 0 452166081 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/3343/statm: 977117 946442 181 55 0 975003 0
[pid=3343/tid=3357] ppid=3341 vsize=3908468 CPUtime=4484.52 cores=0-7
/proc/3343/task/3357/stat : 3357 (plingeling) R 3341 3343 3316 0 -1 4202560 638692 1251 0 0 448337 115 0 0 25 0 2 0 452166120 4002271232 946442 33554432000 4194304 4417452 140733321698880 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 35724.9
Current children cumulated vsize (KiB) 3908468

[startup+4485 s]
/proc/loadavg: 7.14 7.89 7.98 2/483 3510
/proc/meminfo: memFree=13165236/32951124 swapFree=46575304/67111528
[pid=3343] ppid=3341 vsize=605740 CPUtime=35725 cores=0-7
/proc/3343/stat : 3343 (plingeling) R 3341 3343 3316 0 -1 4202496 4659052 1251 0 0 3571512 991 0 0 18 0 1 0 452166081 620277760 125463 33554432000 4194304 4417452 140733321698880 18446744073709551615 268660705415 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3343/statm: 151435 125045 181 55 0 149321 0
Current children cumulated CPU time (s) 35725
Current children cumulated vsize (KiB) 605740

Child status: 10
Real time (s): 4485.02
CPU time (s): 35725.1
CPU user time (s): 35715.1
CPU system time (s): 9.93949
CPU usage (%): 796.542
Max. virtual memory (cumulated for all children) (KiB): 4146376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 35715.1
system time used= 9.93949
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4660317
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 212
involuntary context switches= 173955

runsolver used 19.965 second user time and 53.4419 second system time

The end

Launcher Data

Begin job on node107 at 2011-05-22 17:55:48
IDJOB=3394036
IDBENCH=71153
IDSOLVER=1851
FILE ID=node107/3394036-1306079748
RUNJOBID= node107-1306079748-3330
PBS_JOBID= 13387913
Free space on /tmp= 73188 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/modcircuits/mod3block_2vars_11gates_u2_autoenc.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394036-1306079748/watcher-3394036-1306079748 -o /tmp/evaluation-result-3394036-1306079748/solver-3394036-1306079748 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394036-1306079748.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 36c3169a5cad0483dd15befcefc4323e
RANDOM SEED=736495322

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16958424 kB
Buffers:        296700 kB
Cached:        6685980 kB
SwapCached:       9840 kB
Active:       11695448 kB
Inactive:      3975020 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16958424 kB
SwapTotal:    67111528 kB
SwapFree:     46575304 kB
Dirty:            4312 kB
Writeback:           0 kB
AnonPages:     8686020 kB
Mapped:          31828 kB
Slab:           156780 kB
PageTables:      94764 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145076184 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73188 MiB
End job on node107 at 2011-05-22 19:10:33