Trace number 3371335

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)SAT 2559.08 641.703

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_1_keyfind_1.cnf
MD5SUM9e18e0ee8a56ea2c59fe8e682ff6c747
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark32.783
Satisfiable
(Un)Satisfiability was proved
Number of variables596
Number of clauses2780
Sum of the clauses size10460
Maximum clause length5
Minimum clause length1
Number of clauses of size 1132
Number of clauses of size 280
Number of clauses of size 31168
Number of clauses of size 4336
Number of clauses of size 51064
Number of clauses of size over 50

Solver Data 

2558.96/641.70	s SATISFIABLE
2558.96/641.70	v -1 2 -3 4 5 6 7
2558.96/641.70	v 8 9 10 11 12 13 14 -15
2558.96/641.70	v -16 17 -18 19 20 21 -22 -23
2558.96/641.70	v 24 -25 -26 -27 -28 -29 30 31
2558.96/641.70	v 32 33 34 -35 -36 37 -38 39
2558.96/641.70	v 40 -41 -42 -43 -44 45 46 -47
2558.96/641.70	v 48 49 -50 -51 -52 -53 54 -55
2558.96/641.70	v 56 -57 -58 -59 60 61 62 -63
2558.96/641.70	v -64 -65 66 67 -68 69 70 71
2558.96/641.70	v -72 73 -74 75 76 77 78 -79
2558.96/641.70	v 80 81 -82 -83 84 -85 86 -87
2558.96/641.70	v 88 89 90 -91 -92 93 94 95
2558.96/641.70	v -96 -97 -98 99 -100 -101 -102 103
2558.96/641.70	v -104 105 -106 107 -108 -109 -110 111
2558.96/641.70	v -112 -113 114 -115 -116 -117 118 -119
2558.96/641.70	v -120 121 122 -123 -124 -125 126 -127
2558.96/641.70	v -128 129 130 131 -132 -133 134 -135
2558.96/641.70	v -136 137 -138 139 140 141 142 143
2558.96/641.70	v -144 145 -146 -147 -148 149 150 -151
2558.96/641.70	v -152 -153 -154 -155 156 -157 158 159
2558.96/641.70	v 160 161 162 163 164 -165 166 -167
2558.96/641.70	v -168 -169 170 -171 -172 -173 -174 175
2558.96/641.70	v 176 177 -178 -179 180 -181 182 -183
2558.96/641.70	v 184 -185 186 187 -188 189 -190 -191
2558.96/641.70	v 192 -193 -194 195 196 -197 -198 -199
2558.96/641.70	v 200 -201 202 -203 -204 -205 -206 -207
2558.96/641.70	v 208 -209 -210 211 -212 213 214 -215
2558.96/641.70	v -216 217 218 -219 -220 221 -222 -223
2558.96/641.70	v 224 225 226 227 -228 229 -230 -231
2558.96/641.70	v 232 233 -234 235 -236 237 238 239
2559.07/641.70	v 240 241 242 -243 -244 -245 -246 -247
2559.07/641.70	v 248 249 250 -251 252 253 -254 -255
2559.07/641.70	v -256 -257 258 -259 260 261 262 -263
2559.07/641.70	v 264 265 -266 -267 268 269 270 271
2559.07/641.70	v 272 273 274 -275 -276 277 -278 -279
2559.07/641.70	v -280 -281 282 -283 284 -285 -286 -287
2559.07/641.70	v 288 289 290 291 -292 293 -294 295
2559.07/641.70	v -296 297 298 299 300 -301 -302 303
2559.07/641.70	v 304 305 -306 307 -308 309 310 311
2559.07/641.70	v -312 -313 -314 315 316 -317 318 319
2559.07/641.70	v 320 321 -322 323 324 325 -326 -327
2559.07/641.70	v 328 -329 -330 331 -332 -333 -334 -335
2559.07/641.70	v 336 -337 338 -339 -340 -341 342 -343
2559.07/641.70	v -344 -345 346 -347 -348 -349 350 351
2559.07/641.70	v -352 -353 -354 -355 356 357 358 359
2559.07/641.70	v -360 361 -362 363 364 -365 -366 -367
2559.07/641.70	v -368 -369 -370 371 372 373 -374 375
2559.07/641.70	v 376 -377 378 -379 380 381 382 383
2559.07/641.70	v -384 -385 386 -387 -388 -389 -390 391
2559.07/641.70	v 392 393 394 395 396 397 -398 -399
2559.07/641.70	v 400 -401 402 -403 404 405 406 -407
2559.07/641.70	v 408 -409 -410 -411 412 413 -414 415
2559.07/641.70	v 416 -417 -418 -419 -420 421 -422 423
2559.07/641.70	v 424 -425 -426 427 -428 429 430 -431
2559.07/641.70	v 432 -433 -434 435 436 437 -438 439
2559.07/641.70	v 440 -441 -442 443 444 445 -446 -447
2559.07/641.70	v -448 -449 -450 -451 452 453 454 -455
2559.07/641.70	v -456 457 -458 -459 -460 461 462 -463
2559.07/641.70	v 464 -465 -466 467 -468 -469 470 471
2559.07/641.70	v -472 -473 474 -475 476 477 -478 -479
2559.07/641.70	v -480 -481 482 -483 484 485 486 487
2559.07/641.70	v 488 489 490 491 -492 -493 -494 495
2559.07/641.70	v -496 -497 -498 499 500 501 -502 -503
2559.07/641.70	v 504 -505 506 -507 -508 509 -510 511
2559.07/641.70	v -512 513 -514 -515 516 -517 -518 -519
2559.07/641.70	v -520 -521 522 -523 -524 -525 526 -527
2559.07/641.70	v -528 -529 530 531 -532 -533 534 -535
2559.07/641.70	v 536 537 538 539 -540 -541 -542 -543
2559.07/641.70	v -544 -545 -546 547 548 -549 550 -551
2559.07/641.70	v 552 553 -554 555 556 -557 558 559
2559.07/641.70	v -560 -561 562 -563 564 -565 566 -567
2559.07/641.70	v 568 569 570 571 -572 -573 574 575
2559.07/641.70	v -576 -577 -578 -579 580 -581 -582 583
2559.07/641.70	v -584 -585 -586 587 588 -589 -590 591
2559.07/641.70	v -592 -593 -594 595 -596
2559.07/641.70	v 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371335-1305429138/watcher-3371335-1305429138 -o /tmp/evaluation-result-3371335-1305429138/solver-3371335-1305429138 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371335-1305429138.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.40 5.28 6.92 1/346 18996
/proc/meminfo: memFree=17750436/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=50840 CPUtime=0 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 565 1252 0 0 0 0 0 0 24 0 5 0 733144445 52060160 491 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 12710 491 168 55 0 10596 0
[pid=18996/tid=19004] ppid=18994 vsize=50808 CPUtime=0 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 18 1252 0 0 0 0 0 0 18 0 5 0 733144446 52027392 497 33554432000 4194304 4417452 140734339841088 18446744073709551615 4299536 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=50808 CPUtime=0 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 0 1252 0 0 0 0 0 0 25 0 5 0 733144446 52027392 497 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427189302 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=50808 CPUtime=0 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 1 1252 0 0 0 0 0 0 25 0 5 0 733144446 52027392 497 33554432000 4194304 4417452 140734339841088 18446744073709551615 256415417450 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=50808 CPUtime=0 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 4 1252 0 0 0 0 0 0 25 0 5 0 733144446 52027392 497 33554432000 4194304 4417452 140734339841088 18446744073709551615 4365181 0 0 4096 17442 0 0 0 -1 0 0 0 0

[startup+0.137936 s]
/proc/loadavg: 3.40 5.28 6.92 1/346 18996
/proc/meminfo: memFree=17750436/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=118216 CPUtime=0.5 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 1164 1252 0 0 50 0 0 0 24 0 5 0 733144445 121053184 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 29554 989 180 55 0 27440 0
[pid=18996/tid=19004] ppid=18994 vsize=118216 CPUtime=0.12 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 157 1252 0 0 12 0 0 0 18 0 5 0 733144446 121053184 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=118216 CPUtime=0.12 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 136 1252 0 0 12 0 0 0 25 0 5 0 733144446 121053184 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 18446744073699066098 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=118216 CPUtime=0.12 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 216 1252 0 0 12 0 0 0 25 0 5 0 733144446 121053184 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 4365078 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=118216 CPUtime=0.12 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 107 1252 0 0 12 0 0 0 25 0 5 0 733144446 121053184 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 118216

[startup+0.200924 s]
/proc/loadavg: 3.40 5.28 6.92 1/346 18996
/proc/meminfo: memFree=17750436/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=118188 CPUtime=0.75 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 1374 1252 0 0 75 0 0 0 24 0 5 0 733144445 121024512 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 29547 989 180 55 0 27433 0
[pid=18996/tid=19004] ppid=18994 vsize=118188 CPUtime=0.19 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 199 1252 0 0 19 0 0 0 18 0 5 0 733144446 121024512 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 4252102 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=118188 CPUtime=0.18 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 196 1252 0 0 18 0 0 0 25 0 5 0 733144446 121024512 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 4354037 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=118188 CPUtime=0.18 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 264 1252 0 0 18 0 0 0 25 0 5 0 733144446 121024512 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=118188 CPUtime=0.19 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 167 1252 0 0 19 0 0 0 25 0 5 0 733144446 121024512 989 33554432000 4194304 4417452 140734339841088 18446744073709551615 4353572 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 118188

[startup+0.300906 s]
/proc/loadavg: 3.40 5.28 6.92 1/346 18996
/proc/meminfo: memFree=17750436/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=118988 CPUtime=1.15 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 1863 1252 0 0 115 0 0 0 24 0 5 0 733144445 121843712 1192 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 29747 1192 180 55 0 27633 0
[pid=18996/tid=19004] ppid=18994 vsize=118988 CPUtime=0.29 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 237 1252 0 0 29 0 0 0 18 0 5 0 733144446 121843712 1192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=118988 CPUtime=0.28 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 272 1252 0 0 28 0 0 0 25 0 5 0 733144446 121843712 1192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4357902 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=118988 CPUtime=0.28 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 428 1252 0 0 28 0 0 0 25 0 5 0 733144446 121843712 1192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4251104 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=118988 CPUtime=0.28 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 378 1252 0 0 28 0 0 0 25 0 5 0 733144446 121843712 1192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364684 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 118988

[startup+0.70083 s]
/proc/loadavg: 3.40 5.28 6.92 1/346 18996
/proc/meminfo: memFree=17750436/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=120684 CPUtime=2.76 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 3862 1252 0 0 275 1 0 0 24 0 5 0 733144445 123580416 1617 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 30171 1617 180 55 0 28057 0
[pid=18996/tid=19004] ppid=18994 vsize=120684 CPUtime=0.69 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 594 1252 0 0 69 0 0 0 18 0 5 0 733144446 123580416 1617 33554432000 4194304 4417452 140734339841088 18446744073709551615 4251071 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=120684 CPUtime=0.68 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 977 1252 0 0 68 0 0 0 25 0 5 0 733144446 123580416 1617 33554432000 4194304 4417452 140734339841088 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=120684 CPUtime=0.68 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 906 1252 0 0 68 0 0 0 25 0 5 0 733144446 123580416 1617 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=120684 CPUtime=0.68 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 837 1252 0 0 68 0 0 0 25 0 5 0 733144446 123580416 1617 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 120684

[startup+1.50068 s]
/proc/loadavg: 3.40 5.28 6.92 9/360 19023
/proc/meminfo: memFree=17729996/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=122912 CPUtime=5.94 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 6937 1252 0 0 593 1 0 0 24 0 5 0 733144445 125861888 2175 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 30728 2175 180 55 0 28614 0
[pid=18996/tid=19004] ppid=18994 vsize=122912 CPUtime=1.49 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 1340 1252 0 0 149 0 0 0 20 0 5 0 733144446 125861888 2175 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=122912 CPUtime=1.47 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 1721 1252 0 0 147 0 0 0 25 0 5 0 733144446 125861888 2175 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364597 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=122912 CPUtime=1.48 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 1912 1252 0 0 148 0 0 0 25 0 5 0 733144446 125861888 2175 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=122912 CPUtime=1.48 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 1416 1252 0 0 148 0 0 0 25 0 5 0 733144446 125861888 2175 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 122912

[startup+3.10038 s]
/proc/loadavg: 3.40 5.28 6.92 9/360 19023
/proc/meminfo: memFree=17723672/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=125824 CPUtime=12.33 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 12108 1252 0 0 1231 2 0 0 24 0 5 0 733144445 128843776 2892 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 31456 2892 180 55 0 29342 0
[pid=18996/tid=19004] ppid=18994 vsize=125824 CPUtime=3.08 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 2400 1252 0 0 308 0 0 0 25 0 5 0 733144446 128843776 2892 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=125824 CPUtime=3.05 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 3291 1252 0 0 305 0 0 0 25 0 5 0 733144446 128843776 2892 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=125824 CPUtime=3.07 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 3181 1252 0 0 307 0 0 0 25 0 5 0 733144446 128843776 2892 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=125824 CPUtime=3.08 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 2688 1252 0 0 308 0 0 0 25 0 5 0 733144446 128843776 2892 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 125824

[startup+6.30078 s]
/proc/loadavg: 3.77 5.33 6.92 10/360 19023
/proc/meminfo: memFree=17715880/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=131768 CPUtime=25.09 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 20968 1252 0 0 2506 3 0 0 24 0 5 0 733144445 134930432 4382 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 32942 4382 180 55 0 30828 0
[pid=18996/tid=19004] ppid=18994 vsize=131768 CPUtime=6.28 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 4897 1252 0 0 628 0 0 0 25 0 5 0 733144446 134930432 4382 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=131768 CPUtime=6.21 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 5701 1252 0 0 621 0 0 0 25 0 5 0 733144446 134930432 4382 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=131768 CPUtime=6.27 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 5124 1252 0 0 627 0 0 0 25 0 5 0 733144446 134930432 4382 33554432000 4194304 4417452 140734339841088 18446744073709551615 4253152 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=131768 CPUtime=6.28 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 4698 1252 0 0 628 0 0 0 25 0 5 0 733144446 134930432 4382 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.09
Current children cumulated vsize (KiB) 131768

[startup+12.7006 s]
/proc/loadavg: 4.11 5.37 6.93 9/360 19024
/proc/meminfo: memFree=17698416/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=134960 CPUtime=50.63 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 36366 1252 0 0 5056 7 0 0 24 0 5 0 733144445 138199040 5192 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 33740 5192 180 55 0 31626 0
[pid=18996/tid=19004] ppid=18994 vsize=134960 CPUtime=12.68 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 8588 1252 0 0 1267 1 0 0 25 0 5 0 733144446 138199040 5192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=134960 CPUtime=12.54 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 9076 1252 0 0 1253 1 0 0 25 0 5 0 733144446 138199040 5192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4244288 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=134960 CPUtime=12.68 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 9406 1252 0 0 1267 1 0 0 25 0 5 0 733144446 138199040 5192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=134960 CPUtime=12.68 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 8748 1252 0 0 1267 1 0 0 25 0 5 0 733144446 138199040 5192 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.63
Current children cumulated vsize (KiB) 134960

[startup+25.5012 s]
/proc/loadavg: 4.97 5.50 6.95 10/360 19024
/proc/meminfo: memFree=17679460/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=147292 CPUtime=101.68 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 63594 1252 0 0 10157 11 0 0 24 0 5 0 733144445 150827008 8275 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 36823 8275 180 55 0 34709 0
[pid=18996/tid=19004] ppid=18994 vsize=147292 CPUtime=25.49 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 15878 1252 0 0 2546 3 0 0 25 0 5 0 733144446 150827008 8275 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=147292 CPUtime=25.2 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 16385 1252 0 0 2518 2 0 0 25 0 5 0 733144446 150827008 8275 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=147292 CPUtime=25.47 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 15107 1252 0 0 2545 2 0 0 25 0 5 0 733144446 150827008 8275 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=147292 CPUtime=25.49 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 15676 1252 0 0 2547 2 0 0 25 0 5 0 733144446 150827008 8275 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.68
Current children cumulated vsize (KiB) 147292

[startup+51.1013 s]
/proc/loadavg: 6.13 5.73 6.98 9/360 19025
/proc/meminfo: memFree=17659600/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=155796 CPUtime=203.8 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 102144 1252 0 0 20364 16 0 0 24 0 5 0 733144445 159535104 10369 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 38949 10369 180 55 0 36835 0
[pid=18996/tid=19004] ppid=18994 vsize=155796 CPUtime=51.09 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 24541 1252 0 0 5105 4 0 0 25 0 5 0 733144446 159535104 10369 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=155796 CPUtime=50.53 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 26898 1252 0 0 5049 4 0 0 25 0 5 0 733144446 159535104 10369 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=155796 CPUtime=51.07 cores=0,2,4,6

################
# More data... #
################

/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 514061 1252 0 0 208263 73 0 0 24 0 5 0 733144445 218468352 24757 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 53337 24757 180 55 0 51223 0
[pid=18996/tid=19004] ppid=18994 vsize=213348 CPUtime=522.3 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 118659 1252 0 0 52212 18 0 0 25 0 5 0 733144446 218468352 24757 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=213348 CPUtime=516.52 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 139980 1252 0 0 51635 17 0 0 25 0 5 0 733144446 218468352 24757 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=213348 CPUtime=522.2 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 105397 1252 0 0 52205 15 0 0 25 0 5 0 733144446 218468352 24757 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=213348 CPUtime=522.3 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 149477 1252 0 0 52209 21 0 0 25 0 5 0 733144446 218468352 24757 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2083.36
Current children cumulated vsize (KiB) 213348

[startup+582.301 s]
/proc/loadavg: 8.04 7.67 7.44 9/360 19041
/proc/meminfo: memFree=17456940/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=232188 CPUtime=2322.68 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 552033 1252 0 0 232189 79 0 0 24 0 5 0 733144445 237760512 29467 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 58047 29467 180 55 0 55933 0
[pid=18996/tid=19004] ppid=18994 vsize=232188 CPUtime=582.31 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 126659 1252 0 0 58212 19 0 0 25 0 5 0 733144446 237760512 29467 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=232188 CPUtime=575.85 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 150341 1252 0 0 57566 19 0 0 25 0 5 0 733144446 237760512 29467 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=232188 CPUtime=582.19 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 113832 1252 0 0 58203 16 0 0 25 0 5 0 733144446 237760512 29467 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=232188 CPUtime=582.3 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 160653 1252 0 0 58207 23 0 0 25 0 5 0 733144446 237760512 29467 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2322.68
Current children cumulated vsize (KiB) 232188

Solver just ended. Dumping a history of the last processes samples

[startup+614.401 s]
/proc/loadavg: 8.14 7.73 7.47 10/360 19043
/proc/meminfo: memFree=17446256/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=234184 CPUtime=2450.71 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 565445 1252 0 0 244990 81 0 0 24 0 5 0 733144445 239804416 29976 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 58546 29976 180 55 0 56432 0
[pid=18996/tid=19004] ppid=18994 vsize=234184 CPUtime=614.4 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 129215 1252 0 0 61421 19 0 0 25 0 5 0 733144446 239804416 29976 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=234184 CPUtime=607.59 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 154747 1252 0 0 60739 20 0 0 25 0 5 0 733144446 239804416 29976 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=234184 CPUtime=614.29 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 116081 1252 0 0 61412 17 0 0 25 0 5 0 733144446 239804416 29976 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=234184 CPUtime=614.41 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 164854 1252 0 0 61417 24 0 0 25 0 5 0 733144446 239804416 29976 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364903 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2450.71
Current children cumulated vsize (KiB) 234184

[startup+627.201 s]
/proc/loadavg: 8.12 7.74 7.48 9/360 19043
/proc/meminfo: memFree=17500436/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=225960 CPUtime=2501.76 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 575001 1252 0 0 250093 83 0 0 24 0 5 0 733144445 231383040 27933 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 56490 27933 180 55 0 54376 0
[pid=18996/tid=19004] ppid=18994 vsize=225960 CPUtime=627.21 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 130873 1252 0 0 62701 20 0 0 25 0 5 0 733144446 231383040 27933 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=225960 CPUtime=620.23 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 156192 1252 0 0 62003 20 0 0 25 0 5 0 733144446 231383040 27933 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=225960 CPUtime=627.08 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 117380 1252 0 0 62691 17 0 0 25 0 5 0 733144446 231383040 27933 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=225960 CPUtime=627.2 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 170008 1252 0 0 62696 24 0 0 25 0 5 0 733144446 231383040 27933 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2501.76
Current children cumulated vsize (KiB) 225960

[startup+633.6 s]
/proc/loadavg: 8.10 7.75 7.48 9/360 19043
/proc/meminfo: memFree=17465956/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=231084 CPUtime=2527.33 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 576282 1252 0 0 252650 83 0 0 24 0 5 0 733144445 236630016 29214 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 57771 29214 180 55 0 55657 0
[pid=18996/tid=19004] ppid=18994 vsize=231084 CPUtime=633.62 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 130873 1252 0 0 63342 20 0 0 25 0 5 0 733144446 236630016 29214 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366090 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=231084 CPUtime=626.57 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 156192 1252 0 0 62637 20 0 0 25 0 5 0 733144446 236630016 29214 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=231084 CPUtime=633.49 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 118373 1252 0 0 63332 17 0 0 25 0 5 0 733144446 236630016 29214 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=231084 CPUtime=633.61 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 170296 1252 0 0 63337 24 0 0 25 0 5 0 733144446 236630016 29214 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2527.33
Current children cumulated vsize (KiB) 231084

[startup+636.801 s]
/proc/loadavg: 8.10 7.75 7.48 9/360 19043
/proc/meminfo: memFree=17450580/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=241804 CPUtime=2540.06 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 578962 1252 0 0 253923 83 0 0 24 0 5 0 733144445 247607296 31894 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 60451 31894 180 55 0 58337 0
[pid=18996/tid=19004] ppid=18994 vsize=241804 CPUtime=636.81 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 131779 1252 0 0 63661 20 0 0 25 0 5 0 733144446 247607296 31894 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=241804 CPUtime=629.73 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 156192 1252 0 0 62953 20 0 0 25 0 5 0 733144446 247607296 31894 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=241804 CPUtime=636.68 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 118373 1252 0 0 63651 17 0 0 25 0 5 0 733144446 247607296 31894 33554432000 4194304 4417452 140734339841088 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=241804 CPUtime=636.8 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 172070 1252 0 0 63656 24 0 0 25 0 5 0 733144446 247607296 31894 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2540.06
Current children cumulated vsize (KiB) 241804

[startup+640.001 s]
/proc/loadavg: 8.09 7.75 7.49 10/360 19043
/proc/meminfo: memFree=17467816/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=247824 CPUtime=2552.82 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 580467 1252 0 0 255199 83 0 0 24 0 5 0 733144445 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 61956 33399 180 55 0 59842 0
[pid=18996/tid=19004] ppid=18994 vsize=247824 CPUtime=640.01 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 131779 1252 0 0 63981 20 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=247824 CPUtime=632.89 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 157697 1252 0 0 63269 20 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=247824 CPUtime=639.88 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 118373 1252 0 0 63971 17 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=247824 CPUtime=640 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 172070 1252 0 0 63976 24 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2552.82
Current children cumulated vsize (KiB) 247824

[startup+640.801 s]
/proc/loadavg: 8.09 7.75 7.49 10/360 19043
/proc/meminfo: memFree=17448844/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=247824 CPUtime=2556 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 580467 1252 0 0 255517 83 0 0 24 0 5 0 733144445 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 61956 33399 180 55 0 59842 0
[pid=18996/tid=19004] ppid=18994 vsize=247824 CPUtime=640.81 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 131779 1252 0 0 64061 20 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=247824 CPUtime=633.68 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 157697 1252 0 0 63348 20 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=247824 CPUtime=640.68 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 118373 1252 0 0 64051 17 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=247824 CPUtime=640.8 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 172070 1252 0 0 64056 24 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2556
Current children cumulated vsize (KiB) 247824

[startup+641.201 s]
/proc/loadavg: 8.09 7.75 7.49 10/360 19043
/proc/meminfo: memFree=17448844/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=247824 CPUtime=2557.6 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 580467 1252 0 0 255677 83 0 0 24 0 5 0 733144445 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 61956 33399 180 55 0 59842 0
[pid=18996/tid=19004] ppid=18994 vsize=247824 CPUtime=641.21 cores=0,2,4,6
/proc/18996/task/19004/stat : 19004 (plingeling) R 18994 18996 10053 0 -1 4202560 131779 1252 0 0 64101 20 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18996/tid=19005] ppid=18994 vsize=247824 CPUtime=634.08 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 157697 1252 0 0 63388 20 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18996/tid=19006] ppid=18994 vsize=247824 CPUtime=641.08 cores=0,2,4,6
/proc/18996/task/19006/stat : 19006 (plingeling) R 18994 18996 10053 0 -1 4202560 118373 1252 0 0 64091 17 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4366087 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18996/tid=19007] ppid=18994 vsize=247824 CPUtime=641.2 cores=0,2,4,6
/proc/18996/task/19007/stat : 19007 (plingeling) R 18994 18996 10053 0 -1 4202560 172070 1252 0 0 64096 24 0 0 25 0 5 0 733144446 253771776 33399 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2557.6
Current children cumulated vsize (KiB) 247824

[startup+641.601 s]
/proc/loadavg: 8.09 7.75 7.49 10/360 19043
/proc/meminfo: memFree=17446860/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=247824 CPUtime=2558.96 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) S 18994 18996 10053 0 -1 4202496 580468 1252 0 0 255813 83 0 0 18 0 2 0 733144445 253771776 33400 33554432000 4194304 4417452 140734339841088 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18996/statm: 61956 33400 181 55 0 59842 0
[pid=18996/tid=19005] ppid=18994 vsize=247824 CPUtime=634.46 cores=0,2,4,6
/proc/18996/task/19005/stat : 19005 (plingeling) R 18994 18996 10053 0 -1 4202560 157697 1252 0 0 63426 20 0 0 25 0 2 0 733144446 253771776 33400 33554432000 4194304 4417452 140734339841088 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2558.96
Current children cumulated vsize (KiB) 247824

[startup+641.701 s]
/proc/loadavg: 8.09 7.75 7.49 10/360 19043
/proc/meminfo: memFree=17446860/32950928 swapFree=67111200/67111528
[pid=18996] ppid=18994 vsize=115528 CPUtime=2559.07 cores=0,2,4,6
/proc/18996/stat : 18996 (plingeling) R 18994 18996 10053 0 -1 4202496 580480 1252 0 0 255823 84 0 0 16 0 1 0 733144445 118300672 2891 33554432000 4194304 4417452 140734339841088 18446744073709551615 256414849360 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/18996/statm: 28882 2891 192 55 0 26768 0
Current children cumulated CPU time (s) 2559.07
Current children cumulated vsize (KiB) 115528

Child status: 10
Real time (s): 641.703
CPU time (s): 2559.08
CPU user time (s): 2558.23
CPU system time (s): 0.844871
CPU usage (%): 398.795
Max. virtual memory (cumulated for all children) (KiB): 249596

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2558.23
system time used= 0.844871
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 581734
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 55
involuntary context switches= 12671

runsolver used 2.02969 second user time and 5.11422 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-15 05:12:18
IDJOB=3371335
IDBENCH=83420
IDSOLVER=1848
FILE ID=node115/3371335-1305429138
RUNJOBID= node115-1305429138-18984
PBS_JOBID= 13324588
Free space on /tmp= 73296 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_1_keyfind_1.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371335-1305429138/watcher-3371335-1305429138 -o /tmp/evaluation-result-3371335-1305429138/solver-3371335-1305429138 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371335-1305429138.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9e18e0ee8a56ea2c59fe8e682ff6c747
RANDOM SEED=899329116

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17750700 kB
Buffers:        297568 kB
Cached:        4561360 kB
SwapCached:          0 kB
Active:       11976092 kB
Inactive:      2907556 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17750700 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:             480 kB
Writeback:           0 kB
AnonPages:    10024024 kB
Mapped:          27632 kB
Slab:           210224 kB
PageTables:      40608 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 69651800 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73296 MiB
End job on node115 at 2011-05-15 05:23:00