Trace number 3309621

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587UNSAT 987.694 124.111

General information on the benchmark

Nameapplication/jarvisalo/AAAI2010-SATPlanning/
aaai10-planning-ipc5-pathways-17-step20.cnf
MD5SUM8f0e3738453893efc8a2d1abcf0d190d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark130.866
Satisfiable
(Un)Satisfiability was proved
Number of variables50277
Number of clauses283903
Sum of the clauses size636342
Maximum clause length61
Minimum clause length1
Number of clauses of size 1414
Number of clauses of size 2248375
Number of clauses of size 327490
Number of clauses of size 45332
Number of clauses of size 5458
Number of clauses of size over 51834

Solver Data 

987.67/124.11	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309621-1304007555/watcher-3309621-1304007555 -o /tmp/evaluation-result-3309621-1304007555/solver-3309621-1304007555 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309621-1304007555.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.46 7.71 7.82 1/170 5848
/proc/meminfo: memFree=15221364/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=17684 CPUtime=0 cores=0-7
/proc/5848/stat : 5848 (plingeling) R 5846 5848 5540 0 -1 4202496 2396 1256 0 0 0 0 0 0 23 0 1 0 512354252 18108416 2325 33554432000 4194304 4417332 140734651345888 18446744073709551615 251813934061 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5848/statm: 4421 2341 146 55 0 2307 0

[startup+0.066033 s]
/proc/loadavg: 6.46 7.71 7.82 1/170 5848
/proc/meminfo: memFree=15221364/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=34560 CPUtime=0.05 cores=0-7
/proc/5848/stat : 5848 (plingeling) R 5846 5848 5540 0 -1 4202496 6733 1256 0 0 5 0 0 0 23 0 1 0 512354252 35389440 6662 33554432000 4194304 4417332 140734651345888 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5848/statm: 8640 6662 147 55 0 6526 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 34560

[startup+0.101028 s]
/proc/loadavg: 6.46 7.71 7.82 1/170 5848
/proc/meminfo: memFree=15221364/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=37048 CPUtime=0.09 cores=0-7
/proc/5848/stat : 5848 (plingeling) R 5846 5848 5540 0 -1 4202496 7356 1256 0 0 9 0 0 0 23 0 1 0 512354252 37937152 7285 33554432000 4194304 4417332 140734651345888 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5848/statm: 9262 7285 148 55 0 7148 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 37048

[startup+0.300994 s]
/proc/loadavg: 6.46 7.71 7.82 1/170 5848
/proc/meminfo: memFree=15221364/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=66032 CPUtime=0.29 cores=0-7
/proc/5848/stat : 5848 (plingeling) R 5846 5848 5540 0 -1 4202496 14602 1256 0 0 28 1 0 0 24 0 1 0 512354252 67616768 14531 33554432000 4194304 4417332 140734651345888 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5848/statm: 16508 14531 148 55 0 14394 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 66032

[startup+0.71493 s]
/proc/loadavg: 6.46 7.71 7.82 1/170 5848
/proc/meminfo: memFree=15221364/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=237528 CPUtime=1.44 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 28644 1256 0 0 141 3 0 0 25 0 9 0 512354252 243228672 21773 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 59382 21773 171 55 0 57268 0
Current children cumulated CPU time (s) 1.44
Current children cumulated vsize (KiB) 237528

[startup+1.5008 s]
/proc/loadavg: 6.46 7.71 7.82 10/179 5862
/proc/meminfo: memFree=15129540/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=243308 CPUtime=7.72 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 38170 1256 0 0 768 4 0 0 25 0 9 0 512354252 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 60827 23902 175 55 0 58713 0
[pid=5848/tid=5855] ppid=5846 vsize=243308 CPUtime=0.89 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 2527 1256 0 0 89 0 0 0 19 0 9 0 512354312 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4288259 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=243308 CPUtime=0.89 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 1954 1256 0 0 89 0 0 0 25 0 9 0 512354312 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4284484 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=243308 CPUtime=0.89 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 1605 1256 0 0 89 0 0 0 25 0 9 0 512354312 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4309871 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=243308 CPUtime=0.88 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 2138 1256 0 0 88 0 0 0 25 0 9 0 512354312 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=243308 CPUtime=0.88 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 3498 1256 0 0 88 0 0 0 25 0 9 0 512354312 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4286960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=243308 CPUtime=0.88 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 3514 1256 0 0 88 0 0 0 19 0 9 0 512354313 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4287359 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=243308 CPUtime=0.87 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 1973 1256 0 0 87 0 0 0 19 0 9 0 512354313 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4286414 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=243308 CPUtime=0.88 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 2248 1256 0 0 88 0 0 0 25 0 9 0 512354313 249147392 23902 33554432000 4194304 4417332 140734651345888 18446744073709551615 4290958 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7.72
Current children cumulated vsize (KiB) 243308

[startup+3.10053 s]
/proc/loadavg: 6.46 7.71 7.82 9/179 5862
/proc/meminfo: memFree=15099904/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=341520 CPUtime=20.51 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 58973 1256 0 0 2043 8 0 0 25 0 9 0 512354252 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 85380 33409 181 55 0 83266 0
[pid=5848/tid=5855] ppid=5846 vsize=341520 CPUtime=2.48 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 3551 1256 0 0 248 0 0 0 22 0 9 0 512354312 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4346594 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=341520 CPUtime=2.48 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 5644 1256 0 0 248 0 0 0 25 0 9 0 512354312 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4330435 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=341520 CPUtime=2.49 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 5464 1256 0 0 248 1 0 0 25 0 9 0 512354312 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236316 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=341520 CPUtime=2.48 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 2138 1256 0 0 248 0 0 0 25 0 9 0 512354312 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=341520 CPUtime=2.48 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 6676 1256 0 0 247 1 0 0 25 0 9 0 512354312 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=341520 CPUtime=2.48 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 7445 1256 0 0 247 1 0 0 22 0 9 0 512354313 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4339649 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=341520 CPUtime=2.46 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 4533 1256 0 0 246 0 0 0 22 0 9 0 512354313 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=341520 CPUtime=2.47 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 4809 1256 0 0 247 0 0 0 25 0 9 0 512354313 349716480 33409 33554432000 4194304 4417332 140734651345888 18446744073709551615 4254977 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 20.51
Current children cumulated vsize (KiB) 341520

[startup+6.30099 s]
/proc/loadavg: 6.59 7.71 7.82 9/179 5862
/proc/meminfo: memFree=15056132/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=378828 CPUtime=46.09 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 68832 1256 0 0 4600 9 0 0 25 0 9 0 512354252 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 94707 41292 181 55 0 92593 0
[pid=5848/tid=5855] ppid=5846 vsize=378828 CPUtime=5.68 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 4463 1256 0 0 568 0 0 0 25 0 9 0 512354312 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4248269 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=378828 CPUtime=5.68 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 6812 1256 0 0 568 0 0 0 25 0 9 0 512354312 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4258174 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=378828 CPUtime=5.69 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 6227 1256 0 0 568 1 0 0 25 0 9 0 512354312 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236722 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=378828 CPUtime=5.68 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 2547 1256 0 0 568 0 0 0 25 0 9 0 512354312 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4353540 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=378828 CPUtime=5.68 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 8001 1256 0 0 567 1 0 0 25 0 9 0 512354312 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4334482 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=378828 CPUtime=5.68 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 9623 1256 0 0 567 1 0 0 25 0 9 0 512354313 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=378828 CPUtime=5.65 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 5686 1256 0 0 565 0 0 0 25 0 9 0 512354313 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4251060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=378828 CPUtime=5.67 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 6760 1256 0 0 567 0 0 0 25 0 9 0 512354313 387919872 41292 33554432000 4194304 4417332 140734651345888 18446744073709551615 4258575 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 46.09
Current children cumulated vsize (KiB) 378828

[startup+12.7009 s]
/proc/loadavg: 6.70 7.72 7.82 9/179 5862
/proc/meminfo: memFree=15036468/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=388124 CPUtime=97.26 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 78305 1256 0 0 9716 10 0 0 25 0 9 0 512354252 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 97031 45998 181 55 0 94917 0
[pid=5848/tid=5855] ppid=5846 vsize=388124 CPUtime=12.09 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 6945 1256 0 0 1208 1 0 0 25 0 9 0 512354312 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236874 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=388124 CPUtime=12.09 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 11200 1256 0 0 1208 1 0 0 25 0 9 0 512354312 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=388124 CPUtime=12.09 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 6258 1256 0 0 1208 1 0 0 25 0 9 0 512354312 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4281673 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=388124 CPUtime=12.08 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 3320 1256 0 0 1208 0 0 0 25 0 9 0 512354312 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236644 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=388124 CPUtime=12.08 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 9276 1256 0 0 1207 1 0 0 25 0 9 0 512354312 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=388124 CPUtime=12.08 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 9647 1256 0 0 1207 1 0 0 25 0 9 0 512354313 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=388124 CPUtime=12.01 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 6120 1256 0 0 1201 0 0 0 25 0 9 0 512354313 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4353416 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=388124 CPUtime=12.07 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 6826 1256 0 0 1207 0 0 0 25 0 9 0 512354313 397438976 45998 33554432000 4194304 4417332 140734651345888 18446744073709551615 4326493 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 97.26
Current children cumulated vsize (KiB) 388124

[startup+25.5008 s]
/proc/loadavg: 6.99 7.73 7.82 9/179 5863
/proc/meminfo: memFree=15022836/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=400576 CPUtime=199.59 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 90810 1256 0 0 19947 12 0 0 25 0 9 0 512354252 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 100144 50119 181 55 0 98030 0
[pid=5848/tid=5855] ppid=5846 vsize=400576 CPUtime=24.89 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 8905 1256 0 0 2488 1 0 0 25 0 9 0 512354312 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4354419 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=400576 CPUtime=24.89 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 16456 1256 0 0 2487 2 0 0 25 0 9 0 512354312 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=400576 CPUtime=24.89 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 6814 1256 0 0 2488 1 0 0 25 0 9 0 512354312 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4309871 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=400576 CPUtime=24.88 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 6760 1256 0 0 2487 1 0 0 25 0 9 0 512354312 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4356720 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=400576 CPUtime=24.88 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 9298 1256 0 0 2487 1 0 0 25 0 9 0 512354312 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4237176 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=400576 CPUtime=24.88 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 10440 1256 0 0 2487 1 0 0 25 0 9 0 512354313 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=400576 CPUtime=24.75 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 6598 1256 0 0 2475 0 0 0 25 0 9 0 512354313 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=400576 CPUtime=24.87 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 6826 1256 0 0 2487 0 0 0 25 0 9 0 512354313 410189824 50119 33554432000 4194304 4417332 140734651345888 18446744073709551615 4237221 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 199.59
Current children cumulated vsize (KiB) 400576

[startup+51.1005 s]
/proc/loadavg: 7.33 7.75 7.82 9/179 5864
/proc/meminfo: memFree=14972052/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=438536 CPUtime=404.27 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 119177 1256 0 0 40411 16 0 0 25 0 9 0 512354252 449060864 62407 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 109634 62407 181 55 0 107520 0
[pid=5848/tid=5855] ppid=5846 vsize=438536 CPUtime=50.49 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 15098 1256 0 0 5047 2 0 0 25 0 9 0 512354312 449060864 62407 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=438536 CPUtime=50.49 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 24419 1256 0 0 5046 3 0 0 25 0 9 0 512354312 449060864 62407 33554432000 4194304 4417332 140734651345888 18446744073709551615 4311993 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=438536 CPUtime=50.49 cores=0-7

################
# More data... #
################

/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 9967 1256 0 0 5047 1 0 0 25 0 9 0 512354312 449060864 62407 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=438536 CPUtime=50.48 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 10726 1256 0 0 5047 1 0 0 25 0 9 0 512354313 449060864 62407 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=438536 CPUtime=50.22 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 9050 1256 0 0 5022 0 0 0 25 0 9 0 512354313 449060864 62407 33554432000 4194304 4417332 140734651345888 18446744073709551615 4258176 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=438536 CPUtime=50.47 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 6826 1256 0 0 5047 0 0 0 25 0 9 0 512354313 449060864 62407 33554432000 4194304 4417332 140734651345888 18446744073709551615 4235991 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 404.27
Current children cumulated vsize (KiB) 438536

[startup+102.307 s]
/proc/loadavg: 7.71 7.79 7.83 9/179 5865
/proc/meminfo: memFree=14898212/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=512040 CPUtime=813.64 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 205050 1256 0 0 81334 30 0 0 25 0 9 0 512354252 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 128010 81591 181 55 0 125896 0
[pid=5848/tid=5855] ppid=5846 vsize=512040 CPUtime=101.69 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 29288 1256 0 0 10165 4 0 0 25 0 9 0 512354312 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=512040 CPUtime=101.69 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 45460 1256 0 0 10163 6 0 0 25 0 9 0 512354312 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=512040 CPUtime=101.69 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 15911 1256 0 0 10166 3 0 0 25 0 9 0 512354312 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=512040 CPUtime=101.68 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 20661 1256 0 0 10165 3 0 0 25 0 9 0 512354312 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=512040 CPUtime=101.68 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 15837 1256 0 0 10166 2 0 0 25 0 9 0 512354312 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=512040 CPUtime=101.68 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 14884 1256 0 0 10166 2 0 0 25 0 9 0 512354313 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=512040 CPUtime=101.16 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 22779 1256 0 0 10113 3 0 0 25 0 9 0 512354313 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4265399 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=512040 CPUtime=101.69 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 21517 1256 0 0 10167 2 0 0 25 0 9 0 512354313 524328960 81591 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 813.64
Current children cumulated vsize (KiB) 512040

Solver just ended. Dumping a history of the last processes samples

[startup+115.101 s]
/proc/loadavg: 7.75 7.79 7.83 9/179 5865
/proc/meminfo: memFree=14907372/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=494692 CPUtime=915.92 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 229940 1256 0 0 91558 34 0 0 25 0 9 0 512354252 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 123673 76246 181 55 0 121559 0
[pid=5848/tid=5855] ppid=5846 vsize=494692 CPUtime=114.49 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 34053 1256 0 0 11444 5 0 0 25 0 9 0 512354312 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=494692 CPUtime=114.49 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 47952 1256 0 0 11442 7 0 0 25 0 9 0 512354312 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=494692 CPUtime=114.49 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 21654 1256 0 0 11445 4 0 0 25 0 9 0 512354312 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4275906 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=494692 CPUtime=114.47 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 25832 1256 0 0 11444 3 0 0 25 0 9 0 512354312 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=494692 CPUtime=114.48 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 15854 1256 0 0 11446 2 0 0 25 0 9 0 512354312 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=494692 CPUtime=114.48 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 16949 1256 0 0 11445 3 0 0 25 0 9 0 512354313 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=494692 CPUtime=113.89 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 26350 1256 0 0 11386 3 0 0 25 0 9 0 512354313 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=494692 CPUtime=114.48 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 22583 1256 0 0 11446 2 0 0 25 0 9 0 512354313 506564608 76246 33554432000 4194304 4417332 140734651345888 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 915.92
Current children cumulated vsize (KiB) 494692

[startup+118.301 s]
/proc/loadavg: 7.77 7.80 7.83 9/179 5865
/proc/meminfo: memFree=14919152/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=482512 CPUtime=941.51 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 233504 1256 0 0 94116 35 0 0 25 0 9 0 512354252 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 120628 73201 181 55 0 118514 0
[pid=5848/tid=5855] ppid=5846 vsize=482512 CPUtime=117.69 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 34721 1256 0 0 11764 5 0 0 25 0 9 0 512354312 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4282356 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=482512 CPUtime=117.69 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 48153 1256 0 0 11762 7 0 0 25 0 9 0 512354312 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=482512 CPUtime=117.68 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 23148 1256 0 0 11764 4 0 0 25 0 9 0 512354312 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=482512 CPUtime=117.67 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 25832 1256 0 0 11764 3 0 0 25 0 9 0 512354312 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=482512 CPUtime=117.68 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 15854 1256 0 0 11766 2 0 0 25 0 9 0 512354312 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=482512 CPUtime=117.68 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 16949 1256 0 0 11765 3 0 0 25 0 9 0 512354313 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=482512 CPUtime=117.07 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 26350 1256 0 0 11704 3 0 0 25 0 9 0 512354313 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4307713 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=482512 CPUtime=117.68 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 23784 1256 0 0 11766 2 0 0 25 0 9 0 512354313 494092288 73201 33554432000 4194304 4417332 140734651345888 18446744073709551615 4310225 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 941.51
Current children cumulated vsize (KiB) 482512

[startup+121.501 s]
/proc/loadavg: 7.79 7.80 7.83 9/179 5866
/proc/meminfo: memFree=14950416/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=468164 CPUtime=967.1 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 239658 1256 0 0 96673 37 0 0 25 0 9 0 512354252 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 117041 69613 181 55 0 114927 0
[pid=5848/tid=5855] ppid=5846 vsize=468164 CPUtime=120.88 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 35063 1256 0 0 12083 5 0 0 25 0 9 0 512354312 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=468164 CPUtime=120.89 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 49918 1256 0 0 12082 7 0 0 25 0 9 0 512354312 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=468164 CPUtime=120.88 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 23679 1256 0 0 12084 4 0 0 25 0 9 0 512354312 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=468164 CPUtime=120.87 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 28549 1256 0 0 12083 4 0 0 25 0 9 0 512354312 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=468164 CPUtime=120.88 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 15854 1256 0 0 12086 2 0 0 25 0 9 0 512354312 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4253542 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=468164 CPUtime=120.88 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 16949 1256 0 0 12085 3 0 0 25 0 9 0 512354313 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4309183 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=468164 CPUtime=120.25 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 26725 1256 0 0 12022 3 0 0 25 0 9 0 512354313 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=468164 CPUtime=120.88 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 24208 1256 0 0 12086 2 0 0 25 0 9 0 512354313 479399936 69613 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 967.1
Current children cumulated vsize (KiB) 468164

[startup+123.1 s]
/proc/loadavg: 7.79 7.80 7.83 9/179 5866
/proc/meminfo: memFree=14940256/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=473684 CPUtime=979.92 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 242063 1256 0 0 97955 37 0 0 25 0 9 0 512354252 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 118421 70993 181 55 0 116307 0
[pid=5848/tid=5855] ppid=5846 vsize=473684 CPUtime=122.49 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 35584 1256 0 0 12244 5 0 0 25 0 9 0 512354312 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=473684 CPUtime=122.49 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 50192 1256 0 0 12242 7 0 0 25 0 9 0 512354312 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4366081 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=473684 CPUtime=122.49 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 23679 1256 0 0 12245 4 0 0 25 0 9 0 512354312 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4250938 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=473684 CPUtime=122.47 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 28549 1256 0 0 12243 4 0 0 25 0 9 0 512354312 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4365994 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=473684 CPUtime=122.48 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 15934 1256 0 0 12246 2 0 0 25 0 9 0 512354312 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=473684 CPUtime=122.49 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 16949 1256 0 0 12246 3 0 0 25 0 9 0 512354313 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4346278 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=473684 CPUtime=121.85 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 28255 1256 0 0 12182 3 0 0 25 0 9 0 512354313 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4251107 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=473684 CPUtime=122.48 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 24208 1256 0 0 12246 2 0 0 25 0 9 0 512354313 485052416 70993 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 979.92
Current children cumulated vsize (KiB) 473684

[startup+123.901 s]
/proc/loadavg: 7.79 7.80 7.83 9/179 5866
/proc/meminfo: memFree=14940256/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=482208 CPUtime=986.29 cores=0-7
/proc/5848/stat : 5848 (plingeling) S 5846 5848 5540 0 -1 4202496 245135 1256 0 0 98592 37 0 0 25 0 9 0 512354252 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/5848/statm: 120552 73124 181 55 0 118438 0
[pid=5848/tid=5855] ppid=5846 vsize=482208 CPUtime=123.28 cores=0-7
/proc/5848/task/5855/stat : 5855 (plingeling) R 5846 5848 5540 0 -1 4202560 36608 1256 0 0 12323 5 0 0 25 0 9 0 512354312 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236961 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5848/tid=5856] ppid=5846 vsize=482208 CPUtime=123.29 cores=0-7
/proc/5848/task/5856/stat : 5856 (plingeling) R 5846 5848 5540 0 -1 4202560 50192 1256 0 0 12322 7 0 0 25 0 9 0 512354312 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5848/tid=5857] ppid=5846 vsize=482208 CPUtime=123.28 cores=0-7
/proc/5848/task/5857/stat : 5857 (plingeling) R 5846 5848 5540 0 -1 4202560 25727 1256 0 0 12324 4 0 0 25 0 9 0 512354312 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5848/tid=5858] ppid=5846 vsize=482208 CPUtime=123.27 cores=0-7
/proc/5848/task/5858/stat : 5858 (plingeling) R 5846 5848 5540 0 -1 4202560 28549 1256 0 0 12323 4 0 0 25 0 9 0 512354312 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4358261 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5848/tid=5859] ppid=5846 vsize=482208 CPUtime=123.28 cores=0-7
/proc/5848/task/5859/stat : 5859 (plingeling) R 5846 5848 5540 0 -1 4202560 15934 1256 0 0 12326 2 0 0 25 0 9 0 512354312 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5848/tid=5860] ppid=5846 vsize=482208 CPUtime=123.28 cores=0-7
/proc/5848/task/5860/stat : 5860 (plingeling) R 5846 5848 5540 0 -1 4202560 16949 1256 0 0 12325 3 0 0 25 0 9 0 512354313 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4236290 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5848/tid=5861] ppid=5846 vsize=482208 CPUtime=122.64 cores=0-7
/proc/5848/task/5861/stat : 5861 (plingeling) R 5846 5848 5540 0 -1 4202560 28255 1256 0 0 12261 3 0 0 25 0 9 0 512354313 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4251167 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5848/tid=5862] ppid=5846 vsize=482208 CPUtime=123.28 cores=0-7
/proc/5848/task/5862/stat : 5862 (plingeling) R 5846 5848 5540 0 -1 4202560 24208 1256 0 0 12326 2 0 0 25 0 9 0 512354313 493780992 73124 33554432000 4194304 4417332 140734651345888 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 986.29
Current children cumulated vsize (KiB) 482208

[startup+124.101 s]
/proc/loadavg: 7.79 7.80 7.83 9/179 5866
/proc/meminfo: memFree=14940256/32950928 swapFree=67111528/67111528
[pid=5848] ppid=5846 vsize=327636 CPUtime=987.67 cores=0-7
/proc/5848/stat : 5848 (plingeling) R 5846 5848 5540 0 -1 4202496 245136 1256 0 0 98729 38 0 0 17 0 1 0 512354252 335499264 38966 33554432000 4194304 4417332 140734651345888 18446744073709551615 251814265962 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/5848/statm: 81909 38966 182 55 0 79795 0
Current children cumulated CPU time (s) 987.67
Current children cumulated vsize (KiB) 327636

Child status: 20
Real time (s): 124.111
CPU time (s): 987.694
CPU user time (s): 987.298
CPU system time (s): 0.395939
CPU usage (%): 795.815
Max. virtual memory (cumulated for all children) (KiB): 541804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 987.298
system time used= 0.395939
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 246395
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 228
involuntary context switches= 4629

runsolver used 0.198969 second user time and 0.445932 second system time

The end

Launcher Data 

Begin job on node126 at 2011-04-28 18:19:16
IDJOB=3309621
IDBENCH=82422
IDSOLVER=1695
FILE ID=node126/3309621-1304007555
RUNJOBID= node126-1304003442-5554
PBS_JOBID= 13168804
Free space on /tmp= 71596 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/jarvisalo/AAAI2010-SATPlanning/aaai10-planning-ipc5-pathways-17-step20.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309621-1304007555/watcher-3309621-1304007555 -o /tmp/evaluation-result-3309621-1304007555/solver-3309621-1304007555 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309621-1304007555.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 8f0e3738453893efc8a2d1abcf0d190d
RANDOM SEED=1828841563

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15221520 kB
Buffers:       1838504 kB
Cached:       15237956 kB
SwapCached:          0 kB
Active:        6584184 kB
Inactive:     10559968 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15221520 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            4860 kB
Writeback:           0 kB
AnonPages:       66888 kB
Mapped:          14624 kB
Slab:           519488 kB
PageTables:       4260 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   189600 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71596 MiB
End job on node126 at 2011-04-28 18:21:20