Trace number 3282491

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.24 1202.26

General information on the benchmark

NameAPPLICATIONS/
bitverif/maxxor/maxxor064.cnf
MD5SUM902b28046d424b16042ca612ddad48e0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark788.78
Satisfiable
(Un)Satisfiability was proved
Number of variables51064
Number of clauses152039
Sum of the clauses size354755
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2101358
Number of clauses of size 350679
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3282491-1304042252/watcher-3282491-1304042252 -o /tmp/evaluation-result-3282491-1304042252/solver-3282491-1304042252 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3282491-1304042252.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.40 6.81 6.49 6/181 18504
/proc/meminfo: memFree=18618160/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=9924 CPUtime=0 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) R 18502 18504 18457 0 -1 4202496 542 1252 0 0 0 0 0 0 22 0 1 0 594455904 10162176 471 33554432000 4194304 4417332 140736361115840 18446744073709551615 256415391488 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/18504/statm: 2481 484 147 55 0 367 0

[startup+0.081432 s]
/proc/loadavg: 4.40 6.81 6.49 6/181 18504
/proc/meminfo: memFree=18618160/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=23064 CPUtime=0.07 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) R 18502 18504 18457 0 -1 4202496 3954 1252 0 0 7 0 0 0 22 0 1 0 594455904 23617536 3789 33554432000 4194304 4417332 140736361115840 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/18504/statm: 5766 3789 148 55 0 3652 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 23064

[startup+0.100424 s]
/proc/loadavg: 4.40 6.81 6.49 6/181 18504
/proc/meminfo: memFree=18618160/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=27160 CPUtime=0.09 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) R 18502 18504 18457 0 -1 4202496 4978 1252 0 0 9 0 0 0 22 0 1 0 594455904 27811840 4813 33554432000 4194304 4417332 140736361115840 18446744073709551615 256415391488 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/18504/statm: 6790 4813 148 55 0 4676 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27160

[startup+0.300311 s]
/proc/loadavg: 4.40 6.81 6.49 6/181 18504
/proc/meminfo: memFree=18618160/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=93360 CPUtime=0.58 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 14636 1252 0 0 57 1 0 0 23 0 5 0 594455904 95600640 11118 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 23340 11118 171 55 0 21226 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 93360

[startup+0.700236 s]
/proc/loadavg: 4.40 6.81 6.49 6/181 18504
/proc/meminfo: memFree=18618160/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=93756 CPUtime=2.18 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 16300 1252 0 0 217 1 0 0 23 0 5 0 594455904 96006144 11218 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 23439 11218 172 55 0 21325 0
Current children cumulated CPU time (s) 2.18
Current children cumulated vsize (KiB) 93756

[startup+1.50108 s]
/proc/loadavg: 4.40 6.81 6.49 9/186 18514
/proc/meminfo: memFree=18562224/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=94944 CPUtime=5.39 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 17564 1252 0 0 537 2 0 0 23 0 5 0 594455904 97222656 11519 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 23736 11519 176 55 0 21622 0
[pid=18504/tid=18511] ppid=18502 vsize=94944 CPUtime=1.3 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 1313 1252 0 0 130 0 0 0 25 0 5 0 594455924 97222656 11519 33554432000 4194304 4417332 140736361115840 18446744073709551615 4275748 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=94944 CPUtime=1.28 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 3970 1252 0 0 128 0 0 0 25 0 5 0 594455924 97222656 11519 33554432000 4194304 4417332 140736361115840 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=94944 CPUtime=1.29 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 1699 1252 0 0 129 0 0 0 25 0 5 0 594455924 97222656 11519 33554432000 4194304 4417332 140736361115840 18446744073709551615 4278682 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=94944 CPUtime=1.29 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 1140 1252 0 0 129 0 0 0 25 0 5 0 594455924 97222656 11519 33554432000 4194304 4417332 140736361115840 18446744073709551615 4265499 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.39
Current children cumulated vsize (KiB) 94944

[startup+3.10078 s]
/proc/loadavg: 4.40 6.81 6.49 9/186 18514
/proc/meminfo: memFree=18541640/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=105168 CPUtime=11.78 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 28436 1252 0 0 1175 3 0 0 23 0 5 0 594455904 107692032 14087 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 26292 14087 180 55 0 24178 0
[pid=18504/tid=18511] ppid=18502 vsize=105168 CPUtime=2.9 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 4498 1252 0 0 290 0 0 0 25 0 5 0 594455924 107692032 14087 33554432000 4194304 4417332 140736361115840 18446744073709551615 4252947 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=105168 CPUtime=2.88 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 9929 1252 0 0 287 1 0 0 25 0 5 0 594455924 107692032 14087 33554432000 4194304 4417332 140736361115840 18446744073709551615 4318713 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=105168 CPUtime=2.89 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 3234 1252 0 0 289 0 0 0 25 0 5 0 594455924 107692032 14087 33554432000 4194304 4417332 140736361115840 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=105168 CPUtime=2.89 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 1333 1252 0 0 289 0 0 0 25 0 5 0 594455924 107692032 14087 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.78
Current children cumulated vsize (KiB) 105168

[startup+6.30118 s]
/proc/loadavg: 4.69 6.83 6.50 9/186 18514
/proc/meminfo: memFree=18531476/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=120480 CPUtime=24.56 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 35388 1252 0 0 2452 4 0 0 23 0 5 0 594455904 123371520 17699 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 30120 17699 180 55 0 28006 0
[pid=18504/tid=18511] ppid=18502 vsize=120480 CPUtime=6.1 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 5140 1252 0 0 610 0 0 0 25 0 5 0 594455924 123371520 17699 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=120480 CPUtime=6.06 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 10298 1252 0 0 605 1 0 0 25 0 5 0 594455924 123371520 17699 33554432000 4194304 4417332 140736361115840 18446744073709551615 4365872 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=120480 CPUtime=6.09 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 3234 1252 0 0 609 0 0 0 25 0 5 0 594455924 123371520 17699 33554432000 4194304 4417332 140736361115840 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=120480 CPUtime=6.09 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 7274 1252 0 0 609 0 0 0 25 0 5 0 594455924 123371520 17699 33554432000 4194304 4417332 140736361115840 18446744073709551615 4250869 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.56
Current children cumulated vsize (KiB) 120480

[startup+12.701 s]
/proc/loadavg: 4.95 6.85 6.51 9/186 18514
/proc/meminfo: memFree=18493588/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=129076 CPUtime=50.13 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 60356 1252 0 0 5006 7 0 0 23 0 5 0 594455904 132173824 19849 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 32269 19849 181 55 0 30155 0
[pid=18504/tid=18511] ppid=18502 vsize=129076 CPUtime=12.5 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 5155 1252 0 0 1250 0 0 0 25 0 5 0 594455924 132173824 19849 33554432000 4194304 4417332 140736361115840 18446744073709551615 4365018 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=129076 CPUtime=12.43 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 10311 1252 0 0 1242 1 0 0 25 0 5 0 594455924 132173824 19849 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=129076 CPUtime=12.49 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 4291 1252 0 0 1249 0 0 0 25 0 5 0 594455924 132173824 19849 33554432000 4194304 4417332 140736361115840 18446744073709551615 4365451 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=129076 CPUtime=12.49 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 31157 1252 0 0 1246 3 0 0 25 0 5 0 594455924 132173824 19849 33554432000 4194304 4417332 140736361115840 18446744073709551615 4357865 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.13
Current children cumulated vsize (KiB) 129076

[startup+25.5006 s]
/proc/loadavg: 5.63 6.90 6.53 9/186 18514
/proc/meminfo: memFree=18467852/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=132300 CPUtime=101.25 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 85076 1252 0 0 10115 10 0 0 23 0 5 0 594455904 135475200 20816 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 33075 20816 181 55 0 30961 0
[pid=18504/tid=18511] ppid=18502 vsize=132300 CPUtime=25.3 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 5166 1252 0 0 2530 0 0 0 25 0 5 0 594455924 135475200 20816 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=132300 CPUtime=25.15 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 10452 1252 0 0 2514 1 0 0 25 0 5 0 594455924 135475200 20816 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=132300 CPUtime=25.29 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 4525 1252 0 0 2529 0 0 0 25 0 5 0 594455924 135475200 20816 33554432000 4194304 4417332 140736361115840 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=132300 CPUtime=25.3 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 55491 1252 0 0 2523 7 0 0 25 0 5 0 594455924 135475200 20816 33554432000 4194304 4417332 140736361115840 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.25
Current children cumulated vsize (KiB) 132300

[startup+51.1007 s]
/proc/loadavg: 6.44 6.99 6.57 9/186 18515
/proc/meminfo: memFree=18416944/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=172468 CPUtime=203.51 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 110517 1252 0 0 20337 14 0 0 23 0 5 0 594455904 176607232 30923 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 43117 30923 181 55 0 41003 0
[pid=18504/tid=18511] ppid=18502 vsize=172468 CPUtime=50.9 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 5699 1252 0 0 5090 0 0 0 25 0 5 0 594455924 176607232 30923 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=172468 CPUtime=50.62 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 10476 1252 0 0 5061 1 0 0 25 0 5 0 594455924 176607232 30923 33554432000 4194304 4417332 140736361115840 18446744073709551615 4358022 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=172468 CPUtime=50.89 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 8640 1252 0 0 5088 1 0 0 25 0 5 0 594455924 176607232 30923 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=172468 CPUtime=50.88 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 76260 1252 0 0 5079 9 0 0 25 0 5 0 594455924 176607232 30923 33554432000 4194304 4417332 140736361115840 18446744073709551615 4237214 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.51
Current children cumulated vsize (KiB) 172468

[startup+102.306 s]
/proc/loadavg: 7.36 7.16 6.65 9/186 18516
/proc/meminfo: memFree=18329384/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=244636 CPUtime=408.05 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 159441 1252 0 0 40784 21 0 0 23 0 5 0 594455904 250507264 32614 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 61159 32614 181 55 0 59045 0
[pid=18504/tid=18511] ppid=18502 vsize=244636 CPUtime=102.1 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 12140 1252 0 0 10209 1 0 0 25 0 5 0 594455924 250507264 32614 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=244636 CPUtime=101.54 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 14593 1252 0 0 10152 2 0 0 25 0 5 0 594455924 250507264 32614 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=244636 CPUtime=102.1 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 14220 1252 0 0 10208 2 0 0 25 0 5 0 594455924 250507264 32614 33554432000 4194304 4417332 140736361115840 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=244636 CPUtime=102.09 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 109046 1252 0 0 10195 14 0 0 25 0 5 0 594455924 250507264 32614 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408.05
Current children cumulated vsize (KiB) 244636

[startup+162.301 s]
/proc/loadavg: 7.81 7.32 6.73 9/186 18554
/proc/meminfo: memFree=18322716/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=301712 CPUtime=647.71 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 224955 1252 0 0 64740 31 0 0 23 0 5 0 594455904 308953088 46883 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 75428 46883 181 55 0 73314 0
[pid=18504/tid=18511] ppid=18502 vsize=301712 CPUtime=162.1 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 38440 1252 0 0 16205 5 0 0 25 0 5 0 594455924 308953088 46883 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=301712 CPUtime=161.22 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 17640 1252 0 0 16119 3 0 0 25 0 5 0 594455924 308953088 46883 33554432000 4194304 4417332 140736361115840 18446744073709551615 4257274 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=301712 CPUtime=162.1 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 18441 1252 0 0 16207 3 0 0 25 0 5 0 594455924 308953088 46883 33554432000 4194304 4417332 140736361115840 18446744073709551615 4365695 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=301712 CPUtime=162.08 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 140992 1252 0 0 16190 18 0 0 25 0 5 0 594455924 308953088 46883 33554432000 4194304 4417332 140736361115840 18446744073709551615 4237136 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.71
Current children cumulated vsize (KiB) 301712


################
# More data... #
################

[pid=18504/tid=18512] ppid=18502 vsize=624568 CPUtime=698.25 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 87914 1252 0 0 69812 13 0 0 25 0 5 0 594455924 639557632 127597 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=624568 CPUtime=702 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 117600 1252 0 0 70182 18 0 0 25 0 5 0 594455924 639557632 127597 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=624568 CPUtime=701.96 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 257370 1252 0 0 70164 32 0 0 25 0 5 0 594455924 639557632 127597 33554432000 4194304 4417332 140736361115840 18446744073709551615 4236852 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2803.24
Current children cumulated vsize (KiB) 624568

[startup+762.307 s]
/proc/loadavg: 8.08 8.01 7.39 9/186 19045
/proc/meminfo: memFree=17939900/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=599932 CPUtime=3042.94 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 574255 1252 0 0 304214 80 0 0 23 0 5 0 594455904 614330368 121438 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 149983 121438 181 55 0 147869 0
[pid=18504/tid=18511] ppid=18502 vsize=599932 CPUtime=760.81 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 82608 1252 0 0 76069 12 0 0 25 0 5 0 594455924 614330368 121438 33554432000 4194304 4417332 140736361115840 18446744073709551615 4357861 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=599932 CPUtime=757.93 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 95423 1252 0 0 75779 14 0 0 25 0 5 0 594455924 614330368 121438 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=599932 CPUtime=762.01 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 122027 1252 0 0 76182 19 0 0 25 0 5 0 594455924 614330368 121438 33554432000 4194304 4417332 140736361115840 18446744073709551615 4264256 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=599932 CPUtime=761.97 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 264755 1252 0 0 76164 33 0 0 25 0 5 0 594455924 614330368 121438 33554432000 4194304 4417332 140736361115840 18446744073709551615 4357838 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3042.94
Current children cumulated vsize (KiB) 599932

[startup+822.301 s]
/proc/loadavg: 8.08 8.02 7.44 9/186 19046
/proc/meminfo: memFree=17868316/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=643948 CPUtime=3282.59 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 599952 1252 0 0 328176 83 0 0 23 0 5 0 594455904 659402752 132442 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 160987 132442 181 55 0 158873 0
[pid=18504/tid=18511] ppid=18502 vsize=643948 CPUtime=820.81 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 87764 1252 0 0 82069 12 0 0 25 0 5 0 594455924 659402752 132442 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=643948 CPUtime=817.6 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 97952 1252 0 0 81746 14 0 0 25 0 5 0 594455924 659402752 132442 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=643948 CPUtime=822.01 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 129536 1252 0 0 82181 20 0 0 25 0 5 0 594455924 659402752 132442 33554432000 4194304 4417332 140736361115840 18446744073709551615 4251034 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=643948 CPUtime=821.96 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 275258 1252 0 0 82162 34 0 0 25 0 5 0 594455924 659402752 132442 33554432000 4194304 4417332 140736361115840 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3282.59
Current children cumulated vsize (KiB) 643948

[startup+882.301 s]
/proc/loadavg: 8.07 8.03 7.47 9/186 19048
/proc/meminfo: memFree=17691716/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=843832 CPUtime=3522.26 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 685161 1252 0 0 352134 92 0 0 23 0 5 0 594455904 864083968 182413 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 210958 182413 181 55 0 208844 0
[pid=18504/tid=18511] ppid=18502 vsize=843832 CPUtime=880.81 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 93687 1252 0 0 88068 13 0 0 25 0 5 0 594455924 864083968 182413 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=843832 CPUtime=877.26 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 109556 1252 0 0 87711 15 0 0 25 0 5 0 594455924 864083968 182413 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364608 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=843832 CPUtime=882.01 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 154256 1252 0 0 88178 23 0 0 25 0 5 0 594455924 864083968 182413 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=843832 CPUtime=881.95 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 318220 1252 0 0 88157 38 0 0 25 0 5 0 594455924 864083968 182413 33554432000 4194304 4417332 140736361115840 18446744073709551615 4357997 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3522.26
Current children cumulated vsize (KiB) 843832

[startup+942.301 s]
/proc/loadavg: 8.07 8.04 7.51 10/186 19050
/proc/meminfo: memFree=17587404/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=954916 CPUtime=3761.94 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 742093 1252 0 0 376094 100 0 0 23 0 5 0 594455904 977833984 210184 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 238729 210184 181 55 0 236615 0
[pid=18504/tid=18511] ppid=18502 vsize=954916 CPUtime=940.81 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 93687 1252 0 0 94068 13 0 0 25 0 5 0 594455924 977833984 210184 33554432000 4194304 4417332 140736361115840 18446744073709551615 4309485 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=954916 CPUtime=936.95 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 112463 1252 0 0 93679 16 0 0 25 0 5 0 594455924 977833984 210184 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=954916 CPUtime=942.01 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 185642 1252 0 0 94173 28 0 0 25 0 5 0 594455924 977833984 210184 33554432000 4194304 4417332 140736361115840 18446744073709551615 4365050 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=954916 CPUtime=941.95 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 340859 1252 0 0 94154 41 0 0 25 0 5 0 594455924 977833984 210184 33554432000 4194304 4417332 140736361115840 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3761.94
Current children cumulated vsize (KiB) 954916

[startup+1002.3 s]
/proc/loadavg: 8.14 8.06 7.55 9/186 19051
/proc/meminfo: memFree=17520168/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=1004432 CPUtime=4001.61 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 852822 1252 0 0 400046 115 0 0 23 0 5 0 594455904 1028538368 222563 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 251108 222563 181 55 0 248994 0
[pid=18504/tid=18511] ppid=18502 vsize=1004432 CPUtime=1000.81 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 97260 1252 0 0 100068 13 0 0 25 0 5 0 594455924 1028538368 222563 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=1004432 CPUtime=996.62 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 164727 1252 0 0 99639 23 0 0 25 0 5 0 594455924 1028538368 222563 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=1004432 CPUtime=1002.01 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 217914 1252 0 0 100168 33 0 0 25 0 5 0 594455924 1028538368 222563 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=1004432 CPUtime=1001.94 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 363479 1252 0 0 100150 44 0 0 25 0 5 0 594455924 1028538368 222563 33554432000 4194304 4417332 140736361115840 18446744073709551615 4352237 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4001.61
Current children cumulated vsize (KiB) 1004432

[startup+1062.3 s]
/proc/loadavg: 8.08 8.06 7.58 9/186 19053
/proc/meminfo: memFree=17709240/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=808784 CPUtime=4241.29 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 866521 1252 0 0 424012 117 0 0 23 0 5 0 594455904 828194816 173651 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 202196 173651 181 55 0 200082 0
[pid=18504/tid=18511] ppid=18502 vsize=808784 CPUtime=1060.82 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 97267 1252 0 0 106069 13 0 0 25 0 5 0 594455924 828194816 173651 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=808784 CPUtime=1056.3 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 168187 1252 0 0 105606 24 0 0 25 0 5 0 594455924 828194816 173651 33554432000 4194304 4417332 140736361115840 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=808784 CPUtime=1062.01 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 223652 1252 0 0 106168 33 0 0 25 0 5 0 594455924 828194816 173651 33554432000 4194304 4417332 140736361115840 18446744073709551615 4307843 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=808784 CPUtime=1061.94 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 367973 1252 0 0 106149 45 0 0 25 0 5 0 594455924 828194816 173651 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4241.29
Current children cumulated vsize (KiB) 808784

[startup+1122.3 s]
/proc/loadavg: 8.06 8.06 7.60 9/186 19054
/proc/meminfo: memFree=17641140/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=907468 CPUtime=4480.96 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 900591 1252 0 0 447975 121 0 0 23 0 5 0 594455904 929247232 198322 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 226867 198322 181 55 0 224753 0
[pid=18504/tid=18511] ppid=18502 vsize=907468 CPUtime=1120.82 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 113485 1252 0 0 112067 15 0 0 25 0 5 0 594455924 929247232 198322 33554432000 4194304 4417332 140736361115840 18446744073709551615 4234678 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=907468 CPUtime=1115.97 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 175743 1252 0 0 111573 24 0 0 25 0 5 0 594455924 929247232 198322 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=907468 CPUtime=1122.02 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 227936 1252 0 0 112168 34 0 0 25 0 5 0 594455924 929247232 198322 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=907468 CPUtime=1121.94 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 373985 1252 0 0 112148 46 0 0 25 0 5 0 594455924 929247232 198322 33554432000 4194304 4417332 140736361115840 18446744073709551615 4357034 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4480.96
Current children cumulated vsize (KiB) 907468

[startup+1182.3 s]
/proc/loadavg: 8.02 8.05 7.63 9/186 19056
/proc/meminfo: memFree=17506696/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=1029520 CPUtime=4720.64 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 1005306 1252 0 0 471928 136 0 0 23 0 5 0 594455904 1054228480 228835 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 257380 228835 181 55 0 255266 0
[pid=18504/tid=18511] ppid=18502 vsize=1029520 CPUtime=1180.82 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 175517 1252 0 0 118059 23 0 0 25 0 5 0 594455924 1054228480 228835 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364720 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=1029520 CPUtime=1175.65 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 182670 1252 0 0 117540 25 0 0 25 0 5 0 594455924 1054228480 228835 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=1029520 CPUtime=1182.02 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 235117 1252 0 0 118167 35 0 0 25 0 5 0 594455924 1054228480 228835 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=1029520 CPUtime=1181.93 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 402560 1252 0 0 118143 50 0 0 25 0 5 0 594455924 1054228480 228835 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4720.64
Current children cumulated vsize (KiB) 1029520



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.01 8.04 7.64 9/186 19057
/proc/meminfo: memFree=17418276/32950928 swapFree=67111524/67111528
[pid=18504] ppid=18502 vsize=1077200 CPUtime=4800.17 cores=0,2,4,6
/proc/18504/stat : 18504 (plingeling) S 18502 18504 18457 0 -1 4202496 1017226 1252 0 0 479879 138 0 0 23 0 5 0 594455904 1103052800 240755 33554432000 4194304 4417332 140736361115840 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/18504/statm: 269300 240755 181 55 0 267186 0
[pid=18504/tid=18511] ppid=18502 vsize=1077200 CPUtime=1200.74 cores=0,2,4,6
/proc/18504/task/18511/stat : 18511 (plingeling) R 18502 18504 18457 0 -1 4202560 177287 1252 0 0 120050 24 0 0 25 0 5 0 594455924 1103052800 240755 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18504/tid=18512] ppid=18502 vsize=1077200 CPUtime=1195.44 cores=0,2,4,6
/proc/18504/task/18512/stat : 18512 (plingeling) R 18502 18504 18457 0 -1 4202560 190862 1252 0 0 119518 26 0 0 25 0 5 0 594455924 1103052800 240755 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=18504/tid=18513] ppid=18502 vsize=1077200 CPUtime=1201.93 cores=0,2,4,6
/proc/18504/task/18513/stat : 18513 (plingeling) R 18502 18504 18457 0 -1 4202560 235117 1252 0 0 120158 35 0 0 25 0 5 0 594455924 1103052800 240755 33554432000 4194304 4417332 140736361115840 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18504/tid=18514] ppid=18502 vsize=1077200 CPUtime=1201.85 cores=0,2,4,6
/proc/18504/task/18514/stat : 18514 (plingeling) R 18502 18504 18457 0 -1 4202560 404518 1252 0 0 120134 51 0 0 25 0 5 0 594455924 1103052800 240755 33554432000 4194304 4417332 140736361115840 18446744073709551615 4251091 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 1077200

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.26
CPU time (s): 4800.24
CPU user time (s): 4798.82
CPU system time (s): 1.42378
CPU usage (%): 399.269
Max. virtual memory (cumulated for all children) (KiB): 1220096

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.82
system time used= 1.42378
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1018478
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 196
involuntary context switches= 24427

runsolver used 1.9777 second user time and 4.5923 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-29 03:57:32
IDJOB=3282491
IDBENCH=70817
IDSOLVER=1605
FILE ID=node115/3282491-1304042252
RUNJOBID= node115-1304042252-18475
PBS_JOBID= 13170384
Free space on /tmp= 72728 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/APPLICATIONS/bitverif/maxxor/maxxor064.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3282491-1304042252/watcher-3282491-1304042252 -o /tmp/evaluation-result-3282491-1304042252/solver-3282491-1304042252 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3282491-1304042252.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 902b28046d424b16042ca612ddad48e0
RANDOM SEED=1315254875

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18618316 kB
Buffers:       2315752 kB
Cached:       11382936 kB
SwapCached:          4 kB
Active:        6790904 kB
Inactive:      6984104 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18618316 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            3268 kB
Writeback:           0 kB
AnonPages:       75880 kB
Mapped:          14824 kB
Slab:           489440 kB
PageTables:       5652 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   259568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72724 MiB
End job on node115 at 2011-04-29 04:17:37