Trace number 3288931

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.34 1201.93

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom25.cnf
MD5SUMc40bd543dad558d19995fef4fd742233
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables67777
Number of clauses227761
Sum of the clauses size582177
Maximum clause length2084
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2115213
Number of clauses of size 3111398
Number of clauses of size 4324
Number of clauses of size 523
Number of clauses of size over 5802

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3288931-1304073027/watcher-3288931-1304073027 -o /tmp/evaluation-result-3288931-1304073027/solver-3288931-1304073027 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3288931-1304073027.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.13 7.94 1/172 14782
/proc/meminfo: memFree=26313016/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=15688 CPUtime=0 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) R 14780 14782 12570 0 -1 4202496 1970 1250 0 0 0 0 0 0 24 0 1 0 518902352 16064512 1899 33554432000 4194304 4417332 140734143746672 18446744073709551615 208079926365 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14782/statm: 3922 1911 140 55 0 1808 0

[startup+0.0922469 s]
/proc/loadavg: 8.11 8.13 7.94 1/172 14782
/proc/meminfo: memFree=26313016/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=33940 CPUtime=0.08 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) R 14780 14782 12570 0 -1 4202496 6628 1250 0 0 7 1 0 0 24 0 1 0 518902352 34754560 6509 33554432000 4194304 4417332 140734143746672 18446744073709551615 4274358 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14782/statm: 8485 6509 148 55 0 6371 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 33940

[startup+0.100242 s]
/proc/loadavg: 8.11 8.13 7.94 1/172 14782
/proc/meminfo: memFree=26313016/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=33940 CPUtime=0.09 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) R 14780 14782 12570 0 -1 4202496 6628 1250 0 0 8 1 0 0 24 0 1 0 518902352 34754560 6509 33554432000 4194304 4417332 140734143746672 18446744073709551615 4259061 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/14782/statm: 8485 6509 148 55 0 6371 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 33940

[startup+0.313317 s]
/proc/loadavg: 8.11 8.13 7.94 1/172 14782
/proc/meminfo: memFree=26313016/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=110264 CPUtime=0.36 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 19019 1250 0 0 34 2 0 0 25 0 5 0 518902352 112910336 14960 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 28173 15802 158 55 0 26059 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 110264

[startup+1.09506 s]
/proc/loadavg: 8.11 8.13 7.94 1/172 14782
/proc/meminfo: memFree=26313016/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=174664 CPUtime=3.48 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 38038 1250 0 0 344 4 0 0 25 0 5 0 518902352 178855936 16475 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 43666 16475 174 55 0 41552 0
Current children cumulated CPU time (s) 3.48
Current children cumulated vsize (KiB) 174664

[startup+1.50099 s]
/proc/loadavg: 8.11 8.13 7.94 9/186 14811
/proc/meminfo: memFree=26197204/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=176196 CPUtime=5.11 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 45462 1250 0 0 506 5 0 0 25 0 5 0 518902352 180424704 17690 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 44049 17690 174 55 0 41935 0
[pid=14782/tid=14804] ppid=14780 vsize=176196 CPUtime=1.2 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 7578 1250 0 0 120 0 0 0 25 0 5 0 518902381 180424704 17690 33554432000 4194304 4417332 140734143746672 18446744073709551615 4288704 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=176196 CPUtime=1.2 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 10340 1250 0 0 119 1 0 0 19 0 5 0 518902381 180424704 17690 33554432000 4194304 4417332 140734143746672 18446744073709551615 4265832 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=176196 CPUtime=1.2 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 8041 1250 0 0 119 1 0 0 25 0 5 0 518902381 180424704 17690 33554432000 4194304 4417332 140734143746672 18446744073709551615 4286414 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=176196 CPUtime=1.2 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 1145 1250 0 0 120 0 0 0 19 0 5 0 518902382 180424704 17690 33554432000 4194304 4417332 140734143746672 18446744073709551615 4356907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.11
Current children cumulated vsize (KiB) 176196

[startup+3.10068 s]
/proc/loadavg: 8.10 8.12 7.94 9/186 14812
/proc/meminfo: memFree=26194920/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=182636 CPUtime=11.49 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 60426 1250 0 0 1142 7 0 0 25 0 5 0 518902352 187019264 19637 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 45659 19637 180 55 0 43545 0
[pid=14782/tid=14804] ppid=14780 vsize=182636 CPUtime=2.8 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 11353 1250 0 0 279 1 0 0 25 0 5 0 518902381 187019264 19637 33554432000 4194304 4417332 140734143746672 18446744073709551615 4340607 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=182636 CPUtime=2.8 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 16387 1250 0 0 278 2 0 0 24 0 5 0 518902381 187019264 19637 33554432000 4194304 4417332 140734143746672 18446744073709551615 4254310 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=182636 CPUtime=2.79 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 13183 1250 0 0 278 1 0 0 25 0 5 0 518902381 187019264 19637 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236255 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=182636 CPUtime=2.79 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 1145 1250 0 0 279 0 0 0 23 0 5 0 518902382 187019264 19637 33554432000 4194304 4417332 140734143746672 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.49
Current children cumulated vsize (KiB) 182636

[startup+6.30107 s]
/proc/loadavg: 8.10 8.12 7.94 9/186 14812
/proc/meminfo: memFree=26161124/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=194420 CPUtime=24.28 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 63479 1250 0 0 2420 8 0 0 25 0 5 0 518902352 199086080 22595 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 48605 22595 180 55 0 46491 0
[pid=14782/tid=14804] ppid=14780 vsize=194420 CPUtime=6 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 12834 1250 0 0 599 1 0 0 25 0 5 0 518902381 199086080 22595 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=194420 CPUtime=6 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 17698 1250 0 0 598 2 0 0 25 0 5 0 518902381 199086080 22595 33554432000 4194304 4417332 140734143746672 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=194420 CPUtime=5.99 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 13444 1250 0 0 598 1 0 0 25 0 5 0 518902381 199086080 22595 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=194420 CPUtime=5.97 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 1145 1250 0 0 597 0 0 0 25 0 5 0 518902382 199086080 22595 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.28
Current children cumulated vsize (KiB) 194420

[startup+12.7008 s]
/proc/loadavg: 8.09 8.12 7.94 9/186 14812
/proc/meminfo: memFree=26141184/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=200860 CPUtime=49.84 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 65706 1250 0 0 4976 8 0 0 25 0 5 0 518902352 205680640 24718 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 50215 24718 181 55 0 48101 0
[pid=14782/tid=14804] ppid=14780 vsize=200860 CPUtime=12.4 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 13328 1250 0 0 1239 1 0 0 25 0 5 0 518902381 205680640 24718 33554432000 4194304 4417332 140734143746672 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=200860 CPUtime=12.4 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 18192 1250 0 0 1238 2 0 0 25 0 5 0 518902381 205680640 24718 33554432000 4194304 4417332 140734143746672 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=200860 CPUtime=12.39 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 14166 1250 0 0 1238 1 0 0 25 0 5 0 518902381 205680640 24718 33554432000 4194304 4417332 140734143746672 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=200860 CPUtime=12.34 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 1662 1250 0 0 1234 0 0 0 25 0 5 0 518902382 205680640 24718 33554432000 4194304 4417332 140734143746672 18446744073709551615 4237002 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.84
Current children cumulated vsize (KiB) 200860

[startup+25.5004 s]
/proc/loadavg: 8.07 8.11 7.94 9/186 14812
/proc/meminfo: memFree=26120228/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=213184 CPUtime=100.97 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 70175 1250 0 0 10089 8 0 0 25 0 5 0 518902352 218300416 27805 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 53296 27805 181 55 0 51182 0
[pid=14782/tid=14804] ppid=14780 vsize=213184 CPUtime=25.2 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 13857 1250 0 0 2519 1 0 0 25 0 5 0 518902381 218300416 27805 33554432000 4194304 4417332 140734143746672 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=213184 CPUtime=25.19 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 18226 1250 0 0 2517 2 0 0 25 0 5 0 518902381 218300416 27805 33554432000 4194304 4417332 140734143746672 18446744073709551615 4277034 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=213184 CPUtime=25.19 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 14227 1250 0 0 2518 1 0 0 25 0 5 0 518902381 218300416 27805 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=213184 CPUtime=25.07 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 5507 1250 0 0 2507 0 0 0 25 0 5 0 518902382 218300416 27805 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.97
Current children cumulated vsize (KiB) 213184

[startup+51.1065 s]
/proc/loadavg: 8.12 8.12 7.95 9/186 14813
/proc/meminfo: memFree=26055448/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=258360 CPUtime=203.25 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 84125 1250 0 0 20315 10 0 0 25 0 5 0 518902352 264560640 39099 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 64590 39099 181 55 0 62476 0
[pid=14782/tid=14804] ppid=14780 vsize=258360 CPUtime=50.81 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 14000 1250 0 0 5080 1 0 0 25 0 5 0 518902381 264560640 39099 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236616 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=258360 CPUtime=50.8 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 20763 1250 0 0 5078 2 0 0 25 0 5 0 518902381 264560640 39099 33554432000 4194304 4417332 140734143746672 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=258360 CPUtime=50.79 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 16827 1250 0 0 5078 1 0 0 25 0 5 0 518902381 264560640 39099 33554432000 4194304 4417332 140734143746672 18446744073709551615 4250807 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=258360 CPUtime=50.53 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 14177 1250 0 0 5052 1 0 0 25 0 5 0 518902382 264560640 39099 33554432000 4194304 4417332 140734143746672 18446744073709551615 4250633 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.25
Current children cumulated vsize (KiB) 258360

[startup+102.301 s]
/proc/loadavg: 8.12 8.12 7.95 9/186 14814
/proc/meminfo: memFree=26038432/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=261208 CPUtime=407.76 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 100753 1250 0 0 40764 12 0 0 25 0 5 0 518902352 267476992 39811 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 65302 39811 181 55 0 63188 0
[pid=14782/tid=14804] ppid=14780 vsize=261208 CPUtime=102 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 16145 1250 0 0 10199 1 0 0 25 0 5 0 518902381 267476992 39811 33554432000 4194304 4417332 140734143746672 18446744073709551615 4353463 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=261208 CPUtime=102 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 24461 1250 0 0 10197 3 0 0 25 0 5 0 518902381 267476992 39811 33554432000 4194304 4417332 140734143746672 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=261208 CPUtime=102 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 17377 1250 0 0 10198 2 0 0 25 0 5 0 518902381 267476992 39811 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=261208 CPUtime=101.44 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 24412 1250 0 0 10142 2 0 0 25 0 5 0 518902382 267476992 39811 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.76
Current children cumulated vsize (KiB) 261208

[startup+162.3 s]
/proc/loadavg: 8.15 8.12 7.96 9/186 14816
/proc/meminfo: memFree=25958536/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=297884 CPUtime=647.44 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 129499 1250 0 0 64727 17 0 0 25 0 5 0 518902352 305033216 48980 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 74471 48980 181 55 0 72357 0
[pid=14782/tid=14804] ppid=14780 vsize=297884 CPUtime=162.01 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 23592 1250 0 0 16198 3 0 0 25 0 5 0 518902381 305033216 48980 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=297884 CPUtime=162 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 31660 1250 0 0 16196 4 0 0 25 0 5 0 518902381 305033216 48980 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=297884 CPUtime=162 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 24016 1250 0 0 16197 3 0 0 25 0 5 0 518902381 305033216 48980 33554432000 4194304 4417332 140734143746672 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=297884 CPUtime=161.12 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 31873 1250 0 0 16108 4 0 0 25 0 5 0 518902382 305033216 48980 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 647.44
Current children cumulated vsize (KiB) 297884


################
# More data... #
################

[pid=14782/tid=14805] ppid=14780 vsize=459888 CPUtime=702.02 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 69156 1250 0 0 70193 9 0 0 25 0 5 0 518902381 470925312 89530 33554432000 4194304 4417332 140734143746672 18446744073709551615 4277945 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=459888 CPUtime=702.01 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 48496 1250 0 0 70196 5 0 0 25 0 5 0 518902381 470925312 89530 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=459888 CPUtime=698.2 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 108457 1250 0 0 69806 14 0 0 25 0 5 0 518902382 470925312 89530 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2804.57
Current children cumulated vsize (KiB) 459888

[startup+762.301 s]
/proc/loadavg: 8.14 8.13 8.03 9/186 14832
/proc/meminfo: memFree=25612144/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=459684 CPUtime=3044.23 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 308716 1250 0 0 304383 40 0 0 25 0 5 0 518902352 470716416 89479 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 114921 89479 181 55 0 112807 0
[pid=14782/tid=14804] ppid=14780 vsize=459684 CPUtime=762.02 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 60153 1250 0 0 76195 7 0 0 25 0 5 0 518902381 470716416 89479 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=459684 CPUtime=762.02 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 69156 1250 0 0 76193 9 0 0 25 0 5 0 518902381 470716416 89479 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=459684 CPUtime=762 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 48496 1250 0 0 76195 5 0 0 25 0 5 0 518902381 470716416 89479 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=459684 CPUtime=757.87 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 112553 1250 0 0 75772 15 0 0 25 0 5 0 518902382 470716416 89479 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364522 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3044.23
Current children cumulated vsize (KiB) 459684

[startup+822.301 s]
/proc/loadavg: 8.13 8.14 8.03 9/186 14833
/proc/meminfo: memFree=25624380/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=475560 CPUtime=3283.9 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 316812 1250 0 0 328349 41 0 0 25 0 5 0 518902352 486973440 93431 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 118890 93431 181 55 0 116776 0
[pid=14782/tid=14804] ppid=14780 vsize=475560 CPUtime=822.03 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 64121 1250 0 0 82195 8 0 0 25 0 5 0 518902381 486973440 93431 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=475560 CPUtime=822.02 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 69171 1250 0 0 82193 9 0 0 25 0 5 0 518902381 486973440 93431 33554432000 4194304 4417332 140734143746672 18446744073709551615 4353458 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=475560 CPUtime=822 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 52609 1250 0 0 82195 5 0 0 25 0 5 0 518902381 486973440 93431 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=475560 CPUtime=817.54 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 112553 1250 0 0 81739 15 0 0 25 0 5 0 518902382 486973440 93431 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3283.9
Current children cumulated vsize (KiB) 475560

[startup+882.301 s]
/proc/loadavg: 8.10 8.12 8.03 9/186 14835
/proc/meminfo: memFree=25609088/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=467976 CPUtime=3523.59 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 325186 1250 0 0 352317 42 0 0 25 0 5 0 518902352 479207424 91535 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 116994 91535 181 55 0 114880 0
[pid=14782/tid=14804] ppid=14780 vsize=467976 CPUtime=882.03 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 64121 1250 0 0 88195 8 0 0 25 0 5 0 518902381 479207424 91535 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=467976 CPUtime=882.02 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 69999 1250 0 0 88193 9 0 0 25 0 5 0 518902381 479207424 91535 33554432000 4194304 4417332 140734143746672 18446744073709551615 4365045 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=467976 CPUtime=882 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 54143 1250 0 0 88195 5 0 0 25 0 5 0 518902381 479207424 91535 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=467976 CPUtime=877.22 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 118565 1250 0 0 87706 16 0 0 25 0 5 0 518902382 479207424 91535 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3523.59
Current children cumulated vsize (KiB) 467976

[startup+942.301 s]
/proc/loadavg: 8.08 8.11 8.03 9/186 14837
/proc/meminfo: memFree=25560580/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=509180 CPUtime=3763.27 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 356513 1250 0 0 376281 46 0 0 25 0 5 0 518902352 521400320 101836 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 127295 101836 181 55 0 125181 0
[pid=14782/tid=14804] ppid=14780 vsize=509180 CPUtime=942.03 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 64137 1250 0 0 94195 8 0 0 25 0 5 0 518902381 521400320 101836 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=509180 CPUtime=942.02 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 70016 1250 0 0 94193 9 0 0 25 0 5 0 518902381 521400320 101836 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=509180 CPUtime=942 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 58255 1250 0 0 94194 6 0 0 25 0 5 0 518902381 521400320 101836 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=509180 CPUtime=936.89 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 145747 1250 0 0 93670 19 0 0 25 0 5 0 518902382 521400320 101836 33554432000 4194304 4417332 140734143746672 18446744073709551615 4357108 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3763.27
Current children cumulated vsize (KiB) 509180

[startup+1002.3 s]
/proc/loadavg: 8.03 8.09 8.02 9/186 14838
/proc/meminfo: memFree=25605440/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=464880 CPUtime=4002.95 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 380293 1250 0 0 400245 50 0 0 25 0 5 0 518902352 476037120 90761 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 116220 90761 181 55 0 114106 0
[pid=14782/tid=14804] ppid=14780 vsize=464880 CPUtime=1002.03 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 68233 1250 0 0 100195 8 0 0 25 0 5 0 518902381 476037120 90761 33554432000 4194304 4417332 140734143746672 18446744073709551615 4357618 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=464880 CPUtime=1002.02 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 74112 1250 0 0 100192 10 0 0 25 0 5 0 518902381 476037120 90761 33554432000 4194304 4417332 140734143746672 18446744073709551615 4232626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=464880 CPUtime=1002 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 58255 1250 0 0 100194 6 0 0 25 0 5 0 518902381 476037120 90761 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=464880 CPUtime=996.57 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 161335 1250 0 0 99635 22 0 0 25 0 5 0 518902382 476037120 90761 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364522 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4002.95
Current children cumulated vsize (KiB) 464880

[startup+1062.3 s]
/proc/loadavg: 8.07 8.09 8.02 9/186 14840
/proc/meminfo: memFree=25366092/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=579692 CPUtime=4242.62 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 409029 1250 0 0 424209 53 0 0 25 0 5 0 518902352 593604608 119464 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 144923 119464 181 55 0 142809 0
[pid=14782/tid=14804] ppid=14780 vsize=579692 CPUtime=1062.03 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 79433 1250 0 0 106194 9 0 0 25 0 5 0 518902381 593604608 119464 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364389 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=579692 CPUtime=1062.03 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 79345 1250 0 0 106192 11 0 0 25 0 5 0 518902381 593604608 119464 33554432000 4194304 4417332 140734143746672 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=579692 CPUtime=1062.01 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 66462 1250 0 0 106194 7 0 0 25 0 5 0 518902381 593604608 119464 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=579692 CPUtime=1056.24 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 165431 1250 0 0 105602 22 0 0 25 0 5 0 518902382 593604608 119464 33554432000 4194304 4417332 140734143746672 18446744073709551615 4353957 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4242.62
Current children cumulated vsize (KiB) 579692

[startup+1122.3 s]
/proc/loadavg: 8.09 8.09 8.02 9/186 14841
/proc/meminfo: memFree=25465012/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=579636 CPUtime=4482.3 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 429370 1250 0 0 448174 56 0 0 25 0 5 0 518902352 593547264 119450 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 144909 119450 181 55 0 142795 0
[pid=14782/tid=14804] ppid=14780 vsize=579636 CPUtime=1122.03 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 83529 1250 0 0 112193 10 0 0 25 0 5 0 518902381 593547264 119450 33554432000 4194304 4417332 140734143746672 18446744073709551615 4365076 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=579636 CPUtime=1122.03 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 83441 1250 0 0 112192 11 0 0 25 0 5 0 518902381 593547264 119450 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=579636 CPUtime=1122 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 78611 1250 0 0 112192 8 0 0 25 0 5 0 518902381 593547264 119450 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=579636 CPUtime=1115.92 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 165431 1250 0 0 111570 22 0 0 25 0 5 0 518902382 593547264 119450 33554432000 4194304 4417332 140734143746672 18446744073709551615 4365026 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4482.3
Current children cumulated vsize (KiB) 579636

[startup+1182.3 s]
/proc/loadavg: 8.12 8.10 8.03 9/186 14843
/proc/meminfo: memFree=25416852/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=579772 CPUtime=4721.99 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 437613 1250 0 0 472142 57 0 0 25 0 5 0 518902352 593686528 119484 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 144943 119484 181 55 0 142829 0
[pid=14782/tid=14804] ppid=14780 vsize=579772 CPUtime=1182.03 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 87642 1250 0 0 118193 10 0 0 25 0 5 0 518902381 593686528 119484 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=579772 CPUtime=1182.03 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 83458 1250 0 0 118192 11 0 0 25 0 5 0 518902381 593686528 119484 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=579772 CPUtime=1182.01 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 82724 1250 0 0 118192 9 0 0 25 0 5 0 518902381 593686528 119484 33554432000 4194304 4417332 140734143746672 18446744073709551615 4357063 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=579772 CPUtime=1175.59 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 165431 1250 0 0 117537 22 0 0 25 0 5 0 518902382 593686528 119484 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4721.99
Current children cumulated vsize (KiB) 579772



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.15 8.10 8.03 9/186 14844
/proc/meminfo: memFree=25386464/32950928 swapFree=67111364/67111528
[pid=14782] ppid=14780 vsize=563388 CPUtime=4800.29 cores=1,3,5,7
/proc/14782/stat : 14782 (plingeling) S 14780 14782 12570 0 -1 4202496 441709 1250 0 0 479972 57 0 0 25 0 5 0 518902352 576909312 115388 33554432000 4194304 4417332 140734143746672 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 7 0 0 0
/proc/14782/statm: 140847 115388 181 55 0 138733 0
[pid=14782/tid=14804] ppid=14780 vsize=563388 CPUtime=1201.64 cores=1,3,5,7
/proc/14782/task/14804/stat : 14804 (plingeling) R 14780 14782 12570 0 -1 4202560 87642 1250 0 0 120154 10 0 0 25 0 5 0 518902381 576909312 115388 33554432000 4194304 4417332 140734143746672 18446744073709551615 4366042 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=14782/tid=14805] ppid=14780 vsize=563388 CPUtime=1201.64 cores=1,3,5,7
/proc/14782/task/14805/stat : 14805 (plingeling) R 14780 14782 12570 0 -1 4202560 87554 1250 0 0 120152 12 0 0 25 0 5 0 518902381 576909312 115388 33554432000 4194304 4417332 140734143746672 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=14782/tid=14806] ppid=14780 vsize=563388 CPUtime=1201.61 cores=1,3,5,7
/proc/14782/task/14806/stat : 14806 (plingeling) R 14780 14782 12570 0 -1 4202560 82724 1250 0 0 120152 9 0 0 25 0 5 0 518902381 576909312 115388 33554432000 4194304 4417332 140734143746672 18446744073709551615 4236554 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=14782/tid=14807] ppid=14780 vsize=563388 CPUtime=1195.08 cores=1,3,5,7
/proc/14782/task/14807/stat : 14807 (plingeling) R 14780 14782 12570 0 -1 4202560 165431 1250 0 0 119486 22 0 0 25 0 5 0 518902382 576909312 115388 33554432000 4194304 4417332 140734143746672 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 563388

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.93
CPU time (s): 4800.34
CPU user time (s): 4799.74
CPU system time (s): 0.596909
CPU usage (%): 399.386
Max. virtual memory (cumulated for all children) (KiB): 602996

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.74
system time used= 0.596909
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 442959
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 168
involuntary context switches= 33375

runsolver used 2.07168 second user time and 4.49132 second system time

The end

Launcher Data 

Begin job on node127 at 2011-04-29 12:30:27
IDJOB=3288931
IDBENCH=83109
IDSOLVER=1605
FILE ID=node127/3288931-1304073027
RUNJOBID= node127-1304071822-14667
PBS_JOBID= 13170417
Free space on /tmp= 71816 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom25.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3288931-1304073027/watcher-3288931-1304073027 -o /tmp/evaluation-result-3288931-1304073027/solver-3288931-1304073027 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3288931-1304073027.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c40bd543dad558d19995fef4fd742233
RANDOM SEED=1536599082

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26313296 kB
Buffers:       1391072 kB
Cached:        4707392 kB
SwapCached:          0 kB
Active:        1755360 kB
Inactive:      4406820 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26313296 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            3940 kB
Writeback:           0 kB
AnonPages:       63672 kB
Mapped:          14684 kB
Slab:           410024 kB
PageTables:       4264 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   182960 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71812 MiB
End job on node127 at 2011-04-29 12:50:31