Trace number 3394076

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.9 5009.39

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2100c215164gyes7.cnf
MD5SUM140eea74f7e66501965365160d02fa4d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2100
Number of clauses215164
Sum of the clauses size432288
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2215094
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 570

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394076-1306084729/watcher-3394076-1306084729 -o /tmp/evaluation-result-3394076-1306084729/solver-3394076-1306084729 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394076-1306084729.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.36 7.92 7.99 2/422 16720
/proc/meminfo: memFree=15943748/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=10452 CPUtime=0.01 cores=0-7
/proc/16720/stat : 16720 (plingeling) R 16718 16720 16694 0 -1 4202496 697 1261 0 0 1 0 0 0 21 0 1 0 720073362 10702848 627 33554432000 4194304 4417452 140735950735152 18446744073709551615 4261983 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16720/statm: 2613 627 147 55 0 499 0

[startup+0.0574691 s]
/proc/loadavg: 7.36 7.92 7.99 2/422 16720
/proc/meminfo: memFree=15943748/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=19520 CPUtime=0.05 cores=0-7
/proc/16720/stat : 16720 (plingeling) R 16718 16720 16694 0 -1 4202496 2969 1261 0 0 5 0 0 0 21 0 1 0 720073362 19988480 2899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4259889 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16720/statm: 4880 2899 148 55 0 2766 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 19520

[startup+0.100462 s]
/proc/loadavg: 7.36 7.92 7.99 2/422 16720
/proc/meminfo: memFree=15943748/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=27712 CPUtime=0.09 cores=0-7
/proc/16720/stat : 16720 (plingeling) R 16718 16720 16694 0 -1 4202496 5017 1261 0 0 9 0 0 0 21 0 1 0 720073362 28377088 4947 33554432000 4194304 4417452 140735950735152 18446744073709551615 4259618 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16720/statm: 6928 4947 148 55 0 4814 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27712

[startup+0.455654 s]
/proc/loadavg: 7.36 7.92 7.99 2/422 16720
/proc/meminfo: memFree=15943748/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=197752 CPUtime=1.72 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 11125 1261 0 0 171 1 0 0 18 0 9 0 720073362 202498048 10636 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 49438 10666 176 55 0 47324 0
Current children cumulated CPU time (s) 1.72
Current children cumulated vsize (KiB) 197752

[startup+0.700309 s]
/proc/loadavg: 7.36 7.92 7.99 2/422 16720
/proc/meminfo: memFree=15943748/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=209116 CPUtime=3.65 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 29818 1261 0 0 360 5 0 0 18 0 9 0 720073362 214134784 13604 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 52279 13604 180 55 0 50165 0
Current children cumulated CPU time (s) 3.65
Current children cumulated vsize (KiB) 209116

[startup+1.50115 s]
/proc/loadavg: 7.36 7.92 7.99 9/431 16734
/proc/meminfo: memFree=15853916/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=250472 CPUtime=10.02 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 42659 1261 0 0 995 7 0 0 18 0 9 0 720073362 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 62618 23847 180 55 0 60504 0
[pid=16720/tid=16727] ppid=16718 vsize=250472 CPUtime=1.21 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 4003 1261 0 0 121 0 0 0 19 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249216 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=250472 CPUtime=1.21 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 4778 1261 0 0 121 0 0 0 19 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=250472 CPUtime=1.2 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 3234 1261 0 0 120 0 0 0 25 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=250472 CPUtime=1.22 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 5355 1261 0 0 121 1 0 0 19 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=250472 CPUtime=1.2 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 3325 1261 0 0 120 0 0 0 19 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249943 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=250472 CPUtime=1.21 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 4251 1261 0 0 121 0 0 0 22 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=250472 CPUtime=1.21 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 4104 1261 0 0 121 0 0 0 19 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=250472 CPUtime=1.21 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 4479 1261 0 0 121 0 0 0 22 0 9 0 720073389 256483328 23847 33554432000 4194304 4417452 140735950735152 18446744073709551615 4258472 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.02
Current children cumulated vsize (KiB) 250472

[startup+3.10086 s]
/proc/loadavg: 7.49 7.93 8.00 9/431 16734
/proc/meminfo: memFree=15838912/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=278332 CPUtime=22.81 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 54679 1261 0 0 2271 10 0 0 18 0 9 0 720073362 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 69583 30812 180 55 0 67469 0
[pid=16720/tid=16727] ppid=16718 vsize=278332 CPUtime=2.81 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 4003 1261 0 0 281 0 0 0 22 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4258625 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=278332 CPUtime=2.81 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 5864 1261 0 0 281 0 0 0 22 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4248926 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=278332 CPUtime=2.8 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 3234 1261 0 0 280 0 0 0 25 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=278332 CPUtime=2.82 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 14090 1261 0 0 279 3 0 0 22 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=278332 CPUtime=2.78 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 3325 1261 0 0 278 0 0 0 22 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=278332 CPUtime=2.81 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 5337 1261 0 0 281 0 0 0 25 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4236343 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=278332 CPUtime=2.81 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 4131 1261 0 0 281 0 0 0 22 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=278332 CPUtime=2.81 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 5565 1261 0 0 281 0 0 0 25 0 9 0 720073389 285011968 30812 33554432000 4194304 4417452 140735950735152 18446744073709551615 4258389 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 22.81
Current children cumulated vsize (KiB) 278332

[startup+6.30125 s]
/proc/loadavg: 7.49 7.93 8.00 9/431 16735
/proc/meminfo: memFree=15816352/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=296720 CPUtime=48.37 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 69005 1261 0 0 4825 12 0 0 18 0 9 0 720073362 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 74180 35409 180 55 0 72066 0
[pid=16720/tid=16727] ppid=16718 vsize=296720 CPUtime=6.01 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 4003 1261 0 0 601 0 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=296720 CPUtime=6.01 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 5864 1261 0 0 601 0 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=296720 CPUtime=6 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 3586 1261 0 0 600 0 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=296720 CPUtime=6.01 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 27866 1261 0 0 596 5 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=296720 CPUtime=5.94 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 3325 1261 0 0 594 0 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249216 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=296720 CPUtime=6.01 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 5337 1261 0 0 601 0 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=296720 CPUtime=6.01 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 4329 1261 0 0 601 0 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=296720 CPUtime=6.01 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 5565 1261 0 0 601 0 0 0 25 0 9 0 720073389 303841280 35409 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 48.37
Current children cumulated vsize (KiB) 296720

[startup+12.7011 s]
/proc/loadavg: 7.57 7.94 8.00 9/431 16735
/proc/meminfo: memFree=15756244/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=353124 CPUtime=99.48 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 99344 1261 0 0 9930 18 0 0 18 0 9 0 720073362 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 88281 49510 180 55 0 86167 0
[pid=16720/tid=16727] ppid=16718 vsize=353124 CPUtime=12.41 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 6174 1261 0 0 1241 0 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4250022 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=353124 CPUtime=12.41 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 6949 1261 0 0 1241 0 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=353124 CPUtime=12.4 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 3586 1261 0 0 1240 0 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=353124 CPUtime=12.42 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 50608 1261 0 0 1232 10 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=353124 CPUtime=12.25 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 5496 1261 0 0 1224 1 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=353124 CPUtime=12.42 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 6422 1261 0 0 1241 1 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=353124 CPUtime=12.41 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 4329 1261 0 0 1241 0 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=353124 CPUtime=12.41 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 6650 1261 0 0 1240 1 0 0 25 0 9 0 720073389 361598976 49510 33554432000 4194304 4417452 140735950735152 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 99.48
Current children cumulated vsize (KiB) 353124

[startup+25.5007 s]
/proc/loadavg: 7.64 7.94 8.00 9/431 16735
/proc/meminfo: memFree=15701960/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=398816 CPUtime=201.7 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 144517 1261 0 0 20145 25 0 0 18 0 9 0 720073362 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 99704 62436 180 55 0 97590 0
[pid=16720/tid=16727] ppid=16718 vsize=398816 CPUtime=25.22 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 11376 1261 0 0 2521 1 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=398816 CPUtime=25.22 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 6949 1261 0 0 2521 1 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4366590 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=398816 CPUtime=25.19 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 6782 1261 0 0 2519 0 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=398816 CPUtime=25.21 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 82820 1261 0 0 2506 15 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=398816 CPUtime=24.87 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 5496 1261 0 0 2486 1 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4251076 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=398816 CPUtime=25.22 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 6784 1261 0 0 2521 1 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=398816 CPUtime=25.22 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 7726 1261 0 0 2521 1 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=398816 CPUtime=25.21 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 7454 1261 0 0 2520 1 0 0 25 0 9 0 720073389 408387584 62436 33554432000 4194304 4417452 140735950735152 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 201.7
Current children cumulated vsize (KiB) 398816

[startup+51.1009 s]
/proc/loadavg: 7.76 7.94 8.00 9/431 16736
/proc/meminfo: memFree=15595452/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=508200 CPUtime=406.14 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 212629 1261 0 0 40576 38 0 0 18 0 9 0 720073362 520396800 88358 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 127050 88358 180 55 0 124936 0
[pid=16720/tid=16727] ppid=16718 vsize=508200 CPUtime=50.81 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 13834 1261 0 0 5080 1 0 0 25 0 9 0 720073389 520396800 88358 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=508200 CPUtime=50.82 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 7726 1261 0 0 5081 1 0 0 25 0 9 0 720073389 520396800 88358 33554432000 4194304 4417452 140735950735152 18446744073709551615 4357244 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=508200 CPUtime=50.8 cores=0-7

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.05 8.06 8.00 9/431 16872
/proc/meminfo: memFree=11001904/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=5086584 CPUtime=37709.6 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 4468103 1261 0 0 3770162 796 0 0 18 0 9 0 720073362 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 1271646 1233483 180 55 0 1269532 0
[pid=16720/tid=16727] ppid=16718 vsize=5086584 CPUtime=4677.71 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 586206 1261 0 0 467681 90 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364420 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=5086584 CPUtime=4721.35 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 171760 1261 0 0 472113 22 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4358214 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=5086584 CPUtime=4722.15 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 837544 1261 0 0 472091 124 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=5086584 CPUtime=4721.12 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 2015524 1261 0 0 471686 426 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=5086584 CPUtime=4716.71 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 83785 1261 0 0 471661 10 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=5086584 CPUtime=4722.05 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 148907 1261 0 0 472186 19 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=5086584 CPUtime=4706.13 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 94290 1261 0 0 470599 14 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=5086584 CPUtime=4722.05 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 520957 1261 0 0 472117 88 0 0 25 0 9 0 720073389 5208662016 1233483 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37709.6
Current children cumulated vsize (KiB) 5086584

[startup+4782.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/431 16874
/proc/meminfo: memFree=10934312/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=5153636 CPUtime=38188.6 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 4494702 1261 0 0 3818062 801 0 0 18 0 9 0 720073362 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 1288409 1250246 180 55 0 1286295 0
[pid=16720/tid=16727] ppid=16718 vsize=5153636 CPUtime=4737.7 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 591838 1261 0 0 473678 92 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=5153636 CPUtime=4781.33 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 176342 1261 0 0 478110 23 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=5153636 CPUtime=4782.14 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 837544 1261 0 0 478090 124 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=5153636 CPUtime=4781.09 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 2015524 1261 0 0 477683 426 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=5153636 CPUtime=4776.7 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 83785 1261 0 0 477660 10 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=5153636 CPUtime=4782.04 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 148907 1261 0 0 478185 19 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=5153636 CPUtime=4765.27 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 94290 1261 0 0 476513 14 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4232666 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=5153636 CPUtime=4782.04 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 537342 1261 0 0 478114 90 0 0 25 0 9 0 720073389 5277323264 1250246 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38188.6
Current children cumulated vsize (KiB) 5153636

[startup+4842.32 s]
/proc/loadavg: 8.03 8.05 8.00 9/431 16875
/proc/meminfo: memFree=10743336/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=5345016 CPUtime=38667.9 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 4588100 1261 0 0 3865973 817 0 0 18 0 9 0 720073362 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 1336254 1298091 180 55 0 1334140 0
[pid=16720/tid=16727] ppid=16718 vsize=5345016 CPUtime=4797.71 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 638564 1261 0 0 479672 99 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=5345016 CPUtime=4841.35 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 187926 1261 0 0 484110 25 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=5345016 CPUtime=4842.16 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 837544 1261 0 0 484092 124 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=5345016 CPUtime=4841.09 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 2020171 1261 0 0 483682 427 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=5345016 CPUtime=4836.72 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 97841 1261 0 0 483660 12 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=5345016 CPUtime=4842.06 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 148907 1261 0 0 484187 19 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4343748 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=5345016 CPUtime=4824.42 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 94290 1261 0 0 482428 14 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=5345016 CPUtime=4842.06 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 553727 1261 0 0 484113 93 0 0 25 0 9 0 720073389 5473296384 1298091 33554432000 4194304 4417452 140735950735152 18446744073709551615 4366674 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38667.9
Current children cumulated vsize (KiB) 5345016

[startup+4902.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/431 16877
/proc/meminfo: memFree=10928832/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=5160248 CPUtime=39146.9 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 4676480 1261 0 0 3913859 833 0 0 18 0 9 0 720073362 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 1290062 1251899 180 55 0 1287948 0
[pid=16720/tid=16727] ppid=16718 vsize=5160248 CPUtime=4857.7 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 653603 1261 0 0 485668 102 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=5160248 CPUtime=4901.34 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 191094 1261 0 0 490108 26 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=5160248 CPUtime=4902.14 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 837544 1261 0 0 490090 124 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=5160248 CPUtime=4901.06 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 2043652 1261 0 0 489672 434 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=5160248 CPUtime=4896.7 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 105017 1261 0 0 489657 13 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=5160248 CPUtime=4902.04 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 148907 1261 0 0 490185 19 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=5160248 CPUtime=4883.57 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 94290 1261 0 0 488343 14 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=5160248 CPUtime=4902.04 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 593243 1261 0 0 490106 98 0 0 25 0 9 0 720073389 5284093952 1251899 33554432000 4194304 4417452 140735950735152 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39146.9
Current children cumulated vsize (KiB) 5160248

[startup+4962.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/431 16879
/proc/meminfo: memFree=10853420/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=5233828 CPUtime=39626.1 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 4724638 1261 0 0 3961768 840 0 0 18 0 9 0 720073362 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 1308457 1270774 180 55 0 1306343 0
[pid=16720/tid=16727] ppid=16718 vsize=5233828 CPUtime=4917.7 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 662947 1261 0 0 491667 103 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=5233828 CPUtime=4961.34 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 199437 1261 0 0 496107 27 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=5233828 CPUtime=4962.14 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 837544 1261 0 0 496090 124 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=5233828 CPUtime=4961.05 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 2043652 1261 0 0 495671 434 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=5233828 CPUtime=4956.7 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 108569 1261 0 0 495657 13 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=5233828 CPUtime=4962.04 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 153003 1261 0 0 496185 19 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=5233828 CPUtime=4942.71 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 94290 1261 0 0 494257 14 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=5233828 CPUtime=4962.05 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 616066 1261 0 0 496104 101 0 0 25 0 9 0 720073389 5359439872 1270774 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39626.1
Current children cumulated vsize (KiB) 5233828



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.2 s]
/proc/loadavg: 8.09 8.05 8.00 9/431 16880
/proc/meminfo: memFree=10848688/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=5239284 CPUtime=40000.7 cores=0-7
/proc/16720/stat : 16720 (plingeling) S 16718 16720 16694 0 -1 4202496 4730611 1261 0 0 3999229 841 0 0 18 0 9 0 720073362 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 1309821 1271658 180 55 0 1307707 0
[pid=16720/tid=16727] ppid=16718 vsize=5239284 CPUtime=4964.62 cores=0-7
/proc/16720/task/16727/stat : 16727 (plingeling) R 16718 16720 16694 0 -1 4202560 662947 1261 0 0 496359 103 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16720/tid=16728] ppid=16718 vsize=5239284 CPUtime=5008.25 cores=0-7
/proc/16720/task/16728/stat : 16728 (plingeling) R 16718 16720 16694 0 -1 4202560 204897 1261 0 0 500797 28 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16720/tid=16729] ppid=16718 vsize=5239284 CPUtime=5009.06 cores=0-7
/proc/16720/task/16729/stat : 16729 (plingeling) R 16718 16720 16694 0 -1 4202560 837544 1261 0 0 500782 124 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16720/tid=16730] ppid=16718 vsize=5239284 CPUtime=5007.96 cores=0-7
/proc/16720/task/16730/stat : 16730 (plingeling) R 16718 16720 16694 0 -1 4202560 2043652 1261 0 0 500362 434 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16720/tid=16731] ppid=16718 vsize=5239284 CPUtime=5003.62 cores=0-7
/proc/16720/task/16731/stat : 16731 (plingeling) R 16718 16720 16694 0 -1 4202560 109082 1261 0 0 500349 13 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16720/tid=16732] ppid=16718 vsize=5239284 CPUtime=5008.96 cores=0-7
/proc/16720/task/16732/stat : 16732 (plingeling) R 16718 16720 16694 0 -1 4202560 153003 1261 0 0 500877 19 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=5239284 CPUtime=4988.94 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4202560 94290 1261 0 0 498880 14 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=16720/tid=16734] ppid=16718 vsize=5239284 CPUtime=5008.96 cores=0-7
/proc/16720/task/16734/stat : 16734 (plingeling) R 16718 16720 16694 0 -1 4202560 616066 1261 0 0 500795 101 0 0 25 0 9 0 720073389 5365026816 1271658 33554432000 4194304 4417452 140735950735152 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 5239284

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.32 s]
/proc/loadavg: 8.09 8.05 8.00 9/431 16880
/proc/meminfo: memFree=10848688/32951124 swapFree=44485824/67111528
[pid=16720] ppid=16718 vsize=0 CPUtime=40000.9 cores=0-7
/proc/16720/stat : 16720 (plingeling) Z 16718 16720 16694 0 -1 4203548 4730612 1261 0 0 3999234 851 0 0 18 0 2 0 720073362 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/16720/statm: 0 0 0 0 0 0 0
[pid=16720/tid=16733] ppid=16718 vsize=0 CPUtime=4989.05 cores=0-7
/proc/16720/task/16733/stat : 16733 (plingeling) R 16718 16720 16694 0 -1 4203588 94290 1261 0 0 498881 24 0 0 25 0 2 0 720073389 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.39
CPU time (s): 40000.9
CPU user time (s): 39992.3
CPU system time (s): 8.5837
CPU usage (%): 798.518
Max. virtual memory (cumulated for all children) (KiB): 5387268

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39992.3
system time used= 8.5837
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4731873
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 857
involuntary context switches= 144153

runsolver used 19.738 second user time and 50.2454 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-22 19:18:49
IDJOB=3394076
IDBENCH=71367
IDSOLVER=1851
FILE ID=node105/3394076-1306084729
RUNJOBID= node105-1306084729-16708
PBS_JOBID= 13387919
Free space on /tmp= 73112 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2100c215164gyes7.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394076-1306084729/watcher-3394076-1306084729 -o /tmp/evaluation-result-3394076-1306084729/solver-3394076-1306084729 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394076-1306084729.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 140eea74f7e66501965365160d02fa4d
RANDOM SEED=1999238433

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15943904 kB
Buffers:        349984 kB
Cached:       12754344 kB
SwapCached:      39596 kB
Active:        6584700 kB
Inactive:     10106132 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15943904 kB
SwapTotal:    67111528 kB
SwapFree:     44485824 kB
Dirty:            3164 kB
Writeback:           0 kB
AnonPages:     3554876 kB
Mapped:          18844 kB
Slab:           165672 kB
PageTables:      81792 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 114856796 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73112 MiB
End job on node105 at 2011-05-22 20:42:20