Trace number 3282307

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.14 1202.35

General information on the benchmark

NameAPPLICATIONS/bitverif/countbitswegner/
countbitswegner128.cnf
MD5SUM4b75ef7fb46928f50793af1d74c176e2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4342.44
Satisfiable
(Un)Satisfiability was proved
Number of variables98048
Number of clauses293759
Sum of the clauses size685435
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2195838
Number of clauses of size 397919
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3282307-1304041777/watcher-3282307-1304041777 -o /tmp/evaluation-result-3282307-1304041777/solver-3282307-1304041777 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3282307-1304041777.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.32 4.97 5.20 3/178 3688
/proc/meminfo: memFree=25113940/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 216 0 0 0 0 0 0 0 17 0 1 0 515775960 8937472 146 33554432000 4194304 4417332 140733221433136 18446744073709551615 246516834048 0 0 4096 0 18446744071562362840 0 0 17 0 0 0 0
/proc/3688/statm: 2182 146 122 55 0 68 0

[startup+0.103467 s]
/proc/loadavg: 4.32 4.97 5.20 3/178 3688
/proc/meminfo: memFree=25113940/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=27744 CPUtime=0.09 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) R 3686 3688 2100 0 -1 4202496 5032 1254 0 0 9 0 0 0 19 0 1 0 515775960 28409856 4959 33554432000 4194304 4417332 140733221433136 18446744073709551615 246516834048 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/3688/statm: 6936 4959 148 55 0 4822 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27744

[startup+0.200452 s]
/proc/loadavg: 4.32 4.97 5.20 3/178 3688
/proc/meminfo: memFree=25113940/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=45304 CPUtime=0.19 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) R 3686 3688 2100 0 -1 4202496 9452 1254 0 0 18 1 0 0 19 0 1 0 515775960 46391296 9349 33554432000 4194304 4417332 140733221433136 18446744073709551615 246516834048 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/3688/statm: 11326 9349 148 55 0 9212 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 45304

[startup+0.300415 s]
/proc/loadavg: 4.32 4.97 5.20 3/178 3688
/proc/meminfo: memFree=25113940/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=80640 CPUtime=0.29 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) R 3686 3688 2100 0 -1 4202496 18286 1254 0 0 27 2 0 0 19 0 1 0 515775960 82575360 18183 33554432000 4194304 4417332 140733221433136 18446744073709551615 246516834048 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/3688/statm: 20160 18183 148 55 0 18046 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 80640

[startup+0.700285 s]
/proc/loadavg: 4.32 4.97 5.20 3/178 3688
/proc/meminfo: memFree=25113940/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=135412 CPUtime=1.36 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 29381 1254 0 0 132 4 0 0 19 0 5 0 515775960 138661888 21227 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 33853 21252 171 55 0 31739 0
Current children cumulated CPU time (s) 1.36
Current children cumulated vsize (KiB) 135412

[startup+1.50111 s]
/proc/loadavg: 4.32 4.97 5.20 9/190 3716
/proc/meminfo: memFree=24888004/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=194644 CPUtime=4.55 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 31892 1254 0 0 451 4 0 0 19 0 5 0 515775960 199315456 20121 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 48661 20121 172 55 0 46547 0
[pid=3688/tid=3706] ppid=3686 vsize=194644 CPUtime=1.09 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 4124 1254 0 0 109 0 0 0 24 0 5 0 515775996 199315456 20121 33554432000 4194304 4417332 140733221433136 18446744073709551615 4276587 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=194644 CPUtime=1.02 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 3054 1254 0 0 102 0 0 0 23 0 5 0 515775996 199315456 20121 33554432000 4194304 4417332 140733221433136 18446744073709551615 4276491 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=194644 CPUtime=0.96 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 4526 1254 0 0 96 0 0 0 23 0 5 0 515775996 199315456 20121 33554432000 4194304 4417332 140733221433136 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=194644 CPUtime=1.09 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 1890 1254 0 0 109 0 0 0 24 0 5 0 515775996 199315456 20121 33554432000 4194304 4417332 140733221433136 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.55
Current children cumulated vsize (KiB) 194644

[startup+3.10081 s]
/proc/loadavg: 4.62 5.02 5.21 9/190 3716
/proc/meminfo: memFree=24811496/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=234296 CPUtime=10.95 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 47062 1254 0 0 1089 6 0 0 19 0 5 0 515775960 239919104 30007 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 58574 30007 177 55 0 56460 0
[pid=3688/tid=3706] ppid=3686 vsize=234296 CPUtime=2.69 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 10016 1254 0 0 268 1 0 0 25 0 5 0 515775996 239919104 30007 33554432000 4194304 4417332 140733221433136 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=234296 CPUtime=2.62 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 7103 1254 0 0 262 0 0 0 25 0 5 0 515775996 239919104 30007 33554432000 4194304 4417332 140733221433136 18446744073709551615 4302020 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=234296 CPUtime=2.57 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 9753 1254 0 0 256 1 0 0 25 0 5 0 515775996 239919104 30007 33554432000 4194304 4417332 140733221433136 18446744073709551615 4339766 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=234296 CPUtime=2.68 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 1892 1254 0 0 268 0 0 0 25 0 5 0 515775996 239919104 30007 33554432000 4194304 4417332 140733221433136 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10.95
Current children cumulated vsize (KiB) 234296

[startup+6.30023 s]
/proc/loadavg: 4.62 5.02 5.21 9/190 3716
/proc/meminfo: memFree=24798052/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=234628 CPUtime=23.72 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 47170 1254 0 0 2366 6 0 0 19 0 5 0 515775960 240259072 30105 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 58657 30105 180 55 0 56543 0
[pid=3688/tid=3706] ppid=3686 vsize=234628 CPUtime=5.89 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 10022 1254 0 0 588 1 0 0 25 0 5 0 515775996 240259072 30105 33554432000 4194304 4417332 140733221433136 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=234628 CPUtime=5.82 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 7202 1254 0 0 581 1 0 0 25 0 5 0 515775996 240259072 30105 33554432000 4194304 4417332 140733221433136 18446744073709551615 4252007 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=234628 CPUtime=5.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 9756 1254 0 0 576 1 0 0 25 0 5 0 515775996 240259072 30105 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=234628 CPUtime=5.86 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 1892 1254 0 0 586 0 0 0 25 0 5 0 515775996 240259072 30105 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 23.72
Current children cumulated vsize (KiB) 234628

[startup+12.7011 s]
/proc/loadavg: 5.14 5.12 5.24 9/190 3716
/proc/meminfo: memFree=24767056/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=230260 CPUtime=49.29 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 52607 1254 0 0 4922 7 0 0 19 0 5 0 515775960 235786240 29013 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 57565 29013 180 55 0 55451 0
[pid=3688/tid=3706] ppid=3686 vsize=230260 CPUtime=12.29 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 10022 1254 0 0 1228 1 0 0 25 0 5 0 515775996 235786240 29013 33554432000 4194304 4417332 140733221433136 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=230260 CPUtime=12.22 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 7714 1254 0 0 1221 1 0 0 25 0 5 0 515775996 235786240 29013 33554432000 4194304 4417332 140733221433136 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=230260 CPUtime=12.17 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 9756 1254 0 0 1216 1 0 0 25 0 5 0 515775996 235786240 29013 33554432000 4194304 4417332 140733221433136 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=230260 CPUtime=12.23 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 6817 1254 0 0 1222 1 0 0 25 0 5 0 515775996 235786240 29013 33554432000 4194304 4417332 140733221433136 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.29
Current children cumulated vsize (KiB) 230260

[startup+25.5007 s]
/proc/loadavg: 5.58 5.22 5.27 9/190 3716
/proc/meminfo: memFree=24782572/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=223772 CPUtime=100.41 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 53251 1254 0 0 10034 7 0 0 19 0 5 0 515775960 229142528 27392 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 55943 27392 181 55 0 53829 0
[pid=3688/tid=3706] ppid=3686 vsize=223772 CPUtime=25.09 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 10045 1254 0 0 2508 1 0 0 25 0 5 0 515775996 229142528 27392 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=223772 CPUtime=25.02 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 7741 1254 0 0 2501 1 0 0 25 0 5 0 515775996 229142528 27392 33554432000 4194304 4417332 140733221433136 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=223772 CPUtime=24.97 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 9798 1254 0 0 2496 1 0 0 25 0 5 0 515775996 229142528 27392 33554432000 4194304 4417332 140733221433136 18446744073709551615 4309862 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=223772 CPUtime=24.96 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 7369 1254 0 0 2495 1 0 0 25 0 5 0 515775996 229142528 27392 33554432000 4194304 4417332 140733221433136 18446744073709551615 4357898 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 100.41
Current children cumulated vsize (KiB) 223772

[startup+51.101 s]
/proc/loadavg: 6.52 5.47 5.35 9/190 3717
/proc/meminfo: memFree=24697392/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=296744 CPUtime=202.68 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 81041 1254 0 0 20257 11 0 0 19 0 5 0 515775960 303865856 45635 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 74186 45635 181 55 0 72072 0
[pid=3688/tid=3706] ppid=3686 vsize=296744 CPUtime=50.69 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 11093 1254 0 0 5068 1 0 0 25 0 5 0 515775996 303865856 45635 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=296744 CPUtime=50.62 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 11381 1254 0 0 5060 2 0 0 25 0 5 0 515775996 303865856 45635 33554432000 4194304 4417332 140733221433136 18446744073709551615 4346407 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=296744 CPUtime=50.57 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 16226 1254 0 0 5056 1 0 0 25 0 5 0 515775996 303865856 45635 33554432000 4194304 4417332 140733221433136 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=296744 CPUtime=50.42 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 24043 1254 0 0 5039 3 0 0 25 0 5 0 515775996 303865856 45635 33554432000 4194304 4417332 140733221433136 18446744073709551615 4250744 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 202.68
Current children cumulated vsize (KiB) 296744

[startup+102.301 s]
/proc/loadavg: 7.60 5.94 5.52 9/190 3719
/proc/meminfo: memFree=24618888/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=302964 CPUtime=407.22 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 166617 1254 0 0 40700 22 0 0 19 0 5 0 515775960 310235136 47196 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 75741 47196 181 55 0 73627 0
[pid=3688/tid=3706] ppid=3686 vsize=302964 CPUtime=101.82 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 37437 1254 0 0 10177 5 0 0 25 0 5 0 515775996 310235136 47196 33554432000 4194304 4417332 140733221433136 18446744073709551615 4275918 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=302964 CPUtime=101.82 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 26481 1254 0 0 10179 3 0 0 25 0 5 0 515775996 310235136 47196 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=302964 CPUtime=101.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 39805 1254 0 0 10173 4 0 0 25 0 5 0 515775996 310235136 47196 33554432000 4194304 4417332 140733221433136 18446744073709551615 4250915 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=302964 CPUtime=101.42 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 44596 1254 0 0 10136 6 0 0 25 0 5 0 515775996 310235136 47196 33554432000 4194304 4417332 140733221433136 18446744073709551615 4357444 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.22
Current children cumulated vsize (KiB) 302964

[startup+162.301 s]
/proc/loadavg: 7.96 6.32 5.67 9/190 3720
/proc/meminfo: memFree=24447368/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=435664 CPUtime=646.87 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 371579 1254 0 0 64639 48 0 0 19 0 5 0 515775960 446119936 80523 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 108916 80523 181 55 0 106802 0
[pid=3688/tid=3706] ppid=3686 vsize=435664 CPUtime=161.48 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 71726 1254 0 0 16139 9 0 0 25 0 5 0 515775996 446119936 80523 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=435664 CPUtime=161.82 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 93016 1254 0 0 16169 13 0 0 25 0 5 0 515775996 446119936 80523 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=435664 CPUtime=161.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 82340 1254 0 0 16168 9 0 0 25 0 5 0 515775996 446119936 80523 33554432000 4194304 4417332 140733221433136 18446744073709551615 4358027 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=435664 CPUtime=161.42 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 106199 1254 0 0 16129 13 0 0 25 0 5 0 515775996 446119936 80523 33554432000 4194304 4417332 140733221433136 18446744073709551615 4357874 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 646.87
Current children cumulated vsize (KiB) 435664


################
# More data... #
################

[pid=3688/tid=3707] ppid=3686 vsize=685540 CPUtime=699.06 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 539885 1254 0 0 69831 75 0 0 25 0 5 0 515775996 701992960 142840 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=685540 CPUtime=701.78 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 416754 1254 0 0 70121 57 0 0 25 0 5 0 515775996 701992960 142840 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=685540 CPUtime=701.42 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 597531 1254 0 0 70055 87 0 0 25 0 5 0 515775996 701992960 142840 33554432000 4194304 4417332 140733221433136 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2803.95
Current children cumulated vsize (KiB) 685540

[startup+762.301 s]
/proc/loadavg: 8.37 7.95 6.85 9/190 4211
/proc/meminfo: memFree=24124852/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=591252 CPUtime=3042.42 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 2175785 1254 0 0 303929 313 0 0 19 0 5 0 515775960 605442048 119268 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 147813 119268 181 55 0 145699 0
[pid=3688/tid=3706] ppid=3686 vsize=591252 CPUtime=761.19 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 479712 1254 0 0 76049 70 0 0 25 0 5 0 515775996 605442048 119268 33554432000 4194304 4417332 140733221433136 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=591252 CPUtime=758.72 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 568090 1254 0 0 75793 79 0 0 25 0 5 0 515775996 605442048 119268 33554432000 4194304 4417332 140733221433136 18446744073709551615 4357010 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=591252 CPUtime=761.78 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 463319 1254 0 0 76113 65 0 0 25 0 5 0 515775996 605442048 119268 33554432000 4194304 4417332 140733221433136 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=591252 CPUtime=760.34 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 646366 1254 0 0 75939 95 0 0 25 0 5 0 515775996 605442048 119268 33554432000 4194304 4417332 140733221433136 18446744073709551615 4236784 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3042.42
Current children cumulated vsize (KiB) 591252

[startup+822.301 s]
/proc/loadavg: 8.26 7.98 6.92 9/190 4213
/proc/meminfo: memFree=23968084/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=726152 CPUtime=3282.07 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 2440293 1254 0 0 327853 354 0 0 19 0 5 0 515775960 743579648 153025 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 181538 153025 181 55 0 179424 0
[pid=3688/tid=3706] ppid=3686 vsize=726152 CPUtime=821.18 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 580297 1254 0 0 82033 85 0 0 25 0 5 0 515775996 743579648 153025 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=726152 CPUtime=818.39 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 624688 1254 0 0 81751 88 0 0 25 0 5 0 515775996 743579648 153025 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=726152 CPUtime=821.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 501318 1254 0 0 82107 70 0 0 25 0 5 0 515775996 743579648 153025 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=726152 CPUtime=820.33 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 715692 1254 0 0 81927 106 0 0 25 0 5 0 515775996 743579648 153025 33554432000 4194304 4417332 140733221433136 18446744073709551615 4365872 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3282.07
Current children cumulated vsize (KiB) 726152

[startup+882.307 s]
/proc/loadavg: 8.11 8.00 7.00 9/190 4216
/proc/meminfo: memFree=23912516/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=806552 CPUtime=3521.77 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 2683564 1254 0 0 351791 386 0 0 19 0 5 0 515775960 825909248 173093 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 201638 173093 181 55 0 199524 0
[pid=3688/tid=3706] ppid=3686 vsize=806552 CPUtime=881.2 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 620578 1254 0 0 88029 91 0 0 25 0 5 0 515775996 825909248 173093 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=806552 CPUtime=878.07 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 685213 1254 0 0 87711 96 0 0 25 0 5 0 515775996 825909248 173093 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=806552 CPUtime=881.78 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 564218 1254 0 0 88098 80 0 0 25 0 5 0 515775996 825909248 173093 33554432000 4194304 4417332 140733221433136 18446744073709551615 4346278 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=806552 CPUtime=880.35 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 795257 1254 0 0 87919 116 0 0 25 0 5 0 515775996 825909248 173093 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3521.77
Current children cumulated vsize (KiB) 806552

[startup+942.301 s]
/proc/loadavg: 8.26 8.07 7.08 9/190 4219
/proc/meminfo: memFree=23775648/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=943736 CPUtime=3761.42 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 2953733 1254 0 0 375712 430 0 0 19 0 5 0 515775960 966385664 207389 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 235934 207389 181 55 0 233820 0
[pid=3688/tid=3706] ppid=3686 vsize=943736 CPUtime=941.19 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 674694 1254 0 0 94020 99 0 0 25 0 5 0 515775996 966385664 207389 33554432000 4194304 4417332 140733221433136 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=943736 CPUtime=937.74 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 761323 1254 0 0 93666 108 0 0 25 0 5 0 515775996 966385664 207389 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=943736 CPUtime=941.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 608191 1254 0 0 94090 87 0 0 25 0 5 0 515775996 966385664 207389 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364329 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=943736 CPUtime=940.34 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 891227 1254 0 0 93902 132 0 0 25 0 5 0 515775996 966385664 207389 33554432000 4194304 4417332 140733221433136 18446744073709551615 4366440 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3761.42
Current children cumulated vsize (KiB) 943736

[startup+1002.3 s]
/proc/loadavg: 8.28 8.10 7.15 9/190 4221
/proc/meminfo: memFree=24241368/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=510792 CPUtime=4001.1 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 3081882 1254 0 0 399660 450 0 0 19 0 5 0 515775960 523051008 99185 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 127698 99185 181 55 0 125584 0
[pid=3688/tid=3706] ppid=3686 vsize=510792 CPUtime=1001.2 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 712645 1254 0 0 100015 105 0 0 25 0 5 0 515775996 523051008 99185 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=510792 CPUtime=997.41 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 792410 1254 0 0 99630 111 0 0 25 0 5 0 515775996 523051008 99185 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=510792 CPUtime=1001.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 608201 1254 0 0 100089 88 0 0 25 0 5 0 515775996 523051008 99185 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=510792 CPUtime=1000.35 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 950328 1254 0 0 99893 142 0 0 25 0 5 0 515775996 523051008 99185 33554432000 4194304 4417332 140733221433136 18446744073709551615 4357499 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4001.1
Current children cumulated vsize (KiB) 510792

[startup+1062.3 s]
/proc/loadavg: 8.28 8.13 7.21 9/190 4222
/proc/meminfo: memFree=24073820/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=744220 CPUtime=4240.78 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 3331944 1254 0 0 423594 484 0 0 19 0 5 0 515775960 762081280 157510 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 186055 157510 181 55 0 183941 0
[pid=3688/tid=3706] ppid=3686 vsize=744220 CPUtime=1061.19 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 782957 1254 0 0 106004 115 0 0 25 0 5 0 515775996 762081280 157510 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=744220 CPUtime=1057.09 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 845455 1254 0 0 105590 119 0 0 25 0 5 0 515775996 762081280 157510 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=744220 CPUtime=1061.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 657875 1254 0 0 106082 95 0 0 25 0 5 0 515775996 762081280 157510 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=744220 CPUtime=1060.35 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 1027359 1254 0 0 105884 151 0 0 25 0 5 0 515775996 762081280 157510 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4240.78
Current children cumulated vsize (KiB) 744220

[startup+1122.3 s]
/proc/loadavg: 8.22 8.14 7.28 9/190 4224
/proc/meminfo: memFree=23851708/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=965872 CPUtime=4480.45 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 3550138 1254 0 0 447532 513 0 0 19 0 5 0 515775960 989052928 212923 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 241468 212923 181 55 0 239354 0
[pid=3688/tid=3706] ppid=3686 vsize=965872 CPUtime=1121.19 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 826027 1254 0 0 111998 121 0 0 25 0 5 0 515775996 989052928 212923 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=965872 CPUtime=1116.76 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 911489 1254 0 0 111550 126 0 0 25 0 5 0 515775996 989052928 212923 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=965872 CPUtime=1121.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 710408 1254 0 0 112072 105 0 0 25 0 5 0 515775996 989052928 212923 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=965872 CPUtime=1120.35 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 1083916 1254 0 0 111877 158 0 0 25 0 5 0 515775996 989052928 212923 33554432000 4194304 4417332 140733221433136 18446744073709551615 4236559 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4480.45
Current children cumulated vsize (KiB) 965872

[startup+1182.3 s]
/proc/loadavg: 8.19 8.15 7.33 9/190 4225
/proc/meminfo: memFree=23970852/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=855776 CPUtime=4720.14 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 3765479 1254 0 0 471469 545 0 0 19 0 5 0 515775960 876314624 185399 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 213944 185399 181 55 0 211830 0
[pid=3688/tid=3706] ppid=3686 vsize=855776 CPUtime=1181.2 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 892274 1254 0 0 117989 131 0 0 25 0 5 0 515775996 876314624 185399 33554432000 4194304 4417332 140733221433136 18446744073709551615 4357108 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=855776 CPUtime=1176.44 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 931196 1254 0 0 117515 129 0 0 25 0 5 0 515775996 876314624 185399 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=855776 CPUtime=1181.77 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 757648 1254 0 0 118066 111 0 0 25 0 5 0 515775996 876314624 185399 33554432000 4194304 4417332 140733221433136 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=855776 CPUtime=1180.35 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 1166063 1254 0 0 117865 170 0 0 25 0 5 0 515775996 876314624 185399 33554432000 4194304 4417332 140733221433136 18446744073709551615 4365994 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4720.14
Current children cumulated vsize (KiB) 855776



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.3 s]
/proc/loadavg: 8.26 8.17 7.36 9/190 4226
/proc/meminfo: memFree=23997872/32951124 swapFree=67111352/67111528
[pid=3688] ppid=3686 vsize=819972 CPUtime=4800.07 cores=0,2,4,6
/proc/3688/stat : 3688 (plingeling) S 3686 3688 2100 0 -1 4202496 3845259 1254 0 0 479450 557 0 0 19 0 5 0 515775960 839651328 176448 33554432000 4194304 4417332 140733221433136 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/3688/statm: 204993 176448 181 55 0 202879 0
[pid=3688/tid=3706] ppid=3686 vsize=819972 CPUtime=1201.21 cores=0,2,4,6
/proc/3688/task/3706/stat : 3706 (plingeling) R 3686 3688 2100 0 -1 4202560 911510 1254 0 0 119987 134 0 0 25 0 5 0 515775996 839651328 176448 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3688/tid=3707] ppid=3686 vsize=819972 CPUtime=1196.33 cores=0,2,4,6
/proc/3688/task/3707/stat : 3707 (plingeling) R 3686 3688 2100 0 -1 4202560 942198 1254 0 0 119502 131 0 0 25 0 5 0 515775996 839651328 176448 33554432000 4194304 4417332 140733221433136 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3688/tid=3711] ppid=3686 vsize=819972 CPUtime=1201.79 cores=0,2,4,6
/proc/3688/task/3711/stat : 3711 (plingeling) R 3686 3688 2100 0 -1 4202560 774034 1254 0 0 120065 114 0 0 25 0 5 0 515775996 839651328 176448 33554432000 4194304 4417332 140733221433136 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3688/tid=3712] ppid=3686 vsize=819972 CPUtime=1200.36 cores=0,2,4,6
/proc/3688/task/3712/stat : 3712 (plingeling) R 3686 3688 2100 0 -1 4202560 1199219 1254 0 0 119861 175 0 0 25 0 5 0 515775996 839651328 176448 33554432000 4194304 4417332 140733221433136 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.07
Current children cumulated vsize (KiB) 819972

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.35
CPU time (s): 4800.14
CPU user time (s): 4794.53
CPU system time (s): 5.60915
CPU usage (%): 399.229
Max. virtual memory (cumulated for all children) (KiB): 1044652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.53
system time used= 5.60915
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3846513
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 154
involuntary context switches= 70568

runsolver used 1.82872 second user time and 4.75128 second system time

The end

Launcher Data 

Begin job on node134 at 2011-04-29 03:49:38
IDJOB=3282307
IDBENCH=70799
IDSOLVER=1605
FILE ID=node134/3282307-1304041777
RUNJOBID= node134-1304041777-3674
PBS_JOBID= 13170318
Free space on /tmp= 71576 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/APPLICATIONS/bitverif/countbitswegner/countbitswegner128.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3282307-1304041777/watcher-3282307-1304041777 -o /tmp/evaluation-result-3282307-1304041777/solver-3282307-1304041777 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3282307-1304041777.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4b75ef7fb46928f50793af1d74c176e2
RANDOM SEED=826580261

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25114700 kB
Buffers:       1471088 kB
Cached:        5776624 kB
SwapCached:         64 kB
Active:        1386880 kB
Inactive:      5928176 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25114700 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:            9424 kB
Writeback:           0 kB
AnonPages:       67012 kB
Mapped:          14652 kB
Slab:           458232 kB
PageTables:       4460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187208 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71568 MiB
End job on node134 at 2011-04-29 04:09:42