Trace number 3292427

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.42 1201.82

General information on the benchmark

NameSAT05/industrial/grieu05/vmpc/
vmpc_36.renamed-as.sat05-1922.cnf
MD5SUMc9c90d9af49f4c08c7262ecb9a0b2a3d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark978.31
Satisfiable
(Un)Satisfiability was proved
Number of variables1296
Number of clauses230544
Sum of the clauses size603180
Maximum clause length36
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 290828
Number of clauses of size 3139644
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 572

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3292427-1304108042/watcher-3292427-1304108042 -o /tmp/evaluation-result-3292427-1304108042/solver-3292427-1304108042 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3292427-1304108042.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.09 8.08 8.05 5/179 10076
/proc/meminfo: memFree=30889548/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=9844 CPUtime=0 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) R 10074 10076 9622 0 -1 4202496 522 1251 0 0 0 0 0 0 25 0 1 0 522403827 10080256 451 33554432000 4194304 4417332 140735759117936 18446744073709551615 210646840281 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/10076/statm: 2461 451 147 55 0 347 0

[startup+0.0816499 s]
/proc/loadavg: 8.09 8.08 8.05 5/179 10076
/proc/meminfo: memFree=30889548/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=25892 CPUtime=0.07 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) R 10074 10076 9622 0 -1 4202496 4655 1251 0 0 7 0 0 0 25 0 1 0 522403827 26513408 4496 33554432000 4194304 4417332 140735759117936 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/10076/statm: 6473 4496 148 55 0 4359 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 25892

[startup+0.10064 s]
/proc/loadavg: 8.09 8.08 8.05 5/179 10076
/proc/meminfo: memFree=30889548/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=25892 CPUtime=0.09 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) R 10074 10076 9622 0 -1 4202496 4655 1251 0 0 9 0 0 0 25 0 1 0 522403827 26513408 4496 33554432000 4194304 4417332 140735759117936 18446744073709551615 210646765104 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/10076/statm: 6473 4496 148 55 0 4359 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25892

[startup+0.300577 s]
/proc/loadavg: 8.09 8.08 8.05 5/179 10076
/proc/meminfo: memFree=30889548/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=116156 CPUtime=0.46 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 16999 1251 0 0 45 1 0 0 25 0 5 0 522403827 118943744 16836 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 29039 16836 172 55 0 26925 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 116156

[startup+0.700511 s]
/proc/loadavg: 8.09 8.08 8.05 5/179 10076
/proc/meminfo: memFree=30889548/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=116620 CPUtime=2.06 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 17128 1251 0 0 205 1 0 0 25 0 5 0 522403827 119418880 16937 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 29155 16937 175 55 0 27041 0
Current children cumulated CPU time (s) 2.06
Current children cumulated vsize (KiB) 116620

[startup+1.50037 s]
/proc/loadavg: 7.84 8.03 8.03 9/184 10086
/proc/meminfo: memFree=30814752/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=124108 CPUtime=5.26 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 23457 1251 0 0 524 2 0 0 25 0 5 0 522403827 127086592 18651 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 31027 18651 176 55 0 28913 0
[pid=10076/tid=10083] ppid=10074 vsize=124108 CPUtime=1.25 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 1625 1251 0 0 125 0 0 0 25 0 5 0 522403851 127086592 18651 33554432000 4194304 4417332 140735759117936 18446744073709551615 4346399 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=124108 CPUtime=1.25 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 1976 1251 0 0 125 0 0 0 25 0 5 0 522403851 127086592 18651 33554432000 4194304 4417332 140735759117936 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=124108 CPUtime=1.24 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 2661 1251 0 0 124 0 0 0 25 0 5 0 522403851 127086592 18651 33554432000 4194304 4417332 140735759117936 18446744073709551615 4346456 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=124108 CPUtime=1.25 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 240 1251 0 0 125 0 0 0 25 0 5 0 522403851 127086592 18651 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.26
Current children cumulated vsize (KiB) 124108

[startup+3.1011 s]
/proc/loadavg: 7.84 8.03 8.03 9/184 10086
/proc/meminfo: memFree=30814292/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=124332 CPUtime=11.65 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 23642 1251 0 0 1163 2 0 0 25 0 5 0 522403827 127315968 18711 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 31083 18711 180 55 0 28969 0
[pid=10076/tid=10083] ppid=10074 vsize=124332 CPUtime=2.85 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 1625 1251 0 0 285 0 0 0 25 0 5 0 522403851 127315968 18711 33554432000 4194304 4417332 140735759117936 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=124332 CPUtime=2.85 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 1976 1251 0 0 285 0 0 0 25 0 5 0 522403851 127315968 18711 33554432000 4194304 4417332 140735759117936 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=124332 CPUtime=2.84 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 2665 1251 0 0 284 0 0 0 25 0 5 0 522403851 127315968 18711 33554432000 4194304 4417332 140735759117936 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=124332 CPUtime=2.85 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 421 1251 0 0 285 0 0 0 25 0 5 0 522403851 127315968 18711 33554432000 4194304 4417332 140735759117936 18446744073709551615 4358191 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.65
Current children cumulated vsize (KiB) 124332

[startup+6.30057 s]
/proc/loadavg: 8.02 8.06 8.04 9/184 10086
/proc/meminfo: memFree=30813112/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=99720 CPUtime=24.43 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 23982 1251 0 0 2440 3 0 0 25 0 5 0 522403827 102113280 12558 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 24930 12558 180 55 0 22816 0
[pid=10076/tid=10083] ppid=10074 vsize=99720 CPUtime=6.05 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 1625 1251 0 0 605 0 0 0 25 0 5 0 522403851 102113280 12558 33554432000 4194304 4417332 140735759117936 18446744073709551615 4366011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=99720 CPUtime=6.05 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 1976 1251 0 0 605 0 0 0 25 0 5 0 522403851 102113280 12558 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=99720 CPUtime=6.02 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 2665 1251 0 0 602 0 0 0 25 0 5 0 522403851 102113280 12558 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364575 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=99720 CPUtime=6.05 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 761 1251 0 0 605 0 0 0 25 0 5 0 522403851 102113280 12558 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.43
Current children cumulated vsize (KiB) 99720

[startup+12.7005 s]
/proc/loadavg: 8.01 8.06 8.04 9/184 10087
/proc/meminfo: memFree=30823892/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=104724 CPUtime=50 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 25852 1251 0 0 4997 3 0 0 25 0 5 0 522403827 107237376 13969 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 26181 13969 181 55 0 24067 0
[pid=10076/tid=10083] ppid=10074 vsize=104724 CPUtime=12.45 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 2172 1251 0 0 1245 0 0 0 25 0 5 0 522403851 107237376 13969 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=104724 CPUtime=12.45 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 1976 1251 0 0 1245 0 0 0 25 0 5 0 522403851 107237376 13969 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=104724 CPUtime=12.39 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 3460 1251 0 0 1239 0 0 0 25 0 5 0 522403851 107237376 13969 33554432000 4194304 4417332 140735759117936 18446744073709551615 4346286 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=104724 CPUtime=12.45 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 1289 1251 0 0 1245 0 0 0 25 0 5 0 522403851 107237376 13969 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50
Current children cumulated vsize (KiB) 104724

[startup+25.5003 s]
/proc/loadavg: 8.01 8.06 8.04 9/184 10087
/proc/meminfo: memFree=30806028/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=119828 CPUtime=101.14 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 30795 1251 0 0 10110 4 0 0 25 0 5 0 522403827 122703872 17745 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 29957 17745 181 55 0 27843 0
[pid=10076/tid=10083] ppid=10074 vsize=119828 CPUtime=25.25 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 2431 1251 0 0 2525 0 0 0 25 0 5 0 522403851 122703872 17745 33554432000 4194304 4417332 140735759117936 18446744073709551615 4365872 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=119828 CPUtime=25.25 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 2122 1251 0 0 2525 0 0 0 25 0 5 0 522403851 122703872 17745 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=119828 CPUtime=25.12 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 6140 1251 0 0 2512 0 0 0 25 0 5 0 522403851 122703872 17745 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=119828 CPUtime=25.25 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 3147 1251 0 0 2525 0 0 0 25 0 5 0 522403851 122703872 17745 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.14
Current children cumulated vsize (KiB) 119828

[startup+51.101 s]
/proc/loadavg: 8.14 8.08 8.05 9/184 10087
/proc/meminfo: memFree=30786216/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=128788 CPUtime=203.43 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 35357 1251 0 0 20338 5 0 0 25 0 5 0 522403827 131878912 19985 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 32197 19985 181 55 0 30083 0
[pid=10076/tid=10083] ppid=10074 vsize=128788 CPUtime=50.85 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 4043 1251 0 0 5085 0 0 0 25 0 5 0 522403851 131878912 19985 33554432000 4194304 4417332 140735759117936 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=128788 CPUtime=50.85 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 2363 1251 0 0 5085 0 0 0 25 0 5 0 522403851 131878912 19985 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=128788 CPUtime=50.6 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 6140 1251 0 0 5060 0 0 0 25 0 5 0 522403851 131878912 19985 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=128788 CPUtime=50.85 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 5856 1251 0 0 5084 1 0 0 25 0 5 0 522403851 131878912 19985 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.43
Current children cumulated vsize (KiB) 128788

[startup+102.306 s]
/proc/loadavg: 8.21 8.10 8.05 9/184 10089
/proc/meminfo: memFree=30737092/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=161348 CPUtime=407.99 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 47560 1251 0 0 40793 6 0 0 25 0 5 0 522403827 165220352 28125 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 40337 28125 181 55 0 38223 0
[pid=10076/tid=10083] ppid=10074 vsize=161348 CPUtime=102.06 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 5779 1251 0 0 10205 1 0 0 25 0 5 0 522403851 165220352 28125 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=161348 CPUtime=102.05 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 2363 1251 0 0 10205 0 0 0 25 0 5 0 522403851 165220352 28125 33554432000 4194304 4417332 140735759117936 18446744073709551615 4365883 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=161348 CPUtime=101.55 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 10053 1251 0 0 10154 1 0 0 25 0 5 0 522403851 165220352 28125 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=161348 CPUtime=102.05 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 12410 1251 0 0 10204 1 0 0 25 0 5 0 522403851 165220352 28125 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.99
Current children cumulated vsize (KiB) 161348

[startup+162.3 s]
/proc/loadavg: 8.07 8.08 8.05 9/184 10091
/proc/meminfo: memFree=30695280/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=188196 CPUtime=647.68 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 58666 1251 0 0 64760 8 0 0 25 0 5 0 522403827 192712704 34837 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 47049 34837 181 55 0 44935 0
[pid=10076/tid=10083] ppid=10074 vsize=188196 CPUtime=162.06 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 6268 1251 0 0 16205 1 0 0 25 0 5 0 522403851 192712704 34837 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=188196 CPUtime=162.05 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 5835 1251 0 0 16204 1 0 0 25 0 5 0 522403851 192712704 34837 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=188196 CPUtime=161.25 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 10992 1251 0 0 16124 1 0 0 25 0 5 0 522403851 192712704 34837 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=188196 CPUtime=162.05 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 18616 1251 0 0 16203 2 0 0 25 0 5 0 522403851 192712704 34837 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.68
Current children cumulated vsize (KiB) 188196


################
# More data... #
################

[pid=10076/tid=10084] ppid=10074 vsize=247636 CPUtime=702.05 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 42713 1251 0 0 70199 6 0 0 25 0 5 0 522403851 253579264 49697 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=247636 CPUtime=698.5 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31718 1251 0 0 69845 5 0 0 25 0 5 0 522403851 253579264 49697 33554432000 4194304 4417332 140735759117936 18446744073709551615 4306832 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=247636 CPUtime=702.06 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 75807 1251 0 0 70194 12 0 0 25 0 5 0 522403851 253579264 49697 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2804.95
Current children cumulated vsize (KiB) 247636

[startup+762.307 s]
/proc/loadavg: 8.09 8.10 8.06 9/184 10143
/proc/meminfo: memFree=30662840/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=257608 CPUtime=3044.67 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 229208 1251 0 0 304430 37 0 0 25 0 5 0 522403827 263790592 52190 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 64402 52190 181 55 0 62288 0
[pid=10076/tid=10083] ppid=10074 vsize=257608 CPUtime=762.07 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 51246 1251 0 0 76199 8 0 0 25 0 5 0 522403851 263790592 52190 33554432000 4194304 4417332 140735759117936 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=257608 CPUtime=762.06 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 42713 1251 0 0 76200 6 0 0 25 0 5 0 522403851 263790592 52190 33554432000 4194304 4417332 140735759117936 18446744073709551615 4250886 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=257608 CPUtime=758.2 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31718 1251 0 0 75814 6 0 0 25 0 5 0 522403851 263790592 52190 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=257608 CPUtime=762.07 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 86576 1251 0 0 76193 14 0 0 25 0 5 0 522403851 263790592 52190 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3044.67
Current children cumulated vsize (KiB) 257608

[startup+822.301 s]
/proc/loadavg: 8.03 8.08 8.06 9/184 10144
/proc/meminfo: memFree=30673848/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=323280 CPUtime=3284.33 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 252710 1251 0 0 328393 40 0 0 25 0 5 0 522403827 331038720 52257 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 80820 52257 181 55 0 78706 0
[pid=10076/tid=10083] ppid=10074 vsize=323280 CPUtime=822.06 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 62723 1251 0 0 82197 9 0 0 25 0 5 0 522403851 331038720 52257 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=323280 CPUtime=822.06 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44512 1251 0 0 82199 7 0 0 25 0 5 0 522403851 331038720 52257 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=323280 CPUtime=817.88 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31718 1251 0 0 81782 6 0 0 25 0 5 0 522403851 331038720 52257 33554432000 4194304 4417332 140735759117936 18446744073709551615 4357470 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=323280 CPUtime=822.06 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 96802 1251 0 0 82191 15 0 0 25 0 5 0 522403851 331038720 52257 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.33
Current children cumulated vsize (KiB) 323280

[startup+882.3 s]
/proc/loadavg: 8.08 8.08 8.06 9/184 10145
/proc/meminfo: memFree=30667996/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=316776 CPUtime=3524.01 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 272632 1251 0 0 352358 43 0 0 25 0 5 0 522403827 324378624 50634 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 79194 50634 181 55 0 77080 0
[pid=10076/tid=10083] ppid=10074 vsize=316776 CPUtime=882.06 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 72970 1251 0 0 88195 11 0 0 25 0 5 0 522403851 324378624 50634 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=316776 CPUtime=882.06 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44515 1251 0 0 88199 7 0 0 25 0 5 0 522403851 324378624 50634 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=316776 CPUtime=877.56 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31718 1251 0 0 87750 6 0 0 25 0 5 0 522403851 324378624 50634 33554432000 4194304 4417332 140735759117936 18446744073709551615 4322097 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=316776 CPUtime=882.06 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 106474 1251 0 0 88190 16 0 0 25 0 5 0 522403851 324378624 50634 33554432000 4194304 4417332 140735759117936 18446744073709551615 4365991 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3524.01
Current children cumulated vsize (KiB) 316776

[startup+942.3 s]
/proc/loadavg: 8.10 8.08 8.06 9/184 10147
/proc/meminfo: memFree=30644664/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=336164 CPUtime=3763.71 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 287575 1251 0 0 376325 46 0 0 25 0 5 0 522403827 344231936 55499 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 84041 55499 181 55 0 81927 0
[pid=10076/tid=10083] ppid=10074 vsize=336164 CPUtime=942.07 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 78701 1251 0 0 94195 12 0 0 25 0 5 0 522403851 344231936 55499 33554432000 4194304 4417332 140735759117936 18446744073709551615 4311347 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=336164 CPUtime=942.06 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44533 1251 0 0 94199 7 0 0 25 0 5 0 522403851 344231936 55499 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=336164 CPUtime=937.25 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31718 1251 0 0 93719 6 0 0 25 0 5 0 522403851 344231936 55499 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=336164 CPUtime=942.06 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 115668 1251 0 0 94188 18 0 0 25 0 5 0 522403851 344231936 55499 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3763.71
Current children cumulated vsize (KiB) 336164

[startup+1002.3 s]
/proc/loadavg: 8.11 8.07 8.05 9/184 10149
/proc/meminfo: memFree=30667332/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=314304 CPUtime=4003.39 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 307799 1251 0 0 400290 49 0 0 25 0 5 0 522403827 321847296 50065 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 78576 50065 181 55 0 76462 0
[pid=10076/tid=10083] ppid=10074 vsize=314304 CPUtime=1002.07 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 90425 1251 0 0 100193 14 0 0 25 0 5 0 522403851 321847296 50065 33554432000 4194304 4417332 140735759117936 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=314304 CPUtime=1002.07 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44533 1251 0 0 100200 7 0 0 25 0 5 0 522403851 321847296 50065 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=314304 CPUtime=996.93 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31770 1251 0 0 99687 6 0 0 25 0 5 0 522403851 321847296 50065 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=314304 CPUtime=1002.07 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 124116 1251 0 0 100187 20 0 0 25 0 5 0 522403851 321847296 50065 33554432000 4194304 4417332 140735759117936 18446744073709551615 4365883 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.39
Current children cumulated vsize (KiB) 314304

[startup+1062.3 s]
/proc/loadavg: 8.11 8.07 8.05 9/184 10151
/proc/meminfo: memFree=30626264/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=324444 CPUtime=4243.08 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 322072 1251 0 0 424257 51 0 0 25 0 5 0 522403827 332230656 52548 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 81111 52548 181 55 0 78997 0
[pid=10076/tid=10083] ppid=10074 vsize=324444 CPUtime=1062.07 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 95432 1251 0 0 106192 15 0 0 25 0 5 0 522403851 332230656 52548 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=324444 CPUtime=1062.07 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44533 1251 0 0 106200 7 0 0 25 0 5 0 522403851 332230656 52548 33554432000 4194304 4417332 140735759117936 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=324444 CPUtime=1056.62 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31770 1251 0 0 105656 6 0 0 25 0 5 0 522403851 332230656 52548 33554432000 4194304 4417332 140735759117936 18446744073709551615 4365856 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=324444 CPUtime=1062.07 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 133382 1251 0 0 106186 21 0 0 25 0 5 0 522403851 332230656 52548 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.08
Current children cumulated vsize (KiB) 324444

[startup+1122.3 s]
/proc/loadavg: 8.11 8.07 8.05 9/184 10152
/proc/meminfo: memFree=30635784/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=335916 CPUtime=4482.77 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 337928 1251 0 0 448223 54 0 0 25 0 5 0 522403827 343977984 55416 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 83979 55416 181 55 0 81865 0
[pid=10076/tid=10083] ppid=10074 vsize=335916 CPUtime=1122.07 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 103031 1251 0 0 112191 16 0 0 25 0 5 0 522403851 343977984 55416 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=335916 CPUtime=1122.07 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44533 1251 0 0 112200 7 0 0 25 0 5 0 522403851 343977984 55416 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=335916 CPUtime=1116.31 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 31770 1251 0 0 111624 7 0 0 25 0 5 0 522403851 343977984 55416 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=335916 CPUtime=1122.06 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 141639 1251 0 0 112184 22 0 0 25 0 5 0 522403851 343977984 55416 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364599 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4482.77
Current children cumulated vsize (KiB) 335916

[startup+1182.3 s]
/proc/loadavg: 8.15 8.09 8.06 9/184 10153
/proc/meminfo: memFree=30638856/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=324676 CPUtime=4722.46 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 359691 1251 0 0 472188 58 0 0 25 0 5 0 522403827 332468224 52606 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 81169 52606 181 55 0 79055 0
[pid=10076/tid=10083] ppid=10074 vsize=324676 CPUtime=1182.07 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 110105 1251 0 0 118190 17 0 0 25 0 5 0 522403851 332468224 52606 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=324676 CPUtime=1182.07 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44533 1251 0 0 118200 7 0 0 25 0 5 0 522403851 332468224 52606 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=324676 CPUtime=1176 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 34855 1251 0 0 117592 8 0 0 25 0 5 0 522403851 332468224 52606 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364512 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=324676 CPUtime=1182.07 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 153243 1251 0 0 118183 24 0 0 25 0 5 0 522403851 332468224 52606 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.46
Current children cumulated vsize (KiB) 324676



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.11 8.08 8.06 9/184 10154
/proc/meminfo: memFree=30598552/32951132 swapFree=67080208/67111528
[pid=10076] ppid=10074 vsize=338904 CPUtime=4800.38 cores=1,3,5,7
/proc/10076/stat : 10076 (plingeling) S 10074 10076 9622 0 -1 4202496 368141 1251 0 0 479978 60 0 0 25 0 5 0 522403827 347037696 56163 33554432000 4194304 4417332 140735759117936 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/10076/statm: 84726 56163 181 55 0 82612 0
[pid=10076/tid=10083] ppid=10074 vsize=338904 CPUtime=1201.58 cores=1,3,5,7
/proc/10076/task/10083/stat : 10083 (plingeling) R 10074 10076 9622 0 -1 4202560 114166 1251 0 0 120140 18 0 0 25 0 5 0 522403851 347037696 56163 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10076/tid=10084] ppid=10074 vsize=338904 CPUtime=1201.58 cores=1,3,5,7
/proc/10076/task/10084/stat : 10084 (plingeling) R 10074 10076 9622 0 -1 4202560 44533 1251 0 0 120151 7 0 0 25 0 5 0 522403851 347037696 56163 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10076/tid=10085] ppid=10074 vsize=338904 CPUtime=1195.39 cores=1,3,5,7
/proc/10076/task/10085/stat : 10085 (plingeling) R 10074 10076 9622 0 -1 4202560 36266 1251 0 0 119531 8 0 0 25 0 5 0 522403851 347037696 56163 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10076/tid=10086] ppid=10074 vsize=338904 CPUtime=1201.57 cores=1,3,5,7
/proc/10076/task/10086/stat : 10086 (plingeling) R 10074 10076 9622 0 -1 4202560 156221 1251 0 0 120133 24 0 0 25 0 5 0 522403851 347037696 56163 33554432000 4194304 4417332 140735759117936 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.38
Current children cumulated vsize (KiB) 338904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.82
CPU time (s): 4800.42
CPU user time (s): 4799.81
CPU system time (s): 0.610907
CPU usage (%): 399.428
Max. virtual memory (cumulated for all children) (KiB): 349136

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.81
system time used= 0.610907
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 369392
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 76
involuntary context switches= 36683

runsolver used 1.86272 second user time and 4.27335 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-29 22:14:02
IDJOB=3292427
IDBENCH=85991
IDSOLVER=1605
FILE ID=node129/3292427-1304108042
RUNJOBID= node129-1304107926-9937
PBS_JOBID= 13170649
Free space on /tmp= 66364 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT05/industrial/grieu05/vmpc/vmpc_36.renamed-as.sat05-1922.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3292427-1304108042/watcher-3292427-1304108042 -o /tmp/evaluation-result-3292427-1304108042/solver-3292427-1304108042 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3292427-1304108042.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c9c90d9af49f4c08c7262ecb9a0b2a3d
RANDOM SEED=545329693

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30889828 kB
Buffers:        363016 kB
Cached:        1168700 kB
SwapCached:       5960 kB
Active:         214592 kB
Inactive:      1460188 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30889828 kB
SwapTotal:    67111528 kB
SwapFree:     67080208 kB
Dirty:            3164 kB
Writeback:           0 kB
AnonPages:      139448 kB
Mapped:          13208 kB
Slab:           323668 kB
PageTables:       5024 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   352812 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66368 MiB
End job on node129 at 2011-04-29 22:34:06