Trace number 3281203

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.45 1201.93

General information on the benchmark

Nameindustrial/IBM_FV_2002_13_rule_1/
SAT_dat.k100.cnf
MD5SUMcf1b8194ff6d413d396ac9e26bb031ef
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark202.908
Satisfiable
(Un)Satisfiability was proved
Number of variables50797
Number of clauses177980
Sum of the clauses size470252
Maximum clause length37
Minimum clause length1
Number of clauses of size 11318
Number of clauses of size 295086
Number of clauses of size 374860
Number of clauses of size 4486
Number of clauses of size 5945
Number of clauses of size over 55285

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3281203-1304039078/watcher-3281203-1304039078 -o /tmp/evaluation-result-3281203-1304039078/solver-3281203-1304039078 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3281203-1304039078.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 8.02 8.00 5/179 1956
/proc/meminfo: memFree=16286060/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=8724 CPUtime=0 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) R 1954 1956 1725 0 -1 4202496 243 1252 0 0 0 0 0 0 25 0 1 0 515507434 8933376 171 33554432000 4194304 4417332 140735737680288 18446744073709551615 210647144448 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/1956/statm: 2182 173 137 55 0 68 0

[startup+0.0535421 s]
/proc/loadavg: 8.04 8.02 8.00 5/179 1956
/proc/meminfo: memFree=16286060/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=18888 CPUtime=0.04 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) R 1954 1956 1725 0 -1 4202496 2785 1252 0 0 4 0 0 0 25 0 1 0 515507434 19341312 2713 33554432000 4194304 4417332 140735737680288 18446744073709551615 4231392 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/1956/statm: 4722 2713 148 55 0 2608 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18888

[startup+0.100533 s]
/proc/loadavg: 8.04 8.02 8.00 5/179 1956
/proc/meminfo: memFree=16286060/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=28252 CPUtime=0.08 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) R 1954 1956 1725 0 -1 4202496 5158 1252 0 0 8 0 0 0 25 0 1 0 515507434 28930048 5086 33554432000 4194304 4417332 140735737680288 18446744073709551615 4231420 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/1956/statm: 7063 5086 148 55 0 4949 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 28252

[startup+0.300469 s]
/proc/loadavg: 8.04 8.02 8.00 5/179 1956
/proc/meminfo: memFree=16286060/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=220408 CPUtime=0.49 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 14786 1252 0 0 47 2 0 0 25 0 5 0 515507434 225697792 11096 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 55102 11096 171 55 0 52988 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 220408

[startup+0.700401 s]
/proc/loadavg: 8.04 8.02 8.00 5/179 1956
/proc/meminfo: memFree=16286060/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=221056 CPUtime=2.09 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 15095 1252 0 0 207 2 0 0 25 0 5 0 515507434 226361344 11405 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 55264 11405 175 55 0 53150 0
Current children cumulated CPU time (s) 2.09
Current children cumulated vsize (KiB) 221056

[startup+1.50027 s]
/proc/loadavg: 8.04 8.01 8.00 9/184 1966
/proc/meminfo: memFree=16240780/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=222484 CPUtime=5.28 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 16946 1252 0 0 526 2 0 0 25 0 5 0 515507434 227823616 11090 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 55621 11090 177 55 0 53507 0
[pid=1956/tid=1963] ppid=1954 vsize=222484 CPUtime=1.26 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 2251 1252 0 0 126 0 0 0 25 0 5 0 515507457 227823616 11090 33554432000 4194304 4417332 140735737680288 18446744073709551615 4236559 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=222484 CPUtime=1.26 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 2648 1252 0 0 126 0 0 0 25 0 5 0 515507457 227823616 11090 33554432000 4194304 4417332 140735737680288 18446744073709551615 4264627 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=222484 CPUtime=1.26 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 1340 1252 0 0 126 0 0 0 25 0 5 0 515507457 227823616 11090 33554432000 4194304 4417332 140735737680288 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=222484 CPUtime=1.25 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 1150 1252 0 0 125 0 0 0 25 0 5 0 515507457 227823616 11090 33554432000 4194304 4417332 140735737680288 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.28
Current children cumulated vsize (KiB) 222484

[startup+3.10099 s]
/proc/loadavg: 8.04 8.01 8.00 9/184 1966
/proc/meminfo: memFree=16244872/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=235604 CPUtime=11.68 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 23070 1252 0 0 1165 3 0 0 25 0 5 0 515507434 241258496 14386 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 58901 14386 181 55 0 56787 0
[pid=1956/tid=1963] ppid=1954 vsize=235604 CPUtime=2.86 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 4193 1252 0 0 286 0 0 0 25 0 5 0 515507457 241258496 14386 33554432000 4194304 4417332 140735737680288 18446744073709551615 4252349 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=235604 CPUtime=2.85 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 4988 1252 0 0 285 0 0 0 25 0 5 0 515507457 241258496 14386 33554432000 4194304 4417332 140735737680288 18446744073709551615 4253395 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=235604 CPUtime=2.86 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 2572 1252 0 0 286 0 0 0 25 0 5 0 515507457 241258496 14386 33554432000 4194304 4417332 140735737680288 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=235604 CPUtime=2.85 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 1760 1252 0 0 285 0 0 0 25 0 5 0 515507457 241258496 14386 33554432000 4194304 4417332 140735737680288 18446744073709551615 4365050 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.68
Current children cumulated vsize (KiB) 235604

[startup+6.30046 s]
/proc/loadavg: 8.04 8.01 8.00 7/180 1999
/proc/meminfo: memFree=16673892/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=248480 CPUtime=24.46 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 28495 1252 0 0 2443 3 0 0 25 0 5 0 515507434 254443520 17605 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 62120 17605 181 55 0 60006 0
[pid=1956/tid=1963] ppid=1954 vsize=248480 CPUtime=6.06 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 6397 1252 0 0 606 0 0 0 25 0 5 0 515507457 254443520 17605 33554432000 4194304 4417332 140735737680288 18446744073709551615 4236852 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=248480 CPUtime=6.05 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 5202 1252 0 0 605 0 0 0 25 0 5 0 515507457 254443520 17605 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=248480 CPUtime=6.06 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 2572 1252 0 0 606 0 0 0 25 0 5 0 515507457 254443520 17605 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=248480 CPUtime=6.03 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 4767 1252 0 0 603 0 0 0 25 0 5 0 515507457 254443520 17605 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.46
Current children cumulated vsize (KiB) 248480

[startup+12.7004 s]
/proc/loadavg: 7.97 8.00 8.00 10/184 2003
/proc/meminfo: memFree=16536376/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=265108 CPUtime=50.02 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 38894 1252 0 0 4996 6 0 0 25 0 5 0 515507434 271470592 21762 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 66277 21762 181 55 0 64163 0
[pid=1956/tid=1963] ppid=1954 vsize=265108 CPUtime=12.46 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 10718 1252 0 0 1245 1 0 0 25 0 5 0 515507457 271470592 21762 33554432000 4194304 4417332 140735737680288 18446744073709551615 4250623 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=265108 CPUtime=12.45 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 6286 1252 0 0 1245 0 0 0 25 0 5 0 515507457 271470592 21762 33554432000 4194304 4417332 140735737680288 18446744073709551615 4253542 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=265108 CPUtime=12.45 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 4457 1252 0 0 1245 0 0 0 25 0 5 0 515507457 271470592 21762 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=265108 CPUtime=12.39 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 7876 1252 0 0 1238 1 0 0 25 0 5 0 515507457 271470592 21762 33554432000 4194304 4417332 140735737680288 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.02
Current children cumulated vsize (KiB) 265108

[startup+25.5012 s]
/proc/loadavg: 7.98 8.00 8.00 9/184 2004
/proc/meminfo: memFree=16527680/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=282928 CPUtime=101.15 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 61664 1252 0 0 10102 13 0 0 25 0 5 0 515507434 289718272 26217 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 70732 26217 181 55 0 68618 0
[pid=1956/tid=1963] ppid=1954 vsize=282928 CPUtime=25.26 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 13500 1252 0 0 2524 2 0 0 25 0 5 0 515507457 289718272 26217 33554432000 4194304 4417332 140735737680288 18446744073709551615 4353519 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=282928 CPUtime=25.25 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 18049 1252 0 0 2523 2 0 0 25 0 5 0 515507457 289718272 26217 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=282928 CPUtime=25.24 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 5765 1252 0 0 2521 3 0 0 25 0 5 0 515507457 289718272 26217 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364504 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=282928 CPUtime=25.13 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 14793 1252 0 0 2511 2 0 0 25 0 5 0 515507457 289718272 26217 33554432000 4194304 4417332 140735737680288 18446744073709551615 18446744073699065949 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.15
Current children cumulated vsize (KiB) 282928

[startup+51.1009 s]
/proc/loadavg: 7.98 8.00 8.00 9/184 2005
/proc/meminfo: memFree=16444172/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=334144 CPUtime=203.39 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 113393 1252 0 0 20318 21 0 0 25 0 5 0 515507434 342163456 39027 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 83536 39027 181 55 0 81422 0
[pid=1956/tid=1963] ppid=1954 vsize=334144 CPUtime=50.86 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 25578 1252 0 0 5082 4 0 0 25 0 5 0 515507457 342163456 39027 33554432000 4194304 4417332 140735737680288 18446744073709551615 4357034 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=334144 CPUtime=50.85 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 38376 1252 0 0 5079 6 0 0 25 0 5 0 515507457 342163456 39027 33554432000 4194304 4417332 140735737680288 18446744073709551615 4353447 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=334144 CPUtime=50.81 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 12745 1252 0 0 5077 4 0 0 25 0 5 0 515507457 342163456 39027 33554432000 4194304 4417332 140735737680288 18446744073709551615 4250476 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=334144 CPUtime=50.61 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 27137 1252 0 0 5057 4 0 0 25 0 5 0 515507457 342163456 39027 33554432000 4194304 4417332 140735737680288 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.39
Current children cumulated vsize (KiB) 334144

[startup+102.306 s]
/proc/loadavg: 8.31 8.10 8.03 9/184 2009
/proc/meminfo: memFree=16373232/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=351216 CPUtime=407.91 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 229295 1252 0 0 40750 41 0 0 25 0 5 0 515507434 359645184 43295 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 87804 43295 181 55 0 85690 0
[pid=1956/tid=1963] ppid=1954 vsize=351216 CPUtime=102.07 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 54977 1252 0 0 10199 8 0 0 25 0 5 0 515507457 359645184 43295 33554432000 4194304 4417332 140735737680288 18446744073709551615 4249859 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=351216 CPUtime=102.04 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 75966 1252 0 0 10192 12 0 0 25 0 5 0 515507457 359645184 43295 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=351216 CPUtime=101.98 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 33666 1252 0 0 10189 9 0 0 25 0 5 0 515507457 359645184 43295 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=351216 CPUtime=101.55 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 55129 1252 0 0 10147 8 0 0 25 0 5 0 515507457 359645184 43295 33554432000 4194304 4417332 140735737680288 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.91
Current children cumulated vsize (KiB) 351216

[startup+162.301 s]
/proc/loadavg: 8.26 8.12 8.04 9/184 2010
/proc/meminfo: memFree=16290124/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=392800 CPUtime=647.56 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 338848 1252 0 0 64700 56 0 0 25 0 5 0 515507434 402227200 53691 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 98200 53691 181 55 0 96086 0
[pid=1956/tid=1963] ppid=1954 vsize=392800 CPUtime=162.06 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 72058 1252 0 0 16196 10 0 0 25 0 5 0 515507457 402227200 53691 33554432000 4194304 4417332 140735737680288 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=392800 CPUtime=162.04 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 109983 1252 0 0 16187 17 0 0 25 0 5 0 515507457 402227200 53691 33554432000 4194304 4417332 140735737680288 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=392800 CPUtime=161.94 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 58365 1252 0 0 16183 11 0 0 25 0 5 0 515507457 402227200 53691 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=392800 CPUtime=161.25 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 88885 1252 0 0 16111 14 0 0 25 0 5 0 515507457 402227200 53691 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 647.56
Current children cumulated vsize (KiB) 392800


################
# More data... #
################

[pid=1956/tid=1964] ppid=1954 vsize=535632 CPUtime=762.04 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 392205 1252 0 0 76149 55 0 0 25 0 5 0 515507457 548487168 89399 33554432000 4194304 4417332 140735737680288 18446744073709551615 4270929 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=535632 CPUtime=761.76 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 172564 1252 0 0 76150 26 0 0 25 0 5 0 515507457 548487168 89399 33554432000 4194304 4417332 140735737680288 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=535632 CPUtime=758.04 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 126151 1252 0 0 75785 19 0 0 25 0 5 0 515507457 548487168 89399 33554432000 4194304 4417332 140735737680288 18446744073709551615 4353489 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3044.17
Current children cumulated vsize (KiB) 535632

[startup+822.3 s]
/proc/loadavg: 8.13 8.14 8.08 9/184 2028
/proc/meminfo: memFree=15943252/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=611148 CPUtime=3283.8 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 943126 1252 0 0 328247 133 0 0 25 0 5 0 515507434 625815552 108278 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 152787 108278 181 55 0 150673 0
[pid=1956/tid=1963] ppid=1954 vsize=611148 CPUtime=822.07 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 223113 1252 0 0 82179 28 0 0 25 0 5 0 515507457 625815552 108278 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=611148 CPUtime=822.04 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 411741 1252 0 0 82146 58 0 0 25 0 5 0 515507457 625815552 108278 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364534 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=611148 CPUtime=821.73 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 172564 1252 0 0 82147 26 0 0 25 0 5 0 515507457 625815552 108278 33554432000 4194304 4417332 140735737680288 18446744073709551615 4358010 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=611148 CPUtime=817.71 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 126151 1252 0 0 81752 19 0 0 25 0 5 0 515507457 625815552 108278 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364362 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3283.8
Current children cumulated vsize (KiB) 611148

[startup+882.301 s]
/proc/loadavg: 8.08 8.13 8.08 9/184 2030
/proc/meminfo: memFree=15960212/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=560852 CPUtime=3523.46 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 966682 1252 0 0 352209 137 0 0 25 0 5 0 515507434 574312448 95704 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 140213 95704 181 55 0 138099 0
[pid=1956/tid=1963] ppid=1954 vsize=560852 CPUtime=882.07 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 236258 1252 0 0 88177 30 0 0 25 0 5 0 515507457 574312448 95704 33554432000 4194304 4417332 140735737680288 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=560852 CPUtime=882.03 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 422152 1252 0 0 88144 59 0 0 25 0 5 0 515507457 574312448 95704 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=560852 CPUtime=881.71 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 172564 1252 0 0 88145 26 0 0 25 0 5 0 515507457 574312448 95704 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=560852 CPUtime=877.39 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 126151 1252 0 0 87720 19 0 0 25 0 5 0 515507457 574312448 95704 33554432000 4194304 4417332 140735737680288 18446744073709551615 4236590 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3523.46
Current children cumulated vsize (KiB) 560852

[startup+942.301 s]
/proc/loadavg: 5.76 7.48 7.86 5/174 2048
/proc/meminfo: memFree=16381432/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=628328 CPUtime=3763.17 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 1004263 1252 0 0 376175 142 0 0 25 0 5 0 515507434 643407872 112573 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 157082 112573 181 55 0 154968 0
[pid=1956/tid=1963] ppid=1954 vsize=628328 CPUtime=942.07 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 256970 1252 0 0 94174 33 0 0 25 0 5 0 515507457 643407872 112573 33554432000 4194304 4417332 140735737680288 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=628328 CPUtime=942.04 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 439021 1252 0 0 94143 61 0 0 25 0 5 0 515507457 643407872 112573 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=628328 CPUtime=941.7 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 172564 1252 0 0 94144 26 0 0 25 0 5 0 515507457 643407872 112573 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364317 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=628328 CPUtime=937.11 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 126151 1252 0 0 93692 19 0 0 25 0 5 0 515507457 643407872 112573 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3763.17
Current children cumulated vsize (KiB) 628328

[startup+1002.3 s]
/proc/loadavg: 4.68 6.86 7.62 5/174 2050
/proc/meminfo: memFree=16350304/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=660056 CPUtime=4002.9 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 1041557 1252 0 0 400143 147 0 0 25 0 5 0 515507434 675897344 120505 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 165014 120505 181 55 0 162900 0
[pid=1956/tid=1963] ppid=1954 vsize=660056 CPUtime=1002.07 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 268909 1252 0 0 100172 35 0 0 25 0 5 0 515507457 675897344 120505 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=660056 CPUtime=1002.03 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 453533 1252 0 0 100140 63 0 0 25 0 5 0 515507457 675897344 120505 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=660056 CPUtime=1001.71 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 183407 1252 0 0 100144 27 0 0 25 0 5 0 515507457 675897344 120505 33554432000 4194304 4417332 140735737680288 18446744073709551615 4334678 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=660056 CPUtime=996.83 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 126151 1252 0 0 99664 19 0 0 25 0 5 0 515507457 675897344 120505 33554432000 4194304 4417332 140735737680288 18446744073709551615 4356864 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4002.9
Current children cumulated vsize (KiB) 660056

[startup+1062.3 s]
/proc/loadavg: 4.33 6.35 7.40 5/174 2051
/proc/meminfo: memFree=16414768/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=597332 CPUtime=4242.63 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 1086537 1252 0 0 424108 155 0 0 25 0 5 0 515507434 611667968 104824 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 149333 104824 181 55 0 147219 0
[pid=1956/tid=1963] ppid=1954 vsize=597332 CPUtime=1062.07 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 294873 1252 0 0 106168 39 0 0 25 0 5 0 515507457 611667968 104824 33554432000 4194304 4417332 140735737680288 18446744073709551615 4353540 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=597332 CPUtime=1062.03 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 464423 1252 0 0 106138 65 0 0 25 0 5 0 515507457 611667968 104824 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=597332 CPUtime=1061.71 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 191533 1252 0 0 106142 29 0 0 25 0 5 0 515507457 611667968 104824 33554432000 4194304 4417332 140735737680288 18446744073709551615 4358652 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=597332 CPUtime=1056.56 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 126151 1252 0 0 105637 19 0 0 25 0 5 0 515507457 611667968 104824 33554432000 4194304 4417332 140735737680288 18446744073709551615 4236830 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4242.63
Current children cumulated vsize (KiB) 597332

[startup+1122.3 s]
/proc/loadavg: 4.12 5.92 7.18 5/174 2053
/proc/meminfo: memFree=16383388/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=627328 CPUtime=4482.36 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 1171019 1252 0 0 448071 165 0 0 25 0 5 0 515507434 642383872 112323 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 156832 112323 181 55 0 154718 0
[pid=1956/tid=1963] ppid=1954 vsize=627328 CPUtime=1122.07 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 310311 1252 0 0 112166 41 0 0 25 0 5 0 515507457 642383872 112323 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=627328 CPUtime=1122.04 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 477160 1252 0 0 112137 67 0 0 25 0 5 0 515507457 642383872 112323 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=627328 CPUtime=1121.71 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 247840 1252 0 0 112136 35 0 0 25 0 5 0 515507457 642383872 112323 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=627328 CPUtime=1116.28 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 126151 1252 0 0 111609 19 0 0 25 0 5 0 515507457 642383872 112323 33554432000 4194304 4417332 140735737680288 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4482.36
Current children cumulated vsize (KiB) 627328

[startup+1182.3 s]
/proc/loadavg: 4.11 5.58 6.98 5/174 2055
/proc/meminfo: memFree=16437192/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=573584 CPUtime=4722.07 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 1221981 1252 0 0 472036 171 0 0 25 0 5 0 515507434 587350016 98887 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 143396 98887 181 55 0 141282 0
[pid=1956/tid=1963] ppid=1954 vsize=573584 CPUtime=1182.08 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 324150 1252 0 0 118165 43 0 0 25 0 5 0 515507457 587350016 98887 33554432000 4194304 4417332 140735737680288 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=573584 CPUtime=1182.03 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 488398 1252 0 0 118135 68 0 0 25 0 5 0 515507457 587350016 98887 33554432000 4194304 4417332 140735737680288 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=573584 CPUtime=1181.7 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 258339 1252 0 0 118134 36 0 0 25 0 5 0 515507457 587350016 98887 33554432000 4194304 4417332 140735737680288 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=573584 CPUtime=1176.01 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 141537 1252 0 0 117580 21 0 0 25 0 5 0 515507457 587350016 98887 33554432000 4194304 4417332 140735737680288 18446744073709551615 4352289 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.07
Current children cumulated vsize (KiB) 573584



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 4.08 5.48 6.92 5/174 2055
/proc/meminfo: memFree=16420824/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=590444 CPUtime=4800.39 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 1238234 1252 0 0 479866 173 0 0 25 0 5 0 515507434 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 147611 103102 181 55 0 145497 0
[pid=1956/tid=1963] ppid=1954 vsize=590444 CPUtime=1201.68 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 328246 1252 0 0 120125 43 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=590444 CPUtime=1201.64 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 490583 1252 0 0 120095 69 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=590444 CPUtime=1201.31 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 265916 1252 0 0 120094 37 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4357145 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=590444 CPUtime=1195.51 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 143932 1252 0 0 119530 21 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364308 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 590444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 4.08 5.48 6.92 5/174 2055
/proc/meminfo: memFree=16420824/32951132 swapFree=67111524/67111528
[pid=1956] ppid=1954 vsize=590444 CPUtime=4800.39 cores=1,3,5,7
/proc/1956/stat : 1956 (plingeling) S 1954 1956 1725 0 -1 4202496 1238234 1252 0 0 479866 173 0 0 25 0 5 0 515507434 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/1956/statm: 147611 103102 181 55 0 145497 0
[pid=1956/tid=1963] ppid=1954 vsize=590444 CPUtime=1201.68 cores=1,3,5,7
/proc/1956/task/1963/stat : 1963 (plingeling) R 1954 1956 1725 0 -1 4202560 328246 1252 0 0 120125 43 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1956/tid=1964] ppid=1954 vsize=590444 CPUtime=1201.64 cores=1,3,5,7
/proc/1956/task/1964/stat : 1964 (plingeling) R 1954 1956 1725 0 -1 4202560 490583 1252 0 0 120095 69 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1956/tid=1965] ppid=1954 vsize=590444 CPUtime=1201.31 cores=1,3,5,7
/proc/1956/task/1965/stat : 1965 (plingeling) R 1954 1956 1725 0 -1 4202560 265916 1252 0 0 120094 37 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4357145 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1956/tid=1966] ppid=1954 vsize=590444 CPUtime=1195.51 cores=1,3,5,7
/proc/1956/task/1966/stat : 1966 (plingeling) R 1954 1956 1725 0 -1 4202560 143932 1252 0 0 119530 21 0 0 25 0 5 0 515507457 604614656 103102 33554432000 4194304 4417332 140735737680288 18446744073709551615 4364308 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 590444

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.93
CPU time (s): 4800.45
CPU user time (s): 4798.7
CPU system time (s): 1.75473
CPU usage (%): 399.396
Max. virtual memory (cumulated for all children) (KiB): 679896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.7
system time used= 1.75473
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1239486
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 212
involuntary context switches= 35279

runsolver used 1.77273 second user time and 4.39633 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-29 03:04:38
IDJOB=3281203
IDBENCH=20536
IDSOLVER=1605
FILE ID=node129/3281203-1304039078
RUNJOBID= node129-1304036666-1744
PBS_JOBID= 13170362
Free space on /tmp= 66344 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT07/industrial/IBM_FV_2002_13_rule_1/SAT_dat.k100.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3281203-1304039078/watcher-3281203-1304039078 -o /tmp/evaluation-result-3281203-1304039078/solver-3281203-1304039078 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3281203-1304039078.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cf1b8194ff6d413d396ac9e26bb031ef
RANDOM SEED=145610039

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      16286340 kB
Buffers:       1276740 kB
Cached:       14130152 kB
SwapCached:          4 kB
Active:        4291592 kB
Inactive:     11708504 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      16286340 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            4340 kB
Writeback:           0 kB
AnonPages:      592560 kB
Mapped:          15588 kB
Slab:           602208 kB
PageTables:       5816 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   782676 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66368 MiB
End job on node129 at 2011-04-29 03:24:42