Trace number 3288011

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.42 1202.24

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf
MD5SUMa8ad0173824ed9404a8c153da07c5f9c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark938.798
Satisfiable
(Un)Satisfiability was proved
Number of variables183325
Number of clauses546914
Sum of the clauses size1276130
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2364608
Number of clauses of size 3182304
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3288011-1304064682/watcher-3288011-1304064682 -o /tmp/evaluation-result-3288011-1304064682/solver-3288011-1304064682 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3288011-1304064682.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.00 7.84 7.65 5/181 30540
/proc/meminfo: memFree=19384524/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=11468 CPUtime=0 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) R 30538 30540 30119 0 -1 4202496 937 1250 0 0 0 0 0 0 25 0 1 0 596698927 11743232 866 33554432000 4194304 4417332 140737108594816 18446744073709551615 251367240680 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/30540/statm: 2867 866 147 55 0 753 0

[startup+0.093493 s]
/proc/loadavg: 8.00 7.84 7.65 5/181 30540
/proc/meminfo: memFree=19384524/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=28712 CPUtime=0.08 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) R 30538 30540 30119 0 -1 4202496 5276 1250 0 0 8 0 0 0 25 0 1 0 596698927 29401088 5202 33554432000 4194304 4417332 140737108594816 18446744073709551615 251367165488 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/30540/statm: 7178 5202 148 55 0 5064 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 28712

[startup+0.100482 s]
/proc/loadavg: 8.00 7.84 7.65 5/181 30540
/proc/meminfo: memFree=19384524/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=28712 CPUtime=0.09 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) R 30538 30540 30119 0 -1 4202496 5276 1250 0 0 9 0 0 0 25 0 1 0 596698927 29401088 5202 33554432000 4194304 4417332 140737108594816 18446744073709551615 4274256 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/30540/statm: 7178 5202 148 55 0 5064 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 28712

[startup+0.300454 s]
/proc/loadavg: 8.00 7.84 7.65 5/181 30540
/proc/meminfo: memFree=19384524/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=73416 CPUtime=0.28 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) R 30538 30540 30119 0 -1 4202496 16217 1250 0 0 27 1 0 0 25 0 1 0 596698927 75177984 16114 33554432000 4194304 4417332 140737108594816 18446744073709551615 251367240797 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/30540/statm: 18354 16141 148 55 0 16240 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 73416

[startup+0.700316 s]
/proc/loadavg: 8.00 7.84 7.65 5/181 30540
/proc/meminfo: memFree=19384524/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=174972 CPUtime=0.77 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 36088 1250 0 0 73 4 0 0 25 0 5 0 596698927 179171328 31540 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 43743 31540 157 55 0 41629 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 174972

[startup+1.50117 s]
/proc/loadavg: 8.00 7.84 7.65 9/186 30550
/proc/meminfo: memFree=19236576/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=251184 CPUtime=3.96 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 63521 1250 0 0 388 8 0 0 25 0 5 0 596698927 257212416 34972 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 62796 34972 171 55 0 60682 0
[pid=30540/tid=30547] ppid=30538 vsize=251184 CPUtime=0.82 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 7581 1250 0 0 82 0 0 0 19 0 5 0 596698994 257212416 34972 33554432000 4194304 4417332 140737108594816 18446744073709551615 4302023 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=251184 CPUtime=0.81 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 7567 1250 0 0 80 1 0 0 25 0 5 0 596698994 257212416 34972 33554432000 4194304 4417332 140737108594816 18446744073709551615 4234249 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=251184 CPUtime=0.82 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 7521 1250 0 0 81 1 0 0 25 0 5 0 596698994 257212416 34972 33554432000 4194304 4417332 140737108594816 18446744073709551615 4234725 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=251184 CPUtime=0.81 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4772 1250 0 0 81 0 0 0 25 0 5 0 596698994 257212416 34972 33554432000 4194304 4417332 140737108594816 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3.96
Current children cumulated vsize (KiB) 251184

[startup+3.10087 s]
/proc/loadavg: 8.00 7.84 7.65 9/186 30550
/proc/meminfo: memFree=19227152/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=297492 CPUtime=10.35 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 84868 1250 0 0 1025 10 0 0 25 0 5 0 596698927 304631808 45995 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 74373 46024 173 55 0 72259 0
[pid=30540/tid=30547] ppid=30538 vsize=297492 CPUtime=2.42 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 18703 1250 0 0 241 1 0 0 22 0 5 0 596698994 304631808 46036 33554432000 4194304 4417332 140737108594816 18446744073709551615 251367240787 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=297492 CPUtime=2.4 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 8250 1250 0 0 239 1 0 0 25 0 5 0 596698994 304631808 46051 33554432000 4194304 4417332 140737108594816 18446744073709551615 4259116 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=297492 CPUtime=2.41 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 17104 1250 0 0 239 2 0 0 25 0 5 0 596698994 304631808 46067 33554432000 4194304 4417332 140737108594816 18446744073709551615 4274422 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=297492 CPUtime=2.41 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4772 1250 0 0 241 0 0 0 25 0 5 0 596698994 304631808 46080 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.35
Current children cumulated vsize (KiB) 297492

[startup+6.30028 s]
/proc/loadavg: 8.00 7.84 7.65 9/186 30550
/proc/meminfo: memFree=19232328/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=296800 CPUtime=23.14 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 93998 1250 0 0 2302 12 0 0 25 0 5 0 596698927 303923200 46364 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 74200 46364 179 55 0 72086 0
[pid=30540/tid=30547] ppid=30538 vsize=296800 CPUtime=5.61 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 20216 1250 0 0 560 1 0 0 25 0 5 0 596698994 303923200 46364 33554432000 4194304 4417332 140737108594816 18446744073709551615 4253167 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=296800 CPUtime=5.59 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 9676 1250 0 0 558 1 0 0 25 0 5 0 596698994 303923200 46364 33554432000 4194304 4417332 140737108594816 18446744073709551615 4274358 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=296800 CPUtime=5.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 23252 1250 0 0 559 3 0 0 25 0 5 0 596698994 303923200 46364 33554432000 4194304 4417332 140737108594816 18446744073709551615 4258253 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=296800 CPUtime=5.61 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4774 1250 0 0 561 0 0 0 25 0 5 0 596698994 303923200 46364 33554432000 4194304 4417332 140737108594816 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.14
Current children cumulated vsize (KiB) 296800

[startup+12.7011 s]
/proc/loadavg: 8.00 7.85 7.65 9/186 30550
/proc/meminfo: memFree=19121040/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=380812 CPUtime=48.7 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 116528 1250 0 0 4856 14 0 0 25 0 5 0 596698927 389951488 66651 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 95203 66651 179 55 0 93089 0
[pid=30540/tid=30547] ppid=30538 vsize=380812 CPUtime=12.02 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 30457 1250 0 0 1200 2 0 0 25 0 5 0 596698994 389951488 66651 33554432000 4194304 4417332 140737108594816 18446744073709551615 4336637 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=380812 CPUtime=11.95 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 21965 1250 0 0 1192 3 0 0 25 0 5 0 596698994 389951488 66651 33554432000 4194304 4417332 140737108594816 18446744073709551615 4336161 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=380812 CPUtime=12.02 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 23252 1250 0 0 1199 3 0 0 25 0 5 0 596698994 389951488 66651 33554432000 4194304 4417332 140737108594816 18446744073709551615 4265411 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=380812 CPUtime=12.02 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4774 1250 0 0 1202 0 0 0 25 0 5 0 596698994 389951488 66651 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 48.7
Current children cumulated vsize (KiB) 380812

[startup+25.5007 s]
/proc/loadavg: 8.07 7.87 7.66 9/186 30551
/proc/meminfo: memFree=19176220/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=330408 CPUtime=99.83 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 116662 1250 0 0 9969 14 0 0 25 0 5 0 596698927 338337792 54051 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 82602 54051 180 55 0 80488 0
[pid=30540/tid=30547] ppid=30538 vsize=330408 CPUtime=24.82 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 30485 1250 0 0 2480 2 0 0 25 0 5 0 596698994 338337792 54051 33554432000 4194304 4417332 140737108594816 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=330408 CPUtime=24.68 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 21993 1250 0 0 2465 3 0 0 25 0 5 0 596698994 338337792 54051 33554432000 4194304 4417332 140737108594816 18446744073709551615 4353430 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=330408 CPUtime=24.82 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 23330 1250 0 0 2479 3 0 0 25 0 5 0 596698994 338337792 54051 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=330408 CPUtime=24.82 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4774 1250 0 0 2482 0 0 0 25 0 5 0 596698994 338337792 54051 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.83
Current children cumulated vsize (KiB) 330408

[startup+51.101 s]
/proc/loadavg: 8.05 7.88 7.67 9/186 30551
/proc/meminfo: memFree=19172776/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=330380 CPUtime=202.09 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 116751 1250 0 0 20195 14 0 0 25 0 5 0 596698927 338309120 54045 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 82595 54045 181 55 0 80481 0
[pid=30540/tid=30547] ppid=30538 vsize=330380 CPUtime=50.42 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 30494 1250 0 0 5040 2 0 0 25 0 5 0 596698994 338309120 54045 33554432000 4194304 4417332 140737108594816 18446744073709551615 4365955 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=330380 CPUtime=50.14 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 22001 1250 0 0 5011 3 0 0 25 0 5 0 596698994 338309120 54045 33554432000 4194304 4417332 140737108594816 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=330380 CPUtime=50.42 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 23402 1250 0 0 5039 3 0 0 25 0 5 0 596698994 338309120 54045 33554432000 4194304 4417332 140737108594816 18446744073709551615 4284022 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=330380 CPUtime=50.42 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4774 1250 0 0 5042 0 0 0 25 0 5 0 596698994 338309120 54045 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236830 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.09
Current children cumulated vsize (KiB) 330380

[startup+102.307 s]
/proc/loadavg: 8.07 7.91 7.69 9/186 30553
/proc/meminfo: memFree=19167740/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=321956 CPUtime=406.64 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 116847 1250 0 0 40650 14 0 0 25 0 5 0 596698927 329682944 51945 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 80489 51945 181 55 0 78375 0
[pid=30540/tid=30547] ppid=30538 vsize=321956 CPUtime=101.62 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 30529 1250 0 0 10160 2 0 0 25 0 5 0 596698994 329682944 51945 33554432000 4194304 4417332 140737108594816 18446744073709551615 4308025 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=321956 CPUtime=101.07 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 22025 1250 0 0 10104 3 0 0 25 0 5 0 596698994 329682944 51945 33554432000 4194304 4417332 140737108594816 18446744073709551615 4265368 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=321956 CPUtime=101.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 23439 1250 0 0 10159 3 0 0 25 0 5 0 596698994 329682944 51945 33554432000 4194304 4417332 140737108594816 18446744073709551615 4308718 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=321956 CPUtime=101.62 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4774 1250 0 0 10162 0 0 0 25 0 5 0 596698994 329682944 51945 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 406.64
Current children cumulated vsize (KiB) 321956

[startup+162.3 s]
/proc/loadavg: 8.02 7.92 7.71 9/186 30554
/proc/meminfo: memFree=19140172/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=321916 CPUtime=646.3 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 118943 1250 0 0 64615 15 0 0 25 0 5 0 596698927 329641984 51935 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 80479 51935 181 55 0 78365 0
[pid=30540/tid=30547] ppid=30538 vsize=321916 CPUtime=161.63 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 32586 1250 0 0 16160 3 0 0 25 0 5 0 596698994 329641984 51935 33554432000 4194304 4417332 140737108594816 18446744073709551615 4357787 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=321916 CPUtime=160.74 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 22043 1250 0 0 16071 3 0 0 25 0 5 0 596698994 329641984 51935 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=321916 CPUtime=161.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 23460 1250 0 0 16159 3 0 0 25 0 5 0 596698994 329641984 51935 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=321916 CPUtime=161.62 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 4774 1250 0 0 16162 0 0 0 25 0 5 0 596698994 329641984 51935 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 646.3
Current children cumulated vsize (KiB) 321916


################
# More data... #
################

[pid=30540/tid=30548] ppid=30538 vsize=487964 CPUtime=697.8 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 49928 1250 0 0 69774 6 0 0 25 0 5 0 596698994 499675136 93447 33554432000 4194304 4417332 140737108594816 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=487964 CPUtime=701.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 53612 1250 0 0 70156 6 0 0 25 0 5 0 596698994 499675136 93447 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364329 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=487964 CPUtime=701.64 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 52360 1250 0 0 70156 8 0 0 25 0 5 0 596698994 499675136 93447 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2803.4
Current children cumulated vsize (KiB) 487964

[startup+762.307 s]
/proc/loadavg: 8.08 8.03 7.84 9/186 30786
/proc/meminfo: memFree=18960148/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=496316 CPUtime=3043.09 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 327397 1250 0 0 304264 45 0 0 25 0 5 0 596698927 508227584 95567 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 124079 95567 181 55 0 121965 0
[pid=30540/tid=30547] ppid=30538 vsize=496316 CPUtime=761.64 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 98241 1250 0 0 76152 12 0 0 25 0 5 0 596698994 508227584 95567 33554432000 4194304 4417332 140737108594816 18446744073709551615 4275944 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=496316 CPUtime=757.48 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 59608 1250 0 0 75740 8 0 0 25 0 5 0 596698994 508227584 95567 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364329 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=496316 CPUtime=761.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 73941 1250 0 0 76153 9 0 0 25 0 5 0 596698994 508227584 95567 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=496316 CPUtime=761.64 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 59527 1250 0 0 76155 9 0 0 25 0 5 0 596698994 508227584 95567 33554432000 4194304 4417332 140737108594816 18446744073709551615 4237148 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3043.09
Current children cumulated vsize (KiB) 496316

[startup+822.301 s]
/proc/loadavg: 8.06 8.03 7.85 9/186 30788
/proc/meminfo: memFree=18897384/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=516128 CPUtime=3282.76 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 366089 1250 0 0 328224 52 0 0 25 0 5 0 596698927 528515072 100488 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 129032 100488 181 55 0 126918 0
[pid=30540/tid=30547] ppid=30538 vsize=516128 CPUtime=821.64 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 104166 1250 0 0 82150 14 0 0 25 0 5 0 596698994 528515072 100488 33554432000 4194304 4417332 140737108594816 18446744073709551615 4353565 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=516128 CPUtime=817.15 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 74280 1250 0 0 81705 10 0 0 25 0 5 0 596698994 528515072 100488 33554432000 4194304 4417332 140737108594816 18446744073709551615 4366011 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=516128 CPUtime=821.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 84076 1250 0 0 82151 11 0 0 25 0 5 0 596698994 528515072 100488 33554432000 4194304 4417332 140737108594816 18446744073709551615 4264942 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=516128 CPUtime=821.65 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 67487 1250 0 0 82154 11 0 0 25 0 5 0 596698994 528515072 100488 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3282.76
Current children cumulated vsize (KiB) 516128

[startup+882.3 s]
/proc/loadavg: 8.02 8.03 7.86 9/186 30790
/proc/meminfo: memFree=18827184/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=561744 CPUtime=3522.43 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 412872 1250 0 0 352183 60 0 0 25 0 5 0 596698927 575225856 111892 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 140436 111892 181 55 0 138322 0
[pid=30540/tid=30547] ppid=30538 vsize=561744 CPUtime=881.64 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 110123 1250 0 0 88149 15 0 0 25 0 5 0 596698994 575225856 111892 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=561744 CPUtime=876.83 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 91109 1250 0 0 87669 14 0 0 25 0 5 0 596698994 575225856 111892 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=561744 CPUtime=881.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 101540 1250 0 0 88148 14 0 0 25 0 5 0 596698994 575225856 111892 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=561744 CPUtime=881.65 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 74020 1250 0 0 88153 12 0 0 25 0 5 0 596698994 575225856 111892 33554432000 4194304 4417332 140737108594816 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3522.43
Current children cumulated vsize (KiB) 561744

[startup+942.3 s]
/proc/loadavg: 8.01 8.02 7.87 9/186 30791
/proc/meminfo: memFree=18867328/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=536520 CPUtime=3762.12 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 465143 1250 0 0 376144 68 0 0 25 0 5 0 596698927 549396480 105586 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 134130 105586 181 55 0 132016 0
[pid=30540/tid=30547] ppid=30538 vsize=536520 CPUtime=941.64 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 119013 1250 0 0 94148 16 0 0 25 0 5 0 596698994 549396480 105586 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=536520 CPUtime=936.51 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 105380 1250 0 0 93635 16 0 0 25 0 5 0 596698994 549396480 105586 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=536520 CPUtime=941.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 122198 1250 0 0 94145 17 0 0 25 0 5 0 596698994 549396480 105586 33554432000 4194304 4417332 140737108594816 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=536520 CPUtime=941.65 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 82472 1250 0 0 94152 13 0 0 25 0 5 0 596698994 549396480 105586 33554432000 4194304 4417332 140737108594816 18446744073709551615 4366403 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3762.12
Current children cumulated vsize (KiB) 536520

[startup+1002.3 s]
/proc/loadavg: 8.05 8.03 7.88 9/186 30793
/proc/meminfo: memFree=18735236/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=581088 CPUtime=4001.79 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 502967 1250 0 0 400106 73 0 0 25 0 5 0 596698927 595034112 116728 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 145272 116728 181 55 0 143158 0
[pid=30540/tid=30547] ppid=30538 vsize=581088 CPUtime=1001.64 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 127283 1250 0 0 100147 17 0 0 25 0 5 0 596698994 595034112 116728 33554432000 4194304 4417332 140737108594816 18446744073709551615 4358020 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=581088 CPUtime=996.18 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 118114 1250 0 0 99600 18 0 0 25 0 5 0 596698994 595034112 116728 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=581088 CPUtime=1001.63 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 132507 1250 0 0 100144 19 0 0 25 0 5 0 596698994 595034112 116728 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=581088 CPUtime=1001.64 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 88983 1250 0 0 100151 13 0 0 25 0 5 0 596698994 595034112 116728 33554432000 4194304 4417332 140737108594816 18446744073709551615 4352289 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4001.79
Current children cumulated vsize (KiB) 581088

[startup+1062.3 s]
/proc/loadavg: 8.06 8.04 7.89 9/186 30794
/proc/meminfo: memFree=18702224/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=610336 CPUtime=4241.47 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 526828 1250 0 0 424070 77 0 0 25 0 5 0 596698927 624984064 124054 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 152584 124054 181 55 0 150470 0
[pid=30540/tid=30547] ppid=30538 vsize=610336 CPUtime=1061.64 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 136937 1250 0 0 106145 19 0 0 25 0 5 0 596698994 624984064 124054 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364581 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=610336 CPUtime=1055.86 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 118114 1250 0 0 105568 18 0 0 25 0 5 0 596698994 624984064 124054 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=610336 CPUtime=1061.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 144894 1250 0 0 106142 20 0 0 25 0 5 0 596698994 624984064 124054 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=610336 CPUtime=1061.65 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 90803 1250 0 0 106151 14 0 0 25 0 5 0 596698994 624984064 124054 33554432000 4194304 4417332 140737108594816 18446744073709551615 4237136 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4241.47
Current children cumulated vsize (KiB) 610336

[startup+1122.3 s]
/proc/loadavg: 8.06 8.04 7.90 9/186 30796
/proc/meminfo: memFree=18583648/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=708588 CPUtime=4481.15 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 573851 1250 0 0 448028 87 0 0 25 0 5 0 596698927 725594112 148617 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 177147 148617 181 55 0 175033 0
[pid=30540/tid=30547] ppid=30538 vsize=708588 CPUtime=1121.64 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 147353 1250 0 0 112144 20 0 0 25 0 5 0 596698994 725594112 148617 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=708588 CPUtime=1115.53 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 143402 1250 0 0 111529 24 0 0 25 0 5 0 596698994 725594112 148617 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=708588 CPUtime=1121.62 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 153617 1250 0 0 112140 22 0 0 25 0 5 0 596698994 725594112 148617 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=708588 CPUtime=1121.65 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 93399 1250 0 0 112151 14 0 0 25 0 5 0 596698994 725594112 148617 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4481.15
Current children cumulated vsize (KiB) 708588

[startup+1182.3 s]
/proc/loadavg: 8.06 8.05 7.91 9/186 30798
/proc/meminfo: memFree=18730936/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=589624 CPUtime=4720.84 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 612052 1250 0 0 471991 93 0 0 25 0 5 0 596698927 603774976 118876 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 147406 118876 181 55 0 145292 0
[pid=30540/tid=30547] ppid=30538 vsize=589624 CPUtime=1181.65 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 166781 1250 0 0 118141 24 0 0 25 0 5 0 596698994 603774976 118876 33554432000 4194304 4417332 140737108594816 18446744073709551615 18446744073699065887 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=589624 CPUtime=1175.21 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 151006 1250 0 0 117496 25 0 0 25 0 5 0 596698994 603774976 118876 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=589624 CPUtime=1181.63 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 162520 1250 0 0 118139 24 0 0 25 0 5 0 596698994 603774976 118876 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=589624 CPUtime=1181.65 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 95665 1250 0 0 118151 14 0 0 25 0 5 0 596698994 603774976 118876 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4720.84
Current children cumulated vsize (KiB) 589624



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.11 8.06 7.91 9/186 30798
/proc/meminfo: memFree=18712576/32950928 swapFree=67111364/67111528
[pid=30540] ppid=30538 vsize=599788 CPUtime=4800.36 cores=1,3,5,7
/proc/30540/stat : 30540 (plingeling) S 30538 30540 30119 0 -1 4202496 619120 1250 0 0 479942 94 0 0 25 0 5 0 596698927 614182912 121417 33554432000 4194304 4417332 140737108594816 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30540/statm: 149947 121417 181 55 0 147833 0
[pid=30540/tid=30547] ppid=30538 vsize=599788 CPUtime=1201.56 cores=1,3,5,7
/proc/30540/task/30547/stat : 30547 (plingeling) R 30538 30540 30119 0 -1 4202560 170975 1250 0 0 120132 24 0 0 25 0 5 0 596698994 614182912 121417 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30540/tid=30548] ppid=30538 vsize=599788 CPUtime=1195 cores=1,3,5,7
/proc/30540/task/30548/stat : 30548 (plingeling) R 30538 30540 30119 0 -1 4202560 151006 1250 0 0 119475 25 0 0 25 0 5 0 596698994 614182912 121417 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30540/tid=30549] ppid=30538 vsize=599788 CPUtime=1201.54 cores=1,3,5,7
/proc/30540/task/30549/stat : 30549 (plingeling) R 30538 30540 30119 0 -1 4202560 162520 1250 0 0 120130 24 0 0 25 0 5 0 596698994 614182912 121417 33554432000 4194304 4417332 140737108594816 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30540/tid=30550] ppid=30538 vsize=599788 CPUtime=1201.56 cores=1,3,5,7
/proc/30540/task/30550/stat : 30550 (plingeling) R 30538 30540 30119 0 -1 4202560 98539 1250 0 0 120141 15 0 0 25 0 5 0 596698994 614182912 121417 33554432000 4194304 4417332 140737108594816 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 599788

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.24
CPU time (s): 4800.42
CPU user time (s): 4799.45
CPU system time (s): 0.972852
CPU usage (%): 399.289
Max. virtual memory (cumulated for all children) (KiB): 716728

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.45
system time used= 0.972852
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 620370
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 208
involuntary context switches= 33860

runsolver used 1.9907 second user time and 4.5783 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-29 10:11:23
IDJOB=3288011
IDBENCH=82481
IDSOLVER=1605
FILE ID=node113/3288011-1304064682
RUNJOBID= node113-1304064180-30139
PBS_JOBID= 13170457
Free space on /tmp= 71148 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3288011-1304064682/watcher-3288011-1304064682 -o /tmp/evaluation-result-3288011-1304064682/solver-3288011-1304064682 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3288011-1304064682.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a8ad0173824ed9404a8c153da07c5f9c
RANDOM SEED=2124561432

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19384804 kB
Buffers:       1744984 kB
Cached:       10892992 kB
SwapCached:        164 kB
Active:        6733252 kB
Inactive:      6242856 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19384804 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            9812 kB
Writeback:          12 kB
AnonPages:      337224 kB
Mapped:          15476 kB
Slab:           527204 kB
PageTables:       5052 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   538724 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71148 MiB
End job on node113 at 2011-04-29 10:31:27