Trace number 3309816

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.8 5003.99

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom19.cnf
MD5SUMd725e0d6a363434dce7cb39ffdb1b83f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables40286
Number of clauses134663
Sum of the clauses size343327
Maximum clause length1301
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 269181
Number of clauses of size 364779
Number of clauses of size 4189
Number of clauses of size 517
Number of clauses of size over 5496

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309816-1304009424/watcher-3309816-1304009424 -o /tmp/evaluation-result-3309816-1304009424/solver-3309816-1304009424 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309816-1304009424.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.58 7.90 7.96 2/170 24627
/proc/meminfo: memFree=12973292/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=15376 CPUtime=0 cores=0-7
/proc/24627/stat : 24627 (plingeling) R 24625 24627 24162 0 -1 4202496 1728 1250 0 0 0 0 0 0 25 0 1 0 591173066 15745024 1657 33554432000 4194304 4417332 140734447015216 18446744073709551615 251367240797 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/24627/statm: 3844 1670 140 55 0 1730 0

[startup+0.0806931 s]
/proc/loadavg: 7.58 7.90 7.96 2/170 24627
/proc/meminfo: memFree=12973292/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=33704 CPUtime=0.07 cores=0-7
/proc/24627/stat : 24627 (plingeling) R 24625 24627 24162 0 -1 4202496 6505 1250 0 0 7 0 0 0 25 0 1 0 591173066 34512896 6433 33554432000 4194304 4417332 140734447015216 18446744073709551615 4232730 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/24627/statm: 8426 6433 148 55 0 6312 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 33704

[startup+0.10069 s]
/proc/loadavg: 7.58 7.90 7.96 2/170 24627
/proc/meminfo: memFree=12973292/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=33704 CPUtime=0.09 cores=0-7
/proc/24627/stat : 24627 (plingeling) R 24625 24627 24162 0 -1 4202496 6505 1250 0 0 9 0 0 0 25 0 1 0 591173066 34512896 6433 33554432000 4194304 4417332 140734447015216 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/24627/statm: 8426 6433 148 55 0 6312 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 33704

[startup+0.300655 s]
/proc/loadavg: 7.58 7.90 7.96 2/170 24627
/proc/meminfo: memFree=12973292/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=81064 CPUtime=0.29 cores=0-7
/proc/24627/stat : 24627 (plingeling) R 24625 24627 24162 0 -1 4202496 18329 1250 0 0 27 2 0 0 25 0 1 0 591173066 83009536 18257 33554432000 4194304 4417332 140734447015216 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/24627/statm: 20266 18257 148 55 0 18152 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 81064

[startup+1.17342 s]
/proc/loadavg: 7.58 7.90 7.96 2/170 24627
/proc/meminfo: memFree=12973292/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=225692 CPUtime=7.03 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 43737 1250 0 0 697 6 0 0 18 0 9 0 591173066 231108608 20069 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 56423 20069 175 55 0 54309 0
Current children cumulated CPU time (s) 7.03
Current children cumulated vsize (KiB) 225692

[startup+1.50036 s]
/proc/loadavg: 7.58 7.90 7.96 2/170 24627
/proc/meminfo: memFree=12973292/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=223288 CPUtime=9.65 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 47383 1250 0 0 959 6 0 0 18 0 9 0 591173066 228646912 20287 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 55822 20287 175 55 0 53708 0
Current children cumulated CPU time (s) 9.65
Current children cumulated vsize (KiB) 223288

[startup+3.10106 s]
/proc/loadavg: 7.05 7.78 7.92 9/179 24641
/proc/meminfo: memFree=12889040/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=237808 CPUtime=22.44 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 59930 1250 0 0 2236 8 0 0 18 0 9 0 591173066 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 59452 21877 181 55 0 57338 0
[pid=24627/tid=24634] ppid=24625 vsize=237808 CPUtime=2.75 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 3771 1250 0 0 275 0 0 0 23 0 9 0 591173098 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4252336 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=237808 CPUtime=2.74 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 5083 1250 0 0 274 0 0 0 25 0 9 0 591173098 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4253152 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=237808 CPUtime=2.76 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 1972 1250 0 0 276 0 0 0 23 0 9 0 591173098 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=237808 CPUtime=2.77 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 658 1250 0 0 277 0 0 0 23 0 9 0 591173098 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4353476 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=237808 CPUtime=2.76 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 12863 1250 0 0 275 1 0 0 25 0 9 0 591173098 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4258278 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=237808 CPUtime=2.76 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 10148 1250 0 0 274 2 0 0 25 0 9 0 591173099 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4257020 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=237808 CPUtime=2.76 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 3911 1250 0 0 276 0 0 0 23 0 9 0 591173099 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4259140 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=237808 CPUtime=2.75 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 3179 1250 0 0 275 0 0 0 25 0 9 0 591173099 243515392 21877 33554432000 4194304 4417332 140734447015216 18446744073709551615 4253264 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 22.44
Current children cumulated vsize (KiB) 237808

[startup+6.30047 s]
/proc/loadavg: 7.13 7.79 7.92 9/179 24642
/proc/meminfo: memFree=12878500/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=248252 CPUtime=48.01 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 62690 1250 0 0 4793 8 0 0 18 0 9 0 591173066 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 62063 23363 181 55 0 59949 0
[pid=24627/tid=24634] ppid=24625 vsize=248252 CPUtime=5.93 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 4565 1250 0 0 593 0 0 0 25 0 9 0 591173098 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4365900 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=248252 CPUtime=5.94 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 5877 1250 0 0 594 0 0 0 25 0 9 0 591173098 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=248252 CPUtime=5.96 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 2053 1250 0 0 596 0 0 0 25 0 9 0 591173098 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4301955 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=248252 CPUtime=5.97 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 658 1250 0 0 597 0 0 0 25 0 9 0 591173098 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=248252 CPUtime=5.96 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 13145 1250 0 0 595 1 0 0 25 0 9 0 591173098 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4366014 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=248252 CPUtime=5.96 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 10158 1250 0 0 594 2 0 0 25 0 9 0 591173099 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=248252 CPUtime=5.96 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 3925 1250 0 0 596 0 0 0 25 0 9 0 591173099 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364409 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=248252 CPUtime=5.95 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 3964 1250 0 0 595 0 0 0 25 0 9 0 591173099 254210048 23363 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.01
Current children cumulated vsize (KiB) 248252

[startup+12.7063 s]
/proc/loadavg: 7.20 7.79 7.92 9/179 24642
/proc/meminfo: memFree=12861040/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=267104 CPUtime=99.22 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 67645 1250 0 0 9913 9 0 0 18 0 9 0 591173066 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 66776 28076 181 55 0 64662 0
[pid=24627/tid=24634] ppid=24625 vsize=267104 CPUtime=12.3 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 4675 1250 0 0 1230 0 0 0 25 0 9 0 591173098 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=267104 CPUtime=12.34 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 6288 1250 0 0 1234 0 0 0 25 0 9 0 591173098 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4354736 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=267104 CPUtime=12.36 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 2673 1250 0 0 1236 0 0 0 25 0 9 0 591173098 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=267104 CPUtime=12.37 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 2272 1250 0 0 1237 0 0 0 25 0 9 0 591173098 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4353424 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=267104 CPUtime=12.37 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 13399 1250 0 0 1236 1 0 0 25 0 9 0 591173098 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364329 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=267104 CPUtime=12.37 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 10538 1250 0 0 1235 2 0 0 25 0 9 0 591173099 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4357612 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=267104 CPUtime=12.36 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 5224 1250 0 0 1236 0 0 0 25 0 9 0 591173099 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=267104 CPUtime=12.36 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 4231 1250 0 0 1236 0 0 0 25 0 9 0 591173099 273514496 28076 33554432000 4194304 4417332 140734447015216 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.22
Current children cumulated vsize (KiB) 267104

[startup+25.5009 s]
/proc/loadavg: 7.32 7.80 7.92 9/179 24642
/proc/meminfo: memFree=12832040/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=311896 CPUtime=201.52 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 84358 1250 0 0 20140 12 0 0 18 0 9 0 591173066 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 77974 39286 181 55 0 75860 0
[pid=24627/tid=24634] ppid=24625 vsize=311896 CPUtime=25.03 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 5794 1250 0 0 2503 0 0 0 25 0 9 0 591173098 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4251096 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=311896 CPUtime=25.14 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 8002 1250 0 0 2514 0 0 0 25 0 9 0 591173098 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4365883 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=311896 CPUtime=25.16 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 3357 1250 0 0 2516 0 0 0 25 0 9 0 591173098 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=311896 CPUtime=25.17 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 9725 1250 0 0 2515 2 0 0 25 0 9 0 591173098 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=311896 CPUtime=25.16 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 16169 1250 0 0 2515 1 0 0 25 0 9 0 591173098 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4365065 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=311896 CPUtime=25.16 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 11572 1250 0 0 2514 2 0 0 25 0 9 0 591173099 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4357874 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=311896 CPUtime=25.16 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 5240 1250 0 0 2516 0 0 0 25 0 9 0 591173099 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=311896 CPUtime=25.15 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 6154 1250 0 0 2515 0 0 0 25 0 9 0 591173099 319381504 39286 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 201.52
Current children cumulated vsize (KiB) 311896

[startup+51.1012 s]
/proc/loadavg: 7.59 7.81 7.92 9/179 24643
/proc/meminfo: memFree=12791232/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=337920 CPUtime=406.22 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 125460 1250 0 0 40604 18 0 0 18 0 9 0 591173066 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 84480 45792 181 55 0 82366 0
[pid=24627/tid=24634] ppid=24625 vsize=337920 CPUtime=50.5 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 9632 1250 0 0 5049 1 0 0 25 0 9 0 591173098 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4366398 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=337920 CPUtime=50.75 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 12532 1250 0 0 5074 1 0 0 25 0 9 0 591173098 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=337920 CPUtime=50.76 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 9094 1250 0 0 5076 0 0 0 25 0 9 0 591173098 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=337920 CPUtime=50.77 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 16190 1250 0 0 5074 3 0 0 25 0 9 0 591173098 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4357169 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=337920 CPUtime=50.77 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 23548 1250 0 0 5075 2 0 0 25 0 9 0 591173098 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=337920 CPUtime=50.76 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 14583 1250 0 0 5074 2 0 0 25 0 9 0 591173099 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=337920 CPUtime=50.77 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 6706 1250 0 0 5076 1 0 0 25 0 9 0 591173099 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4236816 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=337920 CPUtime=50.76 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 14830 1250 0 0 5074 2 0 0 25 0 9 0 591173099 346030080 45792 33554432000 4194304 4417332 140734447015216 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 406.22
Current children cumulated vsize (KiB) 337920

[startup+102.301 s]
/proc/loadavg: 7.82 7.84 7.92 9/179 24644

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/179 24788
/proc/meminfo: memFree=9621492/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=3505280 CPUtime=37750 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 4632641 1250 0 0 3774159 844 0 0 18 0 9 0 591173066 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 876320 837632 181 55 0 874206 0
[pid=24627/tid=24634] ppid=24625 vsize=3505280 CPUtime=4696.4 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 558505 1250 0 0 469533 107 0 0 25 0 9 0 591173098 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=3505280 CPUtime=4722.08 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 578216 1250 0 0 472094 114 0 0 25 0 9 0 591173098 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=3505280 CPUtime=4721.45 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 699352 1250 0 0 472025 120 0 0 25 0 9 0 591173098 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=3505280 CPUtime=4721.96 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 505463 1250 0 0 472112 84 0 0 25 0 9 0 591173098 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=3505280 CPUtime=4722.08 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 705830 1250 0 0 472067 141 0 0 25 0 9 0 591173098 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=3505280 CPUtime=4722.1 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 599105 1250 0 0 472093 117 0 0 25 0 9 0 591173099 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=3505280 CPUtime=4722.1 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 363550 1250 0 0 472153 57 0 0 25 0 9 0 591173099 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=3505280 CPUtime=4721.47 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 604275 1250 0 0 472048 99 0 0 25 0 9 0 591173099 3589406720 837632 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37750
Current children cumulated vsize (KiB) 3505280

[startup+4782.31 s]
/proc/loadavg: 8.01 8.02 8.00 9/179 24790
/proc/meminfo: memFree=9565928/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=3560564 CPUtime=38229.8 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 4757148 1250 0 0 3822106 870 0 0 18 0 9 0 591173066 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 890141 851453 181 55 0 888027 0
[pid=24627/tid=24634] ppid=24625 vsize=3560564 CPUtime=4756.08 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 586023 1250 0 0 475496 112 0 0 25 0 9 0 591173098 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=3560564 CPUtime=4782.08 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 595248 1250 0 0 478092 116 0 0 25 0 9 0 591173098 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=3560564 CPUtime=4781.46 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 699352 1250 0 0 478026 120 0 0 25 0 9 0 591173098 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=3560564 CPUtime=4781.98 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 512199 1250 0 0 478112 86 0 0 25 0 9 0 591173098 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=3560564 CPUtime=4782.09 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 779042 1250 0 0 478052 157 0 0 25 0 9 0 591173098 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=3560564 CPUtime=4782.1 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 599114 1250 0 0 478093 117 0 0 25 0 9 0 591173099 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=3560564 CPUtime=4782.11 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 363550 1250 0 0 478154 57 0 0 25 0 9 0 591173099 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=3560564 CPUtime=4781.47 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 604275 1250 0 0 478048 99 0 0 25 0 9 0 591173099 3646017536 851453 33554432000 4194304 4417332 140734447015216 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38229.8
Current children cumulated vsize (KiB) 3560564

[startup+4842.3 s]
/proc/loadavg: 8.04 8.03 8.00 9/179 24792
/proc/meminfo: memFree=9545192/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=3581232 CPUtime=38709.4 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 4775788 1250 0 0 3870067 872 0 0 18 0 9 0 591173066 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 895308 856620 181 55 0 893194 0
[pid=24627/tid=24634] ppid=24625 vsize=3581232 CPUtime=4815.75 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 586023 1250 0 0 481463 112 0 0 25 0 9 0 591173098 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=3581232 CPUtime=4842.08 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 595248 1250 0 0 484092 116 0 0 25 0 9 0 591173098 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=3581232 CPUtime=4841.46 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 699352 1250 0 0 484026 120 0 0 25 0 9 0 591173098 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=3581232 CPUtime=4841.97 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 514455 1250 0 0 484110 87 0 0 25 0 9 0 591173098 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=3581232 CPUtime=4842.08 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 779042 1250 0 0 484051 157 0 0 25 0 9 0 591173098 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=3581232 CPUtime=4842.1 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 599114 1250 0 0 484093 117 0 0 25 0 9 0 591173099 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=3581232 CPUtime=4842.1 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 379934 1250 0 0 484151 59 0 0 25 0 9 0 591173099 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=3581232 CPUtime=4841.46 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 604275 1250 0 0 484047 99 0 0 25 0 9 0 591173099 3667181568 856620 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38709.4
Current children cumulated vsize (KiB) 3581232

[startup+4902.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/179 24793
/proc/meminfo: memFree=9326448/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=3799248 CPUtime=39189.1 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 4870641 1250 0 0 3918016 891 0 0 18 0 9 0 591173066 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 949812 911124 181 55 0 947698 0
[pid=24627/tid=24634] ppid=24625 vsize=3799248 CPUtime=4875.42 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 586023 1250 0 0 487430 112 0 0 25 0 9 0 591173098 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4250432 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=3799248 CPUtime=4902.08 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 595248 1250 0 0 490092 116 0 0 25 0 9 0 591173098 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=3799248 CPUtime=4901.46 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 771819 1250 0 0 490014 132 0 0 25 0 9 0 591173098 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=3799248 CPUtime=4901.97 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 521223 1250 0 0 490109 88 0 0 25 0 9 0 591173098 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4357444 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=3799248 CPUtime=4902.09 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 779042 1250 0 0 490052 157 0 0 25 0 9 0 591173098 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=3799248 CPUtime=4902.1 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 599114 1250 0 0 490093 117 0 0 25 0 9 0 591173099 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=3799248 CPUtime=4902.11 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 395552 1250 0 0 490147 64 0 0 25 0 9 0 591173099 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=3799248 CPUtime=4901.46 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 604275 1250 0 0 490047 99 0 0 25 0 9 0 591173099 3890429952 911124 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39189.1
Current children cumulated vsize (KiB) 3799248

[startup+4962.3 s]
/proc/loadavg: 8.13 8.06 8.01 9/179 24795
/proc/meminfo: memFree=9070380/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=4200556 CPUtime=39668.8 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 5040887 1250 0 0 3965948 927 0 0 18 0 9 0 591173066 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 1050139 1011451 181 55 0 1048025 0
[pid=24627/tid=24634] ppid=24625 vsize=4200556 CPUtime=4935.1 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 618747 1250 0 0 493391 119 0 0 25 0 9 0 591173098 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=4200556 CPUtime=4962.08 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 611632 1250 0 0 496090 118 0 0 25 0 9 0 591173098 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=4200556 CPUtime=4961.46 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 771819 1250 0 0 496014 132 0 0 25 0 9 0 591173098 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=4200556 CPUtime=4961.97 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 539367 1250 0 0 496104 93 0 0 25 0 9 0 591173098 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4357063 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=4200556 CPUtime=4962.09 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 779042 1250 0 0 496052 157 0 0 25 0 9 0 591173098 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=4200556 CPUtime=4962.11 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 639757 1250 0 0 496084 127 0 0 25 0 9 0 591173099 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=4200556 CPUtime=4962.11 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 409073 1250 0 0 496143 68 0 0 25 0 9 0 591173099 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=4200556 CPUtime=4961.45 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 653105 1250 0 0 496037 108 0 0 25 0 9 0 591173099 4301369344 1011451 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39668.8
Current children cumulated vsize (KiB) 4200556



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.8 s]
/proc/loadavg: 8.06 8.05 8.00 9/179 24796
/proc/meminfo: memFree=8909800/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=4215448 CPUtime=40000.6 cores=0-7
/proc/24627/stat : 24627 (plingeling) S 24625 24627 24162 0 -1 4202496 5084271 1250 0 0 3999125 933 0 0 18 0 9 0 591173066 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 1053862 1015174 181 55 0 1051748 0
[pid=24627/tid=24634] ppid=24625 vsize=4215448 CPUtime=4976.37 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4202560 618747 1250 0 0 497518 119 0 0 25 0 9 0 591173098 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24627/tid=24635] ppid=24625 vsize=4215448 CPUtime=5003.59 cores=0-7
/proc/24627/task/24635/stat : 24635 (plingeling) R 24625 24627 24162 0 -1 4202560 611632 1250 0 0 500241 118 0 0 25 0 9 0 591173098 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364811 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24627/tid=24636] ppid=24625 vsize=4215448 CPUtime=5002.97 cores=0-7
/proc/24627/task/24636/stat : 24636 (plingeling) R 24625 24627 24162 0 -1 4202560 771819 1250 0 0 500165 132 0 0 25 0 9 0 591173098 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24627/tid=24637] ppid=24625 vsize=4215448 CPUtime=5003.47 cores=0-7
/proc/24627/task/24637/stat : 24637 (plingeling) R 24625 24627 24162 0 -1 4202560 541127 1250 0 0 500254 93 0 0 25 0 9 0 591173098 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4353540 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=24627/tid=24638] ppid=24625 vsize=4215448 CPUtime=5003.6 cores=0-7
/proc/24627/task/24638/stat : 24638 (plingeling) R 24625 24627 24162 0 -1 4202560 779042 1250 0 0 500203 157 0 0 25 0 9 0 591173098 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24627/tid=24639] ppid=24625 vsize=4215448 CPUtime=5003.61 cores=0-7
/proc/24627/task/24639/stat : 24639 (plingeling) R 24625 24627 24162 0 -1 4202560 681381 1250 0 0 500229 132 0 0 25 0 9 0 591173099 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24627/tid=24640] ppid=24625 vsize=4215448 CPUtime=5003.62 cores=0-7
/proc/24627/task/24640/stat : 24640 (plingeling) R 24625 24627 24162 0 -1 4202560 409073 1250 0 0 500294 68 0 0 25 0 9 0 591173099 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24627/tid=24641] ppid=24625 vsize=4215448 CPUtime=5002.96 cores=0-7
/proc/24627/task/24641/stat : 24641 (plingeling) R 24625 24627 24162 0 -1 4202560 653105 1250 0 0 500188 108 0 0 25 0 9 0 591173099 4316618752 1015174 33554432000 4194304 4417332 140734447015216 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 4215448

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.91 s]
/proc/loadavg: 8.06 8.05 8.00 9/179 24796
/proc/meminfo: memFree=8909800/32950928 swapFree=67111528/67111528
[pid=24627] ppid=24625 vsize=0 CPUtime=40000.7 cores=0-7
/proc/24627/stat : 24627 (plingeling) Z 24625 24627 24162 0 -1 4203548 5084271 1250 0 0 3999129 943 0 0 18 0 2 0 591173066 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 6 0 0 0
/proc/24627/statm: 0 0 0 0 0 0 0
[pid=24627/tid=24634] ppid=24625 vsize=0 CPUtime=4976.47 cores=0-7
/proc/24627/task/24634/stat : 24634 (plingeling) R 24625 24627 24162 0 -1 4203588 618747 1250 0 0 497518 129 0 0 25 0 2 0 591173098 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5003.99
CPU time (s): 40000.8
CPU user time (s): 39991.3
CPU system time (s): 9.51755
CPU usage (%): 799.378
Max. virtual memory (cumulated for all children) (KiB): 4215448

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39991.3
system time used= 9.51755
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5085521
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 529
involuntary context switches= 192794

runsolver used 7.79382 second user time and 19.46 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-28 18:50:24
IDJOB=3309816
IDBENCH=83119
IDSOLVER=1695
FILE ID=node113/3309816-1304009424
RUNJOBID= node113-1304004200-24176
PBS_JOBID= 13168815
Free space on /tmp= 71164 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom19.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309816-1304009424/watcher-3309816-1304009424 -o /tmp/evaluation-result-3309816-1304009424/solver-3309816-1304009424 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309816-1304009424.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= d725e0d6a363434dce7cb39ffdb1b83f
RANDOM SEED=1723298100

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12973324 kB
Buffers:       1871324 kB
Cached:       17442912 kB
SwapCached:          0 kB
Active:       10761148 kB
Inactive:      8617276 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12973324 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2708 kB
Writeback:           0 kB
AnonPages:       64144 kB
Mapped:          14768 kB
Slab:           533224 kB
PageTables:       4708 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   185768 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71164 MiB
End job on node113 at 2011-04-28 20:13:50