Trace number 3362287

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20? (TO) 4800.15 1203.72

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
32/aes_32_5_keyfind_1.cnf
MD5SUM3f4ea4cf17e734bbe947db7c1dc9fde7
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1116
Number of clauses4312
Sum of the clauses size13688
Maximum clause length5
Minimum clause length1
Number of clauses of size 184
Number of clauses of size 2200
Number of clauses of size 33008
Number of clauses of size 4920
Number of clauses of size 5100
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.00/0.00	c ==============================================================================
0.00/0.00	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.00	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.00	c ==============================================================================
0.00/0.00	c |         0 |    4148    13204 |    1244       0        0     nan |  0.000 % |
0.00/0.01	c |         0 |    3748    13284 |      --       0       --      -- |     --   | -272/592
0.00/0.01	c ==============================================================================
0.00/0.01	c Result  :   #vars: 754   #clauses: 3748   #literals: 13284
0.00/0.01	c CPU time:   0.008998 s
0.00/0.01	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3362287-1305301051/watcher-3362287-1305301051 -o /tmp/evaluation-result-3362287-1305301051/solver-3362287-1305301051 -C 4800 -W 1300 -M 15500 manysat.sh HOME/instance-3362287-1305301051.cnf aimd 1 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.09 7.76 5/374 10415
/proc/meminfo: memFree=4837288/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 329 0 0 0 0 0 0 0 25 0 1 0 641702812 8908800 249 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/10415/statm: 2175 249 209 178 0 68 0

[startup+0.018175 s]
/proc/loadavg: 8.13 8.09 7.76 5/374 10415
/proc/meminfo: memFree=4837288/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.107237 s]
/proc/loadavg: 8.13 8.09 7.76 5/374 10415
/proc/meminfo: memFree=4837288/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.928962 s]
/proc/loadavg: 8.13 8.09 7.76 5/374 10415
/proc/meminfo: memFree=4837288/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+1.02894 s]
/proc/loadavg: 8.13 8.09 7.76 5/374 10415
/proc/meminfo: memFree=4837288/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+1.50086 s]
/proc/loadavg: 8.13 8.09 7.76 5/374 10415
/proc/meminfo: memFree=4837288/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+3.10057 s]
/proc/loadavg: 8.20 8.10 7.77 9/379 10421
/proc/meminfo: memFree=4823608/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=46948 CPUtime=12.29 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 3376 0 0 0 1228 1 0 0 25 0 4 0 641702813 48074752 3325 33554432000 134512640 135305190 4287016432 18446744073709551615 134528341 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/10417/statm: 11737 3325 84 194 0 11541 0
[pid=10417/tid=10419] ppid=10415 vsize=46948 CPUtime=3.07 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 822 0 0 0 307 0 0 0 25 0 4 0 641702813 48074752 3325 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=46948 CPUtime=3.05 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 646 0 0 0 305 0 0 0 25 0 4 0 641702813 48074752 3325 33554432000 134512640 135305190 4287016432 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=46948 CPUtime=3.07 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 796 0 0 0 307 0 0 0 25 0 4 0 641702813 48074752 3325 33554432000 134512640 135305190 4287016432 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 55648

[startup+6.30098 s]
/proc/loadavg: 8.18 8.10 7.77 9/379 10421
/proc/meminfo: memFree=4815136/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=53220 CPUtime=25.06 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 5072 0 0 0 2504 2 0 0 25 0 4 0 641702813 54497280 5021 33554432000 134512640 135305190 4287016432 18446744073709551615 134557471 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/10417/statm: 13305 5021 84 194 0 13109 0
[pid=10417/tid=10419] ppid=10415 vsize=53220 CPUtime=6.27 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 1198 0 0 0 627 0 0 0 25 0 4 0 641702813 54497280 5021 33554432000 134512640 135305190 4287016432 18446744073709551615 134528254 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=53220 CPUtime=6.21 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 1049 0 0 0 621 0 0 0 25 0 4 0 641702813 54497280 5021 33554432000 134512640 135305190 4287016432 18446744073709551615 134528506 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=53220 CPUtime=6.27 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 1237 0 0 0 627 0 0 0 25 0 4 0 641702813 54497280 5021 33554432000 134512640 135305190 4287016432 18446744073709551615 134528406 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.07
Current children cumulated vsize (KiB) 61920

[startup+12.7008 s]
/proc/loadavg: 8.17 8.10 7.77 9/379 10421
/proc/meminfo: memFree=4798416/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=66216 CPUtime=50.61 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 8246 0 0 0 5058 3 0 0 25 0 4 0 641702813 67805184 8195 33554432000 134512640 135305190 4287016432 18446744073709551615 134528399 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/10417/statm: 16554 8195 84 194 0 16358 0
[pid=10417/tid=10419] ppid=10415 vsize=66216 CPUtime=12.68 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 1834 0 0 0 1268 0 0 0 25 0 4 0 641702813 67805184 8195 33554432000 134512640 135305190 4287016432 18446744073709551615 134528408 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=66216 CPUtime=12.54 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 1942 0 0 0 1254 0 0 0 25 0 4 0 641702813 67805184 8195 33554432000 134512640 135305190 4287016432 18446744073709551615 134528136 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=66216 CPUtime=12.68 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 2055 0 0 0 1268 0 0 0 25 0 4 0 641702813 67805184 8195 33554432000 134512640 135305190 4287016432 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.62
Current children cumulated vsize (KiB) 74916

[startup+25.5005 s]
/proc/loadavg: 8.29 8.13 7.78 9/379 10421
/proc/meminfo: memFree=4789500/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=71860 CPUtime=101.63 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 9778 0 0 0 10159 4 0 0 25 0 4 0 641702813 73584640 9727 33554432000 134512640 135305190 4287016432 18446744073709551615 134557493 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/10417/statm: 17965 9727 84 194 0 17769 0
[pid=10417/tid=10419] ppid=10415 vsize=71860 CPUtime=25.47 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 2175 0 0 0 2547 0 0 0 25 0 4 0 641702813 73584640 9727 33554432000 134512640 135305190 4287016432 18446744073709551615 134528379 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=71860 CPUtime=25.19 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 2364 0 0 0 2518 1 0 0 25 0 4 0 641702813 73584640 9727 33554432000 134512640 135305190 4287016432 18446744073709551615 134528263 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=71860 CPUtime=25.47 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 2434 0 0 0 2546 1 0 0 25 0 4 0 641702813 73584640 9727 33554432000 134512640 135305190 4287016432 18446744073709551615 134528254 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.64
Current children cumulated vsize (KiB) 80560

[startup+51.1008 s]
/proc/loadavg: 8.19 8.12 7.79 9/379 10422
/proc/meminfo: memFree=4763300/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=87572 CPUtime=203.72 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 13442 0 0 0 20366 6 0 0 25 0 4 0 641702813 89673728 13391 33554432000 134512640 135305190 4287016432 18446744073709551615 134528471 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/10417/statm: 21893 13391 84 194 0 21697 0
[pid=10417/tid=10419] ppid=10415 vsize=87572 CPUtime=51.07 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 2968 0 0 0 5106 1 0 0 25 0 4 0 641702813 89673728 13391 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=87572 CPUtime=50.48 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 3576 0 0 0 5047 1 0 0 25 0 4 0 641702813 89673728 13391 33554432000 134512640 135305190 4287016432 18446744073709551615 134528268 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=87572 CPUtime=51.06 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 3221 0 0 0 5105 1 0 0 25 0 4 0 641702813 89673728 13391 33554432000 134512640 135305190 4287016432 18446744073709551615 134528771 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.73
Current children cumulated vsize (KiB) 96272

[startup+102.3 s]
/proc/loadavg: 8.13 8.11 7.81 9/379 10423
/proc/meminfo: memFree=4733516/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=105776 CPUtime=407.89 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 17910 0 0 0 40780 9 0 0 25 0 4 0 641702813 108314624 17859 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/10417/statm: 26444 17859 84 194 0 26248 0
[pid=10417/tid=10419] ppid=10415 vsize=105776 CPUtime=102.27 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 3925 0 0 0 10226 1 0 0 25 0 4 0 641702813 108314624 17859 33554432000 134512640 135305190 4287016432 18446744073709551615 134528872 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=105776 CPUtime=101.07 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 5187 0 0 0 10104 3 0 0 25 0 4 0 641702813 108314624 17859 33554432000 134512640 135305190 4287016432 18446744073709551615 134528376 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=105776 CPUtime=102.25 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 4257 0 0 0 10223 2 0 0 25 0 4 0 641702813 108314624 17859 33554432000 134512640 135305190 4287016432 18446744073709551615 134528376 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.9
Current children cumulated vsize (KiB) 114476

[startup+162.301 s]
/proc/loadavg: 8.14 8.12 7.83 9/379 10425
/proc/meminfo: memFree=4669348/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=121200 CPUtime=647.19 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 21446 0 0 0 64707 12 0 0 25 0 4 0 641702813 124108800 21395 33554432000 134512640 135305190 4287016432 18446744073709551615 134528609 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/10417/statm: 30300 21395 84 194 0 30104 0
[pid=10417/tid=10419] ppid=10415 vsize=121200 CPUtime=162.27 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 4520 0 0 0 16226 1 0 0 25 0 4 0 641702813 124108800 21395 33554432000 134512640 135305190 4287016432 18446744073709551615 134528254 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=121200 CPUtime=160.37 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 6648 0 0 0 16032 5 0 0 25 0 4 0 641702813 124108800 21395 33554432000 134512640 135305190 4287016432 18446744073709551615 134524804 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=121200 CPUtime=162.25 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 5012 0 0 0 16223 2 0 0 25 0 4 0 641702813 124108800 21395 33554432000 134512640 135305190 4287016432 18446744073709551615 134528265 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.2
Current children cumulated vsize (KiB) 129900

[startup+222.301 s]

################
# More data... #
################

/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 8899 0 0 0 76205 5 0 0 25 0 4 0 641702813 210345984 41892 33554432000 134512640 135305190 4287016432 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3039.9
Current children cumulated vsize (KiB) 214116

[startup+822.301 s]
/proc/loadavg: 8.09 8.10 7.94 9/379 10443
/proc/meminfo: memFree=4405580/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=207556 CPUtime=3279.19 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 42329 0 0 0 327886 33 0 0 25 0 4 0 641702813 212537344 42278 33554432000 134512640 135305190 4287016432 18446744073709551615 134528252 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 51889 42278 84 194 0 51693 0
[pid=10417/tid=10419] ppid=10415 vsize=207556 CPUtime=822.26 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 8371 0 0 0 82222 4 0 0 25 0 4 0 641702813 212537344 42278 33554432000 134512640 135305190 4287016432 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=207556 CPUtime=819.15 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 15205 0 0 0 81899 16 0 0 25 0 4 0 641702813 212537344 42278 33554432000 134512640 135305190 4287016432 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=207556 CPUtime=822.11 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 8910 0 0 0 82206 5 0 0 25 0 4 0 641702813 212537344 42278 33554432000 134512640 135305190 4287016432 18446744073709551615 134528307 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3279.2
Current children cumulated vsize (KiB) 216256

[startup+882.3 s]
/proc/loadavg: 8.08 8.09 7.95 9/379 10444
/proc/meminfo: memFree=4385332/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=220000 CPUtime=3518.46 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 45581 0 0 0 351809 37 0 0 25 0 4 0 641702813 225280000 45530 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 55000 45530 84 194 0 54804 0
[pid=10417/tid=10419] ppid=10415 vsize=220000 CPUtime=882.26 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 8769 0 0 0 88221 5 0 0 25 0 4 0 641702813 225280000 45530 33554432000 134512640 135305190 4287016432 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=220000 CPUtime=879.13 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 17205 0 0 0 87894 19 0 0 25 0 4 0 641702813 225280000 45530 33554432000 134512640 135305190 4287016432 18446744073709551615 134528875 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=220000 CPUtime=882.09 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 9196 0 0 0 88203 6 0 0 25 0 4 0 641702813 225280000 45530 33554432000 134512640 135305190 4287016432 18446744073709551615 134528406 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3518.47
Current children cumulated vsize (KiB) 228700

[startup+942.314 s]
/proc/loadavg: 7.47 7.89 7.89 9/379 10479
/proc/meminfo: memFree=2565432/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=235876 CPUtime=3757.79 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 49236 0 0 0 375733 46 0 0 25 0 4 0 641702813 241537024 49185 33554432000 134512640 135305190 4287016432 18446744073709551615 134528242 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 58969 49185 84 194 0 58773 0
[pid=10417/tid=10419] ppid=10415 vsize=235876 CPUtime=942.27 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 9438 0 0 0 94218 9 0 0 25 0 4 0 641702813 241537024 49185 33554432000 134512640 135305190 4287016432 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=235876 CPUtime=939.15 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 19504 0 0 0 93893 22 0 0 25 0 4 0 641702813 241537024 49185 33554432000 134512640 135305190 4287016432 18446744073709551615 134528379 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=235876 CPUtime=942.09 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 9522 0 0 0 94203 6 0 0 25 0 4 0 641702813 241537024 49185 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3757.8
Current children cumulated vsize (KiB) 244576

[startup+1002.3 s]
/proc/loadavg: 7.84 7.92 7.90 9/379 10480
/proc/meminfo: memFree=2477588/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=241096 CPUtime=3996.95 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 50270 0 0 0 399647 48 0 0 25 0 4 0 641702813 246882304 50219 33554432000 134512640 135305190 4287016432 18446744073709551615 134528252 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 60274 50219 84 194 0 60078 0
[pid=10417/tid=10419] ppid=10415 vsize=241096 CPUtime=1002.24 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 9891 0 0 0 100215 9 0 0 21 0 4 0 641702813 246882304 50219 33554432000 134512640 135305190 4287016432 18446744073709551615 134539420 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=241096 CPUtime=999.08 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 19561 0 0 0 99885 23 0 0 25 0 4 0 641702813 246882304 50219 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=241096 CPUtime=1002.07 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 10042 0 0 0 100200 7 0 0 25 0 4 0 641702813 246882304 50219 33554432000 134512640 135305190 4287016432 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3996.96
Current children cumulated vsize (KiB) 249796

[startup+1062.3 s]
/proc/loadavg: 8.03 7.96 7.91 9/379 10482
/proc/meminfo: memFree=2301056/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=242008 CPUtime=4236.2 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 50498 0 0 0 423572 48 0 0 25 0 4 0 641702813 247816192 50447 33554432000 134512640 135305190 4287016432 18446744073709551615 134528254 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 60502 50447 84 194 0 60306 0
[pid=10417/tid=10419] ppid=10415 vsize=242008 CPUtime=1062.24 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 9891 0 0 0 106215 9 0 0 25 0 4 0 641702813 247816192 50447 33554432000 134512640 135305190 4287016432 18446744073709551615 134528274 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=242008 CPUtime=1059.08 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 19562 0 0 0 105885 23 0 0 25 0 4 0 641702813 247816192 50447 33554432000 134512640 135305190 4287016432 18446744073709551615 134528399 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=242008 CPUtime=1062.04 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 10254 0 0 0 106197 7 0 0 25 0 4 0 641702813 247816192 50447 33554432000 134512640 135305190 4287016432 18446744073709551615 134528256 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4236.21
Current children cumulated vsize (KiB) 250708

[startup+1122.3 s]
/proc/loadavg: 8.09 8.00 7.92 9/379 10484
/proc/meminfo: memFree=2070852/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=242724 CPUtime=4475.49 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 50633 0 0 0 447500 49 0 0 25 0 4 0 641702813 248549376 50582 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 60681 50582 84 194 0 60485 0
[pid=10417/tid=10419] ppid=10415 vsize=242724 CPUtime=1122.24 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 9902 0 0 0 112215 9 0 0 25 0 4 0 641702813 248549376 50582 33554432000 134512640 135305190 4287016432 18446744073709551615 134528536 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=242724 CPUtime=1119.08 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 19600 0 0 0 111885 23 0 0 25 0 4 0 641702813 248549376 50582 33554432000 134512640 135305190 4287016432 18446744073709551615 134528388 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=242724 CPUtime=1122.03 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 10254 0 0 0 112196 7 0 0 25 0 4 0 641702813 248549376 50582 33554432000 134512640 135305190 4287016432 18446744073709551615 134528256 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4475.5
Current children cumulated vsize (KiB) 251424

[startup+1182.3 s]
/proc/loadavg: 8.10 8.02 7.93 9/379 10485
/proc/meminfo: memFree=1966996/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=244592 CPUtime=4714.77 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 51042 0 0 0 471428 49 0 0 25 0 4 0 641702813 250462208 50991 33554432000 134512640 135305190 4287016432 18446744073709551615 134528229 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 61148 50991 84 194 0 60952 0
[pid=10417/tid=10419] ppid=10415 vsize=244592 CPUtime=1182.24 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 9968 0 0 0 118215 9 0 0 25 0 4 0 641702813 250462208 50991 33554432000 134512640 135305190 4287016432 18446744073709551615 134528376 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=244592 CPUtime=1179.08 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 19602 0 0 0 117885 23 0 0 25 0 4 0 641702813 250462208 50991 33554432000 134512640 135305190 4287016432 18446744073709551615 134528329 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=244592 CPUtime=1182.02 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 10299 0 0 0 118195 7 0 0 25 0 4 0 641702813 250462208 50991 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4714.78
Current children cumulated vsize (KiB) 253292



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.7 s]
/proc/loadavg: 8.15 8.04 7.94 9/379 10486
/proc/meminfo: memFree=1921472/32951124 swapFree=67111348/67111528
[pid=10415] ppid=10413 vsize=8700 CPUtime=0.01 cores=0,2,4,6
/proc/10415/stat : 10415 (manysat.sh) S 10413 10415 9547 0 -1 4202496 356 322 0 0 0 0 1 0 25 0 1 0 641702812 8908800 252 33554432000 4194304 4922060 140734446287664 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/10415/statm: 2175 252 209 178 0 68 0
[pid=10417] ppid=10415 vsize=245212 CPUtime=4800.14 cores=0,2,4,6
/proc/10417/stat : 10417 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202496 51163 0 0 0 479965 49 0 0 25 0 4 0 641702813 251097088 51112 33554432000 134512640 135305190 4287016432 18446744073709551615 134528376 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/10417/statm: 61303 51112 84 194 0 61107 0
[pid=10417/tid=10419] ppid=10415 vsize=245212 CPUtime=1203.67 cores=0,2,4,6
/proc/10417/task/10419/stat : 10419 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 10008 0 0 0 120357 10 0 0 25 0 4 0 641702813 251097088 51112 33554432000 134512640 135305190 4287016432 18446744073709551615 134528520 0 0 4096 3 0 0 0 -1 2 0 0 0
[pid=10417/tid=10420] ppid=10415 vsize=245212 CPUtime=1200.49 cores=0,2,4,6
/proc/10417/task/10420/stat : 10420 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 19605 0 0 0 120026 23 0 0 25 0 4 0 641702813 251097088 51112 33554432000 134512640 135305190 4287016432 18446744073709551615 134528421 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=10417/tid=10421] ppid=10415 vsize=245212 CPUtime=1203.43 cores=0,2,4,6
/proc/10417/task/10421/stat : 10421 (manysat1.1_stat) R 10415 10415 9547 0 -1 4202560 10321 0 0 0 120336 7 0 0 25 0 4 0 641702813 251097088 51112 33554432000 134512640 135305190 4287016432 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 253912

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10415 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=11998
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.012997
# while last known CPU time is 4800.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1203.72
CPU time (s): 4800.15
CPU user time (s): 4799.66
CPU system time (s): 0.49
CPU usage (%): 398.775
Max. virtual memory (cumulated for all children) (KiB): 253912

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.011998
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 678
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 4

runsolver used 4.00339 second user time and 10.2304 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-13 17:37:31
IDJOB=3362287
IDBENCH=83430
IDSOLVER=1838
FILE ID=node139/3362287-1305301051
RUNJOBID= node139-1305296392-9565
PBS_JOBID= 13321414
Free space on /tmp= 40600 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20 (4 threads)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/32/aes_32_5_keyfind_1.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3362287-1305301051/watcher-3362287-1305301051 -o /tmp/evaluation-result-3362287-1305301051/solver-3362287-1305301051 -C 4800 -W 1300 -M 15500  manysat.sh HOME/instance-3362287-1305301051.cnf aimd 1

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3f4ea4cf17e734bbe947db7c1dc9fde7
RANDOM SEED=1464598784

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       4837568 kB
Buffers:        256076 kB
Cached:       19977324 kB
SwapCached:          8 kB
Active:       15211936 kB
Inactive:     12172460 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       4837568 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            1572 kB
Writeback:           0 kB
AnonPages:     7150840 kB
Mapped:          28920 kB
Slab:           626816 kB
PageTables:      38992 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 77132524 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 40396 MiB
End job on node139 at 2011-05-13 17:57:37