Trace number 3265304

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.4 1201.78

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/fphp/unsat/
harder/fphp-030-029.shuffled-as.sat05-1234.cnf
MD5SUMc12aa6a0ac1bca448bef51c167f3bbbb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark17.1704
Satisfiable
(Un)Satisfiability was proved
Number of variables870
Number of clauses24825
Sum of the clauses size50460
Maximum clause length29
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 224795
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265304-1304107733/watcher-3265304-1304107733 -o /tmp/evaluation-result-3265304-1304107733/solver-3265304-1304107733 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3265304-1304107733.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.66 8.02 8.01 5/180 16657
/proc/meminfo: memFree=22919020/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=19592 CPUtime=0 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 570 0 0 0 0 0 0 0 25 0 1 0 522373756 20062208 505 33554432000 4194304 4623224 140736788333232 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/16657/statm: 4898 505 297 105 0 402 0

[startup+0.0938591 s]
/proc/loadavg: 7.66 8.02 8.01 5/180 16657
/proc/meminfo: memFree=22919020/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=252748 CPUtime=0.33 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 4560 0 0 0 33 0 0 0 25 0 4 0 522373756 258813952 2896 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 63187 2896 343 105 0 58691 0
Current children cumulated CPU time (s) 0.33
Current children cumulated vsize (KiB) 252748

[startup+0.135855 s]
/proc/loadavg: 7.66 8.02 8.01 5/180 16657
/proc/meminfo: memFree=22919020/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=253052 CPUtime=0.5 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 4905 0 0 0 50 0 0 0 25 0 4 0 522373756 259125248 3241 33554432000 4194304 4623224 140736788333232 18446744073709551615 4355947 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 63263 3242 343 105 0 58767 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 253052

[startup+0.300827 s]
/proc/loadavg: 7.66 8.02 8.01 5/180 16657
/proc/meminfo: memFree=22919020/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=254548 CPUtime=1.16 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 6677 0 0 0 115 1 0 0 25 0 4 0 522373756 260657152 5010 33554432000 4194304 4623224 140736788333232 18446744073709551615 4416120 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 63637 5010 347 105 0 59141 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 254548

[startup+0.700754 s]
/proc/loadavg: 7.66 8.02 8.01 5/180 16657
/proc/meminfo: memFree=22919020/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=259112 CPUtime=2.75 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 10126 0 0 0 274 1 0 0 25 0 4 0 522373756 265330688 8290 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415005 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 64778 8290 354 105 0 60282 0
Current children cumulated CPU time (s) 2.75
Current children cumulated vsize (KiB) 259112

[startup+1.5006 s]
/proc/loadavg: 7.66 8.02 8.01 9/184 16662
/proc/meminfo: memFree=22870512/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=267704 CPUtime=5.95 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 17769 0 0 0 592 3 0 0 25 0 4 0 522373756 274128896 13442 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415005 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 66926 13393 345 105 0 62430 0
[pid=16657/tid=16659] ppid=16655 vsize=267704 CPUtime=1.48 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 4336 0 0 0 147 1 0 0 25 0 4 0 522373757 274128896 13393 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=267704 CPUtime=1.48 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 4394 0 0 0 147 1 0 0 25 0 4 0 522373757 274128896 13393 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=267704 CPUtime=1.48 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 3783 0 0 0 148 0 0 0 25 0 4 0 522373757 274128896 13393 33554432000 4194304 4623224 140736788333232 18446744073709551615 244446988647 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 267704

[startup+3.10031 s]
/proc/loadavg: 7.66 8.02 8.01 9/184 16662
/proc/meminfo: memFree=22831244/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=284156 CPUtime=12.35 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 30400 0 0 0 1230 5 0 0 25 0 4 0 522373756 290975744 22182 33554432000 4194304 4623224 140736788333232 18446744073709551615 4501675 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 71039 22182 393 105 0 66543 0
[pid=16657/tid=16659] ppid=16655 vsize=284156 CPUtime=3.08 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 8088 0 0 0 307 1 0 0 25 0 4 0 522373757 290975744 22182 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=284156 CPUtime=3.06 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 8554 0 0 0 305 1 0 0 25 0 4 0 522373757 290975744 22182 33554432000 4194304 4623224 140736788333232 18446744073709551615 4378505 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=284156 CPUtime=3.08 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 6706 0 0 0 308 0 0 0 25 0 4 0 522373757 290975744 22182 33554432000 4194304 4623224 140736788333232 18446744073709551615 4551500 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 284156

[startup+6.30071 s]
/proc/loadavg: 7.69 8.02 8.01 9/184 16662
/proc/meminfo: memFree=22731940/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=300396 CPUtime=25.13 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 48287 0 0 0 2502 11 0 0 25 0 4 0 522373756 307605504 36597 33554432000 4194304 4623224 140736788333232 18446744073709551615 4360063 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 75099 36597 432 105 0 70603 0
[pid=16657/tid=16659] ppid=16655 vsize=300396 CPUtime=6.28 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 13937 0 0 0 625 3 0 0 25 0 4 0 522373757 307605504 36597 33554432000 4194304 4623224 140736788333232 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=300396 CPUtime=6.25 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 15271 0 0 0 621 4 0 0 25 0 4 0 522373757 307605504 36597 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=300396 CPUtime=6.28 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 8907 0 0 0 627 1 0 0 25 0 4 0 522373757 307605504 36597 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 300396

[startup+12.7005 s]
/proc/loadavg: 7.71 8.02 8.01 9/184 16662
/proc/meminfo: memFree=22612108/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=338660 CPUtime=50.69 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 92927 0 0 0 5049 20 0 0 25 0 4 0 522373756 346787840 53142 33554432000 4194304 4623224 140736788333232 18446744073709551615 4360117 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 84665 52971 344 105 0 80169 0
[pid=16657/tid=16659] ppid=16655 vsize=338660 CPUtime=12.68 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 23873 0 0 0 1261 7 0 0 25 0 4 0 522373757 346787840 52971 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=338660 CPUtime=12.61 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 22675 0 0 0 1255 6 0 0 25 0 4 0 522373757 346787840 52971 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=338660 CPUtime=12.68 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 32022 0 0 0 1264 4 0 0 25 0 4 0 522373757 346787840 52971 33554432000 4194304 4623224 140736788333232 18446744073709551615 244446988647 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 338660

[startup+25.5011 s]
/proc/loadavg: 7.78 8.02 8.01 9/184 16662
/proc/meminfo: memFree=22409256/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=523096 CPUtime=101.82 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 187397 0 0 0 10138 44 0 0 25 0 4 0 522373756 535650304 80764 33554432000 4194304 4623224 140736788333232 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 130774 80764 344 105 0 126278 0
[pid=16657/tid=16659] ppid=16655 vsize=523096 CPUtime=25.47 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 31753 0 0 0 2537 10 0 0 25 0 4 0 522373757 535650304 80764 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=523096 CPUtime=25.34 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 42457 0 0 0 2520 14 0 0 25 0 4 0 522373757 535650304 80764 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=523096 CPUtime=25.48 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 92149 0 0 0 2533 15 0 0 25 0 4 0 522373757 535650304 80764 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 523096

[startup+51.1003 s]
/proc/loadavg: 7.85 8.02 8.00 9/184 16663
/proc/meminfo: memFree=22099976/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=643876 CPUtime=204.08 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 461024 0 0 0 20308 100 0 0 25 0 4 0 522373756 659329024 122394 33554432000 4194304 4623224 140736788333232 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 160969 122394 352 105 0 156473 0
[pid=16657/tid=16659] ppid=16655 vsize=643876 CPUtime=51.08 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 47729 0 0 0 5089 19 0 0 25 0 4 0 522373757 659329024 122394 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376766 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=643876 CPUtime=50.8 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 68116 0 0 0 5052 28 0 0 25 0 4 0 522373757 659329024 122394 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376855 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=643876 CPUtime=51.08 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 313891 0 0 0 5061 47 0 0 25 0 4 0 522373757 659329024 122395 33554432000 4194304 4623224 140736788333232 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 643876

[startup+102.307 s]
/proc/loadavg: 7.93 8.01 8.00 9/184 16664
/proc/meminfo: memFree=21471768/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=944204 CPUtime=408.62 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 922155 0 0 0 40671 191 0 0 25 0 4 0 522373756 966864896 194946 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 236051 194946 450 105 0 231555 0
[pid=16657/tid=16659] ppid=16655 vsize=944204 CPUtime=102.29 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 79109 0 0 0 10197 32 0 0 25 0 4 0 522373757 966864896 194946 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=944204 CPUtime=101.72 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 100083 0 0 0 10126 46 0 0 25 0 4 0 522373757 966864896 194946 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=944204 CPUtime=102.28 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 669967 0 0 0 10128 100 0 0 25 0 4 0 522373757 966864896 194946 33554432000 4194304 4623224 140736788333232 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.62
Current children cumulated vsize (KiB) 944204

[startup+162.301 s]
/proc/loadavg: 8.04 8.02 8.00 9/184 16666
/proc/meminfo: memFree=20975864/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1194644 CPUtime=648.26 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 1432239 0 0 0 64540 286 0 0 25 0 4 0 522373756 1223315456 246287 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415001 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 298661 246287 425 105 0 294165 0
[pid=16657/tid=16659] ppid=16655 vsize=1194644 CPUtime=162.28 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 107760 0 0 0 16177 51 0 0 25 0 4 0 522373757 1223315456 246287 33554432000 4194304 4623224 140736788333232 18446744073709551615 4486229 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1194644 CPUtime=161.39 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 111244 0 0 0 16086 53 0 0 25 0 4 0 522373757 1223315456 246287 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1194644 CPUtime=162.27 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 1104910 0 0 0 16063 164 0 0 25 0 4 0 522373757 1223315456 246287 33554432000 4194304 4623224 140736788333232 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.26
Current children cumulated vsize (KiB) 1194644

[startup+222.3 s]
/proc/loadavg: 8.08 8.03 8.00 9/184 16667
/proc/meminfo: memFree=20735528/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1370132 CPUtime=887.92 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 1765293 0 0 0 88432 360 0 0 25 0 4 0 522373756 1403015168 278086 33554432000 4194304 4623224 140736788333232 18446744073709551615 4414955 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 342533 278086 349 105 0 338037 0
[pid=16657/tid=16659] ppid=16655 vsize=1370132 CPUtime=222.28 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 107983 0 0 0 22177 51 0 0 25 0 4 0 522373757 1403015168 278086 33554432000 4194304 4623224 140736788333232 18446744073709551615 4486219 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1370132 CPUtime=221.06 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 146904 0 0 0 22027 79 0 0 25 0 4 0 522373757 1403015168 278086 33554432000 4194304 4623224 140736788333232 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1370132 CPUtime=222.27 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 1358744 0 0 0 22021 206 0 0 25 0 4 0 522373757 1403015168 278086 33554432000 4194304 4623224 140736788333232 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.92
Current children cumulated vsize (KiB) 1370132

[startup+282.301 s]

################
# More data... #
################

[pid=16657] ppid=16655 vsize=1696156 CPUtime=2805.36 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 4969998 0 0 0 279575 961 0 0 25 0 4 0 522373756 1736863744 338485 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 424039 338485 494 105 0 419543 0
[pid=16657/tid=16659] ppid=16655 vsize=1696156 CPUtime=702.29 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 108917 0 0 0 70178 51 0 0 25 0 4 0 522373757 1736863744 338485 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1696156 CPUtime=698.46 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 148658 0 0 0 69765 81 0 0 25 0 4 0 522373757 1736863744 338485 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1696156 CPUtime=702.29 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 4479662 0 0 0 69441 788 0 0 25 0 4 0 522373757 1736863744 338485 33554432000 4194304 4623224 140736788333232 18446744073709551615 4363987 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2805.36
Current children cumulated vsize (KiB) 1696156

[startup+762.307 s]
/proc/loadavg: 8.16 8.10 8.02 9/184 16682
/proc/meminfo: memFree=20303244/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1696156 CPUtime=3045.07 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 5443791 0 0 0 303459 1048 0 0 25 0 4 0 522373756 1736863744 343636 33554432000 4194304 4623224 140736788333232 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 424039 343636 505 105 0 419543 0
[pid=16657/tid=16659] ppid=16655 vsize=1696156 CPUtime=762.3 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 108935 0 0 0 76179 51 0 0 25 0 4 0 522373757 1736863744 343636 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1696156 CPUtime=758.14 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 148840 0 0 0 75733 81 0 0 25 0 4 0 522373757 1736863744 343637 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1696156 CPUtime=762.3 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 4950499 0 0 0 75356 874 0 0 25 0 4 0 522373757 1736863744 343637 33554432000 4194304 4623224 140736788333232 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3045.07
Current children cumulated vsize (KiB) 1696156

[startup+822.3 s]
/proc/loadavg: 8.18 8.13 8.03 9/184 16683
/proc/meminfo: memFree=20270480/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1708568 CPUtime=3284.71 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 5965679 0 0 0 327323 1148 0 0 25 0 4 0 522373756 1749573632 351058 33554432000 4194304 4623224 140736788333232 18446744073709551615 4414984 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 427142 351058 511 105 0 422646 0
[pid=16657/tid=16659] ppid=16655 vsize=1708568 CPUtime=822.3 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 108951 0 0 0 82179 51 0 0 25 0 4 0 522373757 1749573632 351058 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1708568 CPUtime=817.81 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 148988 0 0 0 81700 81 0 0 25 0 4 0 522373757 1749573632 351058 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1708568 CPUtime=822.29 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 5467796 0 0 0 81256 973 0 0 25 0 4 0 522373757 1749573632 351058 33554432000 4194304 4623224 140736788333232 18446744073709551615 4364235 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.71
Current children cumulated vsize (KiB) 1708568

[startup+882.301 s]
/proc/loadavg: 8.15 8.13 8.04 9/184 16685
/proc/meminfo: memFree=20233868/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1724816 CPUtime=3524.4 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 6505267 0 0 0 351190 1250 0 0 25 0 4 0 522373756 1766211584 355872 33554432000 4194304 4623224 140736788333232 18446744073709551615 4414984 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 431204 355873 507 105 0 426708 0
[pid=16657/tid=16659] ppid=16655 vsize=1724816 CPUtime=882.3 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 108969 0 0 0 88179 51 0 0 25 0 4 0 522373757 1766211584 355873 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1724816 CPUtime=877.49 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149354 0 0 0 87668 81 0 0 25 0 4 0 522373757 1766211584 355874 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357887 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1724816 CPUtime=882.3 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 5996610 0 0 0 87158 1072 0 0 25 0 4 0 522373757 1766211584 355874 33554432000 4194304 4623224 140736788333232 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.4
Current children cumulated vsize (KiB) 1724816

[startup+942.301 s]
/proc/loadavg: 8.21 8.15 8.05 9/184 16686
/proc/meminfo: memFree=20206436/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1746144 CPUtime=3764.08 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 7047513 0 0 0 375058 1350 0 0 25 0 4 0 522373756 1788051456 359483 33554432000 4194304 4623224 140736788333232 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 436536 359483 494 105 0 432040 0
[pid=16657/tid=16659] ppid=16655 vsize=1746144 CPUtime=942.3 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 109024 0 0 0 94179 51 0 0 25 0 4 0 522373757 1788051456 359483 33554432000 4194304 4623224 140736788333232 18446744073709551615 4485442 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1746144 CPUtime=937.16 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149487 0 0 0 93635 81 0 0 25 0 4 0 522373757 1788051456 359483 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1746144 CPUtime=942.3 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 6536070 0 0 0 93059 1171 0 0 25 0 4 0 522373757 1788051456 359483 33554432000 4194304 4623224 140736788333232 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3764.08
Current children cumulated vsize (KiB) 1746144

[startup+1002.3 s]
/proc/loadavg: 8.12 8.14 8.05 9/184 16688
/proc/meminfo: memFree=20173664/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1746144 CPUtime=4003.75 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 7555540 0 0 0 398932 1443 0 0 25 0 4 0 522373756 1788051456 363781 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415005 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 436536 363781 506 105 0 432040 0
[pid=16657/tid=16659] ppid=16655 vsize=1746144 CPUtime=1002.3 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 109085 0 0 0 100179 51 0 0 25 0 4 0 522373757 1788051456 363781 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1746144 CPUtime=996.83 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149590 0 0 0 99602 81 0 0 25 0 4 0 522373757 1788051456 363781 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1746144 CPUtime=1002.29 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 7041672 0 0 0 98966 1263 0 0 25 0 4 0 522373757 1788051456 363781 33554432000 4194304 4623224 140736788333232 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.75
Current children cumulated vsize (KiB) 1746144

[startup+1062.3 s]
/proc/loadavg: 8.15 8.14 8.05 9/184 16690
/proc/meminfo: memFree=20112616/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1890116 CPUtime=4243.42 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 8120996 0 0 0 422795 1547 0 0 25 0 4 0 522373756 1935478784 376709 33554432000 4194304 4623224 140736788333232 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 472529 376729 494 105 0 468033 0
[pid=16657/tid=16659] ppid=16655 vsize=1890116 CPUtime=1062.3 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 109122 0 0 0 106179 51 0 0 25 0 4 0 522373757 1935478784 376740 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1890116 CPUtime=1056.51 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149659 0 0 0 105570 81 0 0 25 0 4 0 522373757 1935478784 376750 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1890116 CPUtime=1062.28 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 7524551 0 0 0 104875 1353 0 0 25 0 4 0 522373757 1935478784 376761 33554432000 4194304 4623224 140736788333232 18446744073709551615 244446642573 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.42
Current children cumulated vsize (KiB) 1890116

[startup+1122.3 s]
/proc/loadavg: 8.12 8.13 8.05 9/184 16691
/proc/meminfo: memFree=20085800/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1890116 CPUtime=4483.1 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 8664969 0 0 0 446666 1644 0 0 25 0 4 0 522373756 1935478784 380449 33554432000 4194304 4623224 140736788333232 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 472529 380449 494 105 0 468033 0
[pid=16657/tid=16659] ppid=16655 vsize=1890116 CPUtime=1122.31 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 109213 0 0 0 112180 51 0 0 25 0 4 0 522373757 1935478784 380449 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1890116 CPUtime=1116.18 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149725 0 0 0 111537 81 0 0 25 0 4 0 522373757 1935478784 380449 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1890116 CPUtime=1122.28 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 8066660 0 0 0 110778 1450 0 0 25 0 4 0 522373757 1935478784 380449 33554432000 4194304 4623224 140736788333232 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4483.1
Current children cumulated vsize (KiB) 1890116

[startup+1182.3 s]
/proc/loadavg: 8.10 8.12 8.05 9/184 16693
/proc/meminfo: memFree=20050312/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1895632 CPUtime=4722.78 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 9099220 0 0 0 470547 1731 0 0 25 0 4 0 522373756 1941127168 384427 33554432000 4194304 4623224 140736788333232 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 473908 384427 494 105 0 469412 0
[pid=16657/tid=16659] ppid=16655 vsize=1895632 CPUtime=1182.32 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 109233 0 0 0 118180 52 0 0 25 0 4 0 522373757 1941127168 384427 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1895632 CPUtime=1175.86 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149793 0 0 0 117505 81 0 0 25 0 4 0 522373757 1941127168 384427 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1895632 CPUtime=1182.29 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 8499385 0 0 0 116692 1537 0 0 25 0 4 0 522373757 1941127168 384427 33554432000 4194304 4623224 140736788333232 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.78
Current children cumulated vsize (KiB) 1895632



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 7.45 7.98 8.01 5/175 16712
/proc/meminfo: memFree=21550776/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1895764 CPUtime=4800.29 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 9108292 0 0 0 478296 1733 0 0 25 0 4 0 522373756 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4414955 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 473941 384991 494 105 0 469445 0
[pid=16657/tid=16659] ppid=16655 vsize=1895764 CPUtime=1201.72 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 109235 0 0 0 120120 52 0 0 25 0 4 0 522373757 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4486256 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1895764 CPUtime=1195.15 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149812 0 0 0 119434 81 0 0 25 0 4 0 522373757 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1895764 CPUtime=1201.7 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 8507956 0 0 0 118631 1539 0 0 25 0 4 0 522373757 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 1895764

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 7.45 7.98 8.01 5/175 16712
/proc/meminfo: memFree=21550776/32951124 swapFree=67111524/67111528
[pid=16657] ppid=16655 vsize=1895764 CPUtime=4800.29 cores=1,3,5,7
/proc/16657/stat : 16657 (SArTagnan) R 16655 16657 16386 0 -1 4202496 9108292 0 0 0 478296 1733 0 0 25 0 4 0 522373756 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4414955 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/16657/statm: 473941 384991 494 105 0 469445 0
[pid=16657/tid=16659] ppid=16655 vsize=1895764 CPUtime=1201.72 cores=1,3,5,7
/proc/16657/task/16659/stat : 16659 (SArTagnan) R 16655 16657 16386 0 -1 4202560 109235 0 0 0 120120 52 0 0 25 0 4 0 522373757 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4486256 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=16657/tid=16660] ppid=16655 vsize=1895764 CPUtime=1195.15 cores=1,3,5,7
/proc/16657/task/16660/stat : 16660 (SArTagnan) R 16655 16657 16386 0 -1 4202560 149812 0 0 0 119434 81 0 0 25 0 4 0 522373757 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=16657/tid=16661] ppid=16655 vsize=1895764 CPUtime=1201.7 cores=1,3,5,7
/proc/16657/task/16661/stat : 16661 (SArTagnan) R 16655 16657 16386 0 -1 4202560 8507956 0 0 0 118631 1539 0 0 25 0 4 0 522373757 1941262336 384991 33554432000 4194304 4623224 140736788333232 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 1895764

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.78
CPU time (s): 4800.4
CPU user time (s): 4782.99
CPU system time (s): 17.4094
CPU usage (%): 399.439
Max. virtual memory (cumulated for all children) (KiB): 2177644

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4782.99
system time used= 17.4094
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9108292
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2802
involuntary context switches= 32622

runsolver used 1.56776 second user time and 4.99724 second system time

The end

Launcher Data 

Begin job on node105 at 2011-04-29 22:08:53
IDJOB=3265304
IDBENCH=85538
IDSOLVER=1656
FILE ID=node105/3265304-1304107733
RUNJOBID= node105-1304105316-16405
PBS_JOBID= 13170654
Free space on /tmp= 71940 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT05/crafted/sabharwal05/counting/fphp/unsat/harder/fphp-030-029.shuffled-as.sat05-1234.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265304-1304107733/watcher-3265304-1304107733 -o /tmp/evaluation-result-3265304-1304107733/solver-3265304-1304107733 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3265304-1304107733.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c12aa6a0ac1bca448bef51c167f3bbbb
RANDOM SEED=925034368

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22919300 kB
Buffers:       2158140 kB
Cached:        7090476 kB
SwapCached:          4 kB
Active:         724260 kB
Inactive:      8762012 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22919300 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            1520 kB
Writeback:           0 kB
AnonPages:      237296 kB
Mapped:          15468 kB
Slab:           483448 kB
PageTables:       5104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   437680 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71940 MiB
End job on node105 at 2011-04-29 22:28:57