Trace number 3386227

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3002.79 1300.36

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UR-20-10p0.cnf
MD5SUMfaef1c850bb82ceddc7da5a4c445dd25
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables258781
Number of clauses1372095
Sum of the clauses size3305764
Maximum clause length10
Minimum clause length1
Number of clauses of size 113149
Number of clauses of size 2980303
Number of clauses of size 3313283
Number of clauses of size 47260
Number of clauses of size 529040
Number of clauses of size over 529060

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386227-1305577795/watcher-3386227-1305577795 -o /tmp/evaluation-result-3386227-1305577795/solver-3386227-1305577795 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386227-1305577795.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.91 12.03 11.79 10/494 8512
/proc/meminfo: memFree=19876956/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=22576 CPUtime=0 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 943 0 0 0 0 0 0 0 22 0 1 0 669376684 23117824 881 33554432000 4194304 4625164 140736759176848 18446744073709551615 4315071 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8512/statm: 5644 881 291 106 0 1147 0

[startup+0.118888 s]
/proc/loadavg: 11.91 12.03 11.79 10/494 8512
/proc/meminfo: memFree=19876956/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=80756 CPUtime=0.09 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 9589 0 0 0 8 1 0 0 22 0 1 0 669376684 82694144 6821 33554432000 4194304 4625164 140736759176848 18446744073709551615 239476313605 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/8512/statm: 20189 6821 296 106 0 15692 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 80756

[startup+0.21887 s]
/proc/loadavg: 11.91 12.03 11.79 10/494 8512
/proc/meminfo: memFree=19876956/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=91812 CPUtime=0.19 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 13554 0 0 0 17 2 0 0 23 0 1 0 669376684 94015488 9399 33554432000 4194304 4625164 140736759176848 18446744073709551615 4306492 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/8512/statm: 22953 9399 296 106 0 18456 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 91812

[startup+0.300856 s]
/proc/loadavg: 11.91 12.03 11.79 10/494 8512
/proc/meminfo: memFree=19876956/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=96672 CPUtime=0.27 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 15188 0 0 0 25 2 0 0 23 0 1 0 669376684 98992128 11033 33554432000 4194304 4625164 140736759176848 18446744073709551615 239476392270 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/8512/statm: 24168 11033 296 106 0 19671 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 96672

[startup+0.70078 s]
/proc/loadavg: 11.91 12.03 11.79 10/494 8512
/proc/meminfo: memFree=19876956/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=257652 CPUtime=0.67 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 53210 0 0 0 60 7 0 0 25 0 1 0 669376684 263835648 43852 33554432000 4194304 4625164 140736759176848 18446744073709551615 239476392405 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/8512/statm: 64413 43852 301 106 0 59916 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 257652

[startup+1.50063 s]
/proc/loadavg: 11.91 12.03 11.79 13/498 8516
/proc/meminfo: memFree=19607480/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=512268 CPUtime=1.83 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 76611 0 0 0 174 9 0 0 25 0 4 0 669376684 524562432 67252 33554432000 4194304 4625164 140736759176848 18446744073709551615 4338060 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 128067 67252 336 106 0 123570 0
[pid=8512/tid=8514] ppid=8510 vsize=512268 CPUtime=0.37 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 3852 0 0 0 37 0 0 0 25 0 4 0 669376756 524562432 67252 33554432000 4194304 4625164 140736759176848 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=512268 CPUtime=0.23 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 5084 0 0 0 23 0 0 0 25 0 4 0 669376756 524562432 67252 33554432000 4194304 4625164 140736759176848 18446744073709551615 4334124 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=512268 CPUtime=0.16 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1559 0 0 0 16 0 0 0 25 0 4 0 669376756 524562432 67252 33554432000 4194304 4625164 140736759176848 18446744073709551615 4335017 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.83
Current children cumulated vsize (KiB) 512268

[startup+3.10032 s]
/proc/loadavg: 11.91 12.03 11.79 13/498 8516
/proc/meminfo: memFree=19588756/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=512268 CPUtime=5.51 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 81192 0 0 0 541 10 0 0 25 0 4 0 669376684 524562432 68111 33554432000 4194304 4625164 140736759176848 18446744073709551615 4278655 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 128067 68111 336 106 0 123570 0
[pid=8512/tid=8514] ppid=8510 vsize=512268 CPUtime=1.67 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 4379 0 0 0 167 0 0 0 25 0 4 0 669376756 524562432 68111 33554432000 4194304 4625164 140736759176848 18446744073709551615 4352186 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=512268 CPUtime=1.01 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 5109 0 0 0 101 0 0 0 25 0 4 0 669376756 524562432 68111 33554432000 4194304 4625164 140736759176848 18446744073709551615 4352831 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=512268 CPUtime=0.96 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 5585 0 0 0 96 0 0 0 25 0 4 0 669376756 524562432 68111 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288690 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.51
Current children cumulated vsize (KiB) 512268

[startup+6.30071 s]
/proc/loadavg: 11.99 12.05 11.79 13/498 8516
/proc/meminfo: memFree=19497864/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=512268 CPUtime=13.45 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 91684 0 0 0 1334 11 0 0 25 0 4 0 669376684 524562432 69294 33554432000 4194304 4625164 140736759176848 18446744073709551615 4390723 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 128067 69294 336 106 0 123570 0
[pid=8512/tid=8514] ppid=8510 vsize=512268 CPUtime=4.87 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 4379 0 0 0 487 0 0 0 25 0 4 0 669376756 524562432 69294 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288908 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=512268 CPUtime=2.59 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 5112 0 0 0 259 0 0 0 25 0 4 0 669376756 524562432 69294 33554432000 4194304 4625164 140736759176848 18446744073709551615 4317256 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=512268 CPUtime=2.56 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 16058 0 0 0 254 2 0 0 25 0 4 0 669376756 524562432 69294 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 13.45
Current children cumulated vsize (KiB) 512268

[startup+12.7005 s]
/proc/loadavg: 11.99 12.04 11.79 13/498 8516
/proc/meminfo: memFree=19431788/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=512268 CPUtime=31.85 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 99712 0 0 0 3172 13 0 0 25 0 4 0 669376684 524562432 72324 33554432000 4194304 4625164 140736759176848 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 128067 72324 336 106 0 123570 0
[pid=8512/tid=8514] ppid=8510 vsize=512268 CPUtime=11.26 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 5736 0 0 0 1126 0 0 0 25 0 4 0 669376756 524562432 72324 33554432000 4194304 4625164 140736759176848 18446744073709551615 4335146 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=512268 CPUtime=5.79 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 5573 0 0 0 579 0 0 0 25 0 4 0 669376756 524562432 72324 33554432000 4194304 4625164 140736759176848 18446744073709551615 4317551 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=512268 CPUtime=5.76 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 21284 0 0 0 574 2 0 0 25 0 4 0 669376756 524562432 72324 33554432000 4194304 4625164 140736759176848 18446744073709551615 4554582 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 31.85
Current children cumulated vsize (KiB) 512268

[startup+25.5011 s]
/proc/loadavg: 11.99 12.04 11.80 13/498 8516
/proc/meminfo: memFree=19203504/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=658288 CPUtime=66.73 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 226008 0 0 0 6643 30 0 0 25 0 4 0 669376684 674086912 122401 33554432000 4194304 4625164 140736759176848 18446744073709551615 4390688 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8512/statm: 164572 122401 337 106 0 160075 0
[pid=8512/tid=8514] ppid=8510 vsize=658288 CPUtime=20.9 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 8596 0 0 0 2090 0 0 0 25 0 4 0 669376756 674086912 122401 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288925 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=658288 CPUtime=15.2 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 9757 0 0 0 1519 1 0 0 25 0 4 0 669376756 674086912 122401 33554432000 4194304 4625164 140736759176848 18446744073709551615 4317225 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=658288 CPUtime=12.15 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 36889 0 0 0 1211 4 0 0 25 0 4 0 669376756 674086912 122401 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 66.73
Current children cumulated vsize (KiB) 658288

[startup+51.1012 s]
/proc/loadavg: 12.07 12.05 11.81 13/498 8517
/proc/meminfo: memFree=18911696/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=1024056 CPUtime=128.44 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 404127 0 0 0 12789 55 0 0 25 0 4 0 669376684 1048633344 178960 33554432000 4194304 4625164 140736759176848 18446744073709551615 4362423 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/8512/statm: 256014 178960 337 106 0 251517 0
[pid=8512/tid=8514] ppid=8510 vsize=1024056 CPUtime=34.66 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 19377 0 0 0 3463 3 0 0 25 0 4 0 669376756 1048633344 178960 33554432000 4194304 4625164 140736759176848 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=1024056 CPUtime=30.08 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 26000 0 0 0 3004 4 0 0 25 0 4 0 669376756 1048633344 178960 33554432000 4194304 4625164 140736759176848 18446744073709551615 4317256 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=1024056 CPUtime=28.24 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 68551 0 0 0 2815 9 0 0 25 0 4 0 669376756 1048633344 178960 33554432000 4194304 4625164 140736759176848 18446744073709551615 4334242 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 128.44
Current children cumulated vsize (KiB) 1024056

[startup+102.3 s]
/proc/loadavg: 12.15 12.07 11.83 13/498 8518
/proc/meminfo: memFree=18173448/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=1684104 CPUtime=246.47 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 787728 0 0 0 24539 108 0 0 25 0 4 0 669376684 1724522496 303777 33554432000 4194304 4625164 140736759176848 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 421026 303777 337 106 0 416529 0
[pid=8512/tid=8514] ppid=8510 vsize=1684104 CPUtime=65.93 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 34646 0 0 0 6588 5 0 0 16 0 4 0 669376756 1724522496 303777 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288755 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=1684104 CPUtime=64.58 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 51304 0 0 0 6449 9 0 0 19 0 4 0 669376756 1724522496 303777 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=1684104 CPUtime=58.01 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 130623 0 0 0 5784 17 0 0 25 0 4 0 669376756 1724522496 303777 33554432000 4194304 4625164 140736759176848 18446744073709551615 4334427 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 246.47
Current children cumulated vsize (KiB) 1684104

[startup+162.301 s]
/proc/loadavg: 12.09 12.07 11.84 12/498 8520
/proc/meminfo: memFree=16883468/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=2955560 CPUtime=375.46 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 1614013 0 0 0 37329 217 0 0 25 0 4 0 669376684 3026493440 565911 33554432000 4194304 4625164 140736759176848 18446744073709551615 4360194 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/8512/statm: 738890 565911 337 106 0 734393 0
[pid=8512/tid=8514] ppid=8510 vsize=2955560 CPUtime=102.58 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 61069 0 0 0 10248 10 0 0 25 0 4 0 669376756 3026493440 565911 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=2955560 CPUtime=97.5 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 84627 0 0 0 9735 15 0 0 25 0 4 0 669376756 3026493440 565911 33554432000 4194304 4625164 140736759176848 18446744073709551615 4317344 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=2955560 CPUtime=91.12 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 252100 0 0 0 9078 34 0 0 25 0 4 0 669376756 3026493440 565911 33554432000 4194304 4625164 140736759176848 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 375.46
Current children cumulated vsize (KiB) 2955560

[startup+222.318 s]
/proc/loadavg: 12.17 12.10 11.86 13/498 8521
/proc/meminfo: memFree=15329984/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=4210884 CPUtime=511.29 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 2342392 0 0 0 50811 318 0 0 25 0 4 0 669376684 4311945216 844426 33554432000 4194304 4625164 140736759176848 18446744073709551615 4360200 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8512/statm: 1052721 844426 337 106 0 1048224 0
[pid=8512/tid=8514] ppid=8510 vsize=4210884 CPUtime=133.82 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 77032 0 0 0 13368 14 0 0 25 0 4 0 669376756 4311945216 844426 33554432000 4194304 4625164 140736759176848 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=4210884 CPUtime=136.64 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 104331 0 0 0 13645 19 0 0 25 0 4 0 669376756 4311945216 844426 33554432000 4194304 4625164 140736759176848 18446744073709551615 4317225 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=4210884 CPUtime=133.97 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 329060 0 0 0 13352 45 0 0 25 0 4 0 669376756 4311945216 844426 33554432000 4194304 4625164 140736759176848 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 511.29
Current children cumulated vsize (KiB) 4210884

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 1652.68
Current children cumulated vsize (KiB) 9078652

[startup+762.3 s]
/proc/loadavg: 12.18 12.18 11.99 13/498 8536
/proc/meminfo: memFree=10449956/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9240372 CPUtime=1801.23 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 5828942 0 0 0 179330 793 0 0 25 0 4 0 669376684 9462140928 1875519 33554432000 4194304 4625164 140736759176848 18446744073709551615 4519248 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 2310093 1875519 344 106 0 2305596 0
[pid=8512/tid=8514] ppid=8510 vsize=9240372 CPUtime=475.92 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 104768 0 0 0 47573 19 0 0 25 0 4 0 669376756 9462140928 1875521 33554432000 4194304 4625164 140736759176848 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9240372 CPUtime=498.32 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 165882 0 0 0 49802 30 0 0 25 0 4 0 669376756 9462140928 1875521 33554432000 4194304 4625164 140736759176848 18446744073709551615 4317935 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9240372 CPUtime=442.07 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1148467 0 0 0 44050 157 0 0 25 0 4 0 669376756 9462140928 1875521 33554432000 4194304 4625164 140736759176848 18446744073709551615 4546872 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1801.23
Current children cumulated vsize (KiB) 9240372

[startup+822.301 s]
/proc/loadavg: 12.23 12.19 12.01 13/498 8537
/proc/meminfo: memFree=10309208/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9326984 CPUtime=1950.21 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 5911279 0 0 0 194215 806 0 0 25 0 4 0 669376684 9550831616 1897442 33554432000 4194304 4625164 140736759176848 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 2331746 1897442 344 106 0 2327249 0
[pid=8512/tid=8514] ppid=8510 vsize=9326984 CPUtime=516.21 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 106394 0 0 0 51602 19 0 0 25 0 4 0 669376756 9550831616 1897442 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9326984 CPUtime=528.15 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 167528 0 0 0 52785 30 0 0 25 0 4 0 669376756 9550831616 1897442 33554432000 4194304 4625164 140736759176848 18446744073709551615 4330976 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9326984 CPUtime=472.03 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1201140 0 0 0 47039 164 0 0 25 0 4 0 669376756 9550831616 1897442 33554432000 4194304 4625164 140736759176848 18446744073709551615 4334891 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1950.21
Current children cumulated vsize (KiB) 9326984

[startup+882.318 s]
/proc/loadavg: 12.31 12.22 12.03 13/498 8539
/proc/meminfo: memFree=10194120/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9406056 CPUtime=2099.07 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6049642 0 0 0 209082 825 0 0 25 0 4 0 669376684 9631801344 1916529 33554432000 4194304 4625164 140736759176848 18446744073709551615 4511795 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8512/statm: 2351514 1916529 370 106 0 2347017 0
[pid=8512/tid=8514] ppid=8510 vsize=9406056 CPUtime=565.94 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 117662 0 0 0 56573 21 0 0 25 0 4 0 669376756 9631801344 1916529 33554432000 4194304 4625164 140736759176848 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9406056 CPUtime=558.21 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 178777 0 0 0 55790 31 0 0 25 0 4 0 669376756 9631801344 1916529 33554432000 4194304 4625164 140736759176848 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9406056 CPUtime=501.92 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1306482 0 0 0 50014 178 0 0 25 0 4 0 669376756 9631801344 1916529 33554432000 4194304 4625164 140736759176848 18446744073709551615 4557107 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2099.07
Current children cumulated vsize (KiB) 9406056

[startup+942.301 s]
/proc/loadavg: 12.15 12.19 12.03 13/498 8541
/proc/meminfo: memFree=9904192/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9427136 CPUtime=2247.85 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6144858 0 0 0 223945 840 0 0 25 0 4 0 669376684 9653387264 1926055 33554432000 4194304 4625164 140736759176848 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8512/statm: 2356784 1926055 370 106 0 2352287 0
[pid=8512/tid=8514] ppid=8510 vsize=9427136 CPUtime=624.94 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 118228 0 0 0 62473 21 0 0 25 0 4 0 669376756 9653387264 1926055 33554432000 4194304 4625164 140736759176848 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9427136 CPUtime=588 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 179356 0 0 0 58769 31 0 0 25 0 4 0 669376756 9653387264 1926055 33554432000 4194304 4625164 140736759176848 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9427136 CPUtime=531.91 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1394427 0 0 0 52999 192 0 0 25 0 4 0 669376756 9653387264 1926055 33554432000 4194304 4625164 140736759176848 18446744073709551615 4547887 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2247.85
Current children cumulated vsize (KiB) 9427136

[startup+1002.3 s]
/proc/loadavg: 12.05 12.16 12.02 13/498 8542
/proc/meminfo: memFree=9373580/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9623744 CPUtime=2371.26 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6296212 0 0 0 236260 866 0 0 25 0 4 0 669376684 9854713856 2037308 33554432000 4194304 4625164 140736759176848 18446744073709551615 239476356129 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8512/statm: 2405936 2037308 370 106 0 2401439 0
[pid=8512/tid=8514] ppid=8510 vsize=9623744 CPUtime=669.79 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 118777 0 0 0 66958 21 0 0 25 0 4 0 669376756 9854713856 2037308 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9623744 CPUtime=631.85 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 179899 0 0 0 63154 31 0 0 25 0 4 0 669376756 9854713856 2037309 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9623744 CPUtime=547.56 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1426992 0 0 0 54560 196 0 0 25 0 4 0 669376756 9854713856 2037309 33554432000 4194304 4625164 140736759176848 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2371.26
Current children cumulated vsize (KiB) 9623744

[startup+1062.3 s]
/proc/loadavg: 12.13 12.16 12.03 13/498 8544
/proc/meminfo: memFree=8959776/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9820352 CPUtime=2506.92 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6449225 0 0 0 249801 891 0 0 22 0 4 0 669376684 10056040448 2129292 33554432000 4194304 4625164 140736759176848 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/8512/statm: 2455088 2129292 370 106 0 2450591 0
[pid=8512/tid=8514] ppid=8510 vsize=9820352 CPUtime=709.97 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 120051 0 0 0 70975 22 0 0 25 0 4 0 669376756 10056040448 2129292 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331081 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9820352 CPUtime=668.71 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 181284 0 0 0 66840 31 0 0 25 0 4 0 669376756 10056040448 2129292 33554432000 4194304 4625164 140736759176848 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9820352 CPUtime=572.66 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1481996 0 0 0 57063 203 0 0 25 0 4 0 669376756 10056040448 2129292 33554432000 4194304 4625164 140736759176848 18446744073709551615 4375272 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2506.92
Current children cumulated vsize (KiB) 9820352

[startup+1122.3 s]
/proc/loadavg: 12.18 12.16 12.03 13/498 8576
/proc/meminfo: memFree=12542092/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9917488 CPUtime=2636.64 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6596950 0 0 0 262750 914 0 0 25 0 4 0 669376684 10155507712 2163424 33554432000 4194304 4625164 140736759176848 18446744073709551615 4512023 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 2479372 2163424 370 106 0 2474875 0
[pid=8512/tid=8514] ppid=8510 vsize=9917488 CPUtime=739.88 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 120772 0 0 0 73966 22 0 0 25 0 4 0 669376756 10155507712 2163424 33554432000 4194304 4625164 140736759176848 18446744073709551615 4488068 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9917488 CPUtime=700.86 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 182306 0 0 0 70055 31 0 0 25 0 4 0 669376756 10155507712 2163424 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9917488 CPUtime=610.61 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1577722 0 0 0 60846 215 0 0 25 0 4 0 669376756 10155507712 2163424 33554432000 4194304 4625164 140736759176848 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2636.64
Current children cumulated vsize (KiB) 9917488

[startup+1182.3 s]
/proc/loadavg: 12.33 12.19 12.05 13/498 8578
/proc/meminfo: memFree=12365496/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9917488 CPUtime=2755.67 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6719998 0 0 0 274633 934 0 0 25 0 4 0 669376684 10155507712 2179068 33554432000 4194304 4625164 140736759176848 18446744073709551615 4519645 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 2479372 2179068 371 106 0 2474875 0
[pid=8512/tid=8514] ppid=8510 vsize=9917488 CPUtime=769.87 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 121085 0 0 0 76965 22 0 0 25 0 4 0 669376756 10155507712 2179068 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9917488 CPUtime=730.87 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 182606 0 0 0 73056 31 0 0 25 0 4 0 669376756 10155507712 2179068 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9917488 CPUtime=640.15 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1687137 0 0 0 63783 232 0 0 25 0 4 0 669376756 10155507712 2179068 33554432000 4194304 4625164 140736759176848 18446744073709551615 4559945 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2755.67
Current children cumulated vsize (KiB) 9917488

[startup+1242.3 s]
/proc/loadavg: 12.30 12.20 12.06 13/498 8580
/proc/meminfo: memFree=12213828/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=9983024 CPUtime=2887.93 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6816135 0 0 0 287846 947 0 0 25 0 4 0 669376684 10222616576 2199219 33554432000 4194304 4625164 140736759176848 18446744073709551615 4519659 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 2495756 2199219 370 106 0 2491259 0
[pid=8512/tid=8514] ppid=8510 vsize=9983024 CPUtime=799.97 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 121412 0 0 0 79975 22 0 0 25 0 4 0 669376756 10222616576 2199219 33554432000 4194304 4625164 140736759176848 18446744073709551615 4330822 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=9983024 CPUtime=760.78 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 182926 0 0 0 76046 32 0 0 25 0 4 0 669376756 10222616576 2199219 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=9983024 CPUtime=669.91 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1761971 0 0 0 66749 242 0 0 25 0 4 0 669376756 10222616576 2199219 33554432000 4194304 4625164 140736759176848 18446744073709551615 4352831 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2887.93
Current children cumulated vsize (KiB) 9983024



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.22 12.19 12.06 13/498 8581
/proc/meminfo: memFree=12087584/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=10048560 CPUtime=3002.42 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4202496 6826054 0 0 0 299292 950 0 0 25 0 4 0 669376684 10289725440 2208207 33554432000 4194304 4625164 140736759176848 18446744073709551615 4509061 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/8512/statm: 2512140 2208207 360 106 0 2507643 0
[pid=8512/tid=8514] ppid=8510 vsize=10048560 CPUtime=828.76 cores=0,2,4,6
/proc/8512/task/8514/stat : 8514 (SArTagnan) R 8510 8512 8278 0 -1 4202560 121518 0 0 0 82854 22 0 0 25 0 4 0 669376756 10289725440 2208207 33554432000 4194304 4625164 140736759176848 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8515] ppid=8510 vsize=10048560 CPUtime=789.71 cores=0,2,4,6
/proc/8512/task/8515/stat : 8515 (SArTagnan) R 8510 8512 8278 0 -1 4202560 183014 0 0 0 78939 32 0 0 25 0 4 0 669376756 10289725440 2208207 33554432000 4194304 4625164 140736759176848 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=8512/tid=8516] ppid=8510 vsize=10048560 CPUtime=698.4 cores=0,2,4,6
/proc/8512/task/8516/stat : 8516 (SArTagnan) R 8510 8512 8278 0 -1 4202560 1762151 0 0 0 69598 242 0 0 25 0 4 0 669376756 10289725440 2208207 33554432000 4194304 4625164 140736759176848 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3002.42
Current children cumulated vsize (KiB) 10048560

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.32 s]
/proc/loadavg: 12.22 12.19 12.06 10/496 8582
/proc/meminfo: memFree=16457112/32950928 swapFree=67056568/67111528
[pid=8512] ppid=8510 vsize=0 CPUtime=3002.74 cores=0,2,4,6
/proc/8512/stat : 8512 (SArTagnan) R 8510 8512 8278 0 -1 4203524 6826054 0 0 0 299294 980 0 0 25 0 1 0 669376684 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/8512/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 3002.74
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.36
CPU time (s): 3002.79
CPU user time (s): 2992.95
CPU system time (s): 9.8425
CPU usage (%): 230.92
Max. virtual memory (cumulated for all children) (KiB): 11991188

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2992.95
system time used= 9.8425
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6826054
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 53572
involuntary context switches= 39805

runsolver used 6.13407 second user time and 14.9457 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-16 22:29:56
IDJOB=3386227
IDBENCH=71036
IDSOLVER=1871
FILE ID=node148/3386227-1305577795
RUNJOBID= node148-1305576286-8296
PBS_JOBID= 13350202
Free space on /tmp= 72856 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UR-20-10p0.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386227-1305577795/watcher-3386227-1305577795 -o /tmp/evaluation-result-3386227-1305577795/solver-3386227-1305577795 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386227-1305577795.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= faef1c850bb82ceddc7da5a4c445dd25
RANDOM SEED=1054429666

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19877236 kB
Buffers:        354460 kB
Cached:        5037020 kB
SwapCached:       8488 kB
Active:        9495916 kB
Inactive:      3207224 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19877236 kB
SwapTotal:    67111528 kB
SwapFree:     67056568 kB
Dirty:           26560 kB
Writeback:           0 kB
AnonPages:     7309656 kB
Mapped:          38184 kB
Slab:           251520 kB
PageTables:      52180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 143480864 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72856 MiB
End job on node148 at 2011-05-16 22:51:38