Trace number 3290187

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.25 1201.99

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_3_keyfind_1.cnf
MD5SUM4738c3d0ccd52030cff8addcec6bcde9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1404
Number of clauses7572
Sum of the clauses size29588
Maximum clause length5
Minimum clause length1
Number of clauses of size 1140
Number of clauses of size 2240
Number of clauses of size 32992
Number of clauses of size 41008
Number of clauses of size 53192
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3290187-1304097124/watcher-3290187-1304097124 -o /tmp/evaluation-result-3290187-1304097124/solver-3290187-1304097124 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3290187-1304097124.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.67 7.46 7.81 3/172 2209
/proc/meminfo: memFree=30923380/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=18836 CPUtime=0 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 473 0 0 0 0 0 0 0 18 0 1 0 502128325 19288064 410 33554432000 4194304 4623224 140736031311264 18446744073709551615 4388779 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2209/statm: 4709 410 300 105 0 213 0

[startup+0.0386821 s]
/proc/loadavg: 5.67 7.46 7.81 3/172 2209
/proc/meminfo: memFree=30923380/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=252220 CPUtime=0.19 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 3649 0 0 0 19 0 0 0 18 0 4 0 502128325 258273280 2088 33554432000 4194304 4623224 140736031311264 18446744073709551615 220815892487 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 63055 2088 342 105 0 58559 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 252220

[startup+0.158237 s]
/proc/loadavg: 5.67 7.46 7.81 3/172 2209
/proc/meminfo: memFree=30923380/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=253960 CPUtime=0.59 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 5124 0 0 0 59 0 0 0 18 0 4 0 502128325 260055040 2439 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 63490 2439 342 105 0 58994 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 253960

[startup+0.3582 s]
/proc/loadavg: 5.67 7.46 7.81 3/172 2209
/proc/meminfo: memFree=30923380/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=254284 CPUtime=1.39 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 6773 0 0 0 139 0 0 0 18 0 4 0 502128325 260386816 3036 33554432000 4194304 4623224 140736031311264 18446744073709551615 4291760 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 63571 3036 343 105 0 59075 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 254284

[startup+0.700139 s]
/proc/loadavg: 5.67 7.46 7.81 3/172 2209
/proc/meminfo: memFree=30923380/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=256868 CPUtime=2.76 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 10396 0 0 0 275 1 0 0 18 0 4 0 502128325 263032832 3978 33554432000 4194304 4623224 140736031311264 18446744073709551615 4385405 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 64217 3979 343 105 0 59721 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 256868

[startup+1.50099 s]
/proc/loadavg: 5.85 7.47 7.82 9/184 2221
/proc/meminfo: memFree=30893540/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=261088 CPUtime=5.95 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 19896 0 0 0 593 2 0 0 20 0 4 0 502128325 267354112 5902 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 65272 5902 343 105 0 60776 0
[pid=2209/tid=2218] ppid=2207 vsize=261088 CPUtime=1.47 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 2041 0 0 0 147 0 0 0 23 0 4 0 502128325 267354112 5902 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=261088 CPUtime=1.48 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 2101 0 0 0 148 0 0 0 24 0 4 0 502128325 267354112 5903 33554432000 4194304 4623224 140736031311264 18446744073709551615 4377613 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=261088 CPUtime=1.48 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 12015 0 0 0 147 1 0 0 23 0 4 0 502128325 267354112 5903 33554432000 4194304 4623224 140736031311264 18446744073709551615 220815897633 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 261088

[startup+3.1007 s]
/proc/loadavg: 5.85 7.47 7.82 9/184 2221
/proc/meminfo: memFree=30875312/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=267920 CPUtime=12.35 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 36229 0 0 0 1230 5 0 0 25 0 4 0 502128325 274350080 9034 33554432000 4194304 4623224 140736031311264 18446744073709551615 4384385 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 66980 9034 343 105 0 62484 0
[pid=2209/tid=2218] ppid=2207 vsize=267920 CPUtime=3.07 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 3070 0 0 0 307 0 0 0 25 0 4 0 502128325 274350080 9034 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376820 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=267920 CPUtime=3.08 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 3362 0 0 0 308 0 0 0 25 0 4 0 502128325 274350080 9034 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=267920 CPUtime=3.08 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 24663 0 0 0 306 2 0 0 25 0 4 0 502128325 274350080 9034 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 267920

[startup+6.30111 s]
/proc/loadavg: 5.85 7.47 7.82 9/184 2222
/proc/meminfo: memFree=30838240/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=275960 CPUtime=25.13 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 65039 0 0 0 2504 9 0 0 25 0 4 0 502128325 282583040 14221 33554432000 4194304 4623224 140736031311264 18446744073709551615 4359560 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 68990 14221 344 105 0 64494 0
[pid=2209/tid=2218] ppid=2207 vsize=275960 CPUtime=6.26 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 5296 0 0 0 625 1 0 0 25 0 4 0 502128325 282583040 14221 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=275960 CPUtime=6.28 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 5343 0 0 0 628 0 0 0 25 0 4 0 502128325 282583040 14221 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=275960 CPUtime=6.28 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 47019 0 0 0 622 6 0 0 25 0 4 0 502128325 282583040 14221 33554432000 4194304 4623224 140736031311264 18446744073709551615 4365976 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 275960

[startup+12.7009 s]
/proc/loadavg: 6.18 7.49 7.82 9/184 2291
/proc/meminfo: memFree=30802396/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=296624 CPUtime=50.7 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 111642 0 0 0 5053 17 0 0 25 0 4 0 502128325 303742976 22229 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 74156 22229 344 105 0 69660 0
[pid=2209/tid=2218] ppid=2207 vsize=296624 CPUtime=12.61 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 8743 0 0 0 1260 1 0 0 25 0 4 0 502128325 303742976 22233 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=296624 CPUtime=12.68 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 9235 0 0 0 1267 1 0 0 25 0 4 0 502128325 303742976 22234 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=296624 CPUtime=12.68 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 83999 0 0 0 1257 11 0 0 25 0 4 0 502128325 303742976 22234 33554432000 4194304 4623224 140736031311264 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 296624

[startup+25.5006 s]
/proc/loadavg: 6.46 7.50 7.82 9/184 2291
/proc/meminfo: memFree=30723784/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=316512 CPUtime=101.83 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 211912 0 0 0 10147 36 0 0 25 0 4 0 502128325 324108288 33481 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510066 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 79128 33481 344 105 0 74632 0
[pid=2209/tid=2218] ppid=2207 vsize=316512 CPUtime=25.35 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 13121 0 0 0 2532 3 0 0 25 0 4 0 502128325 324108288 33481 33554432000 4194304 4623224 140736031311264 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=316512 CPUtime=25.48 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 13331 0 0 0 2546 2 0 0 25 0 4 0 502128325 324108288 33481 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=316512 CPUtime=25.48 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 171557 0 0 0 2521 27 0 0 25 0 4 0 502128325 324108288 33481 33554432000 4194304 4623224 140736031311264 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 316512

[startup+51.1008 s]
/proc/loadavg: 6.99 7.54 7.82 9/184 2292
/proc/meminfo: memFree=30549528/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=449088 CPUtime=204.08 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 331408 0 0 0 20352 56 0 0 25 0 4 0 502128325 459866112 63222 33554432000 4194304 4623224 140736031311264 18446744073709551615 4355953 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 112272 63222 396 105 0 107776 0
[pid=2209/tid=2218] ppid=2207 vsize=449088 CPUtime=50.8 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 20628 0 0 0 5076 4 0 0 25 0 4 0 502128325 459866112 63222 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=449088 CPUtime=51.08 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 21663 0 0 0 5102 6 0 0 25 0 4 0 502128325 459866112 63222 33554432000 4194304 4623224 140736031311264 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=449088 CPUtime=51.08 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 234657 0 0 0 5072 36 0 0 25 0 4 0 502128325 459866112 63222 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 449088

[startup+102.306 s]
/proc/loadavg: 7.59 7.62 7.83 9/184 2293
/proc/meminfo: memFree=30360888/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=576128 CPUtime=408.62 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 416129 0 0 0 40787 75 0 0 25 0 4 0 502128325 589955072 86971 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 144032 86971 527 105 0 139536 0
[pid=2209/tid=2218] ppid=2207 vsize=576128 CPUtime=101.72 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 28309 0 0 0 10164 8 0 0 25 0 4 0 502128325 589955072 86971 33554432000 4194304 4623224 140736031311264 18446744073709551615 4463825 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=576128 CPUtime=102.29 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 29154 0 0 0 10220 9 0 0 25 0 4 0 502128325 589955072 86971 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=576128 CPUtime=102.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 291768 0 0 0 10183 46 0 0 25 0 4 0 502128325 589955072 86971 33554432000 4194304 4623224 140736031311264 18446744073709551615 4364672 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.62
Current children cumulated vsize (KiB) 576128

[startup+162.3 s]
/proc/loadavg: 7.85 7.68 7.83 9/184 2295
/proc/meminfo: memFree=30180052/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=740584 CPUtime=648.27 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 846490 0 0 0 64681 146 0 0 25 0 4 0 502128325 758358016 118063 33554432000 4194304 4623224 140736031311264 18446744073709551615 4517479 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 185146 118063 488 105 0 180650 0
[pid=2209/tid=2218] ppid=2207 vsize=740584 CPUtime=161.39 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 30131 0 0 0 16130 9 0 0 25 0 4 0 502128325 758358016 118063 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=740584 CPUtime=162.28 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 33163 0 0 0 16217 11 0 0 25 0 4 0 502128325 758358016 118063 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=740584 CPUtime=162.28 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 657663 0 0 0 16123 105 0 0 25 0 4 0 502128325 758358016 118064 33554432000 4194304 4623224 140736031311264 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 648.27
Current children cumulated vsize (KiB) 740584

[startup+222.3 s]
/proc/loadavg: 7.99 7.75 7.84 9/184 2296
/proc/meminfo: memFree=30052552/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=776884 CPUtime=887.94 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 1096208 0 0 0 88602 192 0 0 25 0 4 0 502128325 795529216 135525 33554432000 4194304 4623224 140736031311264 18446744073709551615 4511014 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 194221 135525 451 105 0 189725 0
[pid=2209/tid=2218] ppid=2207 vsize=776884 CPUtime=221.05 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 41278 0 0 0 22093 12 0 0 25 0 4 0 502128325 795529216 135525 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=776884 CPUtime=222.29 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 41732 0 0 0 22216 13 0 0 25 0 4 0 502128325 795529216 135525 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=776884 CPUtime=222.28 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 873198 0 0 0 22085 143 0 0 25 0 4 0 502128325 795529216 135525 33554432000 4194304 4623224 140736031311264 18446744073709551615 4557831 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 887.94
Current children cumulated vsize (KiB) 776884

[startup+282.3 s]

################
# More data... #
################

[pid=2209] ppid=2207 vsize=1485660 CPUtime=2805.29 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 4412117 0 0 0 279757 772 0 0 25 0 4 0 502128325 1521315840 280441 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 371415 280441 344 105 0 366919 0
[pid=2209/tid=2218] ppid=2207 vsize=1485660 CPUtime=698.39 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 76075 0 0 0 69807 32 0 0 25 0 4 0 502128325 1521315840 280441 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1485660 CPUtime=702.29 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 76543 0 0 0 70207 22 0 0 25 0 4 0 502128325 1521315840 280441 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1485660 CPUtime=702.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 3925872 0 0 0 69568 661 0 0 25 0 4 0 502128325 1521315840 280441 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376649 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2805.29
Current children cumulated vsize (KiB) 1485660

[startup+762.307 s]
/proc/loadavg: 8.08 8.03 7.93 9/184 2313
/proc/meminfo: memFree=29024976/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=1530540 CPUtime=3044.98 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 4806558 0 0 0 303659 839 0 0 25 0 4 0 502128325 1567272960 293793 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 382635 293813 344 105 0 378139 0
[pid=2209/tid=2218] ppid=2207 vsize=1530540 CPUtime=758.06 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 77068 0 0 0 75773 33 0 0 25 0 4 0 502128325 1567272960 293823 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1530540 CPUtime=762.3 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 76933 0 0 0 76208 22 0 0 25 0 4 0 502128325 1567272960 293824 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1530540 CPUtime=762.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 4289064 0 0 0 75506 723 0 0 25 0 4 0 502128325 1567272960 293824 33554432000 4194304 4623224 140736031311264 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3044.98
Current children cumulated vsize (KiB) 1530540

[startup+822.301 s]
/proc/loadavg: 8.26 8.10 7.96 9/184 2317
/proc/meminfo: memFree=28946980/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=1530540 CPUtime=3283.82 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 5182977 0 0 0 327478 904 0 0 25 0 4 0 502128325 1567272960 303321 33554432000 4194304 4623224 140736031311264 18446744073709551615 4414880 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 382635 303321 344 105 0 378139 0
[pid=2209/tid=2218] ppid=2207 vsize=1530540 CPUtime=817.73 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 78857 0 0 0 81739 34 0 0 25 0 4 0 502128325 1567272960 303321 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1530540 CPUtime=822.28 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 77411 0 0 0 82206 22 0 0 25 0 4 0 502128325 1567272960 303321 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1530540 CPUtime=822.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 4660091 0 0 0 81444 785 0 0 25 0 4 0 502128325 1567272960 303321 33554432000 4194304 4623224 140736031311264 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3283.82
Current children cumulated vsize (KiB) 1530540

[startup+882.301 s]
/proc/loadavg: 8.14 8.09 7.96 9/184 2319
/proc/meminfo: memFree=28871432/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=1634960 CPUtime=3523.49 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 5539312 0 0 0 351384 965 0 0 25 0 4 0 502128325 1674199040 316867 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 408740 316867 344 105 0 404244 0
[pid=2209/tid=2218] ppid=2207 vsize=1634960 CPUtime=877.39 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 80557 0 0 0 87703 36 0 0 25 0 4 0 502128325 1674199040 316867 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1634960 CPUtime=882.28 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 94756 0 0 0 88203 25 0 0 25 0 4 0 502128325 1674199040 316867 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1634960 CPUtime=882.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 4994087 0 0 0 87388 841 0 0 25 0 4 0 502128325 1674199040 316867 33554432000 4194304 4623224 140736031311264 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3523.49
Current children cumulated vsize (KiB) 1634960

[startup+942.301 s]
/proc/loadavg: 8.09 8.08 7.97 9/184 2320
/proc/meminfo: memFree=28799576/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=1667132 CPUtime=3763.16 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 5931052 0 0 0 375283 1033 0 0 25 0 4 0 502128325 1707143168 329015 33554432000 4194304 4623224 140736031311264 18446744073709551615 4414984 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 416783 329015 344 105 0 412287 0
[pid=2209/tid=2218] ppid=2207 vsize=1667132 CPUtime=937.06 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 98703 0 0 0 93665 41 0 0 25 0 4 0 502128325 1707143168 329015 33554432000 4194304 4623224 140736031311264 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1667132 CPUtime=942.28 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 95798 0 0 0 94203 25 0 0 25 0 4 0 502128325 1707143168 329015 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1667132 CPUtime=942.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 5348343 0 0 0 93330 899 0 0 25 0 4 0 502128325 1707143168 329015 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3763.16
Current children cumulated vsize (KiB) 1667132

[startup+1002.3 s]
/proc/loadavg: 8.07 8.08 7.98 9/184 2322
/proc/meminfo: memFree=28726868/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=1672940 CPUtime=4002.83 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 6349110 0 0 0 399173 1110 0 0 25 0 4 0 502128325 1713090560 340474 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 418235 340474 344 105 0 413739 0
[pid=2209/tid=2218] ppid=2207 vsize=1672940 CPUtime=996.72 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 100481 0 0 0 99630 42 0 0 25 0 4 0 502128325 1713090560 340474 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1672940 CPUtime=1002.28 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 97982 0 0 0 100202 26 0 0 25 0 4 0 502128325 1713090560 340474 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1672940 CPUtime=1002.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 5720758 0 0 0 99265 964 0 0 25 0 4 0 502128325 1713090560 340474 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4002.83
Current children cumulated vsize (KiB) 1672940

[startup+1062.3 s]
/proc/loadavg: 8.06 8.08 7.98 9/184 2324
/proc/meminfo: memFree=28581748/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=1824700 CPUtime=4242.5 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 6841565 0 0 0 423056 1194 0 0 25 0 4 0 502128325 1868492800 362626 33554432000 4194304 4623224 140736031311264 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 456175 362626 344 105 0 451679 0
[pid=2209/tid=2218] ppid=2207 vsize=1824700 CPUtime=1056.39 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 102105 0 0 0 105595 44 0 0 25 0 4 0 502128325 1868492800 362626 33554432000 4194304 4623224 140736031311264 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1824700 CPUtime=1062.28 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 101655 0 0 0 106201 27 0 0 25 0 4 0 502128325 1868492800 362626 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1824700 CPUtime=1062.28 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 6081452 0 0 0 105203 1025 0 0 25 0 4 0 502128325 1868492800 362626 33554432000 4194304 4623224 140736031311264 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4242.5
Current children cumulated vsize (KiB) 1824700

[startup+1122.3 s]
/proc/loadavg: 8.02 8.06 7.98 9/184 2325
/proc/meminfo: memFree=28505820/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=1900212 CPUtime=4482.17 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 7240568 0 0 0 446956 1261 0 0 25 0 4 0 502128325 1945817088 373732 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 475053 373732 344 105 0 470557 0
[pid=2209/tid=2218] ppid=2207 vsize=1900212 CPUtime=1116.06 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 103911 0 0 0 111560 46 0 0 25 0 4 0 502128325 1945817088 373732 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=1900212 CPUtime=1122.29 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 102598 0 0 0 112201 28 0 0 25 0 4 0 502128325 1945817088 373732 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=1900212 CPUtime=1122.28 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 6423367 0 0 0 111148 1080 0 0 25 0 4 0 502128325 1945817088 373732 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4482.17
Current children cumulated vsize (KiB) 1900212

[startup+1182.3 s]
/proc/loadavg: 8.05 8.06 7.99 9/184 2327
/proc/meminfo: memFree=28411296/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=2013060 CPUtime=4721.85 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 7398638 0 0 0 470898 1287 0 0 25 0 4 0 502128325 2061373440 387795 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 503265 387795 443 105 0 498769 0
[pid=2209/tid=2218] ppid=2207 vsize=2013060 CPUtime=1175.73 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 105509 0 0 0 117525 48 0 0 25 0 4 0 502128325 2061373440 387795 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=2013060 CPUtime=1182.29 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 104666 0 0 0 118200 29 0 0 25 0 4 0 502128325 2061373440 387795 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=2013060 CPUtime=1182.29 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 6501885 0 0 0 117136 1093 0 0 25 0 4 0 502128325 2061373440 387795 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4721.85
Current children cumulated vsize (KiB) 2013060



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.03 8.06 7.99 9/184 2327
/proc/meminfo: memFree=28395400/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=2015700 CPUtime=4800.14 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 7414268 0 0 0 478724 1290 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 503925 389931 344 105 0 499429 0
[pid=2209/tid=2218] ppid=2207 vsize=2015700 CPUtime=1195.21 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 105966 0 0 0 119473 48 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4357576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=2015700 CPUtime=1201.9 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 105437 0 0 0 120161 29 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=2015700 CPUtime=1201.89 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 6505028 0 0 0 119096 1093 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 2015700

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 8.03 8.06 7.99 9/184 2327
/proc/meminfo: memFree=28395400/32951124 swapFree=67105204/67111528
[pid=2209] ppid=2207 vsize=2015700 CPUtime=4800.14 cores=0,2,4,6
/proc/2209/stat : 2209 (SArTagnan) R 2207 2209 1676 0 -1 4202496 7414268 0 0 0 478724 1290 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2209/statm: 503925 389931 344 105 0 499429 0
[pid=2209/tid=2218] ppid=2207 vsize=2015700 CPUtime=1195.21 cores=0,2,4,6
/proc/2209/task/2218/stat : 2218 (SArTagnan) R 2207 2209 1676 0 -1 4202560 105966 0 0 0 119473 48 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4357576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2209/tid=2219] ppid=2207 vsize=2015700 CPUtime=1201.9 cores=0,2,4,6
/proc/2209/task/2219/stat : 2219 (SArTagnan) R 2207 2209 1676 0 -1 4202560 105437 0 0 0 120161 29 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=2209/tid=2220] ppid=2207 vsize=2015700 CPUtime=1201.89 cores=0,2,4,6
/proc/2209/task/2220/stat : 2220 (SArTagnan) R 2207 2209 1676 0 -1 4202560 6505028 0 0 0 119096 1093 0 0 25 0 4 0 502128325 2064076800 389931 33554432000 4194304 4623224 140736031311264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 2015700

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.99
CPU time (s): 4800.25
CPU user time (s): 4787.28
CPU system time (s): 12.976
CPU usage (%): 399.36
Max. virtual memory (cumulated for all children) (KiB): 2110096

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4787.28
system time used= 12.976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7414268
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9193
involuntary context switches= 22803

runsolver used 2.07069 second user time and 4.48932 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 19:12:04
IDJOB=3290187
IDBENCH=83421
IDSOLVER=1656
FILE ID=node147/3290187-1304097124
RUNJOBID= node147-1304097124-2194
PBS_JOBID= 13170578
Free space on /tmp= 72660 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_3_keyfind_1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3290187-1304097124/watcher-3290187-1304097124 -o /tmp/evaluation-result-3290187-1304097124/solver-3290187-1304097124 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3290187-1304097124.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4738c3d0ccd52030cff8addcec6bcde9
RANDOM SEED=1350379473

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30923652 kB
Buffers:        277180 kB
Cached:        1365824 kB
SwapCached:       3000 kB
Active:         134808 kB
Inactive:      1568992 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30923652 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:             864 kB
Writeback:           0 kB
AnonPages:       58792 kB
Mapped:          14400 kB
Slab:           260536 kB
PageTables:       4352 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185484 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72656 MiB
End job on node147 at 2011-04-29 19:32:08