Trace number 3385854

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.5 1204.21

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf
MD5SUM76c30bc0971bc865c2b988ddaca89385
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark5.29319
Satisfiable
(Un)Satisfiability was proved
Number of variables3651
Number of clauses926696
Sum of the clauses size1856923
Maximum clause length62
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2926636
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 560

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385854-1305583688/watcher-3385854-1305583688 -o /tmp/evaluation-result-3385854-1305583688/solver-3385854-1305583688 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385854-1305583688.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.89 7.90 7.93 7/384 5597
/proc/meminfo: memFree=22079704/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=40988 CPUtime=0 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 682 0 0 0 0 0 0 0 21 0 1 0 669967575 41971712 538 33554432000 4194304 4625164 140733636346880 18446744073709551615 235594866432 0 0 4096 2 0 0 0 17 3 0 0 0
/proc/5597/statm: 10247 538 296 106 0 5750 0

[startup+0.0736981 s]
/proc/loadavg: 6.89 7.90 7.93 7/384 5597
/proc/meminfo: memFree=22079704/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=45776 CPUtime=0.06 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 3964 0 0 0 6 0 0 0 21 0 1 0 669967575 46874624 1425 33554432000 4194304 4625164 140733636346880 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 3 0 0 0
/proc/5597/statm: 11444 1426 296 106 0 6947 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 45776

[startup+0.100693 s]
/proc/loadavg: 6.89 7.90 7.93 7/384 5597
/proc/meminfo: memFree=22079704/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=48324 CPUtime=0.09 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 5647 0 0 0 9 0 0 0 21 0 1 0 669967575 49483776 1836 33554432000 4194304 4625164 140733636346880 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 3 0 0 0
/proc/5597/statm: 12081 1836 296 106 0 7584 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 48324

[startup+0.300659 s]
/proc/loadavg: 6.89 7.90 7.93 7/384 5597
/proc/meminfo: memFree=22079704/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=272956 CPUtime=0.47 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 23448 0 0 0 45 2 0 0 23 0 4 0 669967575 279506944 14794 33554432000 4194304 4625164 140733636346880 18446744073709551615 4360194 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 68239 14794 333 106 0 63742 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 272956

[startup+0.700591 s]
/proc/loadavg: 6.89 7.90 7.93 7/384 5597
/proc/meminfo: memFree=22079704/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=387380 CPUtime=2.06 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 56231 0 0 0 200 6 0 0 25 0 4 0 669967575 396677120 31119 33554432000 4194304 4625164 140733636346880 18446744073709551615 4337665 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 96845 31119 358 106 0 92348 0
Current children cumulated CPU time (s) 2.06
Current children cumulated vsize (KiB) 387380

[startup+1.50045 s]
/proc/loadavg: 6.89 7.90 7.93 9/388 5601
/proc/meminfo: memFree=21925676/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=392200 CPUtime=5.25 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 62359 0 0 0 517 8 0 0 25 0 4 0 669967575 401612800 37053 33554432000 4194304 4625164 140733636346880 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 98050 37053 363 106 0 93553 0
[pid=5597/tid=5599] ppid=5595 vsize=392200 CPUtime=1.23 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 3118 0 0 0 123 0 0 0 25 0 4 0 669967599 401612800 37053 33554432000 4194304 4625164 140733636346880 18446744073709551615 4467820 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=392200 CPUtime=1.25 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 7407 0 0 0 124 1 0 0 25 0 4 0 669967599 401612800 37053 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=392200 CPUtime=1.25 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 1139 0 0 0 125 0 0 0 25 0 4 0 669967599 401612800 37053 33554432000 4194304 4625164 140733636346880 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.25
Current children cumulated vsize (KiB) 392200

[startup+3.10117 s]
/proc/loadavg: 6.89 7.90 7.93 9/388 5601
/proc/meminfo: memFree=21875952/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=414480 CPUtime=11.64 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 72908 0 0 0 1154 10 0 0 25 0 4 0 669967575 424427520 46391 33554432000 4194304 4625164 140733636346880 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 103620 46391 377 106 0 99123 0
[pid=5597/tid=5599] ppid=5595 vsize=414480 CPUtime=2.82 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 5582 0 0 0 281 1 0 0 25 0 4 0 669967599 424427520 46391 33554432000 4194304 4625164 140733636346880 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=414480 CPUtime=2.85 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 13017 0 0 0 283 2 0 0 25 0 4 0 669967599 424427520 46391 33554432000 4194304 4625164 140733636346880 18446744073709551615 235594527429 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=414480 CPUtime=2.85 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 2937 0 0 0 285 0 0 0 25 0 4 0 669967599 424427520 46391 33554432000 4194304 4625164 140733636346880 18446744073709551615 4334268 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.64
Current children cumulated vsize (KiB) 414480

[startup+6.30061 s]
/proc/loadavg: 6.97 7.90 7.93 9/388 5601
/proc/meminfo: memFree=21758208/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=448752 CPUtime=24.4 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 94528 0 0 0 2426 14 0 0 25 0 4 0 669967575 459522048 64659 33554432000 4194304 4625164 140733636346880 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 112188 64659 364 106 0 107691 0
[pid=5597/tid=5599] ppid=5595 vsize=448752 CPUtime=5.98 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 11683 0 0 0 595 3 0 0 25 0 4 0 669967599 459522048 64659 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=448752 CPUtime=6.05 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 21677 0 0 0 602 3 0 0 25 0 4 0 669967599 459522048 64659 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=448752 CPUtime=6.05 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 8196 0 0 0 604 1 0 0 25 0 4 0 669967599 459522048 64659 33554432000 4194304 4625164 140733636346880 18446744073709551615 4291804 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.4
Current children cumulated vsize (KiB) 448752

[startup+12.7005 s]
/proc/loadavg: 7.06 7.90 7.93 9/388 5601
/proc/meminfo: memFree=21585380/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=619328 CPUtime=49.9 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 168935 0 0 0 4960 30 0 0 25 0 4 0 669967575 634191872 93877 33554432000 4194304 4625164 140733636346880 18446744073709551615 4511953 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 154832 93877 373 106 0 150335 0
[pid=5597/tid=5599] ppid=5595 vsize=619328 CPUtime=12.29 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 22135 0 0 0 1222 7 0 0 25 0 4 0 669967599 634191872 93877 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=619328 CPUtime=12.45 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 28219 0 0 0 1241 4 0 0 25 0 4 0 669967599 634191872 93877 33554432000 4194304 4625164 140733636346880 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=619328 CPUtime=12.45 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 32219 0 0 0 1239 6 0 0 25 0 4 0 669967599 634191872 93877 33554432000 4194304 4625164 140733636346880 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.9
Current children cumulated vsize (KiB) 619328

[startup+25.5002 s]
/proc/loadavg: 7.27 7.91 7.93 9/388 5601
/proc/meminfo: memFree=21282284/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=872524 CPUtime=100.92 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 297294 0 0 0 10037 55 0 0 25 0 4 0 669967575 893464576 149164 33554432000 4194304 4625164 140733636346880 18446744073709551615 4392942 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 218131 149164 628 106 0 213634 0
[pid=5597/tid=5599] ppid=5595 vsize=872524 CPUtime=24.91 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 35216 0 0 0 2480 11 0 0 25 0 4 0 669967599 893464576 149164 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=872524 CPUtime=25.25 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 45090 0 0 0 2515 10 0 0 25 0 4 0 669967599 893464576 149164 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=872524 CPUtime=25.25 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 47746 0 0 0 2517 8 0 0 25 0 4 0 669967599 893464576 149164 33554432000 4194304 4625164 140733636346880 18446744073709551615 4288734 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.92
Current children cumulated vsize (KiB) 872524

[startup+51.1007 s]
/proc/loadavg: 7.64 7.94 7.94 9/388 5602
/proc/meminfo: memFree=20748276/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=1380136 CPUtime=202.98 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 529747 0 0 0 20198 100 0 0 25 0 4 0 669967575 1413259264 250733 33554432000 4194304 4625164 140733636346880 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 345034 250733 1052 106 0 340537 0
[pid=5597/tid=5599] ppid=5595 vsize=1380136 CPUtime=50.18 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 58930 0 0 0 4995 23 0 0 25 0 4 0 669967599 1413259264 250733 33554432000 4194304 4625164 140733636346880 18446744073709551615 4469385 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=1380136 CPUtime=50.83 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 80411 0 0 0 5062 21 0 0 25 0 4 0 669967599 1413259264 250733 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=1380136 CPUtime=50.85 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 48046 0 0 0 5076 9 0 0 25 0 4 0 669967599 1413259264 250733 33554432000 4194304 4625164 140733636346880 18446744073709551615 4552452 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.98
Current children cumulated vsize (KiB) 1380136

[startup+102.315 s]
/proc/loadavg: 7.91 7.97 7.95 9/388 5603
/proc/meminfo: memFree=20285360/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=1666788 CPUtime=407.16 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 707358 0 0 0 40588 128 0 0 25 0 4 0 669967575 1706790912 305181 33554432000 4194304 4625164 140733636346880 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 416697 305181 343 106 0 412200 0
[pid=5597/tid=5599] ppid=5595 vsize=1666788 CPUtime=100.73 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 63062 0 0 0 10047 26 0 0 25 0 4 0 669967599 1706790912 305181 33554432000 4194304 4625164 140733636346880 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=1666788 CPUtime=102.04 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 84913 0 0 0 10181 23 0 0 25 0 4 0 669967599 1706790912 305181 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=1666788 CPUtime=102.06 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 57288 0 0 0 10195 11 0 0 25 0 4 0 669967599 1706790912 305181 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.16
Current children cumulated vsize (KiB) 1666788

[startup+162.301 s]
/proc/loadavg: 8.08 8.00 7.96 9/388 5605
/proc/meminfo: memFree=19896092/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=1737132 CPUtime=646.36 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 771395 0 0 0 64494 142 0 0 25 0 4 0 669967575 1778823168 334427 33554432000 4194304 4625164 140733636346880 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 434283 334427 343 106 0 429786 0
[pid=5597/tid=5599] ppid=5595 vsize=1737132 CPUtime=159.96 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 71733 0 0 0 15969 27 0 0 25 0 4 0 669967599 1778823168 334427 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=1737132 CPUtime=162.03 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 87623 0 0 0 16179 24 0 0 25 0 4 0 669967599 1778823168 334427 33554432000 4194304 4625164 140733636346880 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=1737132 CPUtime=162.05 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 67739 0 0 0 16191 14 0 0 25 0 4 0 669967599 1778823168 334427 33554432000 4194304 4625164 140733636346880 18446744073709551615 4328141 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 646.36
Current children cumulated vsize (KiB) 1737132

[startup+222.301 s]
/proc/loadavg: 8.10 8.02 7.96 9/388 5606
/proc/meminfo: memFree=19593512/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=1789088 CPUtime=885.59 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 820105 0 0 0 88406 153 0 0 25 0 4 0 669967575 1832026112 356834 33554432000 4194304 4625164 140733636346880 18446744073709551615 4512039 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 447272 356834 352 106 0 442775 0
[pid=5597/tid=5599] ppid=5595 vsize=1789088 CPUtime=219.19 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 72143 0 0 0 21892 27 0 0 25 0 4 0 669967599 1832026112 356834 33554432000 4194304 4625164 140733636346880 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=1789088 CPUtime=222.03 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 88119 0 0 0 22179 24 0 0 25 0 4 0 669967599 1832026112 356834 33554432000 4194304 4625164 140733636346880 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=1789088 CPUtime=222.04 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 79253 0 0 0 22188 16 0 0 25 0 4 0 669967599 1832026112 356834 33554432000 4194304 4625164 140733636346880 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 885.59
Current children cumulated vsize (KiB) 1789088

[startup+282.301 s]

################
# More data... #
################

[pid=5597] ppid=5595 vsize=2402104 CPUtime=2799.49 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 1833767 0 0 0 279614 335 0 0 25 0 4 0 669967575 2459754496 494880 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 600526 494880 347 106 0 596029 0
[pid=5597/tid=5599] ppid=5595 vsize=2402104 CPUtime=693.1 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 77616 0 0 0 69280 30 0 0 25 0 4 0 669967599 2459754496 494880 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=2402104 CPUtime=702.03 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 102176 0 0 0 70176 27 0 0 25 0 4 0 669967599 2459754496 494880 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=2402104 CPUtime=702.04 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 786996 0 0 0 70057 147 0 0 25 0 4 0 669967599 2459754496 494880 33554432000 4194304 4625164 140733636346880 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2799.49
Current children cumulated vsize (KiB) 2402104

[startup+762.315 s]
/proc/loadavg: 8.08 8.08 8.01 9/388 5621
/proc/meminfo: memFree=18331016/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=2446384 CPUtime=3038.78 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 1857465 0 0 0 303537 341 0 0 25 0 4 0 669967575 2505097216 505094 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338092 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 611596 505094 346 106 0 607099 0
[pid=5597/tid=5599] ppid=5595 vsize=2446384 CPUtime=752.35 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 77837 0 0 0 75205 30 0 0 25 0 4 0 669967599 2505097216 505094 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=2446384 CPUtime=762.04 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 102317 0 0 0 76177 27 0 0 25 0 4 0 669967599 2505097216 505094 33554432000 4194304 4625164 140733636346880 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=2446384 CPUtime=762.05 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 805358 0 0 0 76054 151 0 0 25 0 4 0 669967599 2505097216 505094 33554432000 4194304 4625164 140733636346880 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3038.78
Current children cumulated vsize (KiB) 2446384

[startup+822.3 s]
/proc/loadavg: 8.10 8.10 8.01 9/388 5622
/proc/meminfo: memFree=18262280/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=2470852 CPUtime=3277.97 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 1870300 0 0 0 327453 344 0 0 25 0 4 0 669967575 2530152448 516562 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 617713 516562 343 106 0 613216 0
[pid=5597/tid=5599] ppid=5595 vsize=2470852 CPUtime=811.58 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 78060 0 0 0 81128 30 0 0 25 0 4 0 669967599 2530152448 516562 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=2470852 CPUtime=822.03 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 102903 0 0 0 82176 27 0 0 25 0 4 0 669967599 2530152448 516562 33554432000 4194304 4625164 140733636346880 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=2470852 CPUtime=822.04 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 810712 0 0 0 82051 153 0 0 25 0 4 0 669967599 2530152448 516562 33554432000 4194304 4625164 140733636346880 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3277.97
Current children cumulated vsize (KiB) 2470852

[startup+882.301 s]
/proc/loadavg: 8.18 8.12 8.02 9/388 5624
/proc/meminfo: memFree=18192688/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=2488348 CPUtime=3517.21 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 1881671 0 0 0 351375 346 0 0 25 0 4 0 669967575 2548068352 526663 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 622087 526663 343 106 0 617590 0
[pid=5597/tid=5599] ppid=5595 vsize=2488348 CPUtime=870.81 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 78335 0 0 0 87051 30 0 0 25 0 4 0 669967599 2548068352 526663 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=2488348 CPUtime=882.03 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 103115 0 0 0 88176 27 0 0 25 0 4 0 669967599 2548068352 526663 33554432000 4194304 4625164 140733636346880 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=2488348 CPUtime=882.03 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 815726 0 0 0 88049 154 0 0 25 0 4 0 669967599 2548068352 526663 33554432000 4194304 4625164 140733636346880 18446744073709551615 4288789 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3517.21
Current children cumulated vsize (KiB) 2488348

[startup+942.301 s]
/proc/loadavg: 8.25 8.14 8.03 9/388 5626
/proc/meminfo: memFree=18000824/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=2987624 CPUtime=3756.46 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 2163437 0 0 0 375260 386 0 0 25 0 4 0 669967575 3059326976 566855 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 746906 566855 343 106 0 742409 0
[pid=5597/tid=5599] ppid=5595 vsize=2987624 CPUtime=930.06 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 78529 0 0 0 92976 30 0 0 25 0 4 0 669967599 3059326976 566855 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=2987624 CPUtime=942.03 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 103338 0 0 0 94176 27 0 0 25 0 4 0 669967599 3059326976 566855 33554432000 4194304 4625164 140733636346880 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=2987624 CPUtime=942.04 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 820572 0 0 0 94047 157 0 0 25 0 4 0 669967599 3059326976 566855 33554432000 4194304 4625164 140733636346880 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3756.46
Current children cumulated vsize (KiB) 2987624

[startup+1002.3 s]
/proc/loadavg: 8.23 8.15 8.04 9/388 5627
/proc/meminfo: memFree=17941896/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=3004048 CPUtime=3995.69 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 2172047 0 0 0 399180 389 0 0 25 0 4 0 669967575 3076145152 575403 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 751012 575403 343 106 0 746515 0
[pid=5597/tid=5599] ppid=5595 vsize=3004048 CPUtime=989.29 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 78691 0 0 0 98899 30 0 0 25 0 4 0 669967599 3076145152 575403 33554432000 4194304 4625164 140733636346880 18446744073709551615 4330832 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=3004048 CPUtime=1002.04 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 103533 0 0 0 100176 28 0 0 25 0 4 0 669967599 3076145152 575403 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=3004048 CPUtime=1002.04 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 825305 0 0 0 100045 159 0 0 25 0 4 0 669967599 3076145152 575403 33554432000 4194304 4625164 140733636346880 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3995.69
Current children cumulated vsize (KiB) 3004048

[startup+1062.3 s]
/proc/loadavg: 8.21 8.15 8.04 9/388 5629
/proc/meminfo: memFree=17875516/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=3022676 CPUtime=4234.93 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 2181268 0 0 0 423102 391 0 0 25 0 4 0 669967575 3095220224 584468 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 755669 584468 343 106 0 751172 0
[pid=5597/tid=5599] ppid=5595 vsize=3022676 CPUtime=1048.53 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 78915 0 0 0 104823 30 0 0 25 0 4 0 669967599 3095220224 584468 33554432000 4194304 4625164 140733636346880 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=3022676 CPUtime=1062.04 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 103706 0 0 0 106176 28 0 0 25 0 4 0 669967599 3095220224 584468 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=3022676 CPUtime=1062.03 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 830443 0 0 0 106043 160 0 0 25 0 4 0 669967599 3095220224 584468 33554432000 4194304 4625164 140733636346880 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4234.93
Current children cumulated vsize (KiB) 3022676

[startup+1122.3 s]
/proc/loadavg: 8.20 8.15 8.05 9/388 5630
/proc/meminfo: memFree=17820928/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=3038512 CPUtime=4474.16 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 2189382 0 0 0 447023 393 0 0 25 0 4 0 669967575 3111436288 592357 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 759628 592357 343 106 0 755131 0
[pid=5597/tid=5599] ppid=5595 vsize=3038512 CPUtime=1107.76 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 79137 0 0 0 110746 30 0 0 25 0 4 0 669967599 3111436288 592357 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=3038512 CPUtime=1122.04 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 103883 0 0 0 112176 28 0 0 25 0 4 0 669967599 3111436288 592357 33554432000 4194304 4625164 140733636346880 18446744073709551615 4488064 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=3038512 CPUtime=1122.03 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 834775 0 0 0 112042 161 0 0 25 0 4 0 669967599 3111436288 592357 33554432000 4194304 4625164 140733636346880 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4474.16
Current children cumulated vsize (KiB) 3038512

[startup+1182.3 s]
/proc/loadavg: 8.12 8.14 8.05 9/388 5632
/proc/meminfo: memFree=17751076/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=3077564 CPUtime=4713.42 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 2210062 0 0 0 470945 397 0 0 25 0 4 0 669967575 3151425536 601416 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 769391 601416 343 106 0 764894 0
[pid=5597/tid=5599] ppid=5595 vsize=3077564 CPUtime=1167.01 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 91505 0 0 0 116669 32 0 0 25 0 4 0 669967599 3151425536 601416 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=3077564 CPUtime=1182.04 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 103982 0 0 0 118176 28 0 0 25 0 4 0 669967599 3151425536 601416 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=3077564 CPUtime=1182.03 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 839643 0 0 0 118041 162 0 0 25 0 4 0 669967599 3151425536 601416 33554432000 4194304 4625164 140733636346880 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4713.42
Current children cumulated vsize (KiB) 3077564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.1 s]
/proc/loadavg: 8.08 8.12 8.04 5/383 5634
/proc/meminfo: memFree=19678308/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=3083276 CPUtime=4800.36 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 2213143 0 0 0 479639 397 0 0 25 0 4 0 669967575 3157274624 604343 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 770819 604343 343 106 0 766322 0
[pid=5597/tid=5599] ppid=5595 vsize=3083276 CPUtime=1188.53 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 91541 0 0 0 118821 32 0 0 25 0 4 0 669967599 3157274624 604344 33554432000 4194304 4625164 140733636346880 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=3083276 CPUtime=1203.85 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 104040 0 0 0 120357 28 0 0 25 0 4 0 669967599 3157274624 604344 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=3083276 CPUtime=1203.84 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 841175 0 0 0 120222 162 0 0 25 0 4 0 669967599 3157274624 604344 33554432000 4194304 4625164 140733636346880 18446744073709551615 4579367 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 3083276

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.1 s]
/proc/loadavg: 8.08 8.12 8.04 5/383 5634
/proc/meminfo: memFree=19678308/32950928 swapFree=45972156/67111528
[pid=5597] ppid=5595 vsize=3083276 CPUtime=4800.36 cores=1,3,5,7
/proc/5597/stat : 5597 (SArTagnan) R 5595 5597 4682 0 -1 4202496 2213143 0 0 0 479639 397 0 0 25 0 4 0 669967575 3157274624 604343 33554432000 4194304 4625164 140733636346880 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5597/statm: 770819 604343 343 106 0 766322 0
[pid=5597/tid=5599] ppid=5595 vsize=3083276 CPUtime=1188.53 cores=1,3,5,7
/proc/5597/task/5599/stat : 5599 (SArTagnan) R 5595 5597 4682 0 -1 4202560 91541 0 0 0 118821 32 0 0 25 0 4 0 669967599 3157274624 604344 33554432000 4194304 4625164 140733636346880 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5597/tid=5600] ppid=5595 vsize=3083276 CPUtime=1203.85 cores=1,3,5,7
/proc/5597/task/5600/stat : 5600 (SArTagnan) R 5595 5597 4682 0 -1 4202560 104040 0 0 0 120357 28 0 0 25 0 4 0 669967599 3157274624 604344 33554432000 4194304 4625164 140733636346880 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5597/tid=5601] ppid=5595 vsize=3083276 CPUtime=1203.84 cores=1,3,5,7
/proc/5597/task/5601/stat : 5601 (SArTagnan) R 5595 5597 4682 0 -1 4202560 841175 0 0 0 120222 162 0 0 25 0 4 0 669967599 3157274624 604344 33554432000 4194304 4625164 140733636346880 18446744073709551615 4579367 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 3083276

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.21
CPU time (s): 4800.5
CPU user time (s): 4796.44
CPU system time (s): 4.06538
CPU usage (%): 398.643
Max. virtual memory (cumulated for all children) (KiB): 3946724

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.44
system time used= 4.06538
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2213144
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2484
involuntary context switches= 31944

runsolver used 3.90241 second user time and 11.4393 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-17 00:08:08
IDJOB=3385854
IDBENCH=88219
IDSOLVER=1871
FILE ID=node120/3385854-1305583688
RUNJOBID= node120-1305583688-5575
PBS_JOBID= 13350219
Free space on /tmp= 73484 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385854-1305583688/watcher-3385854-1305583688 -o /tmp/evaluation-result-3385854-1305583688/solver-3385854-1305583688 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385854-1305583688.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 76c30bc0971bc865c2b988ddaca89385
RANDOM SEED=9348677

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      22079860 kB
Buffers:         84532 kB
Cached:         578032 kB
SwapCached:      63496 kB
Active:         442796 kB
Inactive:     10201788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      22079860 kB
SwapTotal:    67111528 kB
SwapFree:     45972156 kB
Dirty:           14908 kB
Writeback:           0 kB
AnonPages:     9923880 kB
Mapped:          15820 kB
Slab:            78072 kB
PageTables:      82084 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 78792700 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73488 MiB
End job on node120 at 2011-05-17 00:28:14