Trace number 3386015

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 2452.57 1300.09

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m27-q255-n25-p15-s2076598.cnf
MD5SUMf5a22d1154b549fd98215f1710a15f46
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.357944
Satisfiable
(Un)Satisfiability was proved
Number of variables545
Number of clauses29734
Sum of the clauses size59963
Maximum clause length27
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 229709
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386015-1305583699/watcher-3386015-1305583699 -o /tmp/evaluation-result-3386015-1305583699/solver-3386015-1305583699 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386015-1305583699.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 15.31 15.14 13.83 13/350 19258
/proc/meminfo: memFree=9595200/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=19188 CPUtime=0 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 452 0 0 0 0 0 0 0 20 0 1 0 669969688 19648512 390 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278879488 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/19258/statm: 4797 390 295 106 0 300 0

[startup+0.14126 s]
/proc/loadavg: 15.31 15.14 13.83 13/350 19258
/proc/meminfo: memFree=9595200/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=52056 CPUtime=0.09 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 1070 0 0 0 9 0 0 0 20 0 4 0 669969688 53305344 823 33554432000 4194304 4625164 140736766638816 18446744073709551615 47950692378544 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 13014 823 318 106 0 8517 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 52056

[startup+0.200249 s]
/proc/loadavg: 15.31 15.14 13.83 13/350 19258
/proc/meminfo: memFree=9595200/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=52188 CPUtime=0.09 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 1085 0 0 0 9 0 0 0 20 0 4 0 669969688 53440512 838 33554432000 4194304 4625164 140736766638816 18446744073709551615 47950692378544 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 13047 838 318 106 0 8550 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 52188

[startup+0.300234 s]
/proc/loadavg: 15.31 15.14 13.83 13/350 19258
/proc/meminfo: memFree=9595200/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=251152 CPUtime=0.27 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 2915 0 0 0 27 0 0 0 21 0 4 0 669969688 257179648 2143 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511795 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 62788 2143 346 106 0 58291 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 251152

[startup+0.700164 s]
/proc/loadavg: 15.31 15.14 13.83 13/350 19258
/proc/meminfo: memFree=9595200/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=254160 CPUtime=1.04 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 4955 0 0 0 103 1 0 0 21 0 4 0 669969688 260259840 3808 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511986 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 63540 3808 348 106 0 59043 0
Current children cumulated CPU time (s) 1.04
Current children cumulated vsize (KiB) 254160

[startup+1.50102 s]
/proc/loadavg: 15.31 15.14 13.83 16/354 19262
/proc/meminfo: memFree=9574592/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=260168 CPUtime=2.53 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 7919 0 0 0 252 1 0 0 22 0 4 0 669969688 266412032 6206 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511986 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 65042 6206 361 106 0 60545 0
[pid=19258/tid=19260] ppid=19256 vsize=260168 CPUtime=0.69 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 1470 0 0 0 69 0 0 0 24 0 4 0 669969694 266412032 6206 33554432000 4194304 4625164 140736766638816 18446744073709551615 4204720 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=260168 CPUtime=0.66 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 1536 0 0 0 66 0 0 0 24 0 4 0 669969694 266412032 6206 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=260168 CPUtime=0.64 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 1029 0 0 0 64 0 0 0 24 0 4 0 669969694 266412032 6206 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.53
Current children cumulated vsize (KiB) 260168

[startup+3.10074 s]
/proc/loadavg: 15.31 15.14 13.83 16/354 19262
/proc/meminfo: memFree=9561852/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=263556 CPUtime=5.37 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 13916 0 0 0 535 2 0 0 24 0 4 0 669969688 269881344 8220 33554432000 4194304 4625164 140736766638816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 65889 8220 346 106 0 61392 0
[pid=19258/tid=19260] ppid=19256 vsize=263556 CPUtime=1.28 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 2490 0 0 0 128 0 0 0 25 0 4 0 669969694 269881344 8220 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278984686 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=263556 CPUtime=1.41 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 2547 0 0 0 141 0 0 0 25 0 4 0 669969694 269881344 8220 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=263556 CPUtime=1.33 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 4629 0 0 0 133 0 0 0 25 0 4 0 669969694 269881344 8220 33554432000 4194304 4625164 140736766638816 18446744073709551615 4328158 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.37
Current children cumulated vsize (KiB) 263556

[startup+6.30017 s]
/proc/loadavg: 15.29 15.14 13.84 14/354 19262
/proc/meminfo: memFree=9546988/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=270448 CPUtime=6.72 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) D 19256 19258 19071 0 -1 4202496 15128 0 0 0 670 2 0 0 17 0 4 0 669969688 276938752 9430 33554432000 4194304 4625164 140736766638816 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 67612 9430 357 106 0 63115 0
[pid=19258/tid=19260] ppid=19256 vsize=270448 CPUtime=1.32 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) D 19256 19258 19071 0 -1 4202560 2545 0 0 0 132 0 0 0 18 0 4 0 669969694 276938752 9430 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278922842 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=270448 CPUtime=1.45 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 3134 0 0 0 145 0 0 0 25 0 4 0 669969694 276938752 9430 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278577109 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=270448 CPUtime=1.66 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) D 19256 19258 19071 0 -1 4202560 5144 0 0 0 166 0 0 0 18 0 4 0 669969694 276938752 9430 33554432000 4194304 4625164 140736766638816 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.72
Current children cumulated vsize (KiB) 270448

[startup+12.701 s]
/proc/loadavg: 15.26 15.14 13.84 16/354 19262
/proc/meminfo: memFree=9532948/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=271808 CPUtime=7.8 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 16180 0 0 0 777 3 0 0 18 0 4 0 669969688 278331392 9789 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278540833 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 67952 9789 363 106 0 63455 0
[pid=19258/tid=19260] ppid=19256 vsize=271808 CPUtime=1.39 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 3339 0 0 0 139 0 0 0 18 0 4 0 669969694 278331392 9789 33554432000 4194304 4625164 140736766638816 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=271808 CPUtime=1.45 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 3199 0 0 0 145 0 0 0 25 0 4 0 669969694 278331392 9789 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278577109 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=271808 CPUtime=2.21 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 5243 0 0 0 220 1 0 0 18 0 4 0 669969694 278331392 9789 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278576840 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 7.8
Current children cumulated vsize (KiB) 271808
heavy processes:

[startup+25.5008 s]
/proc/loadavg: 15.20 15.13 13.86 14/354 19262
/proc/meminfo: memFree=9487444/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=280520 CPUtime=15.02 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 34482 0 0 0 1497 5 0 0 18 0 4 0 669969688 287252480 13564 33554432000 4194304 4625164 140736766638816 18446744073709551615 4356539 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 70130 13564 346 106 0 65633 0
[pid=19258/tid=19260] ppid=19256 vsize=280520 CPUtime=3.27 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) D 19256 19258 19071 0 -1 4202560 6233 0 0 0 326 1 0 0 18 0 4 0 669969694 287252480 13564 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278922935 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=280520 CPUtime=2.35 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 4019 0 0 0 235 0 0 0 25 0 4 0 669969694 287252480 13564 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278577109 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=280520 CPUtime=4.16 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 18076 0 0 0 414 2 0 0 18 0 4 0 669969694 287252480 13564 33554432000 4194304 4625164 140736766638816 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 15.02
Current children cumulated vsize (KiB) 280520
heavy processes:

[startup+51.1012 s]
/proc/loadavg: 15.21 15.13 13.89 15/354 19263
/proc/meminfo: memFree=9429632/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=283496 CPUtime=22.99 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 48591 0 0 0 2292 7 0 0 18 0 4 0 669969688 290299904 16445 33554432000 4194304 4625164 140736766638816 18446744073709551615 4513479 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 70874 16445 346 106 0 66377 0
[pid=19258/tid=19260] ppid=19256 vsize=283496 CPUtime=4.54 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 8453 0 0 0 453 1 0 0 18 0 4 0 669969694 290299904 16445 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=283496 CPUtime=2.57 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 5137 0 0 0 257 0 0 0 25 0 4 0 669969694 290299904 16445 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278984686 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=283496 CPUtime=6.06 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 26347 0 0 0 603 3 0 0 17 0 4 0 669969694 290299904 16445 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 22.99
Current children cumulated vsize (KiB) 283496
heavy processes:

[startup+102.301 s]
/proc/loadavg: 15.21 15.14 13.96 16/354 19264
/proc/meminfo: memFree=9172668/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=381268 CPUtime=119.32 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 247924 0 0 0 11888 44 0 0 25 0 4 0 669969688 390418432 53860 33554432000 4194304 4625164 140736766638816 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/19258/statm: 95317 53860 399 106 0 90820 0
[pid=19258/tid=19260] ppid=19256 vsize=381268 CPUtime=29.83 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 30461 0 0 0 2975 8 0 0 25 0 4 0 669969694 390418432 53860 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=381268 CPUtime=27.21 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 20515 0 0 0 2716 5 0 0 25 0 4 0 669969694 390418432 53860 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=381268 CPUtime=27.69 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 161926 0 0 0 2744 25 0 0 25 0 4 0 669969694 390418432 53860 33554432000 4194304 4625164 140736766638816 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 119.32
Current children cumulated vsize (KiB) 381268

[startup+162.3 s]
/proc/loadavg: 15.22 15.15 14.03 16/354 19266
/proc/meminfo: memFree=8861368/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=530100 CPUtime=237.08 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 602097 0 0 0 23609 99 0 0 25 0 4 0 669969688 542822400 89287 33554432000 4194304 4625164 140736766638816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 132525 89287 495 106 0 128028 0
[pid=19258/tid=19260] ppid=19256 vsize=530100 CPUtime=61.1 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 45506 0 0 0 6099 11 0 0 25 0 4 0 669969694 542822400 89287 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=530100 CPUtime=56.01 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 42078 0 0 0 5590 11 0 0 25 0 4 0 669969694 542822400 89287 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=530100 CPUtime=56.23 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 455590 0 0 0 5556 67 0 0 25 0 4 0 669969694 542822400 89287 33554432000 4194304 4625164 140736766638816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 237.08
Current children cumulated vsize (KiB) 530100

[startup+222.314 s]
/proc/loadavg: 15.13 15.13 14.10 16/354 19267
/proc/meminfo: memFree=8619008/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=700440 CPUtime=367.41 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 938537 0 0 0 36593 148 0 0 25 0 4 0 669969688 717250560 112655 33554432000 4194304 4625164 140736766638816 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 175110 112655 498 106 0 170613 0
[pid=19258/tid=19260] ppid=19256 vsize=700440 CPUtime=91.24 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 49727 0 0 0 9110 14 0 0 25 0 4 0 669969694 717250560 112655 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=700440 CPUtime=86 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 45354 0 0 0 8589 11 0 0 25 0 4 0 669969694 717250560 112655 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352145 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=700440 CPUtime=96.69 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 750799 0 0 0 9561 108 0 0 25 0 4 0 669969694 717250560 112655 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 367.41

################
# More data... #
################

[pid=19258] ppid=19256 vsize=1986988 CPUtime=1465.54 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 2438944 0 0 0 146180 374 0 0 25 0 4 0 669969688 2034675712 386895 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 496747 386895 346 106 0 492250 0
[pid=19258/tid=19260] ppid=19256 vsize=1986988 CPUtime=360.78 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 144109 0 0 0 36037 41 0 0 25 0 4 0 669969694 2034675712 386895 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351769 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=1986988 CPUtime=348.68 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 104711 0 0 0 34837 31 0 0 25 0 4 0 669969694 2034675712 386895 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=1986988 CPUtime=390.84 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 1509300 0 0 0 38874 210 0 0 25 0 4 0 669969694 2034675712 386895 33554432000 4194304 4625164 140736766638816 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1465.54
Current children cumulated vsize (KiB) 1986988

[startup+822.301 s]
/proc/loadavg: 15.16 15.17 14.59 16/354 19283
/proc/meminfo: memFree=6597380/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2040688 CPUtime=1580.28 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 2773476 0 0 0 157606 422 0 0 25 0 4 0 669969688 2089664512 400267 33554432000 4194304 4625164 140736766638816 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/19258/statm: 510172 400267 346 106 0 505675 0
[pid=19258/tid=19260] ppid=19256 vsize=2040688 CPUtime=389.44 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 145660 0 0 0 38901 43 0 0 25 0 4 0 669969694 2089664512 400267 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2040688 CPUtime=377.91 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 107696 0 0 0 37759 32 0 0 25 0 4 0 669969694 2089664512 400267 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2040688 CPUtime=417.64 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 1800423 0 0 0 41514 250 0 0 25 0 4 0 669969694 2089664512 400267 33554432000 4194304 4625164 140736766638816 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1580.28
Current children cumulated vsize (KiB) 2040688

[startup+882.314 s]
/proc/loadavg: 15.23 15.18 14.63 13/354 19285
/proc/meminfo: memFree=6471832/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2110316 CPUtime=1690.32 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 3070177 0 0 0 168564 468 0 0 18 0 4 0 669969688 2160963584 408133 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19258/statm: 527579 408133 346 106 0 523082 0
[pid=19258/tid=19260] ppid=19256 vsize=2110316 CPUtime=416.48 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 147570 0 0 0 41602 46 0 0 18 0 4 0 669969694 2160963584 408133 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2110316 CPUtime=405.92 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 110362 0 0 0 40559 33 0 0 18 0 4 0 669969694 2160963584 408133 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2110316 CPUtime=443.25 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 2073743 0 0 0 44035 290 0 0 25 0 4 0 669969694 2160963584 408133 33554432000 4194304 4625164 140736766638816 18446744073709551615 237278577017 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1690.32
Current children cumulated vsize (KiB) 2110316

[startup+942.301 s]
/proc/loadavg: 15.12 15.16 14.66 16/354 19287
/proc/meminfo: memFree=6334296/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2178624 CPUtime=1732.04 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 3155525 0 0 0 172726 478 0 0 25 0 4 0 669969688 2230910976 420866 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 544656 420866 359 106 0 540159 0
[pid=19258/tid=19260] ppid=19256 vsize=2178624 CPUtime=429.27 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 148885 0 0 0 42881 46 0 0 25 0 4 0 669969694 2230910976 420866 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2178624 CPUtime=421.98 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 111507 0 0 0 42165 33 0 0 25 0 4 0 669969694 2230910976 420866 33554432000 4194304 4625164 140736766638816 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2178624 CPUtime=449.01 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 2146562 0 0 0 44602 299 0 0 25 0 4 0 669969694 2230910976 420866 33554432000 4194304 4625164 140736766638816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1732.04
Current children cumulated vsize (KiB) 2178624

[startup+1002.3 s]
/proc/loadavg: 15.04 15.13 14.67 16/354 19288
/proc/meminfo: memFree=6266836/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2243048 CPUtime=1852.04 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 3563143 0 0 0 184668 536 0 0 25 0 4 0 669969688 2296881152 433007 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 560762 433007 346 106 0 556265 0
[pid=19258/tid=19260] ppid=19256 vsize=2243048 CPUtime=459.26 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 150898 0 0 0 45879 47 0 0 25 0 4 0 669969694 2296881152 433007 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2243048 CPUtime=451.99 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 144310 0 0 0 45162 37 0 0 25 0 4 0 669969694 2296881152 433007 33554432000 4194304 4625164 140736766638816 18446744073709551615 4339536 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2243048 CPUtime=478.93 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 2511582 0 0 0 47543 350 0 0 25 0 4 0 669969694 2296881152 433007 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1852.04
Current children cumulated vsize (KiB) 2243048

[startup+1062.3 s]
/proc/loadavg: 13.69 14.79 14.59 12/345 19308
/proc/meminfo: memFree=8170920/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2343600 CPUtime=1977.04 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 3803920 0 0 0 197135 569 0 0 25 0 4 0 669969688 2399846400 447863 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 585900 447863 351 106 0 581403 0
[pid=19258/tid=19260] ppid=19256 vsize=2343600 CPUtime=489.36 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 152755 0 0 0 48888 48 0 0 25 0 4 0 669969694 2399846400 447863 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2343600 CPUtime=486.54 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 146014 0 0 0 48616 38 0 0 25 0 4 0 669969694 2399846400 447863 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2343600 CPUtime=508.93 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 2725435 0 0 0 50516 377 0 0 25 0 4 0 669969694 2399846400 447863 33554432000 4194304 4625164 140736766638816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1977.04
Current children cumulated vsize (KiB) 2343600

[startup+1122.3 s]
/proc/loadavg: 11.99 14.10 14.36 12/345 19309
/proc/meminfo: memFree=8085472/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2396620 CPUtime=2097.04 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 4099774 0 0 0 209096 608 0 0 25 0 4 0 669969688 2454138880 461196 33554432000 4194304 4625164 140736766638816 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 599155 461196 350 106 0 594658 0
[pid=19258/tid=19260] ppid=19256 vsize=2396620 CPUtime=519.35 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 160490 0 0 0 51886 49 0 0 25 0 4 0 669969694 2454138880 461196 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2396620 CPUtime=516.54 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 147024 0 0 0 51615 39 0 0 25 0 4 0 669969694 2454138880 461196 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2396620 CPUtime=538.94 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 2994844 0 0 0 53483 411 0 0 25 0 4 0 669969694 2454138880 461196 33554432000 4194304 4625164 140736766638816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2097.04
Current children cumulated vsize (KiB) 2396620

[startup+1182.3 s]
/proc/loadavg: 11.42 13.55 14.15 12/345 19311
/proc/meminfo: memFree=8023704/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2401848 CPUtime=2217.04 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 4468540 0 0 0 221049 655 0 0 25 0 4 0 669969688 2459492352 466051 33554432000 4194304 4625164 140736766638816 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 600462 466051 346 106 0 595965 0
[pid=19258/tid=19260] ppid=19256 vsize=2401848 CPUtime=549.28 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 162038 0 0 0 54878 50 0 0 25 0 4 0 669969694 2459492352 466051 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2401848 CPUtime=546.53 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 147436 0 0 0 54614 39 0 0 25 0 4 0 669969694 2459492352 466051 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2401848 CPUtime=569.01 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 3358530 0 0 0 56445 456 0 0 25 0 4 0 669969694 2459492352 466051 33554432000 4194304 4625164 140736766638816 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2217.04
Current children cumulated vsize (KiB) 2401848

[startup+1242.3 s]
/proc/loadavg: 11.21 13.10 13.96 12/345 19313
/proc/meminfo: memFree=7962684/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2403164 CPUtime=2337.05 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 4816312 0 0 0 233005 700 0 0 25 0 4 0 669969688 2460839936 472893 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 600791 472893 349 106 0 596294 0
[pid=19258/tid=19260] ppid=19256 vsize=2403164 CPUtime=579.28 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 163714 0 0 0 57877 51 0 0 25 0 4 0 669969694 2460839936 472893 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2403164 CPUtime=576.53 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 147650 0 0 0 57614 39 0 0 25 0 4 0 669969694 2460839936 472893 33554432000 4194304 4625164 140736766638816 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2403164 CPUtime=599.01 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 3701658 0 0 0 59401 500 0 0 25 0 4 0 669969694 2460839936 472893 33554432000 4194304 4625164 140736766638816 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2337.05
Current children cumulated vsize (KiB) 2403164



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 11.13 12.73 13.78 12/345 19314
/proc/meminfo: memFree=7901908/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2404212 CPUtime=2452.47 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 5131432 0 0 0 244506 741 0 0 25 0 4 0 669969688 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 601053 479417 356 106 0 596556 0
[pid=19258/tid=19260] ppid=19256 vsize=2404212 CPUtime=608.14 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 165637 0 0 0 60761 53 0 0 25 0 4 0 669969694 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2404212 CPUtime=605.42 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 148070 0 0 0 60503 39 0 0 25 0 4 0 669969694 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2404212 CPUtime=627.86 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 4011647 0 0 0 62248 538 0 0 25 0 4 0 669969694 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2452.47
Current children cumulated vsize (KiB) 2404212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 11.13 12.73 13.78 12/345 19314
/proc/meminfo: memFree=7901908/32950904 swapFree=67057400/67111528
[pid=19258] ppid=19256 vsize=2404212 CPUtime=2452.47 cores=1,3,5,7
/proc/19258/stat : 19258 (SArTagnan) R 19256 19258 19071 0 -1 4202496 5131432 0 0 0 244506 741 0 0 25 0 4 0 669969688 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19258/statm: 601053 479417 356 106 0 596556 0
[pid=19258/tid=19260] ppid=19256 vsize=2404212 CPUtime=608.14 cores=1,3,5,7
/proc/19258/task/19260/stat : 19260 (SArTagnan) R 19256 19258 19071 0 -1 4202560 165637 0 0 0 60761 53 0 0 25 0 4 0 669969694 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19258/tid=19261] ppid=19256 vsize=2404212 CPUtime=605.42 cores=1,3,5,7
/proc/19258/task/19261/stat : 19261 (SArTagnan) R 19256 19258 19071 0 -1 4202560 148070 0 0 0 60503 39 0 0 25 0 4 0 669969694 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19258/tid=19262] ppid=19256 vsize=2404212 CPUtime=627.86 cores=1,3,5,7
/proc/19258/task/19262/stat : 19262 (SArTagnan) R 19256 19258 19071 0 -1 4202560 4011647 0 0 0 62248 538 0 0 25 0 4 0 669969694 2461913088 479417 33554432000 4194304 4625164 140736766638816 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2452.47
Current children cumulated vsize (KiB) 2404212

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.09
CPU time (s): 2452.57
CPU user time (s): 2445.08
CPU system time (s): 7.48986
CPU usage (%): 188.646
Max. virtual memory (cumulated for all children) (KiB): 2404212

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2445.08
system time used= 7.48986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5131432
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13255
involuntary context switches= 38297

runsolver used 4.03539 second user time and 10.1954 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-17 00:08:19
IDJOB=3386015
IDBENCH=88220
IDSOLVER=1871
FILE ID=node121/3386015-1305583699
RUNJOBID= node121-1305582131-19090
PBS_JOBID= 13350299
Free space on /tmp= 73424 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m27-q255-n25-p15-s2076598.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386015-1305583699/watcher-3386015-1305583699 -o /tmp/evaluation-result-3386015-1305583699/solver-3386015-1305583699 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386015-1305583699.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f5a22d1154b549fd98215f1710a15f46
RANDOM SEED=1810874815

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:       9595356 kB
Buffers:        340568 kB
Cached:        7022652 kB
SwapCached:       7656 kB
Active:       17300620 kB
Inactive:      5673000 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:       9595356 kB
SwapTotal:    67111528 kB
SwapFree:     67057400 kB
Dirty:             788 kB
Writeback:           0 kB
AnonPages:    15608188 kB
Mapped:          29512 kB
Slab:           267244 kB
PageTables:      51236 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS: 67575524 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73424 MiB
End job on node121 at 2011-05-17 00:30:01