Trace number 3439271

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001.2 5010.36

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf
MD5SUMad30956261e72142648a01bc7c025dba
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables85
Number of clauses29282
Sum of the clauses size292650
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 534
Number of clauses of size over 529248

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439271-1306960628/watcher-3439271-1306960628 -o /tmp/evaluation-result-3439271-1306960628/solver-3439271-1306960628 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439271-1306960628.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/457 20465
/proc/meminfo: memFree=30418360/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=22472 CPUtime=0.01 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 1306 0 0 0 1 0 0 0 25 0 1 0 807662644 23011328 954 33554432000 4194304 4625164 140733576778576 18446744073709551615 248089395408 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/20465/statm: 5618 968 296 106 0 1121 0

[startup+0.907006 s]
/proc/loadavg: 0.00 0.00 0.00 2/457 20465
/proc/meminfo: memFree=30418360/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=399848 CPUtime=6.45 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 29661 0 0 0 642 3 0 0 25 0 8 0 807662644 409444352 15349 33554432000 4194304 4625164 140733576778576 18446744073709551615 248089803295 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 99962 15349 415 106 0 95465 0
Current children cumulated CPU time (s) 6.45
Current children cumulated vsize (KiB) 399848

[startup+1.0003 s]
/proc/loadavg: 0.00 0.00 0.00 2/457 20465
/proc/meminfo: memFree=30418360/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=399848 CPUtime=7.2 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 30782 0 0 0 717 3 0 0 25 0 8 0 807662644 409444352 16026 33554432000 4194304 4625164 140733576778576 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 99962 16026 408 106 0 95465 0
Current children cumulated CPU time (s) 7.2
Current children cumulated vsize (KiB) 399848

[startup+1.10029 s]
/proc/loadavg: 0.00 0.00 0.00 2/457 20465
/proc/meminfo: memFree=30418360/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=404948 CPUtime=8 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 32686 0 0 0 797 3 0 0 25 0 8 0 807662644 414666752 17459 33554432000 4194304 4625164 140733576778576 18446744073709551615 4519394 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 101237 17459 400 106 0 96740 0
Current children cumulated CPU time (s) 8
Current children cumulated vsize (KiB) 404948

[startup+1.20027 s]
/proc/loadavg: 0.00 0.00 0.00 2/457 20465
/proc/meminfo: memFree=30418360/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=404948 CPUtime=8.8 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 34435 0 0 0 876 4 0 0 25 0 8 0 807662644 414666752 18109 33554432000 4194304 4625164 140733576778576 18446744073709551615 4360345 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 101237 18109 388 106 0 96740 0
Current children cumulated CPU time (s) 8.8
Current children cumulated vsize (KiB) 404948

[startup+1.50022 s]
/proc/loadavg: 0.00 0.00 0.00 2/457 20465
/proc/meminfo: memFree=30418360/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=414796 CPUtime=11.19 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 40846 0 0 0 1115 4 0 0 25 0 8 0 807662644 424751104 20219 33554432000 4194304 4625164 140733576778576 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 103699 20219 432 106 0 99202 0
Current children cumulated CPU time (s) 11.19
Current children cumulated vsize (KiB) 414796

[startup+3.11793 s]
/proc/loadavg: 0.64 0.13 0.04 9/465 20473
/proc/meminfo: memFree=30315640/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=432048 CPUtime=24.1 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 65706 0 0 0 2402 8 0 0 25 0 8 0 807662644 442417152 25682 33554432000 4194304 4625164 140733576778576 18446744073709551615 4511959 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 108012 25682 379 106 0 103515 0
[pid=20465/tid=20467] ppid=20463 vsize=432048 CPUtime=3.06 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 4579 0 0 0 306 0 0 0 25 0 8 0 807662648 442417152 25682 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=432048 CPUtime=3.02 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 4859 0 0 0 302 0 0 0 25 0 8 0 807662648 442417152 25682 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=432048 CPUtime=3.05 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 28092 0 0 0 302 3 0 0 25 0 8 0 807662648 442417152 25684 33554432000 4194304 4625164 140733576778576 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=432048 CPUtime=2.75 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 4580 0 0 0 275 0 0 0 25 0 8 0 807662648 442417152 25684 33554432000 4194304 4625164 140733576778576 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=432048 CPUtime=3.06 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 5145 0 0 0 306 0 0 0 25 0 8 0 807662648 442417152 25684 33554432000 4194304 4625164 140733576778576 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=432048 CPUtime=3.07 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 5093 0 0 0 306 1 0 0 25 0 8 0 807662648 442417152 25684 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=432048 CPUtime=3 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 4695 0 0 0 300 0 0 0 25 0 8 0 807662648 442417152 25684 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.1
Current children cumulated vsize (KiB) 432048

[startup+6.30137 s]
/proc/loadavg: 1.23 0.26 0.09 9/465 20473
/proc/meminfo: memFree=30266660/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=459880 CPUtime=49.61 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 113764 0 0 0 4945 16 0 0 25 0 8 0 807662644 470917120 38105 33554432000 4194304 4625164 140733576778576 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 114970 38105 356 106 0 110473 0
[pid=20465/tid=20467] ppid=20463 vsize=459880 CPUtime=6.26 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 7926 0 0 0 625 1 0 0 25 0 8 0 807662648 470917120 38121 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=459880 CPUtime=6.17 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 8282 0 0 0 616 1 0 0 25 0 8 0 807662648 470917120 38122 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=459880 CPUtime=6.24 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 55544 0 0 0 617 7 0 0 25 0 8 0 807662648 470917120 38122 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=459880 CPUtime=5.96 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 7736 0 0 0 595 1 0 0 25 0 8 0 807662648 470917120 38122 33554432000 4194304 4625164 140733576778576 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=459880 CPUtime=6.26 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 8703 0 0 0 626 0 0 0 25 0 8 0 807662648 470917120 38122 33554432000 4194304 4625164 140733576778576 18446744073709551615 4436746 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=459880 CPUtime=6.26 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 8326 0 0 0 625 1 0 0 25 0 8 0 807662648 470917120 38122 33554432000 4194304 4625164 140733576778576 18446744073709551615 4339639 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=459880 CPUtime=6.2 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 8150 0 0 0 620 0 0 0 25 0 8 0 807662648 470917120 38122 33554432000 4194304 4625164 140733576778576 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.61
Current children cumulated vsize (KiB) 459880

[startup+12.7012 s]
/proc/loadavg: 1.77 0.39 0.13 9/465 20474
/proc/meminfo: memFree=30208328/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=503788 CPUtime=100.64 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 204286 0 0 0 10033 31 0 0 25 0 8 0 807662644 515878912 54303 33554432000 4194304 4625164 140733576778576 18446744073709551615 4512193 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 125947 54303 347 106 0 121450 0
[pid=20465/tid=20467] ppid=20463 vsize=503788 CPUtime=12.65 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 12153 0 0 0 1263 2 0 0 25 0 8 0 807662648 515878912 54303 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=503788 CPUtime=12.47 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 12519 0 0 0 1246 1 0 0 25 0 8 0 807662648 515878912 54303 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=503788 CPUtime=12.64 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 119677 0 0 0 1246 18 0 0 25 0 8 0 807662648 515878912 54303 33554432000 4194304 4625164 140733576778576 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=503788 CPUtime=12.34 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 12339 0 0 0 1232 2 0 0 25 0 8 0 807662648 515878912 54304 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=503788 CPUtime=12.64 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 13070 0 0 0 1263 1 0 0 25 0 8 0 807662648 515878912 54318 33554432000 4194304 4625164 140733576778576 18446744073709551615 4349087 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=503788 CPUtime=12.65 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 12470 0 0 0 1263 2 0 0 25 0 8 0 807662648 515878912 54332 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351811 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=503788 CPUtime=12.58 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 12428 0 0 0 1257 1 0 0 25 0 8 0 807662648 515878912 54333 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.64
Current children cumulated vsize (KiB) 503788

[startup+25.501 s]
/proc/loadavg: 2.73 0.64 0.21 9/465 20474
/proc/meminfo: memFree=30103184/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=552884 CPUtime=202.82 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 312827 0 0 0 20233 49 0 0 25 0 8 0 807662644 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 138221 78963 414 106 0 133724 0
[pid=20465/tid=20467] ppid=20463 vsize=552884 CPUtime=25.44 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 14300 0 0 0 2542 2 0 0 25 0 8 0 807662648 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=552884 CPUtime=25.07 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 20474 0 0 0 2504 3 0 0 25 0 8 0 807662648 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=552884 CPUtime=25.42 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 195574 0 0 0 2513 29 0 0 25 0 8 0 807662648 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=552884 CPUtime=25.14 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 19183 0 0 0 2510 4 0 0 25 0 8 0 807662648 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=552884 CPUtime=25.44 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 19566 0 0 0 2542 2 0 0 25 0 8 0 807662648 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=552884 CPUtime=25.44 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 19506 0 0 0 2541 3 0 0 25 0 8 0 807662648 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=552884 CPUtime=25.38 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 14354 0 0 0 2537 1 0 0 25 0 8 0 807662648 566153216 78963 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 202.82
Current children cumulated vsize (KiB) 552884

[startup+51.1005 s]
/proc/loadavg: 4.53 1.23 0.42 9/465 20475
/proc/meminfo: memFree=29946536/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=755796 CPUtime=407.23 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 565149 0 0 0 40635 88 0 0 25 0 8 0 807662644 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4393263 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 188949 118812 347 106 0 184452 0
[pid=20465/tid=20467] ppid=20463 vsize=755796 CPUtime=51.05 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 30624 0 0 0 5100 5 0 0 25 0 8 0 807662648 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=755796 CPUtime=50.28 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 29212 0 0 0 5023 5 0 0 25 0 8 0 807662648 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4339559 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=755796 CPUtime=51.01 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 374148 0 0 0 5046 55 0 0 25 0 8 0 807662648 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4339655 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=755796 CPUtime=50.74 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 29530 0 0 0 5069 5 0 0 25 0 8 0 807662648 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=755796 CPUtime=51.05 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 29197 0 0 0 5101 4 0 0 25 0 8 0 807662648 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4348832 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=755796 CPUtime=51.04 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 28966 0 0 0 5100 4 0 0 25 0 8 0 807662648 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=755796 CPUtime=50.98 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 31247 0 0 0 5094 4 0 0 25 0 8 0 807662648 773935104 118812 33554432000 4194304 4625164 140733576778576 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.23
Current children cumulated vsize (KiB) 755796

[startup+102.3 s]
/proc/loadavg: 6.61 2.37 0.85 9/465 20476
/proc/meminfo: memFree=29728512/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=1110432 CPUtime=816.02 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 793893 0 0 0 81473 129 0 0 25 0 8 0 807662644 1137082368 172472 33554432000 4194304 4625164 140733576778576 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 277608 172472 587 106 0 273111 0
[pid=20465/tid=20467] ppid=20463 vsize=1110432 CPUtime=102.25 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 45309 0 0 0 10217 8 0 0 25 0 8 0 807662648 1137082368 172472 33554432000 4194304 4625164 140733576778576 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=1110432 CPUtime=101.17 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 33596 0 0 0 10111 6 0 0 25 0 8 0 807662648 1137082368 172472 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=1110432 CPUtime=102.21 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 511052 0 0 0 10142 79 0 0 25 0 8 0 807662648 1137082368 172472 33554432000 4194304 4625164 140733576778576 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=20465/tid=20469] ppid=20463 vsize=5749580 CPUtime=4660.28 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 20315156 0 0 0 462850 3178 0 0 25 0 8 0 807662648 5887569920 1204849 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=5749580 CPUtime=4662.02 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 288723 0 0 0 466143 59 0 0 25 0 8 0 807662648 5887569920 1204849 33554432000 4194304 4625164 140733576778576 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=5749580 CPUtime=4662.35 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 375539 0 0 0 466157 78 0 0 25 0 8 0 807662648 5887569920 1204849 33554432000 4194304 4625164 140733576778576 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=5749580 CPUtime=4659.52 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 363077 0 0 0 465865 87 0 0 25 0 8 0 807662648 5887569920 1204849 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=5749580 CPUtime=4662.28 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 291429 0 0 0 466168 60 0 0 25 0 8 0 807662648 5887569920 1204849 33554432000 4194304 4625164 140733576778576 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37223.9
Current children cumulated vsize (KiB) 5749580

[startup+4722.3 s]
/proc/loadavg: 8.02 8.05 7.99 9/465 20611
/proc/meminfo: memFree=25577692/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=5749580 CPUtime=37703 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 30739425 0 0 0 3765347 4949 0 0 25 0 8 0 807662644 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 1437395 1208667 429 106 0 1432898 0
[pid=20465/tid=20467] ppid=20463 vsize=5749580 CPUtime=4722.35 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 286035 0 0 0 472169 66 0 0 25 0 8 0 807662648 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=5749580 CPUtime=4651.96 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 131086 0 0 0 465152 44 0 0 25 0 8 0 807662648 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=5749580 CPUtime=4720.26 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 20549025 0 0 0 468809 3217 0 0 25 0 8 0 807662648 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=5749580 CPUtime=4722.03 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 288750 0 0 0 472144 59 0 0 25 0 8 0 807662648 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=5749580 CPUtime=4722.35 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 375583 0 0 0 472157 78 0 0 25 0 8 0 807662648 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=5749580 CPUtime=4719.52 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 363181 0 0 0 471865 87 0 0 25 0 8 0 807662648 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=5749580 CPUtime=4722.28 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 291448 0 0 0 472168 60 0 0 25 0 8 0 807662648 5887569920 1208667 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37703
Current children cumulated vsize (KiB) 5749580

[startup+4782.3 s]
/proc/loadavg: 8.05 8.05 7.99 9/465 20613
/proc/meminfo: memFree=25564128/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=5752076 CPUtime=38182 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 31139735 0 0 0 3813184 5017 0 0 25 0 8 0 807662644 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 1438019 1209801 355 106 0 1433522 0
[pid=20465/tid=20467] ppid=20463 vsize=5752076 CPUtime=4782.35 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 286183 0 0 0 478169 66 0 0 25 0 8 0 807662648 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=5752076 CPUtime=4711.02 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 131131 0 0 0 471058 44 0 0 25 0 8 0 807662648 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=5752076 CPUtime=4780.26 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 20856208 0 0 0 474757 3269 0 0 25 0 8 0 807662648 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4579317 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=5752076 CPUtime=4782.02 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 288773 0 0 0 478143 59 0 0 25 0 8 0 807662648 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=5752076 CPUtime=4782.35 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 375623 0 0 0 478157 78 0 0 25 0 8 0 807662648 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4329671 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=5752076 CPUtime=4779.53 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 363228 0 0 0 477865 88 0 0 25 0 8 0 807662648 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=5752076 CPUtime=4782.28 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 291467 0 0 0 478168 60 0 0 25 0 8 0 807662648 5890125824 1209801 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38182
Current children cumulated vsize (KiB) 5752076

[startup+4842.3 s]
/proc/loadavg: 8.13 8.08 8.01 9/465 20614
/proc/meminfo: memFree=25560120/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=5752076 CPUtime=38661 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 31547292 0 0 0 3861013 5091 0 0 25 0 8 0 807662644 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 1438019 1211400 381 106 0 1433522 0
[pid=20465/tid=20467] ppid=20463 vsize=5752076 CPUtime=4842.35 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 286189 0 0 0 484169 66 0 0 25 0 8 0 807662648 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=5752076 CPUtime=4770.06 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 131131 0 0 0 476962 44 0 0 25 0 8 0 807662648 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=5752076 CPUtime=4840.23 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 21109281 0 0 0 480708 3315 0 0 25 0 8 0 807662648 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=5752076 CPUtime=4842.03 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 288799 0 0 0 484144 59 0 0 25 0 8 0 807662648 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=5752076 CPUtime=4842.35 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 375666 0 0 0 484157 78 0 0 25 0 8 0 807662648 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4460372 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=5752076 CPUtime=4839.53 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 363304 0 0 0 483865 88 0 0 25 0 8 0 807662648 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=5752076 CPUtime=4842.28 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 291484 0 0 0 484168 60 0 0 25 0 8 0 807662648 5890125824 1211400 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38661
Current children cumulated vsize (KiB) 5752076

[startup+4902.3 s]
/proc/loadavg: 8.15 8.09 8.01 9/465 20616
/proc/meminfo: memFree=25551892/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=5752076 CPUtime=39140.1 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 31979966 0 0 0 3908845 5164 0 0 25 0 8 0 807662644 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4512190 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 1438019 1213233 347 106 0 1433522 0
[pid=20465/tid=20467] ppid=20463 vsize=5752076 CPUtime=4902.35 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 286197 0 0 0 490169 66 0 0 25 0 8 0 807662648 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=5752076 CPUtime=4829.12 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 131443 0 0 0 482867 45 0 0 25 0 8 0 807662648 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=5752076 CPUtime=4900.22 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 21385628 0 0 0 486661 3361 0 0 25 0 8 0 807662648 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=5752076 CPUtime=4902.03 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 288821 0 0 0 490144 59 0 0 25 0 8 0 807662648 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=5752076 CPUtime=4902.35 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 375709 0 0 0 490157 78 0 0 25 0 8 0 807662648 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=5752076 CPUtime=4899.53 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 363408 0 0 0 489865 88 0 0 25 0 8 0 807662648 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=5752076 CPUtime=4902.29 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 291507 0 0 0 490169 60 0 0 25 0 8 0 807662648 5890125824 1213233 33554432000 4194304 4625164 140733576778576 18446744073709551615 4488064 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39140.1
Current children cumulated vsize (KiB) 5752076

[startup+4962.3 s]
/proc/loadavg: 8.05 8.07 8.00 9/465 20618
/proc/meminfo: memFree=25544664/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=5752076 CPUtime=39619.1 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 32349783 0 0 0 3956684 5228 0 0 25 0 8 0 807662644 5890125824 1216281 33554432000 4194304 4625164 140733576778576 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 1438019 1216281 404 106 0 1433522 0
[pid=20465/tid=20467] ppid=20463 vsize=5752076 CPUtime=4962.36 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 286204 0 0 0 496170 66 0 0 25 0 8 0 807662648 5890125824 1216281 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=5752076 CPUtime=4888.15 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 132574 0 0 0 488769 46 0 0 25 0 8 0 807662648 5890125824 1216281 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=5752076 CPUtime=4960.21 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 21666729 0 0 0 492610 3411 0 0 25 0 8 0 807662648 5890125824 1216281 33554432000 4194304 4625164 140733576778576 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=5752076 CPUtime=4962.03 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 288846 0 0 0 496144 59 0 0 25 0 8 0 807662648 5890125824 1216281 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=5752076 CPUtime=4962.35 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 375751 0 0 0 496157 78 0 0 25 0 8 0 807662648 5890125824 1216282 33554432000 4194304 4625164 140733576778576 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=5752076 CPUtime=4959.53 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 363632 0 0 0 495865 88 0 0 25 0 8 0 807662648 5890125824 1216282 33554432000 4194304 4625164 140733576778576 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=5752076 CPUtime=4962.29 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 291531 0 0 0 496169 60 0 0 25 0 8 0 807662648 5890125824 1216282 33554432000 4194304 4625164 140733576778576 18446744073709551615 4330814 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39619.1
Current children cumulated vsize (KiB) 5752076



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.1 s]
/proc/loadavg: 8.07 8.08 8.00 9/465 20619
/proc/meminfo: memFree=25535692/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=5752076 CPUtime=40000.9 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) R 20463 20465 20439 0 -1 4202496 32642079 0 0 0 3994808 5277 0 0 25 0 8 0 807662644 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 1438019 1217721 407 106 0 1433522 0
[pid=20465/tid=20467] ppid=20463 vsize=5752076 CPUtime=5010.17 cores=0-7
/proc/20465/task/20467/stat : 20467 (SArTagnan) R 20463 20465 20439 0 -1 4202560 286211 0 0 0 500951 66 0 0 25 0 8 0 807662648 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=5752076 CPUtime=4935.22 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4202560 132828 0 0 0 493475 47 0 0 25 0 8 0 807662648 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=20465/tid=20469] ppid=20463 vsize=5752076 CPUtime=5008.02 cores=0-7
/proc/20465/task/20469/stat : 20469 (SArTagnan) R 20463 20465 20439 0 -1 4202560 21896376 0 0 0 497351 3451 0 0 25 0 8 0 807662648 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20465/tid=20470] ppid=20463 vsize=5752076 CPUtime=5009.85 cores=0-7
/proc/20465/task/20470/stat : 20470 (SArTagnan) R 20463 20465 20439 0 -1 4202560 288866 0 0 0 500926 59 0 0 25 0 8 0 807662648 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4330968 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20465/tid=20471] ppid=20463 vsize=5752076 CPUtime=5010.17 cores=0-7
/proc/20465/task/20471/stat : 20471 (SArTagnan) R 20463 20465 20439 0 -1 4202560 375783 0 0 0 500939 78 0 0 25 0 8 0 807662648 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4329690 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=20465/tid=20472] ppid=20463 vsize=5752076 CPUtime=5007.34 cores=0-7
/proc/20465/task/20472/stat : 20472 (SArTagnan) R 20463 20465 20439 0 -1 4202560 363858 0 0 0 500646 88 0 0 25 0 8 0 807662648 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=20465/tid=20473] ppid=20463 vsize=5752076 CPUtime=5010.11 cores=0-7
/proc/20465/task/20473/stat : 20473 (SArTagnan) R 20463 20465 20439 0 -1 4202560 291551 0 0 0 500951 60 0 0 25 0 8 0 807662648 5890125824 1217721 33554432000 4194304 4625164 140733576778576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 5752076

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.32 s]
/proc/loadavg: 8.07 8.08 8.00 2/460 20620
/proc/meminfo: memFree=27381348/32950928 swapFree=45617076/67111528
[pid=20465] ppid=20463 vsize=0 CPUtime=40001.1 cores=0-7
/proc/20465/stat : 20465 (SArTagnan) Z 20463 20465 20439 0 -1 4203548 32642098 0 0 0 3994816 5297 0 0 25 0 2 0 807662644 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/20465/statm: 0 0 0 0 0 0 0
[pid=20465/tid=20468] ppid=20463 vsize=0 CPUtime=4935.41 cores=0-7
/proc/20465/task/20468/stat : 20468 (SArTagnan) R 20463 20465 20439 0 -1 4203588 132828 0 0 0 493475 66 0 0 25 0 2 0 807662648 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.36
CPU time (s): 40001.2
CPU user time (s): 39948.2
CPU system time (s): 53.0119
CPU usage (%): 798.37
Max. virtual memory (cumulated for all children) (KiB): 5981656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39948.2
system time used= 53.0119
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32642098
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3328
involuntary context switches= 165515

runsolver used 20.4009 second user time and 57.2823 second system time

The end

Launcher Data 

Begin job on node123 at 2011-06-01 22:37:08
IDJOB=3439271
IDBENCH=83924
IDSOLVER=1936
FILE ID=node123/3439271-1306960628
RUNJOBID= node123-1306960628-20453
PBS_JOBID= 13497630
Free space on /tmp= 73808 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439271-1306960628/watcher-3439271-1306960628 -o /tmp/evaluation-result-3439271-1306960628/solver-3439271-1306960628 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439271-1306960628.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ad30956261e72142648a01bc7c025dba
RANDOM SEED=790568201

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30418772 kB
Buffers:        166040 kB
Cached:         154588 kB
SwapCached:       9456 kB
Active:        2101828 kB
Inactive:       162624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30418772 kB
SwapTotal:    67111528 kB
SwapFree:     45617076 kB
Dirty:            1584 kB
Writeback:           0 kB
AnonPages:     1942292 kB
Mapped:          22516 kB
Slab:           121144 kB
PageTables:      78204 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 133346296 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73808 MiB
End job on node123 at 2011-06-02 00:00:41