Trace number 3386001

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.17 1205.27

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_464.cnf
MD5SUMa722a199fd84ba0b319251daa47aa19c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables232
Number of clauses28991
Sum of the clauses size130855
Maximum clause length22
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 277
Number of clauses of size 326594
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52320

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386001-1305581841/watcher-3386001-1305581841 -o /tmp/evaluation-result-3386001-1305581841/solver-3386001-1305581841 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386001-1305581841.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.38 5.17 6.62 4/498 23635
/proc/meminfo: memFree=24170472/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=21896 CPUtime=0.01 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 1894 0 0 0 1 0 0 0 20 0 1 0 669785063 22421504 1174 33554432000 4194304 4625164 140736696816160 18446744073709551615 4360561 0 0 4096 2 0 0 0 17 3 0 0 0
/proc/23635/statm: 5474 1176 296 106 0 977 0

[startup+0.076837 s]
/proc/loadavg: 4.38 5.17 6.62 4/498 23635
/proc/meminfo: memFree=24170472/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=190764 CPUtime=0.2 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 4872 0 0 0 20 0 0 0 21 0 4 0 669785063 195342336 3134 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 47691 3134 336 106 0 43194 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 190764

[startup+0.100832 s]
/proc/loadavg: 4.38 5.17 6.62 4/498 23635
/proc/meminfo: memFree=24170472/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=191324 CPUtime=0.29 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 5463 0 0 0 29 0 0 0 21 0 4 0 669785063 195915776 3088 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 47831 3088 336 106 0 43334 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 191324

[startup+0.300798 s]
/proc/loadavg: 4.38 5.17 6.62 4/498 23635
/proc/meminfo: memFree=24170472/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=191884 CPUtime=1.1 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 8307 0 0 0 109 1 0 0 21 0 4 0 669785063 196489216 3618 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 47971 3618 338 106 0 43474 0
Current children cumulated CPU time (s) 1.1
Current children cumulated vsize (KiB) 191884

[startup+0.700727 s]
/proc/loadavg: 4.38 5.17 6.62 4/498 23635
/proc/meminfo: memFree=24170472/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=196420 CPUtime=2.7 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 11566 0 0 0 268 2 0 0 22 0 4 0 669785063 201134080 4616 33554432000 4194304 4625164 140736696816160 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 49105 4616 338 106 0 44608 0
Current children cumulated CPU time (s) 2.7
Current children cumulated vsize (KiB) 196420

[startup+1.50059 s]
/proc/loadavg: 4.38 5.17 6.62 11/506 23643
/proc/meminfo: memFree=24128264/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=197612 CPUtime=5.87 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 18125 0 0 0 585 2 0 0 25 0 4 0 669785063 202354688 6105 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512042 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 49403 6105 342 106 0 44906 0
[pid=23635/tid=23638] ppid=23631 vsize=197612 CPUtime=1.46 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2219 0 0 0 146 0 0 0 25 0 4 0 669785066 202354688 6105 33554432000 4194304 4625164 140736696816160 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=197612 CPUtime=1.47 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 1498 0 0 0 147 0 0 0 25 0 4 0 669785066 202354688 6105 33554432000 4194304 4625164 140736696816160 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=197612 CPUtime=1.45 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 10624 0 0 0 144 1 0 0 25 0 4 0 669785066 202354688 6105 33554432000 4194304 4625164 140736696816160 18446744073709551615 4547788 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.87
Current children cumulated vsize (KiB) 197612

[startup+3.10031 s]
/proc/loadavg: 4.38 5.17 6.62 11/506 23643
/proc/meminfo: memFree=24112036/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=266320 CPUtime=12.26 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 32407 0 0 0 1221 5 0 0 25 0 4 0 669785063 272711680 8767 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512974 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 66580 8767 342 106 0 62083 0
[pid=23635/tid=23638] ppid=23631 vsize=266320 CPUtime=3.06 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 3853 0 0 0 306 0 0 0 25 0 4 0 669785066 272711680 8767 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=266320 CPUtime=3.06 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2593 0 0 0 306 0 0 0 25 0 4 0 669785066 272711680 8767 33554432000 4194304 4625164 140736696816160 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=266320 CPUtime=3.05 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 22059 0 0 0 302 3 0 0 25 0 4 0 669785066 272711680 8767 33554432000 4194304 4625164 140736696816160 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.26
Current children cumulated vsize (KiB) 266320

[startup+6.30074 s]
/proc/loadavg: 4.75 5.23 6.63 11/506 23643
/proc/meminfo: memFree=24077940/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=274528 CPUtime=25 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 54407 0 0 0 2492 8 0 0 25 0 4 0 669785063 281116672 13621 33554432000 4194304 4625164 140736696816160 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 68632 13621 342 106 0 64135 0
[pid=23635/tid=23638] ppid=23631 vsize=274528 CPUtime=6.25 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 6698 0 0 0 625 0 0 0 25 0 4 0 669785066 281116672 13621 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=274528 CPUtime=6.26 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 4962 0 0 0 626 0 0 0 25 0 4 0 669785066 281116672 13621 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351860 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=274528 CPUtime=6.25 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 38249 0 0 0 620 5 0 0 25 0 4 0 669785066 281116672 13621 33554432000 4194304 4625164 140736696816160 18446744073709551615 4554593 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25
Current children cumulated vsize (KiB) 274528

[startup+12.7006 s]
/proc/loadavg: 5.09 5.29 6.65 11/506 23643
/proc/meminfo: memFree=24024600/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=286320 CPUtime=50.48 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 93869 0 0 0 5035 13 0 0 25 0 4 0 669785063 293191680 20677 33554432000 4194304 4625164 140736696816160 18446744073709551615 4511926 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 71580 20677 351 106 0 67083 0
[pid=23635/tid=23638] ppid=23631 vsize=286320 CPUtime=12.65 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 10897 0 0 0 1264 1 0 0 25 0 4 0 669785066 293191680 20677 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=286320 CPUtime=12.66 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 8497 0 0 0 1265 1 0 0 25 0 4 0 669785066 293191680 20678 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=286320 CPUtime=12.66 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 68625 0 0 0 1257 9 0 0 25 0 4 0 669785066 293191680 20678 33554432000 4194304 4625164 140736696816160 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.48
Current children cumulated vsize (KiB) 286320

[startup+25.5003 s]
/proc/loadavg: 5.96 5.47 6.68 11/506 23644
/proc/meminfo: memFree=23937300/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=317792 CPUtime=101.46 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 191842 0 0 0 10115 31 0 0 25 0 4 0 669785063 325419008 34876 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 79448 34876 412 106 0 74951 0
[pid=23635/tid=23638] ppid=23631 vsize=317792 CPUtime=25.46 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 18518 0 0 0 2542 4 0 0 25 0 4 0 669785066 325419008 34876 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351811 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=317792 CPUtime=25.46 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 17399 0 0 0 2544 2 0 0 25 0 4 0 669785066 325419008 34876 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=317792 CPUtime=25.46 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 148059 0 0 0 2524 22 0 0 25 0 4 0 669785066 325419008 34876 33554432000 4194304 4625164 140736696816160 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.46
Current children cumulated vsize (KiB) 317792

[startup+51.1008 s]
/proc/loadavg: 7.06 5.77 6.75 11/506 23644
/proc/meminfo: memFree=23821408/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=339728 CPUtime=203.43 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 280440 0 0 0 20297 46 0 0 25 0 4 0 669785063 347881472 47957 33554432000 4194304 4625164 140736696816160 18446744073709551615 4396480 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 84932 47957 413 106 0 80435 0
[pid=23635/tid=23638] ppid=23631 vsize=339728 CPUtime=51.06 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 27794 0 0 0 5099 7 0 0 25 0 4 0 669785066 347881472 47957 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=339728 CPUtime=51.06 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 20416 0 0 0 5102 4 0 0 25 0 4 0 669785066 347881472 47957 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=339728 CPUtime=51.05 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 223778 0 0 0 5073 32 0 0 25 0 4 0 669785066 347881472 47957 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351820 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.43
Current children cumulated vsize (KiB) 339728

[startup+102.32 s]
/proc/loadavg: 8.16 6.27 6.86 11/506 23646
/proc/meminfo: memFree=23647276/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=456788 CPUtime=407.43 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 578165 0 0 0 40648 95 0 0 25 0 4 0 669785063 467750912 72322 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 114197 72322 544 106 0 109700 0
[pid=23635/tid=23638] ppid=23631 vsize=456788 CPUtime=102.28 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 42505 0 0 0 10218 10 0 0 25 0 4 0 669785066 467750912 72322 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=456788 CPUtime=102.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 30330 0 0 0 10222 6 0 0 25 0 4 0 669785066 467750912 72322 33554432000 4194304 4625164 140736696816160 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=456788 CPUtime=102.27 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 489284 0 0 0 10153 74 0 0 25 0 4 0 669785066 467750912 72322 33554432000 4194304 4625164 140736696816160 18446744073709551615 4547262 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.43
Current children cumulated vsize (KiB) 456788

[startup+162.301 s]
/proc/loadavg: 8.69 6.76 6.99 11/506 23647
/proc/meminfo: memFree=23466700/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=536556 CPUtime=646.33 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 634198 0 0 0 64523 110 0 0 25 0 4 0 669785063 549433344 98533 33554432000 4194304 4625164 140736696816160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 134139 98533 1199 106 0 129642 0
[pid=23635/tid=23638] ppid=23631 vsize=536556 CPUtime=162.26 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 57546 0 0 0 16213 13 0 0 25 0 4 0 669785066 549433344 98533 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=536556 CPUtime=162.27 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 43870 0 0 0 16215 12 0 0 25 0 4 0 669785066 549433344 98533 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=536556 CPUtime=162.26 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 495017 0 0 0 16150 76 0 0 25 0 4 0 669785066 549433344 98533 33554432000 4194304 4625164 140736696816160 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 646.33
Current children cumulated vsize (KiB) 536556

[startup+222.301 s]
/proc/loadavg: 9.00 7.20 7.13 11/506 23649
/proc/meminfo: memFree=23303716/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=671648 CPUtime=885.3 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 757130 0 0 0 88398 132 0 0 25 0 4 0 669785063 687767552 111716 33554432000 4194304 4625164 140736696816160 18446744073709551615 4511926 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23635/statm: 167912 111716 449 106 0 163415 0
[pid=23635/tid=23638] ppid=23631 vsize=671648 CPUtime=222.26 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 61314 0 0 0 22210 16 0 0 25 0 4 0 669785066 687767552 111716 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=671648 CPUtime=222.26 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 44949 0 0 0 22214 12 0 0 25 0 4 0 669785066 687767552 111716 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=671648 CPUtime=222.26 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 598783 0 0 0 22135 91 0 0 25 0 4 0 669785066 687767552 111716 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 885.3
Current children cumulated vsize (KiB) 671648

[startup+282.301 s]

################
# More data... #
################

[pid=23635] ppid=23631 vsize=1100776 CPUtime=2558.18 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 2137320 0 0 0 255452 366 0 0 25 0 4 0 669785063 1127194624 212204 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512891 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 275194 212204 758 106 0 270697 0
[pid=23635/tid=23638] ppid=23631 vsize=1100776 CPUtime=642.3 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 132471 0 0 0 64194 36 0 0 25 0 4 0 669785066 1127194624 212204 33554432000 4194304 4625164 140736696816160 18446744073709551615 4352053 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1100776 CPUtime=642.29 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 96120 0 0 0 64201 28 0 0 25 0 4 0 669785066 1127194624 212204 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1100776 CPUtime=636.84 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 1781234 0 0 0 63410 274 0 0 25 0 4 0 669785066 1127194624 212204 33554432000 4194304 4625164 140736696816160 18446744073709551615 4335282 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2558.18
Current children cumulated vsize (KiB) 1100776

[startup+702.301 s]
/proc/loadavg: 9.06 8.73 7.93 11/506 23662
/proc/meminfo: memFree=22507284/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1100776 CPUtime=2797.07 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 2151213 0 0 0 279335 372 0 0 25 0 4 0 669785063 1127194624 220220 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 275194 220220 537 106 0 270697 0
[pid=23635/tid=23638] ppid=23631 vsize=1100776 CPUtime=702.27 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 137155 0 0 0 70187 40 0 0 25 0 4 0 669785066 1127194624 220220 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1100776 CPUtime=702.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 97450 0 0 0 70199 29 0 0 25 0 4 0 669785066 1127194624 220220 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1100776 CPUtime=695.8 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 1787414 0 0 0 69305 275 0 0 25 0 4 0 669785066 1127194624 220220 33554432000 4194304 4625164 140736696816160 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2797.07
Current children cumulated vsize (KiB) 1100776

[startup+762.32 s]
/proc/loadavg: 9.13 8.81 8.00 11/506 23663
/proc/meminfo: memFree=22429824/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1100776 CPUtime=3036.11 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 2477368 0 0 0 303186 425 0 0 25 0 4 0 669785063 1127194624 229881 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 275194 229881 468 106 0 270697 0
[pid=23635/tid=23638] ppid=23631 vsize=1100776 CPUtime=762.3 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 140504 0 0 0 76186 44 0 0 25 0 4 0 669785066 1127194624 229881 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1100776 CPUtime=762.29 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 99063 0 0 0 76200 29 0 0 25 0 4 0 669785066 1127194624 229881 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1100776 CPUtime=754.78 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2107374 0 0 0 75154 324 0 0 25 0 4 0 669785066 1127194624 229881 33554432000 4194304 4625164 140736696816160 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3036.11
Current children cumulated vsize (KiB) 1100776

[startup+822.301 s]
/proc/loadavg: 9.19 8.87 8.07 11/506 23665
/proc/meminfo: memFree=22345928/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1253384 CPUtime=3275.01 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3009787 0 0 0 326984 517 0 0 25 0 4 0 669785063 1283465216 244853 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512789 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 313346 244853 427 106 0 308849 0
[pid=23635/tid=23638] ppid=23631 vsize=1253384 CPUtime=822.28 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 144102 0 0 0 82180 48 0 0 25 0 4 0 669785066 1283465216 244853 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1253384 CPUtime=822.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 108179 0 0 0 82196 32 0 0 25 0 4 0 669785066 1283465216 244853 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1253384 CPUtime=813.73 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2610058 0 0 0 80966 407 0 0 25 0 4 0 669785066 1283465216 244853 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3275.01
Current children cumulated vsize (KiB) 1253384

[startup+882.301 s]
/proc/loadavg: 9.20 8.93 8.14 11/506 23666
/proc/meminfo: memFree=22270092/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1344900 CPUtime=3513.98 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3055251 0 0 0 350870 528 0 0 25 0 4 0 669785063 1377177600 254163 33554432000 4194304 4625164 140736696816160 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 336225 254163 419 106 0 331728 0
[pid=23635/tid=23638] ppid=23631 vsize=1344900 CPUtime=882.28 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 146347 0 0 0 88177 51 0 0 25 0 4 0 669785066 1377177600 254163 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1344900 CPUtime=882.27 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 136754 0 0 0 88191 36 0 0 25 0 4 0 669785066 1377177600 254163 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1344900 CPUtime=872.69 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2610642 0 0 0 86861 408 0 0 25 0 4 0 669785066 1377177600 254163 33554432000 4194304 4625164 140736696816160 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3513.98
Current children cumulated vsize (KiB) 1344900

[startup+942.3 s]
/proc/loadavg: 9.20 8.97 8.20 11/506 23668
/proc/meminfo: memFree=22227108/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1344900 CPUtime=3752.96 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3061099 0 0 0 374763 533 0 0 25 0 4 0 669785063 1377177600 259965 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 336225 259965 413 106 0 331728 0
[pid=23635/tid=23638] ppid=23631 vsize=1344900 CPUtime=942.28 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 150274 0 0 0 94174 54 0 0 25 0 4 0 669785066 1377177600 259965 33554432000 4194304 4625164 140736696816160 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1344900 CPUtime=942.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 137120 0 0 0 94191 37 0 0 25 0 4 0 669785066 1377177600 259965 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1344900 CPUtime=931.67 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2611111 0 0 0 92758 409 0 0 25 0 4 0 669785066 1377177600 259965 33554432000 4194304 4625164 140736696816160 18446744073709551615 4547365 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3752.96
Current children cumulated vsize (KiB) 1344900

[startup+1002.3 s]
/proc/loadavg: 9.18 9.00 8.26 11/506 23670
/proc/meminfo: memFree=22131796/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1411744 CPUtime=3991.92 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3344231 0 0 0 398616 576 0 0 25 0 4 0 669785063 1445625856 277800 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512854 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 352936 277800 360 106 0 348439 0
[pid=23635/tid=23638] ppid=23631 vsize=1411744 CPUtime=1002.28 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 159182 0 0 0 100172 56 0 0 25 0 4 0 669785066 1445625856 277800 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1411744 CPUtime=1002.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 141741 0 0 0 100187 41 0 0 25 0 4 0 669785066 1445625856 277800 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1411744 CPUtime=990.62 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2879701 0 0 0 98617 445 0 0 25 0 4 0 669785066 1445625856 277800 33554432000 4194304 4625164 140736696816160 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3991.92
Current children cumulated vsize (KiB) 1411744

[startup+1062.3 s]
/proc/loadavg: 9.23 9.04 8.31 11/506 23671
/proc/meminfo: memFree=22083228/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1439452 CPUtime=4230.9 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3361489 0 0 0 422510 580 0 0 25 0 4 0 669785063 1473998848 284139 33554432000 4194304 4625164 140736696816160 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 359863 284139 360 106 0 355366 0
[pid=23635/tid=23638] ppid=23631 vsize=1439452 CPUtime=1062.29 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 161344 0 0 0 106171 58 0 0 25 0 4 0 669785066 1473998848 284139 33554432000 4194304 4625164 140736696816160 18446744073709551615 4353062 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1439452 CPUtime=1062.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 142350 0 0 0 106187 41 0 0 25 0 4 0 669785066 1473998848 284139 33554432000 4194304 4625164 140736696816160 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1439452 CPUtime=1049.59 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2892827 0 0 0 104512 447 0 0 25 0 4 0 669785066 1473998848 284139 33554432000 4194304 4625164 140736696816160 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4230.9
Current children cumulated vsize (KiB) 1439452

[startup+1122.3 s]
/proc/loadavg: 9.14 9.05 8.36 11/506 23673
/proc/meminfo: memFree=22030696/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1442784 CPUtime=4469.85 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3368022 0 0 0 446401 584 0 0 25 0 4 0 669785063 1477410816 290568 33554432000 4194304 4625164 140736696816160 18446744073709551615 4511997 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 360696 290568 342 106 0 356199 0
[pid=23635/tid=23638] ppid=23631 vsize=1442784 CPUtime=1122.29 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 164136 0 0 0 112168 61 0 0 25 0 4 0 669785066 1477410816 290568 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1442784 CPUtime=1122.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 143121 0 0 0 112187 41 0 0 25 0 4 0 669785066 1477410816 290568 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1442784 CPUtime=1108.55 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2894131 0 0 0 110407 448 0 0 25 0 4 0 669785066 1477410816 290568 33554432000 4194304 4625164 140736696816160 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4469.85
Current children cumulated vsize (KiB) 1442784

[startup+1182.3 s]
/proc/loadavg: 9.10 9.05 8.40 11/506 23674
/proc/meminfo: memFree=21965276/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1528056 CPUtime=4708.84 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3376263 0 0 0 470293 591 0 0 25 0 4 0 669785063 1564729344 298653 33554432000 4194304 4625164 140736696816160 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 382014 298653 342 106 0 377517 0
[pid=23635/tid=23638] ppid=23631 vsize=1528056 CPUtime=1182.29 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 166339 0 0 0 118165 64 0 0 25 0 4 0 669785066 1564729344 298653 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1528056 CPUtime=1182.28 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 144892 0 0 0 118185 43 0 0 25 0 4 0 669785066 1564729344 298653 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1528056 CPUtime=1167.53 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2897391 0 0 0 116304 449 0 0 25 0 4 0 669785066 1564729344 298653 33554432000 4194304 4625164 140736696816160 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4708.84
Current children cumulated vsize (KiB) 1528056



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.2 s]
/proc/loadavg: 9.07 9.05 8.42 10/506 23675
/proc/meminfo: memFree=21943532/32951124 swapFree=60609076/67111528
[pid=23635] ppid=23631 vsize=1528056 CPUtime=4800.09 cores=1,3,5,7
/proc/23635/stat : 23635 (SArTagnan) R 23631 23635 22974 0 -1 4202496 3439955 0 0 0 479406 603 0 0 25 0 4 0 669785063 1564729344 300424 33554432000 4194304 4625164 140736696816160 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23635/statm: 382014 300424 342 106 0 377517 0
[pid=23635/tid=23638] ppid=23631 vsize=1528056 CPUtime=1205.2 cores=1,3,5,7
/proc/23635/task/23638/stat : 23638 (SArTagnan) R 23631 23635 22974 0 -1 4202560 167303 0 0 0 120455 65 0 0 25 0 4 0 669785066 1564729344 300424 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23635/tid=23639] ppid=23631 vsize=1528056 CPUtime=1205.2 cores=1,3,5,7
/proc/23635/task/23639/stat : 23639 (SArTagnan) R 23631 23635 22974 0 -1 4202560 144988 0 0 0 120477 43 0 0 25 0 4 0 669785066 1564729344 300424 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=23635/tid=23640] ppid=23631 vsize=1528056 CPUtime=1190.03 cores=1,3,5,7
/proc/23635/task/23640/stat : 23640 (SArTagnan) R 23631 23635 22974 0 -1 4202560 2959542 0 0 0 118543 460 0 0 25 0 4 0 669785066 1564729344 300424 33554432000 4194304 4625164 140736696816160 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 1528056

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.27
CPU time (s): 4800.17
CPU user time (s): 4794.09
CPU system time (s): 6.08408
CPU usage (%): 398.264
Max. virtual memory (cumulated for all children) (KiB): 1528056

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.09
system time used= 6.08408
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3439955
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 620
involuntary context switches= 62900

runsolver used 5.70513 second user time and 15.0907 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-16 23:37:21
IDJOB=3386001
IDBENCH=83268
IDSOLVER=1871
FILE ID=node108/3386001-1305581841
RUNJOBID= node108-1305581841-23617
PBS_JOBID= 13350217
Free space on /tmp= 73452 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-22_464.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386001-1305581841/watcher-3386001-1305581841 -o /tmp/evaluation-result-3386001-1305581841/solver-3386001-1305581841 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386001-1305581841.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a722a199fd84ba0b319251daa47aa19c
RANDOM SEED=1236049068

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24171040 kB
Buffers:         71504 kB
Cached:         734912 kB
SwapCached:      25796 kB
Active:        1199644 kB
Inactive:      7364876 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24171040 kB
SwapTotal:    67111528 kB
SwapFree:     60609076 kB
Dirty:            2008 kB
Writeback:           0 kB
AnonPages:     7741968 kB
Mapped:          28300 kB
Slab:            81816 kB
PageTables:      65776 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 134805728 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73452 MiB
End job on node108 at 2011-05-16 23:57:28