Trace number 1781455

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
satake 2009-03-22 (4 threads)? (TO) 1701.73 1000.06

General information on the benchmark

Namemanol-pipe-f10ni.cnf
MD5SUMb99a5b8844b4e1d2656eb1422e6e888f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark513.47
Satisfiable
(Un)Satisfiability was proved
Number of variables368888
Number of clauses1100500
Sum of the clauses size2567832
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2733666
Number of clauses of size 3366833
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781455-1243654328/watcher-1781455-1243654328 -o /tmp/evaluation-result-1781455-1243654328/solver-1781455-1243654328 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1781455-1243654328.cnf 4 10000 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.24 6.26 6.27 5/111 30979
/proc/meminfo: memFree=3011076/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=5260 CPUtime=0
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 780 0 0 0 0 0 0 0 18 0 5 0 1130097035 5386240 737 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 1315 741 63 164 0 1150 0
[pid=30979/tid=30980] ppid=30977 vsize=5260 CPUtime=0
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130097035 5386240 757 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=5260 CPUtime=0
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 688 0 0 0 0 0 0 0 19 0 5 0 1130097035 5386240 762 4294967295 134512640 135180984 3217678320 3086000420 134583077 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=5260 CPUtime=0
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 5 0 1130097035 5386240 767 4294967295 134512640 135180984 3217678320 3085935428 134705812 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=5260 CPUtime=0
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 5 0 1130097035 5386240 773 4294967295 134512640 135180984 3217678320 3085869892 134705812 0 0 0 0 0 0 0 -1 0 0 0 0

[startup+0.039997 s]
/proc/loadavg: 6.24 6.26 6.27 5/111 30979
/proc/meminfo: memFree=3011076/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=34016 CPUtime=0.04
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 6323 0 0 0 0 4 0 0 18 0 5 0 1130097035 34832384 6280 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 8504 6284 63 164 0 8339 0
[pid=30979/tid=30980] ppid=30977 vsize=34016 CPUtime=0
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130097035 34832384 6287 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=34016 CPUtime=0.01
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 1474 0 0 0 0 1 0 0 19 0 5 0 1130097035 34832384 6290 4294967295 134512640 135180984 3217678320 3086000420 134583077 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=34016 CPUtime=0.01
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 1567 0 0 0 0 1 0 0 19 0 5 0 1130097035 34832384 6294 4294967295 134512640 135180984 3217678320 3085934884 134583077 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=34016 CPUtime=0.02
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 3183 0 0 0 0 2 0 0 20 0 5 0 1130097035 34832384 6298 4294967295 134512640 135180984 3217678320 3085869348 134583077 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 34016

[startup+0.109989 s]
/proc/loadavg: 6.24 6.26 6.27 5/111 30979
/proc/meminfo: memFree=3011076/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=76640 CPUtime=0.11
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 14810 0 0 0 2 9 0 0 18 0 5 0 1130097035 78479360 14766 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 19160 14770 63 164 0 18995 0
[pid=30979/tid=30980] ppid=30977 vsize=76640 CPUtime=0
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130097035 78479360 14773 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=76640 CPUtime=0.03
/proc/30979/task/30981/stat : 30981 (satake) S 30977 30979 23155 0 -1 4202560 5018 0 0 0 0 3 0 0 19 0 5 0 1130097035 78479360 14777 4294967295 134512640 135180984 3217678320 3086000276 134579486 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=76640 CPUtime=0.03
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 4324 0 0 0 0 3 0 0 19 0 5 0 1130097035 78479360 14781 4294967295 134512640 135180984 3217678320 3085934884 134583077 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=76640 CPUtime=0.05
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 5366 0 0 0 2 3 0 0 20 0 5 0 1130097035 78479360 14785 4294967295 134512640 135180984 3217678320 3085869144 134673459 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 76640

[startup+0.309973 s]
/proc/loadavg: 6.24 6.26 6.27 5/111 30979
/proc/meminfo: memFree=3011076/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=86588 CPUtime=0.35
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 20104 0 0 0 24 11 0 0 18 0 5 0 1130097035 88666112 20046 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 21647 20047 63 164 0 21482 0
[pid=30979/tid=30980] ppid=30977 vsize=86588 CPUtime=0
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130097035 88666112 20047 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=86588 CPUtime=0.15
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 7278 0 0 0 11 4 0 0 19 0 5 0 1130097035 88666112 20047 4294967295 134512640 135180984 3217678320 3086000200 134675846 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=86588 CPUtime=0.07
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 5729 0 0 0 4 3 0 0 19 0 5 0 1130097035 88666112 20050 4294967295 134512640 135180984 3217678320 3085934864 134520025 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=86588 CPUtime=0.13
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 6983 0 0 0 9 4 0 0 21 0 5 0 1130097035 88666112 20054 4294967295 134512640 135180984 3217678320 3085869392 134513490 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 86588

[startup+0.70994 s]
/proc/loadavg: 6.24 6.26 6.27 5/111 30979
/proc/meminfo: memFree=3011076/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=152096 CPUtime=1.04
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 32711 0 0 0 87 17 0 0 18 0 5 0 1130097035 155746304 32647 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 38024 32647 63 164 0 37859 0
[pid=30979/tid=30980] ppid=30977 vsize=152096 CPUtime=0
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 5 0 1130097035 155746304 32648 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=152096 CPUtime=0.44
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 12829 0 0 0 40 4 0 0 18 0 5 0 1130097035 155746304 32649 4294967295 134512640 135180984 3217678320 3086000276 134579745 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=152096 CPUtime=0.47
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 12780 0 0 0 38 9 0 0 17 0 5 0 1130097035 155746304 32651 4294967295 134512640 135180984 3217678320 3085934832 134522598 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=152096 CPUtime=0.13
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 6989 0 0 0 9 4 0 0 21 0 5 0 1130097035 155746304 32651 4294967295 134512640 135180984 3217678320 3085869248 134522980 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.04
Current children cumulated vsize (KiB) 152096

[startup+1.50988 s]
/proc/loadavg: 6.24 6.26 6.27 7/116 30984
/proc/meminfo: memFree=2840580/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=216436 CPUtime=2.72
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 55468 0 0 0 248 24 0 0 18 0 5 0 1130097035 221630464 45411 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 54109 45411 66 164 0 53944 0
[pid=30979/tid=30980] ppid=30977 vsize=216436 CPUtime=0
/proc/30979/task/30980/stat : 30980 (satake) R 30977 30979 23155 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 5 0 1130097035 221630464 45411 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=216436 CPUtime=1.21
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 23105 0 0 0 112 9 0 0 17 0 5 0 1130097035 221630464 45411 4294967295 134512640 135180984 3217678320 3085999976 134520863 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=216436 CPUtime=1.27
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 23166 0 0 0 116 11 0 0 16 0 5 0 1130097035 221630464 45411 4294967295 134512640 135180984 3217678320 3085934448 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=216436 CPUtime=0.24
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 9080 0 0 0 20 4 0 0 21 0 5 0 1130097035 221630464 45411 4294967295 134512640 135180984 3217678320 3085869336 134513830 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.72
Current children cumulated vsize (KiB) 216436

[startup+3.10975 s]
/proc/loadavg: 6.24 6.26 6.27 7/116 30984
/proc/meminfo: memFree=2781580/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=308180 CPUtime=6.47
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 76128 0 0 0 611 36 0 0 18 0 5 0 1130097035 315576320 66071 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 77045 66071 68 164 0 76880 0
[pid=30979/tid=30980] ppid=30977 vsize=308180 CPUtime=0.11
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 6504 0 0 0 7 4 0 0 15 0 5 0 1130097035 315576320 66071 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=308180 CPUtime=2.56
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 23214 0 0 0 247 9 0 0 15 0 5 0 1130097035 315576320 66071 4294967295 134512640 135180984 3217678320 3085999980 134520864 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=308180 CPUtime=2.76
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 23268 0 0 0 265 11 0 0 17 0 5 0 1130097035 315576320 66071 4294967295 134512640 135180984 3217678320 3085934448 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=308180 CPUtime=1.04
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 23032 0 0 0 92 12 0 0 22 0 5 0 1130097035 315576320 66071 4294967295 134512640 135180984 3217678320 3085869376 134535641 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6.47
Current children cumulated vsize (KiB) 308180

[startup+6.31948 s]
/proc/loadavg: 6.30 6.27 6.27 8/116 30984
/proc/meminfo: memFree=2766204/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=289612 CPUtime=13.4
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 76486 0 0 0 1297 43 0 0 18 0 5 0 1130097035 296562688 61433 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 72403 61433 68 164 0 72238 0
[pid=30979/tid=30980] ppid=30977 vsize=289612 CPUtime=0.16
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 6525 0 0 0 10 6 0 0 15 0 5 0 1130097035 296562688 61433 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=289612 CPUtime=5.53
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 23324 0 0 0 542 11 0 0 19 0 5 0 1130097035 296562688 61433 4294967295 134512640 135180984 3217678320 3085999976 134520863 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=289612 CPUtime=5.86
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 23388 0 0 0 573 13 0 0 21 0 5 0 1130097035 296562688 61433 4294967295 134512640 135180984 3217678320 3085934448 134528462 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=289612 CPUtime=1.85
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 23139 0 0 0 172 13 0 0 25 0 5 0 1130097035 296562688 61433 4294967295 134512640 135180984 3217678320 3085868908 134520901 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 13.4
Current children cumulated vsize (KiB) 289612

[startup+12.7189 s]
/proc/loadavg: 6.27 6.27 6.27 7/116 30984
/proc/meminfo: memFree=2763604/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=290424 CPUtime=26.07
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 77076 0 0 0 2550 57 0 0 18 0 5 0 1130097035 297394176 62023 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 72606 62023 68 164 0 72441 0
[pid=30979/tid=30980] ppid=30977 vsize=290424 CPUtime=0.25
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 6580 0 0 0 11 14 0 0 15 0 5 0 1130097035 297394176 62023 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=290424 CPUtime=9.88
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 23440 0 0 0 972 16 0 0 25 0 5 0 1130097035 297394176 62023 4294967295 134512640 135180984 3217678320 3085999984 134528411 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=290424 CPUtime=9.65
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 23609 0 0 0 952 13 0 0 25 0 5 0 1130097035 297394176 62023 4294967295 134512640 135180984 3217678320 3085934464 134518667 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=290424 CPUtime=6.29
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 23337 0 0 0 615 14 0 0 25 0 5 0 1130097035 297394176 62023 4294967295 134512640 135180984 3217678320 3085868704 134580407 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 26.07
Current children cumulated vsize (KiB) 290424

[startup+25.5179 s]
/proc/loadavg: 6.43 6.30 6.28 7/116 30985
/proc/meminfo: memFree=2760644/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=294620 CPUtime=51.32
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 77852 0 0 0 5030 102 0 0 18 0 5 0 1130097035 301690880 62799 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 73655 62799 68 164 0 73490 0
[pid=30979/tid=30980] ppid=30977 vsize=294620 CPUtime=0.55
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 6732 0 0 0 16 39 0 0 15 0 5 0 1130097035 301690880 62799 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=294620 CPUtime=19.21
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 23662 0 0 0 1899 22 0 0 25 0 5 0 1130097035 301690880 62799 4294967295 134512640 135180984 3217678320 3085999920 134523833 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=294620 CPUtime=18.03
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 23835 0 0 0 1780 23 0 0 25 0 5 0 1130097035 301690880 62799 4294967295 134512640 135180984 3217678320 3085934440 134520863 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=294620 CPUtime=13.53
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 23513 0 0 0 1335 18 0 0 25 0 5 0 1130097035 301690880 62799 4294967295 134512640 135180984 3217678320 3085868912 134528065 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 51.32
Current children cumulated vsize (KiB) 294620

[startup+51.1158 s]
/proc/loadavg: 6.58 6.34 6.29 7/116 31176
/proc/meminfo: memFree=2751856/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=301452 CPUtime=101.66
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 79946 0 0 0 10011 155 0 0 18 0 5 0 1130097035 308686848 64893 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 75363 64893 68 164 0 75198 0
[pid=30979/tid=30980] ppid=30977 vsize=301452 CPUtime=1.08
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 7058 0 0 0 36 72 0 0 16 0 5 0 1130097035 308686848 64893 4294967295 134512640 135180984 3217678320 3086065684 134580588 0 0 0 0 3223036975 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=301452 CPUtime=35.64
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 24131 0 0 0 3531 33 0 0 25 0 5 0 1130097035 308686848 64893 4294967295 134512640 135180984 3217678320 3085999952 134519935 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=301452 CPUtime=35.47
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 24353 0 0 0 3517 30 0 0 25 0 5 0 1130097035 308686848 64893 4294967295 134512640 135180984 3217678320 3085934252 134706407 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=301452 CPUtime=29.47
/proc/30979/task/30983/stat : 30983 (satake) S 30977 30979 23155 0 -1 4202560 24294 0 0 0 2927 20 0 0 25 0 5 0 1130097035 308686848 64893 4294967295 134512640 135180984 3217678320 3085868704 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.66
Current children cumulated vsize (KiB) 301452

[startup+102.322 s]
/proc/loadavg: 6.30 6.30 6.28 8/117 31194

################
# More data... #
################

[pid=30979/tid=30981] ppid=30977 vsize=485936 CPUtime=300.81
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 36780 0 0 0 29957 124 0 0 25 0 5 0 1130097035 497598464 110291 4294967295 134512640 135180984 3217678320 3085999984 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=485936 CPUtime=285.95
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 37436 0 0 0 28468 127 0 0 25 0 5 0 1130097035 497598464 110291 4294967295 134512640 135180984 3217678320 3085934448 134528441 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=485936 CPUtime=282.8
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 38884 0 0 0 28185 95 0 0 25 0 5 0 1130097035 497598464 110291 4294967295 134512640 135180984 3217678320 3085868912 134526240 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 875.74
Current children cumulated vsize (KiB) 485936

[startup+582.312 s]
/proc/loadavg: 6.30 6.29 6.27 7/116 32688
/proc/meminfo: memFree=2552264/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=504840 CPUtime=968.92
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 129754 0 0 0 96116 776 0 0 18 0 5 0 1130097035 516956160 114701 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 126210 114701 68 164 0 126045 0
[pid=30979/tid=30980] ppid=30977 vsize=504840 CPUtime=6.57
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 12456 0 0 0 249 408 0 0 16 0 5 0 1130097035 516956160 114701 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=504840 CPUtime=329.61
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 38238 0 0 0 32832 129 0 0 25 0 5 0 1130097035 516956160 114701 4294967295 134512640 135180984 3217678320 3085999776 134580407 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=504840 CPUtime=315.24
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 38665 0 0 0 31386 138 0 0 25 0 5 0 1130097035 516956160 114701 4294967295 134512640 135180984 3217678320 3085934372 134521141 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=504840 CPUtime=317.5
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 40285 0 0 0 31649 101 0 0 25 0 5 0 1130097035 516956160 114701 4294967295 134512640 135180984 3217678320 3085868912 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 968.92
Current children cumulated vsize (KiB) 504840

[startup+642.317 s]
/proc/loadavg: 6.47 6.34 6.29 7/116 408
/proc/meminfo: memFree=2532920/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=523108 CPUtime=1087.45
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 134513 0 0 0 107937 808 0 0 18 0 5 0 1130097035 535662592 119460 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 130777 119460 68 164 0 130612 0
[pid=30979/tid=30980] ppid=30977 vsize=523108 CPUtime=6.83
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 12696 0 0 0 262 421 0 0 15 0 5 0 1130097035 535662592 119460 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=523108 CPUtime=368.01
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 40010 0 0 0 36665 136 0 0 25 0 5 0 1130097035 535662592 119460 4294967295 134512640 135180984 3217678320 3085999984 134528519 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=523108 CPUtime=350.6
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 40356 0 0 0 34913 147 0 0 25 0 5 0 1130097035 535662592 119460 4294967295 134512640 135180984 3217678320 3085934280 134675767 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=523108 CPUtime=362.01
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 41341 0 0 0 36097 104 0 0 25 0 5 0 1130097035 535662592 119460 4294967295 134512640 135180984 3217678320 3085868976 134532445 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1087.45
Current children cumulated vsize (KiB) 523108

[startup+702.312 s]
/proc/loadavg: 6.41 6.35 6.29 7/116 594
/proc/meminfo: memFree=2514924/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=543680 CPUtime=1192.76
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 138960 0 0 0 118437 839 0 0 18 0 5 0 1130097035 556728320 123907 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 135920 123907 68 164 0 135755 0
[pid=30979/tid=30980] ppid=30977 vsize=543680 CPUtime=7.09
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 12878 0 0 0 270 439 0 0 15 0 5 0 1130097035 556728320 123907 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=543680 CPUtime=402.75
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 41181 0 0 0 40135 140 0 0 25 0 5 0 1130097035 556728320 123907 4294967295 134512640 135180984 3217678320 3085999976 134520863 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=543680 CPUtime=386.47
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 42143 0 0 0 38497 150 0 0 25 0 5 0 1130097035 556728320 123907 4294967295 134512640 135180984 3217678320 3085934448 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=543680 CPUtime=396.45
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 42648 0 0 0 39535 110 0 0 25 0 5 0 1130097035 556728320 123907 4294967295 134512640 135180984 3217678320 3085868912 134528214 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1192.76
Current children cumulated vsize (KiB) 543680

[startup+762.317 s]
/proc/loadavg: 6.50 6.39 6.30 8/116 782
/proc/meminfo: memFree=2496804/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=563136 CPUtime=1309.98
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 143540 0 0 0 130112 886 0 0 18 0 5 0 1130097035 576651264 128487 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 140784 128487 68 164 0 140619 0
[pid=30979/tid=30980] ppid=30977 vsize=563136 CPUtime=7.42
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 13286 0 0 0 280 462 0 0 15 0 5 0 1130097035 576651264 128487 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 1 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=563136 CPUtime=445.91
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 42078 0 0 0 44440 151 0 0 25 0 5 0 1130097035 576651264 128487 4294967295 134512640 135180984 3217678320 3085999984 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=563136 CPUtime=424.91
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 44070 0 0 0 42335 156 0 0 25 0 5 0 1130097035 576651264 128487 4294967295 134512640 135180984 3217678320 3085934448 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=563136 CPUtime=431.74
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 43996 0 0 0 43057 117 0 0 25 0 5 0 1130097035 576651264 128487 4294967295 134512640 135180984 3217678320 3085868976 134532508 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1309.98
Current children cumulated vsize (KiB) 563136

[startup+822.312 s]
/proc/loadavg: 6.30 6.37 6.30 7/116 982
/proc/meminfo: memFree=2478932/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=581236 CPUtime=1421.46
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 147977 0 0 0 141221 925 0 0 18 0 5 0 1130097035 595185664 132924 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 145309 132924 68 164 0 145144 0
[pid=30979/tid=30980] ppid=30977 vsize=581236 CPUtime=7.72
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 13514 0 0 0 293 479 0 0 15 0 5 0 1130097035 595185664 132924 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=581236 CPUtime=478.61
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 43355 0 0 0 47703 158 0 0 22 0 5 0 1130097035 595185664 132924 4294967295 134512640 135180984 3217678320 3085999984 134528433 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=581236 CPUtime=461.68
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 45894 0 0 0 46005 163 0 0 25 0 5 0 1130097035 595185664 132924 4294967295 134512640 135180984 3217678320 3085934352 134525171 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=581236 CPUtime=473.45
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 45104 0 0 0 47220 125 0 0 25 0 5 0 1130097035 595185664 132924 4294967295 134512640 135180984 3217678320 3085868912 134528760 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1421.46
Current children cumulated vsize (KiB) 581236

[startup+882.307 s]
/proc/loadavg: 6.44 6.39 6.31 7/116 1175
/proc/meminfo: memFree=2465572/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=594752 CPUtime=1513.54
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 151388 0 0 0 150396 958 0 0 18 0 5 0 1130097035 609026048 136335 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 148688 136335 68 164 0 148523 0
[pid=30979/tid=30980] ppid=30977 vsize=594752 CPUtime=7.96
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 13776 0 0 0 302 494 0 0 15 0 5 0 1130097035 609026048 136335 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=594752 CPUtime=505.21
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 44322 0 0 0 50356 165 0 0 25 0 5 0 1130097035 609026048 136335 4294967295 134512640 135180984 3217678320 3085999984 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=594752 CPUtime=492.32
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 47360 0 0 0 49061 171 0 0 25 0 5 0 1130097035 609026048 136335 4294967295 134512640 135180984 3217678320 3085934448 134528267 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=594752 CPUtime=508.05
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 45820 0 0 0 50677 128 0 0 25 0 5 0 1130097035 609026048 136335 4294967295 134512640 135180984 3217678320 3085868912 134528433 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1513.54
Current children cumulated vsize (KiB) 594752

[startup+942.312 s]
/proc/loadavg: 6.30 6.35 6.30 7/116 1363
/proc/meminfo: memFree=2453436/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=606668 CPUtime=1588.73
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 154252 0 0 0 157905 968 0 0 18 0 5 0 1130097035 621228032 139199 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 151667 139199 68 164 0 151502 0
[pid=30979/tid=30980] ppid=30977 vsize=606668 CPUtime=8.03
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 13902 0 0 0 307 496 0 0 16 0 5 0 1130097035 621228032 139199 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=606668 CPUtime=527.58
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 45281 0 0 0 52592 166 0 0 17 0 5 0 1130097035 621228032 139199 4294967295 134512640 135180984 3217678320 3085999984 134528433 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=606668 CPUtime=517.2
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 48612 0 0 0 51545 175 0 0 25 0 5 0 1130097035 621228032 139199 4294967295 134512640 135180984 3217678320 3085934448 134528267 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=606668 CPUtime=535.92
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 46347 0 0 0 53461 131 0 0 25 0 5 0 1130097035 621228032 139199 4294967295 134512640 135180984 3217678320 3085868704 134580407 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1588.73
Current children cumulated vsize (KiB) 606668



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 6.53 6.41 6.32 8/116 1549
/proc/meminfo: memFree=2438556/3368532 swapFree=1953788/1959888
[pid=30979] ppid=30977 vsize=621544 CPUtime=1701.66
/proc/30979/stat : 30979 (satake) S 30977 30979 23155 0 -1 4202496 157852 0 0 0 169176 990 0 0 18 0 5 0 1130097035 636461056 142799 4294967295 134512640 135180984 3217678320 3217677756 134573496 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/30979/statm: 155386 142799 68 164 0 155221 0
[pid=30979/tid=30980] ppid=30977 vsize=621544 CPUtime=8.17
/proc/30979/task/30980/stat : 30980 (satake) S 30977 30979 23155 0 -1 4202560 14002 0 0 0 311 506 0 0 16 0 5 0 1130097035 636461056 142799 4294967295 134512640 135180984 3217678320 3086065680 134580407 0 0 0 0 3223036458 0 0 -1 0 0 0 0
[pid=30979/tid=30981] ppid=30977 vsize=621544 CPUtime=566.3
/proc/30979/task/30981/stat : 30981 (satake) R 30977 30979 23155 0 -1 4202560 46595 0 0 0 56459 171 0 0 25 0 5 0 1130097035 636461056 142799 4294967295 134512640 135180984 3217678320 3085999776 134580407 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30982] ppid=30977 vsize=621544 CPUtime=549.08
/proc/30979/task/30982/stat : 30982 (satake) R 30977 30979 23155 0 -1 4202560 50038 0 0 0 54730 178 0 0 25 0 5 0 1130097035 636461056 142799 4294967295 134512640 135180984 3217678320 3085934280 134675846 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=30979/tid=30983] ppid=30977 vsize=621544 CPUtime=578.11
/proc/30979/task/30983/stat : 30983 (satake) R 30977 30979 23155 0 -1 4202560 47107 0 0 0 57676 135 0 0 25 0 5 0 1130097035 636461056 142799 4294967295 134512640 135180984 3217678320 3085868816 134525183 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1701.66
Current children cumulated vsize (KiB) 621544

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.06
CPU time (s): 1701.73
CPU user time (s): 1691.8
CPU system time (s): 9.93
CPU usage (%): 170.163
Max. virtual memory (cumulated for all children) (KiB): 621544

deleting IPC queue 16777216
deleting IPC queue 16809985
deleting IPC queue 16842754
deleting IPC queue 16875523
deleting IPC queue 16908292
deleting IPC queue 16941061
deleting IPC queue 16973830
deleting IPC queue 17006599
deleting IPC queue 17039368
deleting IPC queue 17072137
deleting IPC queue 17104906
deleting IPC queue 17137675
deleting IPC queue 17170444
deleting IPC queue 17203213
deleting IPC queue 17235982
deleting IPC queue 17268751

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1691.8
system time used= 9.93
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 157854
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3439575
involuntary context switches= 3390064

runsolver used 0 second user time and 0 second system time

The end

Launcher Data

Begin job on  at 2009-05-30 05:32:08
IDJOB=1781455
IDBENCH=71749
IDSOLVER=629
FILE ID=/1781455-1243654328
PBS_JOBID=
Free space on /tmp= 6457 MiB

SOLVER NAME= satake 2009-03-22 (4 threads)
BENCH NAME= SAT_RACE06/manol-pipe-f10ni.cnf
COMMAND LINE= HOME/satake BENCHNAME MAXNBTHREAD TIMEOUT
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781455-1243654328/watcher-1781455-1243654328 -o /tmp/evaluation-result-1781455-1243654328/solver-1781455-1243654328 -C 10000 -W 1000 -M 2047 --output-limit 1,15 --cleanup-all-ipc-queues HOME/satake HOME/instance-1781455-1243654328.cnf 4 10000

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= b99a5b8844b4e1d2656eb1422e6e888f
RANDOM SEED= 1466467492

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3011224 kB
Buffers:         73496 kB
Cached:         177176 kB
SwapCached:       2256 kB
Active:         127912 kB
Inactive:       139564 kB
HighTotal:     2489216 kB
HighFree:      2293804 kB
LowTotal:       879316 kB
LowFree:        717420 kB
SwapTotal:     1959888 kB
SwapFree:      1953788 kB
Dirty:           21108 kB
Writeback:           0 kB
AnonPages:       15876 kB
Mapped:           5228 kB
Slab:            80884 kB
SReclaimable:    66984 kB
SUnreclaim:      13900 kB
PageTables:        696 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   112672 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 6457 MiB
End job on  at 2009-05-30 05:48:52