Trace number 1778347

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
gNovelty+-T 2009-03-22 (4 threads)? (TO) 3705.35 1000.03

General information on the benchmark

NameRANDOM/MEDIUM/3SAT/UNKNOWN/380/
unif-k3-r4.25-v380-c1615-S2043187304-036.cnf
MD5SUM8f761d7a83f8ed9f2fb1562cef6a194f
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables380
Number of clauses1615
Sum of the clauses size4845
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31615
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.08	c +------------------------------+
0.00/0.08	c | gNovelty+, version 1.0       |
0.00/0.08	c +------------------------------+
0.00/0.08	c gnovelty+ -h for help
0.00/0.08	c

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1778347-1243478672/watcher-1778347-1243478672 -o /tmp/evaluation-result-1778347-1243478672/solver-1778347-1243478672 -C 5000 -W 1000 -M 2047 HOME/gnovelty+ HOME/instance-1778347-1243478672.cnf 403685156 4 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 3.79 3.80 3.80 3/115 16672
/proc/meminfo: memFree=3159564/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=509228 CPUtime=0
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 1668 0 0 0 0 0 0 0 18 0 1 0 1112546996 521449472 1625 4294967295 134512640 135680988 3218932000 3218931264 134537167 0 0 0 0 0 0 0 17 3 0 0 0
/proc/16672/statm: 127307 1634 99 286 0 127019 0

[startup+0.096563 s]
/proc/loadavg: 3.79 3.80 3.80 3/115 16672
/proc/meminfo: memFree=3159564/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=0.09
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19786 0 0 0 3 6 0 0 20 0 4 0 1112546996 558895104 19742 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/16672/statm: 136449 19742 103 286 0 136161 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 545796

[startup+0.116584 s]
/proc/loadavg: 3.79 3.80 3.80 3/115 16672
/proc/meminfo: memFree=3159564/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=0.15
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19792 0 0 0 8 7 0 0 19 0 4 0 1112546996 558895104 19748 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19748 103 286 0 136161 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 545796

[startup+0.316536 s]
/proc/loadavg: 3.79 3.80 3.80 3/115 16672
/proc/meminfo: memFree=3159564/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=0.89
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19792 0 0 0 43 46 0 0 18 0 4 0 1112546996 558895104 19748 4294967295 134512640 135680988 3218932000 3218931244 134957426 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19748 103 286 0 136161 0
Current children cumulated CPU time (s) 0.89
Current children cumulated vsize (KiB) 545796

[startup+0.716528 s]
/proc/loadavg: 3.79 3.80 3.80 3/115 16672
/proc/meminfo: memFree=3159564/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=2.37
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19792 0 0 0 116 121 0 0 15 0 4 0 1112546996 558895104 19748 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19748 103 286 0 136161 0
Current children cumulated CPU time (s) 2.37
Current children cumulated vsize (KiB) 545796

[startup+1.5165 s]
/proc/loadavg: 3.79 3.80 3.80 5/119 16676
/proc/meminfo: memFree=3081124/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=5.28
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19792 0 0 0 277 251 0 0 15 0 4 0 1112546996 558895104 19748 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19748 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=1.26
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 56 70 0 0 15 0 4 0 1112547005 558895104 19748 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=1.34
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 71 63 0 0 15 0 4 0 1112547005 558895104 19748 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=1.28
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 79 49 0 0 15 0 4 0 1112547005 558895104 19748 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.28
Current children cumulated vsize (KiB) 545796

[startup+3.11643 s]
/proc/loadavg: 3.80 3.80 3.80 5/119 16676
/proc/meminfo: memFree=3081072/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=11.26
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 596 530 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=2.75
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 133 142 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=2.85
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 153 132 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=2.76
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 158 118 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.26
Current children cumulated vsize (KiB) 545796

[startup+6.3163 s]
/proc/loadavg: 3.80 3.80 3.80 5/119 16678
/proc/meminfo: memFree=3080948/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=23.15
/proc/16672/stat : 16672 (gnovelty+) S 16670 16672 24991 0 -1 4202496 19793 0 0 0 1232 1083 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=5.71
/proc/16672/task/16674/stat : 16674 (gnovelty+) S 16670 16672 24991 0 -1 4202560 5 0 0 0 287 284 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=5.81
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 314 267 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236132 134957432 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=5.71
/proc/16672/task/16676/stat : 16676 (gnovelty+) S 16670 16672 24991 0 -1 4202560 6 0 0 0 323 248 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.15
Current children cumulated vsize (KiB) 545796

[startup+12.7161 s]
/proc/loadavg: 3.83 3.81 3.81 5/119 16678
/proc/meminfo: memFree=3080888/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=46.97
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 2536 2161 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=11.65
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 622 543 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=11.9
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 647 543 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=11.58
/proc/16672/task/16676/stat : 16676 (gnovelty+) S 16670 16672 24991 0 -1 4202560 6 0 0 0 653 505 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 46.97
Current children cumulated vsize (KiB) 545796

[startup+25.5156 s]
/proc/loadavg: 3.86 3.82 3.81 5/119 16680
/proc/meminfo: memFree=3080672/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=94.38
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 5086 4352 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931196 134957422 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=23.62
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 1289 1073 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=23.77
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 1289 1088 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=23.54
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 1306 1048 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 94.38
Current children cumulated vsize (KiB) 545796

[startup+51.1147 s]
/proc/loadavg: 3.91 3.83 3.81 5/119 16866
/proc/meminfo: memFree=3080456/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=189.54
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 10244 8710 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=47.6
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 2560 2200 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=47.46
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 2617 2129 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=47.25
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 2571 2154 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843948 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 189.54
Current children cumulated vsize (KiB) 545796

[startup+102.313 s]
/proc/loadavg: 3.80 3.81 3.81 5/119 17055
/proc/meminfo: memFree=3079880/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=378.14
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 20485 17329 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957681 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=95.01
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 5158 4343 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628204 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=94.34
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 5120 4314 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=94.39
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 5138 4301 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 378.14
Current children cumulated vsize (KiB) 545796

[startup+162.31 s]
/proc/loadavg: 3.92 3.84 3.82 5/119 17242
/proc/meminfo: memFree=3080120/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=600.67
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 32708 27359 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931196 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=150.86
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 8228 6858 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=149.82
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 8165 6817 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=150.02
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 8199 6803 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 600.67
Current children cumulated vsize (KiB) 545796

[startup+222.308 s]
/proc/loadavg: 3.75 3.80 3.80 5/119 17428
/proc/meminfo: memFree=3080260/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=823.2
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 44704 37616 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=206.88
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 11243 9445 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=205.6
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 11181 9379 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=205.7
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 11193 9377 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843948 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 823.2
Current children cumulated vsize (KiB) 545796

[startup+282.306 s]
/proc/loadavg: 3.79 3.79 3.80 6/119 17621
/proc/meminfo: memFree=3080360/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=1046.58
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 56769 47889 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957681 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=262.66
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 14313 11953 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628204 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=261.73
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 14258 11915 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957422 0 0 0 0 0 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=16672] ppid=16670 vsize=545796 CPUtime=1491.56
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 80866 68290 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=374.05
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 20324 17081 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=372.75
/proc/16672/task/16675/stat : 16675 (gnovelty+) S 16670 16672 24991 0 -1 4202560 6 0 0 0 20255 17020 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=372.44
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 20211 17033 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1491.56
Current children cumulated vsize (KiB) 545796

[startup+462.308 s]
/proc/loadavg: 3.74 3.76 3.79 5/119 18187
/proc/meminfo: memFree=3079748/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=1713.43
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 93013 78330 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=429.46
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 23373 19573 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=428.13
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 23329 19484 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=427.93
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 23256 19537 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1713.43
Current children cumulated vsize (KiB) 545796

[startup+522.316 s]
/proc/loadavg: 3.71 3.75 3.78 7/119 18373
/proc/meminfo: memFree=3079392/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=1936.56
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 105082 88574 0 0 16 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=485.04
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 26337 22167 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628204 134957681 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=483.92
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 26339 22053 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=483.51
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 26274 22077 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1936.56
Current children cumulated vsize (KiB) 545796

[startup+582.313 s]
/proc/loadavg: 3.85 3.78 3.79 5/119 18562
/proc/meminfo: memFree=3079856/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=2159.33
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 117152 98781 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=540.5
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 29306 24744 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=539.77
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 29384 24593 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236076 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=539.1
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 29310 24600 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2159.33
Current children cumulated vsize (KiB) 545796

[startup+642.311 s]
/proc/loadavg: 3.87 3.80 3.79 5/119 18754
/proc/meminfo: memFree=3080268/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=2380.77
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 129317 108760 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957681 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=595.01
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 32313 27188 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=595.05
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 32451 27054 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957422 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=594.97
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 32338 27159 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2380.77
Current children cumulated vsize (KiB) 545796

[startup+702.318 s]
/proc/loadavg: 3.83 3.80 3.79 5/119 18943
/proc/meminfo: memFree=3080120/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=2603.07
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 141361 118946 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=650.54
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 35320 29734 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=650.29
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 35445 29584 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=650.8
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 35364 29716 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2603.07
Current children cumulated vsize (KiB) 545796

[startup+762.316 s]
/proc/loadavg: 3.72 3.78 3.79 5/119 19130
/proc/meminfo: memFree=3079980/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=2825.28
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 153433 129095 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=705.93
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 38337 32256 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=705.9
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 38461 32129 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=705.97
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 38304 32293 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2825.28
Current children cumulated vsize (KiB) 545796

[startup+822.304 s]
/proc/loadavg: 3.80 3.79 3.79 5/119 19316
/proc/meminfo: memFree=3080028/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=3047.82
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 165586 139196 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957681 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=761.75
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 41400 34775 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=761.95
/proc/16672/task/16675/stat : 16675 (gnovelty+) S 16670 16672 24991 0 -1 4202560 6 0 0 0 41506 34689 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=761.41
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 41282 34859 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3047.82
Current children cumulated vsize (KiB) 545796

[startup+882.311 s]
/proc/loadavg: 3.75 3.79 3.79 5/119 19505
/proc/meminfo: memFree=3080352/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=3269.5
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 177682 149268 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=817.04
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 44523 37181 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=817.57
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 44542 37215 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236076 134957681 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=817.05
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 44279 37426 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3269.5
Current children cumulated vsize (KiB) 545796

[startup+942.309 s]
/proc/loadavg: 3.96 3.84 3.80 5/119 19693
/proc/meminfo: memFree=3080268/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=3492.24
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 189722 159502 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957681 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=872.61
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 47533 39728 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628204 134957422 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=873.35
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 47594 39741 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=872.77
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 47228 40049 0 0 16 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3492.24
Current children cumulated vsize (KiB) 545796



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 3.89 3.83 3.80 5/119 19886
/proc/meminfo: memFree=3079872/3368532 swapFree=1941392/1959888
[pid=16672] ppid=16670 vsize=545796 CPUtime=3705.29
/proc/16672/stat : 16672 (gnovelty+) R 16670 16672 24991 0 -1 4202496 19793 0 0 0 201366 169163 0 0 15 0 4 0 1112546996 558895104 19749 4294967295 134512640 135680988 3218932000 3218931244 134957422 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/16672/statm: 136449 19749 103 286 0 136161 0
[pid=16672/tid=16674] ppid=16670 vsize=545796 CPUtime=925.89
/proc/16672/task/16674/stat : 16674 (gnovelty+) R 16670 16672 24991 0 -1 4202560 5 0 0 0 50407 42182 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3077628252 134957681 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16672/tid=16675] ppid=16670 vsize=545796 CPUtime=926.89
/proc/16672/task/16675/stat : 16675 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 50610 42079 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3068236124 134957681 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16672/tid=16676] ppid=16670 vsize=545796 CPUtime=925.64
/proc/16672/task/16676/stat : 16676 (gnovelty+) R 16670 16672 24991 0 -1 4202560 6 0 0 0 50039 42525 0 0 15 0 4 0 1112547005 558895104 19749 4294967295 134512640 135680988 3218932000 3058843996 134957422 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3705.29
Current children cumulated vsize (KiB) 545796

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.03
CPU time (s): 3705.35
CPU user time (s): 2013.71
CPU system time (s): 1691.64
CPU usage (%): 370.524
Max. virtual memory (cumulated for all children) (KiB): 545796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2013.71
system time used= 1691.64
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19793
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 94709127
involuntary context switches= 238272

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-28 04:44:32
IDJOB=1778347
IDBENCH=70631
IDSOLVER=617
FILE ID=/1778347-1243478672
PBS_JOBID=
Free space on /tmp= 15730 MiB

SOLVER NAME= gNovelty+-T 2009-03-22 (4 threads)
BENCH NAME= SAT09/RANDOM/MEDIUM/3SAT/UNKNOWN/380/unif-k3-r4.25-v380-c1615-S2043187304-036.cnf
COMMAND LINE= HOME/gnovelty+ BENCHNAME RANDOMSEED MAXNBTHREAD
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1778347-1243478672/watcher-1778347-1243478672 -o /tmp/evaluation-result-1778347-1243478672/solver-1778347-1243478672 -C 5000 -W 1000 -M 2047  HOME/gnovelty+ HOME/instance-1778347-1243478672.cnf 403685156 4

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 8f761d7a83f8ed9f2fb1562cef6a194f
RANDOM SEED= 403685156

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3159416 kB
Buffers:         13116 kB
Cached:         122896 kB
SwapCached:       4320 kB
Active:         105500 kB
Inactive:        41492 kB
HighTotal:     2489216 kB
HighFree:      2352972 kB
LowTotal:       879316 kB
LowFree:        806444 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            1388 kB
Writeback:           0 kB
AnonPages:        9564 kB
Mapped:           4076 kB
Slab:            51188 kB
SReclaimable:    43408 kB
SUnreclaim:       7780 kB
PageTables:        748 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127260 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15730 MiB
End job on  at 2009-05-28 05:01:14