Trace number 3262824

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
priss 1.0? (TO) 4800.16 1201.82

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf
MD5SUMb5a637600c242725f15a247a84bdea1b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables810
Number of clauses68270
Sum of the clauses size137296
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 268243
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 527

Solver Data 

0.00/0.00	c *****************************************************
0.00/0.00	c *        riss, Copyright 2009 Norbert Manthey       *
0.00/0.00	c *   This program may be redistributed or modified   *
0.00/0.00	c * under the terms of the GNU General Public License *
0.00/0.00	c *****************************************************
0.00/0.00	c process id: 28862
0.00/0.02	c parsetime: 15164us
0.00/0.02	c parsed 68270 clauses with 810 variables
0.00/0.02	c NW started thread 0 successfully (1106823488)
0.00/0.03	c NW started thread 1 successfully (1117636928)
0.00/0.05	c NW started thread 2 successfully (1093888320)
0.00/0.06	c NW started thread 3 successfully (1128126784)
10.45/2.77	c preprocessor returned 10001 variables
10.45/2.77	c preprocessing returned UNKNOWN
10.45/2.77	c PP set 0 variables
10.45/2.77	c pp time: 2714925us (2s)
10.84/2.80	c preprocessor returned 10001 variables
10.84/2.80	c preprocessing returned UNKNOWN
10.84/2.80	c PP set 0 variables
10.84/2.80	c pp time: 2775933us (2s)
10.84/2.83	c preprocessor returned 10001 variables
10.84/2.83	c preprocessing returned UNKNOWN
10.84/2.83	c PP set 0 variables
10.84/2.83	c pp time: 2802494us (2s)
42.80/10.81	c preprocessor returned 30044 variables
42.80/10.81	c preprocessing returned UNKNOWN
42.80/10.81	c PP set 0 variables
42.80/10.81	c pp time: 10754183us (10s)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262824-1304063785/watcher-3262824-1304063785 -o /tmp/evaluation-result-3262824-1304063785/solver-3262824-1304063785 -C 4800 -W 1300 -M 15500 HOME/priss.sh HOME HOME/instance-3262824-1304063785.cnf 1473979265 4800 15500 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.16 8.12 8.01 6/182 28861
/proc/meminfo: memFree=14352932/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0

[startup+0.099465 s]
/proc/loadavg: 8.16 8.12 8.01 6/182 28861
/proc/meminfo: memFree=14352932/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100512 s]
/proc/loadavg: 8.16 8.12 8.01 6/182 28861
/proc/meminfo: memFree=14352932/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.0173 s]
/proc/loadavg: 8.16 8.12 8.01 6/182 28861
/proc/meminfo: memFree=14352932/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.11729 s]
/proc/loadavg: 8.16 8.12 8.01 6/182 28861
/proc/meminfo: memFree=14352932/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50022 s]
/proc/loadavg: 8.16 8.12 8.01 6/182 28861
/proc/meminfo: memFree=14352932/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+3.10094 s]
/proc/loadavg: 8.14 8.12 8.01 9/188 28868
/proc/meminfo: memFree=14305032/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=286932 CPUtime=12.04 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 23878 0 0 0 1195 9 0 0 18 0 5 0 596609207 293818368 12066 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 71733 12066 404 389 0 67483 0
[pid=28862/tid=28864] ppid=28861 vsize=286932 CPUtime=3.02 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 4914 0 0 0 299 3 0 0 25 0 5 0 596609210 293818368 12066 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591695 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=286932 CPUtime=2.97 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 4846 0 0 0 296 1 0 0 24 0 5 0 596609210 293818368 12066 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591095 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=286932 CPUtime=2.99 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 5722 0 0 0 298 1 0 0 25 0 5 0 596609213 293818368 12066 33554432000 4194304 5787044 140734895633120 18446744073709551615 5585255 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=286932 CPUtime=2.99 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 4420 0 0 0 297 2 0 0 24 0 5 0 596609214 293818368 12066 33554432000 4194304 5787044 140734895633120 18446744073709551615 4359248 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.04
Current children cumulated vsize (KiB) 295632

[startup+6.30638 s]
/proc/loadavg: 8.14 8.12 8.01 9/188 28868
/proc/meminfo: memFree=14290108/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=292912 CPUtime=24.84 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 26340 0 0 0 2474 10 0 0 18 0 5 0 596609207 299941888 14528 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 73228 14528 404 389 0 68978 0
[pid=28862/tid=28864] ppid=28861 vsize=292912 CPUtime=6.22 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 5395 0 0 0 619 3 0 0 25 0 5 0 596609210 299941888 14528 33554432000 4194304 5787044 140734895633120 18446744073709551615 5586755 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=292912 CPUtime=6.17 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 6344 0 0 0 615 2 0 0 25 0 5 0 596609210 299941888 14528 33554432000 4194304 5787044 140734895633120 18446744073709551615 5588013 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=292912 CPUtime=6.19 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 6205 0 0 0 618 1 0 0 25 0 5 0 596609213 299941888 14528 33554432000 4194304 5787044 140734895633120 18446744073709551615 4213825 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=292912 CPUtime=6.19 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 4420 0 0 0 617 2 0 0 25 0 5 0 596609214 299941888 14528 33554432000 4194304 5787044 140734895633120 18446744073709551615 4359256 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.84
Current children cumulated vsize (KiB) 301612

[startup+12.7003 s]
/proc/loadavg: 8.12 8.12 8.01 9/188 28868
/proc/meminfo: memFree=14272536/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=296248 CPUtime=50.38 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 32416 0 0 0 5027 11 0 0 18 0 5 0 596609207 303357952 18168 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 74062 18168 417 389 0 69812 0
[pid=28862/tid=28864] ppid=28861 vsize=296248 CPUtime=12.62 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 6180 0 0 0 1258 4 0 0 25 0 5 0 596609210 303357952 18168 33554432000 4194304 5787044 140734895633120 18446744073709551615 4220295 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=296248 CPUtime=12.53 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 7097 0 0 0 1251 2 0 0 25 0 5 0 596609210 303357952 18168 33554432000 4194304 5787044 140734895633120 18446744073709551615 4238741 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=296248 CPUtime=12.58 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 7045 0 0 0 1257 1 0 0 25 0 5 0 596609213 303357952 18168 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591319 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=296248 CPUtime=12.58 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 8118 0 0 0 1256 2 0 0 25 0 5 0 596609214 303357952 18168 33554432000 4194304 5787044 140734895633120 18446744073709551615 5527579 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.38
Current children cumulated vsize (KiB) 304948

[startup+25.501 s]
/proc/loadavg: 8.10 8.11 8.01 9/188 28868
/proc/meminfo: memFree=14240544/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=305072 CPUtime=101.51 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 38411 0 0 0 10136 15 0 0 18 0 5 0 596609207 312393728 24163 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 76268 24163 417 389 0 72018 0
[pid=28862/tid=28864] ppid=28861 vsize=305072 CPUtime=25.42 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 7289 0 0 0 2537 5 0 0 25 0 5 0 596609210 312393728 24163 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591511 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=305072 CPUtime=25.26 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 9225 0 0 0 2524 2 0 0 25 0 5 0 596609210 312393728 24163 33554432000 4194304 5787044 140734895633120 18446744073709551615 5585228 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=305072 CPUtime=25.38 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 8280 0 0 0 2535 3 0 0 25 0 5 0 596609213 312393728 24163 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=305072 CPUtime=25.38 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 9641 0 0 0 2535 3 0 0 25 0 5 0 596609214 312393728 24163 33554432000 4194304 5787044 140734895633120 18446744073709551615 5527472 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.51
Current children cumulated vsize (KiB) 313772

[startup+51.1006 s]
/proc/loadavg: 8.19 8.13 8.01 9/188 28869
/proc/meminfo: memFree=14175536/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=321628 CPUtime=203.75 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 49121 0 0 0 20351 24 0 0 18 0 5 0 596609207 329347072 34827 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 80407 34827 417 389 0 76157 0
[pid=28862/tid=28864] ppid=28861 vsize=321628 CPUtime=51.01 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 10469 0 0 0 5095 6 0 0 25 0 5 0 596609210 329347072 34827 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=321628 CPUtime=50.72 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 11232 0 0 0 5067 5 0 0 25 0 5 0 596609210 329347072 34827 33554432000 4194304 5787044 140734895633120 18446744073709551615 5592784 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=321628 CPUtime=50.98 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 10626 0 0 0 5093 5 0 0 25 0 5 0 596609213 329347072 34827 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591561 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=321628 CPUtime=50.98 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 12818 0 0 0 5092 6 0 0 25 0 5 0 596609214 329347072 34827 33554432000 4194304 5787044 140734895633120 18446744073709551615 5527239 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.75
Current children cumulated vsize (KiB) 330328

[startup+102.301 s]
/proc/loadavg: 8.27 8.16 8.03 9/188 28870
/proc/meminfo: memFree=14083648/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=342088 CPUtime=408.25 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 62209 0 0 0 40785 40 0 0 18 0 5 0 596609207 350298112 47794 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 85522 47794 417 389 0 81272 0
[pid=28862/tid=28864] ppid=28861 vsize=342088 CPUtime=102.21 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 13436 0 0 0 10212 9 0 0 25 0 5 0 596609210 350298112 47794 33554432000 4194304 5787044 140734895633120 18446744073709551615 5585255 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=342088 CPUtime=101.63 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 14256 0 0 0 10153 10 0 0 25 0 5 0 596609210 350298112 47794 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=342088 CPUtime=102.16 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 14197 0 0 0 10207 9 0 0 25 0 5 0 596609213 350298112 47794 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=342088 CPUtime=102.18 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 16344 0 0 0 10208 10 0 0 25 0 5 0 596609214 350298112 47794 33554432000 4194304 5787044 140734895633120 18446744073709551615 5528446 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.25
Current children cumulated vsize (KiB) 350788

[startup+162.301 s]
/proc/loadavg: 8.17 8.14 8.03 9/188 28872
/proc/meminfo: memFree=14021500/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=354320 CPUtime=647.92 cores=0,2,4,6

################
# More data... #
################

/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 33942 0 0 0 82035 33 0 0 25 0 5 0 596609210 659722240 123849 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591236 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=644260 CPUtime=819.1 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 36948 0 0 0 81866 44 0 0 25 0 5 0 596609213 659722240 123849 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=644260 CPUtime=822.17 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 32704 0 0 0 82182 35 0 0 25 0 5 0 596609214 659722240 123849 33554432000 4194304 5787044 140734895633120 18446744073709551615 5527610 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.23
Current children cumulated vsize (KiB) 652960

[startup+882.301 s]
/proc/loadavg: 8.11 8.09 8.02 9/188 28900
/proc/meminfo: memFree=13492060/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=657416 CPUtime=3523.91 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 145145 0 0 0 352249 142 0 0 18 0 5 0 596609207 673193984 129392 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 164354 129392 417 389 0 160104 0
[pid=28862/tid=28864] ppid=28861 vsize=657416 CPUtime=882.21 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 34287 0 0 0 88198 23 0 0 25 0 5 0 596609210 673193984 129392 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591543 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=657416 CPUtime=880.69 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 37195 0 0 0 88031 38 0 0 25 0 5 0 596609210 673193984 129392 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=657416 CPUtime=878.78 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 36949 0 0 0 87834 44 0 0 25 0 5 0 596609213 673193984 129392 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591511 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=657416 CPUtime=882.17 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 32738 0 0 0 88182 35 0 0 25 0 5 0 596609214 673193984 129392 33554432000 4194304 5787044 140734895633120 18446744073709551615 5527068 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3523.91
Current children cumulated vsize (KiB) 666116

[startup+942.301 s]
/proc/loadavg: 8.11 8.09 8.02 9/188 28902
/proc/meminfo: memFree=13445880/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=674516 CPUtime=3763.59 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 152035 0 0 0 376212 147 0 0 18 0 5 0 596609207 690704384 136057 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 168629 136057 417 389 0 164379 0
[pid=28862/tid=28864] ppid=28861 vsize=674516 CPUtime=942.21 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 37472 0 0 0 94196 25 0 0 25 0 5 0 596609210 690704384 136057 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=674516 CPUtime=940.68 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 40664 0 0 0 94028 40 0 0 25 0 5 0 596609210 690704384 136057 33554432000 4194304 5787044 140734895633120 18446744073709551615 4215360 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=674516 CPUtime=938.45 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 36951 0 0 0 93801 44 0 0 25 0 5 0 596609213 690704384 136057 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591526 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=674516 CPUtime=942.17 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 32972 0 0 0 94182 35 0 0 25 0 5 0 596609214 690704384 136057 33554432000 4194304 5787044 140734895633120 18446744073709551615 5527140 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3763.59
Current children cumulated vsize (KiB) 683216

[startup+1002.3 s]
/proc/loadavg: 8.10 8.08 8.02 9/188 28903
/proc/meminfo: memFree=13420412/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=685984 CPUtime=4003.23 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 154657 0 0 0 400175 148 0 0 18 0 5 0 596609207 702447616 138679 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 171496 138679 417 389 0 167246 0
[pid=28862/tid=28864] ppid=28861 vsize=685984 CPUtime=1002.21 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 39028 0 0 0 100195 26 0 0 25 0 5 0 596609210 702447616 138679 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591095 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=685984 CPUtime=1000.67 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 40664 0 0 0 100027 40 0 0 25 0 5 0 596609210 702447616 138679 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591623 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=685984 CPUtime=998.12 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 36959 0 0 0 99768 44 0 0 25 0 5 0 596609213 702447616 138679 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=685984 CPUtime=1002.17 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 34030 0 0 0 100181 36 0 0 25 0 5 0 596609214 702447616 138679 33554432000 4194304 5787044 140734895633120 18446744073709551615 5528404 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.23
Current children cumulated vsize (KiB) 694684

[startup+1062.31 s]
/proc/loadavg: 8.04 8.07 8.01 9/188 28938
/proc/meminfo: memFree=13927048/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=685984 CPUtime=4242.94 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 156555 0 0 0 424142 152 0 0 18 0 5 0 596609207 702447616 140577 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 171496 140577 417 389 0 167246 0
[pid=28862/tid=28864] ppid=28861 vsize=685984 CPUtime=1062.22 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 39029 0 0 0 106196 26 0 0 25 0 5 0 596609210 702447616 140577 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=685984 CPUtime=1060.67 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 40668 0 0 0 106027 40 0 0 25 0 5 0 596609210 702447616 140577 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591236 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=685984 CPUtime=1057.79 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 37017 0 0 0 105735 44 0 0 25 0 5 0 596609213 702447616 140577 33554432000 4194304 5787044 140734895633120 18446744073709551615 5590442 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=685984 CPUtime=1062.18 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 35865 0 0 0 106179 39 0 0 25 0 5 0 596609214 702447616 140577 33554432000 4194304 5787044 140734895633120 18446744073709551615 5528446 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4242.94
Current children cumulated vsize (KiB) 694684

[startup+1122.3 s]
/proc/loadavg: 8.01 8.05 8.01 9/188 28939
/proc/meminfo: memFree=13839484/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=690084 CPUtime=4482.58 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 160581 0 0 0 448100 158 0 0 18 0 5 0 596609207 706646016 144603 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 172521 144603 417 389 0 168271 0
[pid=28862/tid=28864] ppid=28861 vsize=690084 CPUtime=1122.21 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 39032 0 0 0 112195 26 0 0 25 0 5 0 596609210 706646016 144603 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591526 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=690084 CPUtime=1120.67 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 40670 0 0 0 112026 41 0 0 25 0 5 0 596609210 706646016 144603 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=690084 CPUtime=1117.47 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 39358 0 0 0 111699 48 0 0 25 0 5 0 596609213 706646016 144603 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=690084 CPUtime=1122.17 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 37545 0 0 0 112176 41 0 0 25 0 5 0 596609214 706646016 144603 33554432000 4194304 5787044 140734895633120 18446744073709551615 5528446 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4482.58
Current children cumulated vsize (KiB) 698784

[startup+1182.3 s]
/proc/loadavg: 8.00 8.04 8.00 9/188 28941
/proc/meminfo: memFree=13771860/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=759720 CPUtime=4722.24 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 165733 0 0 0 472060 164 0 0 18 0 5 0 596609207 777953280 149755 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 189930 149755 417 389 0 185680 0
[pid=28862/tid=28864] ppid=28861 vsize=759720 CPUtime=1182.21 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 39037 0 0 0 118195 26 0 0 25 0 5 0 596609210 777953280 149755 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=759720 CPUtime=1180.66 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 40685 0 0 0 118025 41 0 0 25 0 5 0 596609210 777953280 149755 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=759720 CPUtime=1177.14 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 41671 0 0 0 117663 51 0 0 25 0 5 0 596609213 777953280 149760 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=759720 CPUtime=1182.17 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 40369 0 0 0 118173 44 0 0 25 0 5 0 596609214 777953280 149760 33554432000 4194304 5787044 140734895633120 18446744073709551615 5546383 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.24
Current children cumulated vsize (KiB) 768420



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.00 8.04 8.00 9/188 28942
/proc/meminfo: memFree=13756352/32950928 swapFree=67111528/67111528
[pid=28861] ppid=28859 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/28861/stat : 28861 (priss.sh) S 28859 28861 28330 0 -1 4202496 332 0 0 0 0 0 0 0 25 0 1 0 596609207 8908800 252 33554432000 4194304 4922060 140733369129392 18446744073709551615 218880384133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/28861/statm: 2175 252 211 178 0 68 0
[pid=28862] ppid=28861 vsize=759720 CPUtime=4800.16 cores=0,2,4,6
/proc/28862/stat : 28862 (priss) S 28861 28861 28330 0 -1 4202496 167404 0 0 0 479851 165 0 0 18 0 5 0 596609207 777953280 151201 33554432000 4194304 5787044 140734895633120 18446744073709551615 218892388785 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/28862/statm: 189930 151201 417 389 0 185680 0
[pid=28862/tid=28864] ppid=28861 vsize=759720 CPUtime=1201.72 cores=0,2,4,6
/proc/28862/task/28864/stat : 28864 (priss) R 28861 28861 28330 0 -1 4202560 39041 0 0 0 120146 26 0 0 25 0 5 0 596609210 777953280 151201 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=28862/tid=28865] ppid=28861 vsize=759720 CPUtime=1200.17 cores=0,2,4,6
/proc/28862/task/28865/stat : 28865 (priss) R 28861 28861 28330 0 -1 4202560 40691 0 0 0 119976 41 0 0 25 0 5 0 596609210 777953280 151201 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=28862/tid=28866] ppid=28861 vsize=759720 CPUtime=1196.54 cores=0,2,4,6
/proc/28862/task/28866/stat : 28866 (priss) R 28861 28861 28330 0 -1 4202560 42421 0 0 0 119602 52 0 0 25 0 5 0 596609213 777953280 151201 33554432000 4194304 5787044 140734895633120 18446744073709551615 5591630 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=28862/tid=28867] ppid=28861 vsize=759720 CPUtime=1201.68 cores=0,2,4,6
/proc/28862/task/28867/stat : 28867 (priss) R 28861 28861 28330 0 -1 4202560 41275 0 0 0 120123 45 0 0 25 0 5 0 596609214 777953280 151201 33554432000 4194304 5787044 140734895633120 18446744073709551615 5522477 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 768420

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28861 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0
# while last known CPU time is 4800.16
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.82
CPU time (s): 4800.16
CPU user time (s): 4798.51
CPU system time (s): 1.65
CPU usage (%): 399.408
Max. virtual memory (cumulated for all children) (KiB): 768420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 332
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 2

runsolver used 1.87571 second user time and 4.68829 second system time

The end

Launcher Data 

Begin job on node112 at 2011-04-29 09:56:25
IDJOB=3262824
IDBENCH=83896
IDSOLVER=1603
FILE ID=node112/3262824-1304063785
RUNJOBID= node112-1304062780-28650
PBS_JOBID= 13170443
Free space on /tmp= 72560 MiB

SOLVER NAME= priss 1.0
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_27_50_3-dir.shuffled-as.sat03-169.cnf
COMMAND LINE= DIR/priss.sh DIR BENCHNAME RANDOMSEED TIMELIMIT MEMLIMIT NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262824-1304063785/watcher-3262824-1304063785 -o /tmp/evaluation-result-3262824-1304063785/solver-3262824-1304063785 -C 4800 -W 1300 -M 15500  HOME/priss.sh HOME HOME/instance-3262824-1304063785.cnf 1473979265 4800 15500 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b5a637600c242725f15a247a84bdea1b
RANDOM SEED=1473979265

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5261.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14353212 kB
Buffers:       1995464 kB
Cached:       15804448 kB
SwapCached:          0 kB
Active:        7284724 kB
Inactive:     10757264 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14353212 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2340 kB
Writeback:           0 kB
AnonPages:      241784 kB
Mapped:          15704 kB
Slab:           492448 kB
PageTables:       4912 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   429540 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72560 MiB
End job on node112 at 2011-04-29 10:16:29