Trace number 333450

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
KCNFS SMPSAT 374.06 187.599

General information on the benchmark

Namecrafted/Medium/contest05/jarvisalo/
mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.cnf
MD5SUMce96de70272a2ecfcbbf1c8e965c8e57
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.010997
Satisfiable
(Un)Satisfiability was proved
Number of variables220
Number of clauses880
Sum of the clauses size2640
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3880
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	
0.00/0.00	c Computed by /tmp/evaluation/333450-1173516139/kcnfs-smp   V. 1.2
0.00/0.00	c reading file ... done
0.00/0.00	c Input file : '/tmp/evaluation/333450-1173516139/instance-333450-1173516139.cnf'
0.00/0.00	c [#vars: 220, #clauses: 880 -> 977 clauses (pre-processing), tautology: 0, 3-CNF]
0.00/0.00	c unit clauses propagate before processing (#clause: 976)
0.00/0.00	c estimated distribution: 8 tasks
0.00/0.01	c <22904> [PID]: 22906 22907 22908 22909 22910 22911 22912
0.00/0.50	c <22904> [PID]: 22913
0.00/0.50	c real distribution: 8 tasks
374.06/187.59	c <22904> [22910: SAT]
374.06/187.59	c <22904> [END]: 22906 22907 22908 22909 22911 22912 22913
374.06/187.59	s SATISFIABLE
374.06/187.59	v       -1        2        3       -4       -5       -6        7
374.06/187.59	v        8        9      -10       11       12       13      -14
374.06/187.59	v      -15      -16      -17      -18       19      -20      -21
374.06/187.59	v       22       23      -24       25       26       27      -28
374.06/187.59	v       29       30       31      -32       33      -34       35
374.06/187.59	v       36       37      -38       39       40      -41      -42
374.06/187.59	v      -43       44      -45      -46       47       48       49
374.06/187.59	v       50       51      -52       53       54      -55       56
374.06/187.59	v      -57       58       59       60      -61      -62      -63
374.06/187.59	v      -64      -65      -66      -67       68      -69      -70
374.06/187.59	v      -71       72       73       74       75      -76       77
374.06/187.59	v       78      -79      -80       81      -82      -83      -84
374.06/187.59	v      -85       86      -87       88      -89      -90      -91
374.06/187.59	v       92       93       94       95      -96       97       98
374.06/187.59	v       99      100      101      102     -103      104      105
374.06/187.59	v     -106     -107      108     -109      110     -111     -112
374.06/187.59	v     -113     -114      115     -116      117     -118      119
374.06/187.59	v      120     -121     -122      123     -124      125     -126
374.06/187.59	v     -127     -128      129      130     -131      132      133
374.06/187.59	v      134     -135     -136      137     -138     -139      140
374.06/187.59	v     -141     -142      143      144     -145     -146     -147
374.06/187.59	v     -148     -149      150      151      152     -153     -154
374.06/187.59	v     -155     -156     -157      158      159     -160     -161
374.06/187.59	v     -162     -163      164     -165      166      167      168
374.06/187.59	v      169     -170      171      172      173      174     -175
374.06/187.59	v      176      177      178     -179      180     -181     -182
374.06/187.59	v      183     -184     -185      186      187     -188      189
374.06/187.59	v      190     -191      192      193      194     -195     -196
374.06/187.59	v     -197      198      199      200      201      202     -203
374.06/187.59	v     -204     -205     -206     -207     -208      209      210
374.06/187.59	v      211     -212      213     -214     -215      216      217
374.06/187.59	v     -218     -219     -220        0
374.06/187.59	c CPU time            : 46.520 seconds
374.06/187.59	c Elapsed Time        : 187.596 seconds
374.06/187.59	c Size of search tree : 185892 nodes
374.06/187.59	c average speed       : 3995.959 nodes/sec.
374.06/187.59	

Verifier Data (download as text)

OK

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node17/watcher-333450-1173516139 -o ROOT/results/node17/solver-333450-1173516139 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/333450-1173516139/kcnfs-smp /tmp/evaluation/333450-1173516139/instance-333450-1173516139.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 22904
/proc/meminfo: memFree=1381304/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=181848 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) R 22902 22904 21516 0 -1 4194304 113 0 0 0 0 0 0 0 18 0 1 0 371568157 186212352 97 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/22904/statm: 45462 97 51 160 0 45300 0

[startup+0.0819309 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 22904
/proc/meminfo: memFree=1381304/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) R 22902 22904 21516 0 -1 4194304 314 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 182316

[startup+0.101932 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 22904
/proc/meminfo: memFree=1381304/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) R 22902 22904 21516 0 -1 4194304 314 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 182316

[startup+0.301953 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 22904
/proc/meminfo: memFree=1381304/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) R 22902 22904 21516 0 -1 4194304 314 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836899 0 0 4096 0 0 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 182316

[startup+0.701995 s]
/proc/loadavg: 0.91 0.98 0.99 3/77 22904
/proc/meminfo: memFree=1381304/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 182316

[startup+1.50208 s]
/proc/loadavg: 0.91 0.98 0.99 9/86 22913
/proc/meminfo: memFree=1379056/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=0.64
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 64 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572856 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=0.42
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 42 0 0 0 24 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572179 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=0.35
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 35 0 0 0 24 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572893 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=0.4
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 40 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134636465 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=182316 CPUtime=0.3
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 30 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572850 0 0 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 45579 177 70 160 0 45417 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=0.39
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 39 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134639232 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=0.2
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 20 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577649 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=0.24
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 24 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577417 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 2.94
Current children cumulated vsize (KiB) 1640844

[startup+3.10125 s]
/proc/loadavg: 0.91 0.98 0.99 9/86 22913
/proc/meminfo: memFree=1378672/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=0.98
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 98 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572655 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=0.82
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 82 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577090 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=0.81
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 81 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579685 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=0.8
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 80 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134639232 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=182316 CPUtime=0.7
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 70 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567281 0 0 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 45579 177 70 160 0 45417 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=0.78
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 78 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572655 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=0.6
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 60 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134633583 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=0.64
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 64 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572863 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 6.13
Current children cumulated vsize (KiB) 1640844

[startup+6.30258 s]
/proc/loadavg: 1.48 1.10 1.03 9/86 22913
/proc/meminfo: memFree=1378544/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=1.78
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 178 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572949 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=1.62
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 162 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577653 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=1.61
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 161 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577454 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=1.6
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 160 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567243 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=182316 CPUtime=1.5
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 150 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134633783 0 0 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 45579 177 70 160 0 45417 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=1.57
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 157 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567218 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=1.4
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 140 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=1.44
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 144 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572642 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 12.52
Current children cumulated vsize (KiB) 1640844

[startup+12.7012 s]
/proc/loadavg: 2.00 1.21 1.06 9/86 22913
/proc/meminfo: memFree=1378480/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=3.38
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 338 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567466 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=3.22
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 322 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640134 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=3.21
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 321 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572907 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=3.2
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 320 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134569781 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=182316 CPUtime=3.1
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 310 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134589840 0 0 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 45579 177 70 160 0 45417 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=3.13
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 313 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=3
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 300 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572655 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=3.04
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 304 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567570 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 25.28
Current children cumulated vsize (KiB) 1640844

[startup+25.5026 s]
/proc/loadavg: 3.41 1.56 1.18 9/86 22913
/proc/meminfo: memFree=1378544/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=6.58
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 658 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572638 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=6.42
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 642 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572122 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0

################
# More data... #
################

[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=45.76
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 4576 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683183 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=45.61
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4561 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134636621 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=45.6
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4560 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640239 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=45.39
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4539 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=182316 CPUtime=45.49
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4549 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640292 0 0 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 45579 177 70 160 0 45417 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=45.39
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4539 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572727 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=45.2
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4520 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567636 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=45.24
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4524 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572092 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 363.68
Current children cumulated vsize (KiB) 1640844

[startup+185.502 s]
/proc/loadavg: 7.68 4.23 2.25 9/86 22915
/proc/meminfo: memFree=1378480/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=46.56
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 4656 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580638 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=46.41
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4641 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640190 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=46.4
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4640 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640292 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=46.19
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4619 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683130 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=182316 CPUtime=46.29
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4629 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579695 0 0 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 45579 177 70 160 0 45417 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=46.19
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4619 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577479 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=45.99
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4599 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640211 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=46.04
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4604 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572863 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 370.07
Current children cumulated vsize (KiB) 1640844

[startup+186.302 s]
/proc/loadavg: 7.68 4.23 2.25 9/86 22915
/proc/meminfo: memFree=1378480/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=46.76
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 4676 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134569510 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=46.61
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4661 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577108 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=46.6
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4660 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572698 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=46.39
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4639 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580239 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=182316 CPUtime=46.49
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4649 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134683195 0 0 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 45579 177 70 160 0 45417 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=46.39
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4639 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572243 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=46.19
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4619 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134589621 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=46.24
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4624 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567258 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 371.67
Current children cumulated vsize (KiB) 1640844

[startup+187.102 s]
/proc/loadavg: 7.68 4.23 2.25 9/86 22915
/proc/meminfo: memFree=1378480/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=47.03
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 4703 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580020 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=46.91
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4691 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134639317 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=46.8
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4680 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577605 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=46.59
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4659 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572080 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=0 CPUtime=46.51
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194372 38 0 0 0 4651 0 0 0 25 0 1 0 371568163 0 0 18446744073709551615 0 0 0 0 0 0 2147483391 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 0 0 0 0 0 0 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=46.58
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4658 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134640563 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=46.39
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4639 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134639317 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=46.44
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4644 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572286 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 373.25
Current children cumulated vsize (KiB) 1458528

[startup+187.502 s]
/proc/loadavg: 7.68 4.23 2.25 9/86 22915
/proc/meminfo: memFree=1378480/2055920 swapFree=4168576/4192956
[pid=22904] ppid=22902 vsize=182316 CPUtime=0
/proc/22904/stat : 22904 (kcnfs-smp) S 22902 22904 21516 0 -1 4194304 337 0 0 0 0 0 0 0 24 0 1 0 371568157 186691584 172 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/22904/statm: 45579 172 69 160 0 45417 0
[pid=22906] ppid=22904 vsize=182316 CPUtime=47.14
/proc/22906/stat : 22906 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 30 0 0 0 4714 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567303 0 0 4096 2 0 0 0 17 1 0 0
/proc/22906/statm: 45579 177 70 160 0 45417 0
[pid=22907] ppid=22904 vsize=182316 CPUtime=47.01
/proc/22907/stat : 22907 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4701 0 0 0 25 0 1 0 371568158 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567265 0 0 4096 0 0 0 0 17 1 0 0
/proc/22907/statm: 45579 177 70 160 0 45417 0
[pid=22908] ppid=22904 vsize=182316 CPUtime=47
/proc/22908/stat : 22908 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4700 0 0 0 25 0 1 0 371568161 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134578165 0 0 4096 2 0 0 0 17 1 0 0
/proc/22908/statm: 45579 177 70 160 0 45417 0
[pid=22909] ppid=22904 vsize=182316 CPUtime=46.69
/proc/22909/stat : 22909 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4669 0 0 0 25 0 1 0 371568162 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577430 0 0 4096 0 0 0 0 17 0 0 0
/proc/22909/statm: 45579 177 70 160 0 45417 0
[pid=22910] ppid=22904 vsize=0 CPUtime=46.51
/proc/22910/stat : 22910 (kcnfs-smp) R 22904 22904 21516 0 -1 4194372 38 0 0 0 4651 0 0 0 25 0 1 0 371568163 0 0 18446744073709551615 0 0 0 0 0 0 2147483391 4096 2 0 0 0 17 1 0 0
/proc/22910/statm: 0 0 0 0 0 0 0
[pid=22911] ppid=22904 vsize=182316 CPUtime=46.68
/proc/22911/stat : 22911 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4668 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577536 0 0 4096 0 0 0 0 17 0 0 0
/proc/22911/statm: 45579 177 70 160 0 45417 0
[pid=22912] ppid=22904 vsize=182316 CPUtime=46.49
/proc/22912/stat : 22912 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4649 0 0 0 25 0 1 0 371568163 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134634774 0 0 4096 2 0 0 0 17 0 0 0
/proc/22912/statm: 45579 177 70 160 0 45417 0
[pid=22913] ppid=22904 vsize=182316 CPUtime=46.54
/proc/22913/stat : 22913 (kcnfs-smp) R 22904 22904 21516 0 -1 4194368 29 0 0 0 4654 0 0 0 25 0 1 0 371568203 186691584 177 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/22913/statm: 45579 177 70 160 0 45417 0
Current children cumulated CPU time (s) 374.06
Current children cumulated vsize (KiB) 1458528

Child status: 10

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 22904 and gives childrusage.ru_utime.tv_sec=46 childrusage.ru_utime.tv_usec=521927 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=1999
CPU time returned by wait4() is 46.5239
while last known CPU time is 374.06

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 187.599
CPU time (s): 374.06
CPU user time (s): 374.06
CPU system time (s): 0
CPU usage (%): 199.393
Max. virtual memory (cumulated for all children) (KiB): 1640844

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 46.5219
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 395
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 530

runsolver used 0.171973 second user time and 0.52592 second system time

The end

Launcher Data (download as text)

Begin job on node17 on Sat Mar 10 08:42:19 UTC 2007

IDJOB= 333450
IDBENCH= 24604
IDSOLVER= 112
FILE ID= node17/333450-1173516139

PBS_JOBID= 4101123

Free space on /tmp= 66531 MiB

SOLVER NAME= KCNFS SMP
BENCH NAME= HOME/pub/bench/SAT07/crafted/Medium/contest05/jarvisalo/mod2-rand3bip-sat-220-1.sat05-2173.reshuffled-07.cnf
COMMAND LINE= /tmp/evaluation/333450-1173516139/kcnfs-smp /tmp/evaluation/333450-1173516139/instance-333450-1173516139.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node17/watcher-333450-1173516139 -o ROOT/results/node17/solver-333450-1173516139 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/333450-1173516139/kcnfs-smp /tmp/evaluation/333450-1173516139/instance-333450-1173516139.cnf            

META MD5SUM SOLVER= 23f87ccf1c743ff5b6146b444e216cd3
MD5SUM BENCH=  ce96de70272a2ecfcbbf1c8e965c8e57

RANDOM SEED= 339758785

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node17.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.229
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.229
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1381712 kB
Buffers:         51568 kB
Cached:         528340 kB
SwapCached:       2172 kB
Active:         293260 kB
Inactive:       309216 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1381712 kB
SwapTotal:     4192956 kB
SwapFree:      4168576 kB
Dirty:            3272 kB
Writeback:           0 kB
Mapped:          30352 kB
Slab:            57324 kB
Committed_AS:  1446588 kB
PageTables:       1748 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66531 MiB

End job on node17 on Sat Mar 10 08:45:27 UTC 2007