Trace number 330336

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
KCNFS SMP? (TO) 1200.08 602.119

General information on the benchmark

Nameindustrial/IBM_FV_2004_30/
IBM_FV_2004_rule_batch_30_SAT_dat.k20.cnf
MD5SUM42009d0a86b074043b8da4b9e8720c85
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables39544
Number of clauses163269
Sum of the clauses size415841
Maximum clause length12
Minimum clause length1
Number of clauses of size 12072
Number of clauses of size 2114940
Number of clauses of size 330226
Number of clauses of size 45754
Number of clauses of size 53259
Number of clauses of size over 57018

Solver Data (download as text)

0.00/0.00	
0.00/0.00	c Computed by /tmp/evaluation/330336-1173162697/kcnfs-smp   V. 1.2
0.00/0.00	c reading file ... done
0.29/0.34	c Input file : '/tmp/evaluation/330336-1173162697/instance-330336-1173162697.cnf'
0.29/0.34	c [#vars: 39544, #clauses: 163269 , (1-12)-CNF]
0.39/0.49	c unit clauses propagate before processing (#clause: 133718)
0.39/0.49	c estimated distribution: 8 tasks
0.49/0.57	c [PID]: 29915 29916 29917 29918 29919 29920 29921
3.01/2.08	c [PID]: 29922
3.01/2.08	c real distribution: 8 tasks

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node72/watcher-330336-1173162697 -o ROOT/results/node72/solver-330336-1173162697 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/330336-1173162697/kcnfs-smp /tmp/evaluation/330336-1173162697/instance-330336-1173162697.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.97 0.99 3/77 29913
/proc/meminfo: memFree=1042664/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=180784 CPUtime=0
/proc/29913/stat : 29913 (kcnfs-smp) R 29911 29913 29552 0 -1 4194304 66 0 0 0 0 0 0 0 18 0 1 0 336237488 185122816 51 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134841789 0 0 4096 0 0 0 0 17 1 0 0
/proc/29913/statm: 45196 51 43 160 0 45034 0

[startup+0.0653551 s]
/proc/loadavg: 0.99 0.97 0.99 3/77 29913
/proc/meminfo: memFree=1042664/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=180784 CPUtime=0.06
/proc/29913/stat : 29913 (kcnfs-smp) R 29911 29913 29552 0 -1 4194304 66 0 0 0 6 0 0 0 18 0 1 0 336237488 185122816 51 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134841789 0 0 4096 0 0 0 0 17 1 0 0
/proc/29913/statm: 45196 51 43 160 0 45034 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 180784

[startup+0.101358 s]
/proc/loadavg: 0.99 0.97 0.99 3/77 29913
/proc/meminfo: memFree=1042664/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=182764 CPUtime=0.09
/proc/29913/stat : 29913 (kcnfs-smp) R 29911 29913 29552 0 -1 4194304 586 0 0 0 9 0 0 0 18 0 1 0 336237488 187150336 571 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/29913/statm: 45691 571 48 160 0 45529 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 182764

[startup+0.301376 s]
/proc/loadavg: 0.99 0.97 0.99 3/77 29913
/proc/meminfo: memFree=1042664/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=193720 CPUtime=0.29
/proc/29913/stat : 29913 (kcnfs-smp) R 29911 29913 29552 0 -1 4194304 3309 0 0 0 28 1 0 0 19 0 1 0 336237488 198369280 3294 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/29913/statm: 48430 3295 48 160 0 48268 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 193720

[startup+0.701431 s]
/proc/loadavg: 0.99 0.97 0.99 3/77 29913
/proc/meminfo: memFree=1042664/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.63
/proc/29913/stat : 29913 (kcnfs-smp) R 29911 29913 29552 0 -1 4194304 17520 0 0 0 55 8 0 0 25 0 1 0 336237488 207826944 13390 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 0 0 0
/proc/29913/statm: 50739 13390 66 160 0 50577 0
Current children cumulated CPU time (s) 0.63
Current children cumulated vsize (KiB) 202956

[startup+1.5025 s]
/proc/loadavg: 1.15 1.00 1.01 6/82 29918
/proc/meminfo: memFree=957184/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.77
/proc/29913/stat : 29913 (kcnfs-smp) R 29911 29913 29552 0 -1 4194304 22878 0 0 0 65 12 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720428 0 0 4096 0 0 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=0.7
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2256 0 0 0 70 0 0 0 25 0 1 0 336237546 207826944 13494 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567202 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13494 67 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=0.44
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2259 0 0 0 43 1 0 0 25 0 1 0 336237549 207826944 13511 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13511 66 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=0.24
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2099 0 0 0 22 2 0 0 25 0 1 0 336237568 207826944 13418 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134708968 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13418 67 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=0.2
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2076 0 0 0 19 1 0 0 25 0 1 0 336237575 207826944 13407 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13407 66 160 0 50577 0
Current children cumulated CPU time (s) 2.35
Current children cumulated vsize (KiB) 1014780

[startup+3.10265 s]
/proc/loadavg: 1.15 1.00 1.01 9/86 29922
/proc/meminfo: memFree=925144/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=1.11
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2367 0 0 0 111 0 0 0 25 0 1 0 336237546 207826944 13587 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720296 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13587 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=0.93
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2372 0 0 0 92 1 0 0 25 0 1 0 336237549 207826944 13562 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13562 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=0.74
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2261 0 0 0 72 2 0 0 25 0 1 0 336237568 207826944 13496 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13496 67 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=0.6
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2212 0 0 0 59 1 0 0 25 0 1 0 336237575 207826944 13466 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134692459 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13466 66 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=0.5
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2301 0 0 0 49 1 0 0 25 0 1 0 336237616 207826944 13534 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720348 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13534 68 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=0.34
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2215 0 0 0 32 2 0 0 25 0 1 0 336237650 207826944 13488 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579685 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13488 67 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=0.24
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2095 0 0 0 22 2 0 0 25 0 1 0 336237689 207826944 13421 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572623 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13421 66 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=0.2
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2092 0 0 0 19 1 0 0 25 0 1 0 336237696 207826944 13417 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720296 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13417 66 160 0 50577 0
Current children cumulated CPU time (s) 5.52
Current children cumulated vsize (KiB) 1826604

[startup+6.30295 s]
/proc/loadavg: 1.15 1.00 1.01 9/86 29922
/proc/meminfo: memFree=911704/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=1.91
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2378 0 0 0 191 0 0 0 25 0 1 0 336237546 207826944 13595 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720312 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13595 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=1.74
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2387 0 0 0 172 2 0 0 25 0 1 0 336237549 207826944 13562 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720418 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13562 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=1.54
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2331 0 0 0 152 2 0 0 25 0 1 0 336237568 207826944 13554 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572623 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13554 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=1.4
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2379 0 0 0 139 1 0 0 25 0 1 0 336237575 207826944 13568 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579720 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13568 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=1.29
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2392 0 0 0 128 1 0 0 25 0 1 0 336237616 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13574 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=1.13
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2391 0 0 0 111 2 0 0 25 0 1 0 336237650 207826944 13572 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13572 69 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=1.04
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2333 0 0 0 102 2 0 0 25 0 1 0 336237689 207826944 13550 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572834 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13550 69 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=1
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2373 0 0 0 99 1 0 0 25 0 1 0 336237696 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572846 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13576 69 160 0 50577 0
Current children cumulated CPU time (s) 11.91
Current children cumulated vsize (KiB) 1826604

[startup+12.7015 s]
/proc/loadavg: 2.21 1.23 1.08 9/86 29922
/proc/meminfo: memFree=910552/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=3.51
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2379 0 0 0 351 0 0 0 25 0 1 0 336237546 207826944 13595 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720322 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13595 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=3.34
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2387 0 0 0 332 2 0 0 25 0 1 0 336237549 207826944 13562 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720241 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13562 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=3.14
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2345 0 0 0 312 2 0 0 25 0 1 0 336237568 207826944 13562 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134572261 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13562 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=3
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2392 0 0 0 299 1 0 0 25 0 1 0 336237575 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580198 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13574 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=2.86
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2395 0 0 0 285 1 0 0 25 0 1 0 336237616 207826944 13575 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720364 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13575 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=2.73
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2391 0 0 0 271 2 0 0 25 0 1 0 336237650 207826944 13572 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720380 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13572 69 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=2.64
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2395 0 0 0 262 2 0 0 25 0 1 0 336237689 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13574 69 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=2.6
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2430 0 0 0 259 1 0 0 25 0 1 0 336237696 207826944 13586 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13586 69 160 0 50577 0
Current children cumulated CPU time (s) 24.68
Current children cumulated vsize (KiB) 1826604

[startup+25.5027 s]
/proc/loadavg: 3.10 1.46 1.15 9/86 29922
/proc/meminfo: memFree=910296/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=6.71
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2380 0 0 0 671 0 0 0 25 0 1 0 336237546 207826944 13596 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13596 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=6.54
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2408 0 0 0 652 2 0 0 25 0 1 0 336237549 207826944 13572 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720286 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13572 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=6.33
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2362 0 0 0 631 2 0 0 25 0 1 0 336237568 207826944 13564 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13564 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=6.19
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2393 0 0 0 618 1 0 0 25 0 1 0 336237575 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720408 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13574 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=6
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2395 0 0 0 599 1 0 0 25 0 1 0 336237616 207826944 13575 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720238 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13575 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=5.93
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2392 0 0 0 591 2 0 0 25 0 1 0 336237650 207826944 13572 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720354 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13572 69 160 0 50577 0

################
# More data... #
################

[pid=29917] ppid=29913 vsize=202956 CPUtime=115.48
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2371 0 0 0 11546 2 0 0 25 0 1 0 336237568 207826944 13570 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720428 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13570 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=114.79
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2410 0 0 0 11477 2 0 0 25 0 1 0 336237575 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13574 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=114.63
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2396 0 0 0 11462 1 0 0 25 0 1 0 336237616 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720428 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13576 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=114.51
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2392 0 0 0 11449 2 0 0 25 0 1 0 336237650 207826944 13572 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134708968 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13572 69 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=114.42
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2403 0 0 0 11440 2 0 0 25 0 1 0 336237689 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720408 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13576 69 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=114.98
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2484 0 0 0 11497 1 0 0 25 0 1 0 336237696 207826944 13589 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720251 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13589 69 160 0 50577 0
Current children cumulated CPU time (s) 921.28
Current children cumulated vsize (KiB) 1826604

[startup+522.302 s]
/proc/loadavg: 8.16 6.86 4.02 9/86 29923
/proc/meminfo: memFree=909784/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=130.89
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2423 0 0 0 13088 1 0 0 25 0 1 0 336237546 207826944 13601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579685 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13601 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=130.71
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2415 0 0 0 13069 2 0 0 25 0 1 0 336237549 207826944 13573 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580056 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13573 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=130.47
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2371 0 0 0 13045 2 0 0 25 0 1 0 336237568 207826944 13570 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720657 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13570 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=129.68
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2410 0 0 0 12966 2 0 0 25 0 1 0 336237575 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567604 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13574 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=129.58
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2396 0 0 0 12957 1 0 0 25 0 1 0 336237616 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720398 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13576 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=129.44
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2392 0 0 0 12942 2 0 0 25 0 1 0 336237650 207826944 13572 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720251 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13572 69 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=129.31
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2403 0 0 0 12929 2 0 0 25 0 1 0 336237689 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720428 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13576 69 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=129.98
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2489 0 0 0 12996 2 0 0 25 0 1 0 336237696 207826944 13594 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13594 69 160 0 50577 0
Current children cumulated CPU time (s) 1040.92
Current children cumulated vsize (KiB) 1826604

[startup+582.303 s]
/proc/loadavg: 8.06 7.06 4.27 9/86 29924
/proc/meminfo: memFree=909784/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=145.88
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2425 0 0 0 14587 1 0 0 25 0 1 0 336237546 207826944 13601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134708968 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13601 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=145.71
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2415 0 0 0 14569 2 0 0 25 0 1 0 336237549 207826944 13573 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134567455 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13573 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=145.46
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2371 0 0 0 14544 2 0 0 25 0 1 0 336237568 207826944 13570 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134580256 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13570 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=144.58
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2410 0 0 0 14456 2 0 0 25 0 1 0 336237575 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134708968 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13574 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=144.47
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2396 0 0 0 14446 1 0 0 25 0 1 0 336237616 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134577693 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13576 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=144.41
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2397 0 0 0 14438 3 0 0 25 0 1 0 336237650 207826944 13573 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13573 69 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=144.22
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2403 0 0 0 14420 2 0 0 25 0 1 0 336237689 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579723 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13576 69 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=144.98
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2489 0 0 0 14496 2 0 0 25 0 1 0 336237696 207826944 13594 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134610434 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13594 69 160 0 50577 0
Current children cumulated CPU time (s) 1160.57
Current children cumulated vsize (KiB) 1826604



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+602.102 s]
/proc/loadavg: 8.04 7.12 4.35 9/86 29924
/proc/meminfo: memFree=909784/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=150.88
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2425 0 0 0 15087 1 0 0 25 0 1 0 336237546 207826944 13601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13601 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=150.61
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2418 0 0 0 15059 2 0 0 25 0 1 0 336237549 207826944 13573 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720328 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13573 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=150.41
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2371 0 0 0 15039 2 0 0 25 0 1 0 336237568 207826944 13570 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720364 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13570 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=149.48
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2410 0 0 0 14946 2 0 0 25 0 1 0 336237575 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13574 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=149.38
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2396 0 0 0 14936 2 0 0 25 0 1 0 336237616 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720312 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13576 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=149.31
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2397 0 0 0 14928 3 0 0 25 0 1 0 336237650 207826944 13573 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13573 69 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=149.21
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2403 0 0 0 14919 2 0 0 25 0 1 0 336237689 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13576 69 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=149.94
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2489 0 0 0 14992 2 0 0 25 0 1 0 336237696 207826944 13594 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579685 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13594 69 160 0 50577 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 1826604

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+602.102 s]
/proc/loadavg: 8.04 7.12 4.35 9/86 29924
/proc/meminfo: memFree=909784/2055920 swapFree=4152568/4192956
[pid=29913] ppid=29911 vsize=202956 CPUtime=0.86
/proc/29913/stat : 29913 (kcnfs-smp) S 29911 29913 29552 0 -1 4194304 27650 0 0 0 72 14 0 0 25 0 1 0 336237488 207826944 13392 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/29913/statm: 50739 13392 66 160 0 50577 0
[pid=29915] ppid=29913 vsize=202956 CPUtime=150.88
/proc/29915/stat : 29915 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2425 0 0 0 15087 1 0 0 25 0 1 0 336237546 207826944 13601 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720583 0 0 4096 2 0 0 0 17 1 0 0
/proc/29915/statm: 50739 13601 69 160 0 50577 0
[pid=29916] ppid=29913 vsize=202956 CPUtime=150.61
/proc/29916/stat : 29916 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2418 0 0 0 15059 2 0 0 25 0 1 0 336237549 207826944 13573 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720328 0 0 4096 0 0 0 0 17 1 0 0
/proc/29916/statm: 50739 13573 69 160 0 50577 0
[pid=29917] ppid=29913 vsize=202956 CPUtime=150.41
/proc/29917/stat : 29917 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2371 0 0 0 15039 2 0 0 25 0 1 0 336237568 207826944 13570 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720364 0 0 4096 2 0 0 0 17 1 0 0
/proc/29917/statm: 50739 13570 69 160 0 50577 0
[pid=29918] ppid=29913 vsize=202956 CPUtime=149.48
/proc/29918/stat : 29918 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2410 0 0 0 14946 2 0 0 25 0 1 0 336237575 207826944 13574 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/29918/statm: 50739 13574 69 160 0 50577 0
[pid=29919] ppid=29913 vsize=202956 CPUtime=149.38
/proc/29919/stat : 29919 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2396 0 0 0 14936 2 0 0 25 0 1 0 336237616 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720312 0 0 4096 2 0 0 0 17 0 0 0
/proc/29919/statm: 50739 13576 69 160 0 50577 0
[pid=29920] ppid=29913 vsize=202956 CPUtime=149.31
/proc/29920/stat : 29920 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2397 0 0 0 14928 3 0 0 25 0 1 0 336237650 207826944 13573 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720673 0 0 4096 0 0 0 0 17 0 0 0
/proc/29920/statm: 50739 13573 69 160 0 50577 0
[pid=29921] ppid=29913 vsize=202956 CPUtime=149.21
/proc/29921/stat : 29921 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2403 0 0 0 14919 2 0 0 25 0 1 0 336237689 207826944 13576 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134720519 0 0 4096 2 0 0 0 17 0 0 0
/proc/29921/statm: 50739 13576 69 160 0 50577 0
[pid=29922] ppid=29913 vsize=202956 CPUtime=149.94
/proc/29922/stat : 29922 (kcnfs-smp) R 29913 29913 29552 0 -1 4194368 2489 0 0 0 14992 2 0 0 25 0 1 0 336237696 207826944 13594 18446744073709551615 134512640 135172044 4294956704 18446744073709551615 134579685 0 0 4096 0 0 0 0 17 1 0 0
/proc/29922/statm: 50739 13594 69 160 0 50577 0
Current children cumulated CPU time (s) 1200.08
Current children cumulated vsize (KiB) 1826604

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 29913 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=728889 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=149977
CPU time returned by wait4() is 0.878866
while last known CPU time is 1200.08

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 602.119
CPU time (s): 1200.08
CPU user time (s): 1199.78
CPU system time (s): 0.3
CPU usage (%): 199.309
Max. virtual memory (cumulated for all children) (KiB): 1826604

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.728889
system time used= 0.149977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27650
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 38

runsolver used 0.725889 second user time and 2.05069 second system time

The end

Launcher Data (download as text)

Begin job on node72 on Tue Mar  6 06:31:37 UTC 2007

IDJOB= 330336
IDBENCH= 20561
IDSOLVER= 112
FILE ID= node72/330336-1173162697

PBS_JOBID= 4015240

Free space on /tmp= 66443 MiB

SOLVER NAME= KCNFS SMP
BENCH NAME= HOME/pub/bench/SAT07/industrial/IBM_FV_2004_30/IBM_FV_2004_rule_batch_30_SAT_dat.k20.cnf
COMMAND LINE= /tmp/evaluation/330336-1173162697/kcnfs-smp /tmp/evaluation/330336-1173162697/instance-330336-1173162697.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node72/watcher-330336-1173162697 -o ROOT/results/node72/solver-330336-1173162697 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/330336-1173162697/kcnfs-smp /tmp/evaluation/330336-1173162697/instance-330336-1173162697.cnf            

META MD5SUM SOLVER= 23f87ccf1c743ff5b6146b444e216cd3
MD5SUM BENCH=  42009d0a86b074043b8da4b9e8720c85

RANDOM SEED= 25910453

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node72.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1043072 kB
Buffers:         46316 kB
Cached:         853552 kB
SwapCached:       8272 kB
Active:         178712 kB
Inactive:       758200 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1043072 kB
SwapTotal:     4192956 kB
SwapFree:      4152568 kB
Dirty:            6888 kB
Writeback:           0 kB
Mapped:          44108 kB
Slab:            61576 kB
Committed_AS: 10510844 kB
PageTables:       1716 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66443 MiB

End job on node72 on Tue Mar  6 06:41:41 UTC 2007