Trace number 332051

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT4J JVM PARAM CHANGED SAT 2007? (TO) 1200.16 1199.16

General information on the benchmark

Nameindustrial/IBM_FV_2004_30/
IBM_FV_2004_rule_batch_30_SAT_dat.k85.cnf
MD5SUMe2ab53f07158137fdccdce6798b16e56
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark680.601
Satisfiable
(Un)Satisfiability was proved
Number of variables175524
Number of clauses730199
Sum of the clauses size1873791
Maximum clause length12
Minimum clause length1
Number of clauses of size 12072
Number of clauses of size 2518005
Number of clauses of size 3137216
Number of clauses of size 426034
Number of clauses of size 514829
Number of clauses of size over 532043

Solver Data (download as text)

0.08/0.14	c SAT4J: a SATisfiability library for Java (c) 2004-2006 Daniel Le Berre
0.08/0.14	c This is free software under the GNU LGPL licence. See www.sat4j.org for details.
0.08/0.14	c This software uses some libraries from the Jakarta project. See jakarta.apache.org for details.
0.08/0.15	c version SAT COMPETITION 2007
0.08/0.15	c sun.arch.data.model	32
0.08/0.15	c java.version	1.6.0
0.08/0.15	c os.name	Linux
0.08/0.15	c os.version	2.6.9-22.EL.rootsmp
0.08/0.15	c os.arch	i386
0.08/0.15	c Free memory 1651659224
0.08/0.15	c Max memory 1654456320
0.08/0.15	c Total memory 1654456320
0.08/0.15	c Number of processors 2
0.19/0.20	c --- Begin Solver configuration ---
0.19/0.20	c Stops conflict analysis at the first Unique Implication Point
0.19/0.20	c org.sat4j.minisat.constraints.MixedDataStructureDaniel@15cda3f
0.19/0.20	c Limit learning to clauses of size smaller or equal to 10% of the number of variables
0.19/0.20	c claDecay=0.999 varDecay=0.95 conflictBoundIncFactor=1.5 initConflictBound=100 
0.19/0.20	c VSIDS like heuristics from MiniSAT using a heap
0.19/0.20	c Expensive reason simplification
0.19/0.20	c --- End Solver configuration ---
0.19/0.20	c timeout: 2147483s
0.19/0.20	c solving /tmp/evaluation/332051-1173366484/instance-332051-1173366484.cnf
0.19/0.20	c reading problem ... 
2.60/2.53	c ... done. Wall clock time 2.329s.
2.60/2.53	c CPU time (experimental) 2.41s.
2.60/2.53	c #vars     175524
2.60/2.53	c #constraints  720762
1200.09/1199.11	c starts		: 19
1200.09/1199.11	c conflicts		: 333111
1200.09/1199.11	c decisions		: 753044
1200.09/1199.11	c propagations		: 503147455
1200.09/1199.11	c inspects		: 2112170784
1200.09/1199.11	c learnt literals	: 50
1200.09/1199.11	c learnt binary clauses	: 5392
1200.09/1199.11	c learnt ternary clauses	: 9024
1200.09/1199.11	c learnt clauses	: 333061
1200.09/1199.11	c root simplifications	: 0
1200.09/1199.11	c removed literals (reason simplification)	: 16317113
1200.09/1199.11	c reason swapping (by a shorter reason)	: 0
1200.09/1199.11	c Calls to reduceDB	: 0
1200.09/1199.11	c speed (decisions/second)	: 629.360021729592
1200.09/1199.11	c non guided choices	38784
1200.09/1199.11	s UNKNOWN
1200.09/1199.11	c Total wall clock time (in seconds) : 1198.911
1200.09/1199.11	c Total CPU time (experimental, in seconds) : 0.0

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node2/watcher-332051-1173366484 -o ROOT/results/node2/solver-332051-1173366484 -C 1200 -W 2400 -M 1800 --output-limit 1,15 java6 -server -Xmx1600m -Xms1600m -jar /tmp/evaluation/332051-1173366484/sat4j-sat2007.jar /tmp/evaluation/332051-1173366484/instance-332051-1173366484.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.97 0.94 2/77 12567
/proc/meminfo: memFree=1684024/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=18568 CPUtime=0
/proc/12567/stat : 12567 (runsolver) R 12565 12567 11902 0 -1 4194368 16 0 0 0 0 0 0 0 20 0 1 0 356603444 19013632 293 18446744073709551615 4194304 4294612 548682068832 18446744073709551615 206381313319 0 0 4096 24578 0 0 0 17 0 0 0
/proc/12567/statm: 4642 293 258 24 0 2626 0

[startup+0.082888 s]
/proc/loadavg: 0.91 0.97 0.94 2/77 12567
/proc/meminfo: memFree=1684024/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1778732 CPUtime=0.06
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 3783 0 1 0 4 2 0 0 18 0 7 0 356603444 1821421568 3526 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23755 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 444683 3526 1086 9 0 442319 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 1778732

[startup+0.101888 s]
/proc/loadavg: 0.91 0.97 0.94 2/77 12567
/proc/meminfo: memFree=1684024/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1781132 CPUtime=0.08
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 3960 0 1 0 6 2 0 0 18 0 12 0 356603444 1823879168 3702 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 445283 3702 1122 9 0 442902 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 1781132

[startup+0.301909 s]
/proc/loadavg: 0.91 0.97 0.94 2/77 12567
/proc/meminfo: memFree=1684024/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1781864 CPUtime=0.31
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 4989 0 1 0 27 4 0 0 18 0 12 0 356603444 1824628736 4728 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 445466 4728 1272 9 0 443078 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 1781864

[startup+0.701955 s]
/proc/loadavg: 0.91 0.97 0.94 2/77 12567
/proc/meminfo: memFree=1684024/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1781864 CPUtime=0.76
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 7522 0 1 0 71 5 0 0 18 0 12 0 356603444 1824628736 7228 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 445466 7228 1287 9 0 443078 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 1781864

[startup+1.50203 s]
/proc/loadavg: 0.91 0.97 0.94 2/89 12579
/proc/meminfo: memFree=1648856/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1781864 CPUtime=1.6
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 15488 0 1 0 151 9 0 0 18 0 12 0 356603444 1824628736 15187 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 445466 15188 1290 9 0 443078 0
[pid=12567/tid=12569] ppid=12565 vsize=1781864 CPUtime=1.37
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 14191 0 1 0 130 7 0 0 20 0 12 0 356603446 1824628736 15188 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109517243 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 3 0 0 0 0 0 0 0 19 0 12 0 356603448 1824628736 15189 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 12 0 356603448 1824628736 15190 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 2 0 0 0 0 0 0 0 16 0 12 0 356603450 1824628736 15191 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 10 0 0 0 0 0 0 0 22 0 12 0 356603450 1824628736 15192 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 12 0 356603450 1824628736 15192 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 12 0 356603454 1824628736 15192 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1781864 CPUtime=0.11
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 371 0 0 0 11 0 0 0 16 0 12 0 356603454 1824628736 15192 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1781864 CPUtime=0.09
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 205 0 0 0 9 0 0 0 16 0 12 0 356603454 1824628736 15193 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 12 0 356603454 1824628736 15193 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1781864 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 356603454 1824628736 15194 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.6
Current children cumulated vsize (KiB) 1781864

[startup+3.1022 s]
/proc/loadavg: 0.91 0.97 0.94 2/89 12579
/proc/meminfo: memFree=1606168/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1784296 CPUtime=3.49
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 27779 0 1 0 334 15 0 0 18 0 13 0 356603444 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 446074 26398 1310 9 0 443686 0
[pid=12567/tid=12569] ppid=12565 vsize=1784296 CPUtime=2.84
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 24899 0 1 0 271 13 0 0 25 0 13 0 356603446 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109556390 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 356603448 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603448 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 2 0 0 0 0 0 0 0 17 0 13 0 356603450 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 356603450 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1784296 CPUtime=0.28
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 834 0 0 0 28 0 0 0 16 0 13 0 356603454 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1784296 CPUtime=0.34
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1320 0 0 0 34 0 0 0 16 0 13 0 356603454 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1784296 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1827119104 26398 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.49
Current children cumulated vsize (KiB) 1784296

[startup+6.30254 s]
/proc/loadavg: 0.92 0.97 0.94 2/90 12580
/proc/meminfo: memFree=1582672/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1784168 CPUtime=6.81
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 28157 0 1 0 666 15 0 0 18 0 13 0 356603444 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 446042 26568 1316 9 0 443654 0
[pid=12567/tid=12569] ppid=12565 vsize=1784168 CPUtime=5.99
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 25116 0 1 0 586 13 0 0 25 0 13 0 356603446 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109596078 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 356603448 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603448 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 2 0 0 0 0 0 0 0 16 0 13 0 356603450 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 356603450 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1784168 CPUtime=0.36
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 901 0 0 0 36 0 0 0 17 0 13 0 356603454 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1784168 CPUtime=0.42
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1414 0 0 0 42 0 0 0 16 0 13 0 356603454 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12580] ppid=12565 vsize=1784168 CPUtime=0
/proc/12567/task/12580/stat : 12580 (java) S 12565 12567 11902 0 -1 64 4 0 0 0 0 0 0 0 23 0 13 0 356603710 1826988032 26568 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.81
Current children cumulated vsize (KiB) 1784168

[startup+12.7012 s]
/proc/loadavg: 0.93 0.97 0.94 2/90 12580
/proc/meminfo: memFree=1582352/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1783656 CPUtime=13.19
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 28512 0 1 0 1304 15 0 0 18 0 13 0 356603444 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 445914 26690 1316 9 0 443526 0
[pid=12567/tid=12569] ppid=12565 vsize=1783656 CPUtime=12.37
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 25470 0 1 0 1224 13 0 0 25 0 13 0 356603446 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109557399 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 356603448 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603448 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 2 0 0 0 0 0 0 0 16 0 13 0 356603450 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 356603450 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1783656 CPUtime=0.37
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 901 0 0 0 37 0 0 0 17 0 13 0 356603454 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1783656 CPUtime=0.42
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1415 0 0 0 42 0 0 0 16 0 13 0 356603454 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12580] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12580/stat : 12580 (java) S 12565 12567 11902 0 -1 64 4 0 0 0 0 0 0 0 23 0 13 0 356603710 1826463744 26690 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 13.19
Current children cumulated vsize (KiB) 1783656

[startup+25.5025 s]
/proc/loadavg: 0.94 0.97 0.94 2/90 12580
/proc/meminfo: memFree=1580048/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1783656 CPUtime=26.02
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 29086 0 1 0 2586 16 0 0 18 0 13 0 356603444 1826463744 27263 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 445914 27263 1317 9 0 443526 0
[pid=12567/tid=12569] ppid=12565 vsize=1783656 CPUtime=25.13
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 26037 0 1 0 2499 14 0 0 25 0 13 0 356603446 1826463744 27263 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109644371 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 3 0 0 0 0 0 0 0 19 0 13 0 356603448 1826463744 27263 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603448 1826463744 27263 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 2 0 0 0 0 0 0 0 16 0 13 0 356603450 1826463744 27263 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1783656 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 10 0 0 0 0 0 0 0 22 0 13 0 356603450 1826463744 27263 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0

################
# More data... #
################

[pid=12567] ppid=12565 vsize=1791344 CPUtime=1063.32
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 78730 0 1 0 106275 57 0 0 18 0 13 0 356603444 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 447836 70708 1324 9 0 445448 0
[pid=12567/tid=12569] ppid=12565 vsize=1791344 CPUtime=1060.81
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 37710 0 1 0 106045 36 0 0 25 0 13 0 356603446 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109655627 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 23558 0 0 0 68 11 0 0 24 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 14408 0 0 0 72 7 0 0 16 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 9 0 0 0 0 0 0 0 16 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 11 0 0 0 0 0 0 0 17 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1791344 CPUtime=0.42
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 904 0 0 0 42 0 0 0 17 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1791344 CPUtime=0.47
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1420 0 0 0 47 0 0 0 16 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12580] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12580/stat : 12580 (java) S 12565 12567 11902 0 -1 64 4 0 0 0 0 0 0 0 23 0 13 0 356603710 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1063.32
Current children cumulated vsize (KiB) 1791344

[startup+1122.3 s]
/proc/loadavg: 0.99 0.97 0.94 2/90 12580
/proc/meminfo: memFree=1405584/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1791344 CPUtime=1123.31
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 78730 0 1 0 112273 58 0 0 18 0 13 0 356603444 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 447836 70708 1324 9 0 445448 0
[pid=12567/tid=12569] ppid=12565 vsize=1791344 CPUtime=1120.8
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 37710 0 1 0 112043 37 0 0 25 0 13 0 356603446 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109557333 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 23558 0 0 0 68 11 0 0 24 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 14408 0 0 0 72 7 0 0 16 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 9 0 0 0 0 0 0 0 16 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 11 0 0 0 0 0 0 0 17 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1791344 CPUtime=0.42
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 904 0 0 0 42 0 0 0 17 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1791344 CPUtime=0.47
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1420 0 0 0 47 0 0 0 16 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12580] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12580/stat : 12580 (java) S 12565 12567 11902 0 -1 64 4 0 0 0 0 0 0 0 23 0 13 0 356603710 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1123.31
Current children cumulated vsize (KiB) 1791344

[startup+1182.3 s]
/proc/loadavg: 0.99 0.97 0.94 2/90 12580
/proc/meminfo: memFree=1405648/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1791344 CPUtime=1183.29
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 78730 0 1 0 118271 58 0 0 18 0 13 0 356603444 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 447836 70708 1324 9 0 445448 0
[pid=12567/tid=12569] ppid=12565 vsize=1791344 CPUtime=1180.78
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 37710 0 1 0 118041 37 0 0 25 0 13 0 356603446 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109630737 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 23558 0 0 0 68 11 0 0 24 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 14408 0 0 0 72 7 0 0 16 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 9 0 0 0 0 0 0 0 16 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 11 0 0 0 0 0 0 0 17 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1791344 CPUtime=0.42
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 904 0 0 0 42 0 0 0 17 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1791344 CPUtime=0.47
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1420 0 0 0 47 0 0 0 16 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12580] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12580/stat : 12580 (java) S 12565 12567 11902 0 -1 64 4 0 0 0 0 0 0 0 23 0 13 0 356603710 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1183.29
Current children cumulated vsize (KiB) 1791344



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1199.1 s]
/proc/loadavg: 0.99 0.97 0.94 2/90 12580
/proc/meminfo: memFree=1405584/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1791344 CPUtime=1200.09
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 78730 0 1 0 119951 58 0 0 18 0 13 0 356603444 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 447836 70708 1324 9 0 445448 0
[pid=12567/tid=12569] ppid=12565 vsize=1791344 CPUtime=1197.57
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 37710 0 1 0 119720 37 0 0 25 0 13 0 356603446 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109595423 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 23558 0 0 0 68 11 0 0 24 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 14408 0 0 0 72 7 0 0 16 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 9 0 0 0 0 0 0 0 16 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 11 0 0 0 0 0 0 0 17 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1791344 CPUtime=0.42
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 904 0 0 0 42 0 0 0 17 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1791344 CPUtime=0.47
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1420 0 0 0 47 0 0 0 16 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12580] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12580/stat : 12580 (java) S 12565 12567 11902 0 -1 64 4 0 0 0 0 0 0 0 23 0 13 0 356603710 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 1791344

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1199.1 s]
/proc/loadavg: 0.99 0.97 0.94 2/90 12580
/proc/meminfo: memFree=1405584/2055920 swapFree=4153164/4192956
[pid=12567] ppid=12565 vsize=1791344 CPUtime=1200.09
/proc/12567/stat : 12567 (java) S 12565 12567 11902 0 -1 0 78730 0 1 0 119951 58 0 0 18 0 13 0 356603444 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12567/statm: 447836 70708 1324 9 0 445448 0
[pid=12567/tid=12569] ppid=12565 vsize=1791344 CPUtime=1197.57
/proc/12567/task/12569/stat : 12569 (java) R 12565 12567 11902 0 -1 64 37710 0 1 0 119720 37 0 0 25 0 13 0 356603446 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4109595423 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12570] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12570/stat : 12570 (java) S 12565 12567 11902 0 -1 64 23558 0 0 0 68 11 0 0 24 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12571] ppid=12565 vsize=1791344 CPUtime=0.79
/proc/12567/task/12571/stat : 12571 (java) S 12565 12567 11902 0 -1 64 14408 0 0 0 72 7 0 0 16 0 13 0 356603448 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12572] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12572/stat : 12572 (java) S 12565 12567 11902 0 -1 64 9 0 0 0 0 0 0 0 16 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12573] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12573/stat : 12573 (java) S 12565 12567 11902 0 -1 64 11 0 0 0 0 0 0 0 17 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12574] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12574/stat : 12574 (java) S 12565 12567 11902 0 -1 64 5 0 0 0 0 0 0 0 23 0 13 0 356603450 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12575] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12575/stat : 12575 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 19 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12576] ppid=12565 vsize=1791344 CPUtime=0.42
/proc/12567/task/12576/stat : 12576 (java) S 12565 12567 11902 0 -1 64 904 0 0 0 42 0 0 0 17 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12567/tid=12577] ppid=12565 vsize=1791344 CPUtime=0.47
/proc/12567/task/12577/stat : 12577 (java) S 12565 12567 11902 0 -1 64 1420 0 0 0 47 0 0 0 16 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12578] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12578/stat : 12578 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 20 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12579] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12579/stat : 12579 (java) S 12565 12567 11902 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 356603454 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12567/tid=12580] ppid=12565 vsize=1791344 CPUtime=0
/proc/12567/task/12580/stat : 12580 (java) S 12565 12567 11902 0 -1 64 4 0 0 0 0 0 0 0 23 0 13 0 356603710 1834336256 70708 18446744073709551615 134512640 134550740 4294956400 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1200.09
Current children cumulated vsize (KiB) 1791344

Child status: 143
Real time (s): 1199.16
CPU time (s): 1200.16
CPU user time (s): 1199.53
CPU system time (s): 0.629904
CPU usage (%): 100.083
Max. virtual memory (cumulated for all children) (KiB): 1791344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.53
system time used= 0.629904
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 78751
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 24730
involuntary context switches= 33575

runsolver used 1.07984 second user time and 3.3055 second system time

The end

Launcher Data (download as text)

Begin job on node2 on Thu Mar  8 15:08:05 UTC 2007

IDJOB= 332051
IDBENCH= 20572
IDSOLVER= 141
FILE ID= node2/332051-1173366484

PBS_JOBID= 4045320

Free space on /tmp= 66493 MiB

SOLVER NAME= SAT4J  JVM PARAM CHANGED SAT 2007
BENCH NAME= HOME/pub/bench/SAT07/industrial/IBM_FV_2004_30/IBM_FV_2004_rule_batch_30_SAT_dat.k85.cnf
COMMAND LINE= java6 -server -Xmx1600m -Xms1600m -jar /tmp/evaluation/332051-1173366484/sat4j-sat2007.jar /tmp/evaluation/332051-1173366484/instance-332051-1173366484.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node2/watcher-332051-1173366484 -o ROOT/results/node2/solver-332051-1173366484 -C 1200 -W 2400 -M 1800 --output-limit 1,15  java6 -server -Xmx1600m -Xms1600m -jar /tmp/evaluation/332051-1173366484/sat4j-sat2007.jar /tmp/evaluation/332051-1173366484/instance-332051-1173366484.cnf            

META MD5SUM SOLVER= fd7c3100383641221a90b938607cc598
MD5SUM BENCH=  e2ab53f07158137fdccdce6798b16e56

RANDOM SEED= 256125657

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node2.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.247
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.247
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1684432 kB
Buffers:         38764 kB
Cached:         255236 kB
SwapCached:       2276 kB
Active:         177440 kB
Inactive:       139704 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1684432 kB
SwapTotal:     4192956 kB
SwapFree:      4153164 kB
Dirty:           18808 kB
Writeback:           0 kB
Mapped:          30688 kB
Slab:            39836 kB
Committed_AS:  1596364 kB
PageTables:       1816 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66493 MiB

End job on node2 on Thu Mar  8 15:28:06 UTC 2007