Trace number 2074826

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT4J CSP 2.1.1? (TO) 1800.14 1807.58

General information on the benchmark

Namecsp/wordsPuzzle/
normalized-crossword-m1-words-puzzle08.xml
MD5SUMf1369e2d264736f03a1eaa99e48651c1
Bench CategoryN-ARY-INT (n-ary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.071988
Satisfiable
(Un)Satisfiability was proved
Number of variables41
Number of constraints97
Maximum constraint arity14
Maximum domain size26
Number of constraints which are defined in extension24
Number of constraints which are defined in intension73
Global constraints used (with number of constraints)

Solver Data 

0.08/0.13	c SAT4J: a SATisfiability library for Java (c) 2004-2008 Daniel Le Berre
0.08/0.13	c This is free software under the dual EPL/GNU LGPL licenses.
0.08/0.13	c See www.sat4j.org for details.
0.08/0.13	c That software uses the Rhino library from the Mozilla project.
0.08/0.15	c version 2.1.1.v20090622
0.08/0.15	c sun.arch.data.model	32
0.08/0.15	c java.version	1.6.0_12
0.08/0.15	c os.name	Linux
0.08/0.15	c os.version	2.6.9-22.EL.rootsmp
0.08/0.15	c os.arch	i386
0.08/0.15	c Free memory 671000808
0.08/0.15	c Max memory 672137216
0.08/0.15	c Total memory 672137216
0.08/0.15	c Number of processors 2
0.18/0.23	c c --- Begin Solver configuration ---
0.18/0.23	c Stops conflict analysis at the first Unique Implication Point
0.18/0.23	c org.sat4j.minisat.constraints.MixedDataStructureDanielWL@1f14ceb
0.18/0.23	c Learn all clauses as in MiniSAT
0.18/0.23	c claDecay=0.999 varDecay=0.95 conflictBoundIncFactor=1.5 initConflictBound=100 
0.18/0.23	c VSIDS like heuristics from MiniSAT using a heap phase appearing in latest learned clause
0.18/0.23	c Expensive reason simplification
0.18/0.23	c MiniSAT restarts strategy
0.18/0.23	c Memory based learned constraints deletion strategy
0.18/0.23	c timeout=2147483s
0.18/0.23	c DB Simplification allowed=false
0.18/0.23	c --- End Solver configuration ---
0.18/0.23	c solving HOME/instance-2074826-1247359328.xml
0.18/0.23	c reading problem ... 
0.38/0.46	c reading problem named null
0.38/0.46	c reading domains done.
0.38/0.47	c reading variables done.
0.47/0.50	c reading relations done.
1.37/1.45	c reading predicates  done.
1.58/1.66	c reading constraints
1800.06/1807.51	c starts		: 0
1800.06/1807.51	c conflicts		: 0
1800.06/1807.51	c decisions		: 0
1800.06/1807.51	c propagations		: 0
1800.06/1807.51	c inspects		: 0
1800.06/1807.51	c learnt literals	: 0
1800.06/1807.51	c learnt binary clauses	: 0
1800.06/1807.51	c learnt ternary clauses	: 0
1800.06/1807.51	c learnt clauses	: 0
1800.06/1807.51	c ignored clauses	: 0
1800.06/1807.51	c root simplifications	: 0
1800.06/1807.51	c removed literals (reason simplification)	: 0
1800.06/1807.51	c reason swapping (by a shorter reason)	: 0
1800.06/1807.51	c Calls to reduceDB	: 0
1800.06/1807.51	c speed (assignments/second)	: 0.0
1800.06/1807.51	c non guided choices	0
1800.06/1807.51	c learnt constraints type 
1800.06/1807.51	c constraints type 
1800.06/1807.51	c org.sat4j.minisat.constraints.cnf.OriginalWLClause => 1464816
1800.06/1807.51	c org.sat4j.minisat.constraints.card.AtLeast => 41
1800.06/1807.51	c org.sat4j.minisat.constraints.cnf.OriginalBinaryClause => 92
1800.06/1807.51	s UNKNOWN
1800.06/1807.51	c Total wall clock time (in seconds) : 1807.281

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2074826-1247359328/watcher-2074826-1247359328 -o /tmp/evaluation-result-2074826-1247359328/solver-2074826-1247359328 -C 1800 -W 2000 -M 900 java6 -server -Xms650m -Xmx650m -jar HOME/sat4j-csp.jar HOME/instance-2074826-1247359328.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.30 1.47 1.74 4/83 19693
/proc/meminfo: memFree=1858880/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=18576 CPUtime=0
/proc/19693/stat : 19693 (runsolver) R 19691 19693 18083 0 -1 4194368 16 0 0 0 0 0 0 0 20 0 1 0 22998113 19021824 284 996147200 4194304 4302564 548682068448 18446744073709551615 240153849127 0 2147483391 4096 24578 0 0 0 17 0 0 0
/proc/19693/statm: 4644 284 249 26 0 2626 0

[startup+0.0285189 s]
/proc/loadavg: 1.30 1.47 1.74 4/83 19693
/proc/meminfo: memFree=1858880/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=800544 CPUtime=0.01
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 1962 0 1 0 0 1 0 0 20 0 4 0 22998113 819757056 1709 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16784584 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 200136 1709 630 9 0 197487 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 800544

[startup+0.10153 s]
/proc/loadavg: 1.30 1.47 1.74 4/83 19693
/proc/meminfo: memFree=1858880/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=804560 CPUtime=0.08
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 3048 0 1 0 6 2 0 0 20 0 12 0 22998113 823869440 2791 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 201140 2791 1082 9 0 198474 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 804560

[startup+0.301568 s]
/proc/loadavg: 1.30 1.47 1.74 4/83 19693
/proc/meminfo: memFree=1858880/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=805896 CPUtime=0.27
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 4398 0 1 0 24 3 0 0 20 0 12 0 22998113 825237504 4135 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 201474 4135 1363 9 0 198801 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 805896

[startup+0.701643 s]
/proc/loadavg: 1.30 1.47 1.74 4/83 19693
/proc/meminfo: memFree=1858880/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=807176 CPUtime=0.68
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 5746 0 1 0 63 5 0 0 20 0 12 0 22998113 826548224 5196 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 201794 5196 1398 9 0 199121 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 807176

[startup+1.50281 s]
/proc/loadavg: 1.30 1.47 1.74 4/95 19705
/proc/meminfo: memFree=1838496/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=812872 CPUtime=1.48
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 11744 0 1 0 140 8 0 0 20 0 12 0 22998113 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203218 9790 1406 9 0 200545 0
[pid=19693/tid=19695] ppid=19691 vsize=812872 CPUtime=0.67
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 7032 0 1 0 62 5 0 0 25 0 12 0 22998115 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19696] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 3 0 0 0 0 0 0 0 22 0 12 0 22998116 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19697] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 23 0 12 0 22998116 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19698] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 2 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19699] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 10 0 0 0 0 0 0 0 25 0 12 0 22998118 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 4 0 0 0 0 0 0 0 25 0 12 0 22998118 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=812872 CPUtime=0.04
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 264 0 0 0 4 0 0 0 18 0 12 0 22998122 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=812872 CPUtime=0.74
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3705 0 0 0 73 1 0 0 16 0 12 0 22998122 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19704] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 832380928 9790 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 812872

[startup+3.10211 s]
/proc/loadavg: 1.30 1.47 1.74 4/95 19705
/proc/meminfo: memFree=1821344/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=812872 CPUtime=3.19
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 29364 0 1 0 303 16 0 0 20 0 12 0 22998113 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203218 26577 1422 9 0 200545 0
[pid=19693/tid=19695] ppid=19691 vsize=812872 CPUtime=1.63
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 17171 0 1 0 153 10 0 0 25 0 12 0 22998115 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4109674150 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19696] ppid=19691 vsize=812872 CPUtime=0.12
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 3756 0 0 0 10 2 0 0 18 0 12 0 22998116 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19697] ppid=19691 vsize=812872 CPUtime=0.11
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 3459 0 0 0 10 1 0 0 18 0 12 0 22998116 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19698] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19699] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=812872 CPUtime=0.16
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 275 0 0 0 16 0 0 0 16 0 12 0 22998122 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=812872 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 832380928 26577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3.19
Current children cumulated vsize (KiB) 812872

[startup+6.30171 s]
/proc/loadavg: 1.43 1.49 1.75 6/95 19705
/proc/meminfo: memFree=1705128/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=812872 CPUtime=6.56
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 43965 0 1 0 635 21 0 0 20 0 12 0 22998113 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203218 39626 1434 9 0 200545 0
[pid=19693/tid=19695] ppid=19691 vsize=812872 CPUtime=3.83
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 17222 0 1 0 373 10 0 0 25 0 12 0 22998115 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4109838956 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19696] ppid=19691 vsize=812872 CPUtime=0.5
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 9510 0 0 0 47 3 0 0 16 0 12 0 22998116 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19697] ppid=19691 vsize=812872 CPUtime=0.53
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 11817 0 0 0 49 4 0 0 16 0 12 0 22998116 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19698] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19699] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=812872 CPUtime=0.5
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 713 0 0 0 50 0 0 0 18 0 12 0 22998122 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=812872 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 832380928 39626 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.56
Current children cumulated vsize (KiB) 812872

[startup+12.7029 s]
/proc/loadavg: 1.64 1.54 1.76 3/95 19705
/proc/meminfo: memFree=1695464/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=812872 CPUtime=12.99
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 46426 0 1 0 1276 23 0 0 20 0 12 0 22998113 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203218 41976 1434 9 0 200545 0
[pid=19693/tid=19695] ppid=19691 vsize=812872 CPUtime=9.62
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 17241 0 1 0 952 10 0 0 25 0 12 0 22998115 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4109838956 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19696] ppid=19691 vsize=812872 CPUtime=0.85
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 10602 0 0 0 81 4 0 0 16 0 12 0 22998116 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19697] ppid=19691 vsize=812872 CPUtime=0.82
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 13167 0 0 0 77 5 0 0 16 0 12 0 22998116 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19698] ppid=19691 vsize=812872 CPUtime=0.01
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 1 0 0 0 16 0 12 0 22998118 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19699] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=812872 CPUtime=0.5
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 713 0 0 0 50 0 0 0 18 0 12 0 22998122 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=812872 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 832380928 41976 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.99
Current children cumulated vsize (KiB) 812872

[startup+25.5095 s]
/proc/loadavg: 1.72 1.56 1.77 3/95 19705
/proc/meminfo: memFree=1695016/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=812872 CPUtime=25.72
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 46562 0 1 0 2549 23 0 0 20 0 12 0 22998113 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203218 42090 1434 9 0 200545 0
[pid=19693/tid=19695] ppid=19691 vsize=812872 CPUtime=21.92
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 17263 0 1 0 2182 10 0 0 25 0 12 0 22998115 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19696] ppid=19691 vsize=812872 CPUtime=1.06
/proc/19693/task/19696/stat : 19696 (java) R 19691 19693 18083 0 -1 64 10663 0 0 0 102 4 0 0 15 0 12 0 22998116 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 105886416 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19697] ppid=19691 vsize=812872 CPUtime=1.04
/proc/19693/task/19697/stat : 19697 (java) R 19691 19693 18083 0 -1 64 13220 0 0 0 99 5 0 0 15 0 12 0 22998116 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19698] ppid=19691 vsize=812872 CPUtime=0.01
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 1 0 0 0 15 0 12 0 22998118 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19699] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=812872 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 832380928 42090 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=812872 CPUtime=0.5

################
# More data... #
################

[pid=19693/tid=19704] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55286 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 833695744 55286 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1596.09
Current children cumulated vsize (KiB) 814156

[startup+1662.3 s]
/proc/loadavg: 2.00 2.02 1.94 3/95 19713
/proc/meminfo: memFree=1639656/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=814156 CPUtime=1655.79
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 61821 0 1 0 165514 65 0 0 20 0 12 0 22998113 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203539 55384 1434 9 0 200866 0
[pid=19693/tid=19695] ppid=19691 vsize=814156 CPUtime=1601.72
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 19229 0 1 0 160152 20 0 0 25 0 12 0 22998115 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4109590361 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19696] ppid=19691 vsize=814156 CPUtime=25.88
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 15272 0 0 0 2576 12 0 0 16 0 12 0 22998116 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19697] ppid=19691 vsize=814156 CPUtime=25.83
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 21897 0 0 0 2570 13 0 0 17 0 12 0 22998116 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19698] ppid=19691 vsize=814156 CPUtime=0.47
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 31 16 0 0 16 0 12 0 22998118 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19699] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=814156 CPUtime=0.71
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 720 0 0 0 71 0 0 0 16 0 12 0 22998122 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=814156 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) R 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 833695744 55384 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1655.79
Current children cumulated vsize (KiB) 814156

[startup+1722.3 s]
/proc/loadavg: 2.00 2.02 1.94 3/95 19713
/proc/meminfo: memFree=1639272/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=814156 CPUtime=1715.51
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 61990 0 1 0 171484 67 0 0 20 0 12 0 22998113 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203539 55481 1434 9 0 200866 0
[pid=19693/tid=19695] ppid=19691 vsize=814156 CPUtime=1659.6
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 19301 0 1 0 165940 20 0 0 25 0 12 0 22998115 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4109708869 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19696] ppid=19691 vsize=814156 CPUtime=26.81
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 15310 0 0 0 2668 13 0 0 17 0 12 0 22998116 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19697] ppid=19691 vsize=814156 CPUtime=26.72
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 21956 0 0 0 2659 13 0 0 16 0 12 0 22998116 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19698] ppid=19691 vsize=814156 CPUtime=0.48
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 31 17 0 0 16 0 12 0 22998118 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19699] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=814156 CPUtime=0.71
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 720 0 0 0 71 0 0 0 16 0 12 0 22998122 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=814156 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 833695744 55481 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1715.51
Current children cumulated vsize (KiB) 814156

[startup+1782.3 s]
/proc/loadavg: 2.09 2.04 1.95 3/95 19713
/proc/meminfo: memFree=1638632/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=814156 CPUtime=1775.22
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 62157 0 1 0 177454 68 0 0 20 0 12 0 22998113 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203539 55577 1434 9 0 200866 0
[pid=19693/tid=19695] ppid=19691 vsize=814156 CPUtime=1717.5
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 19372 0 1 0 171730 20 0 0 25 0 12 0 22998115 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4109818710 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19696] ppid=19691 vsize=814156 CPUtime=27.67
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 15364 0 0 0 2754 13 0 0 17 0 12 0 22998116 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19697] ppid=19691 vsize=814156 CPUtime=27.64
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 21998 0 0 0 2751 13 0 0 17 0 12 0 22998116 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19698] ppid=19691 vsize=814156 CPUtime=0.51
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 33 18 0 0 16 0 12 0 22998118 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19699] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=814156 CPUtime=0.71
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 720 0 0 0 71 0 0 0 16 0 12 0 22998122 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=814156 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 833695744 55577 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1775.22
Current children cumulated vsize (KiB) 814156



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1807.5 s]
/proc/loadavg: 1.99 2.02 1.95 3/97 19753
/proc/meminfo: memFree=1517280/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=814156 CPUtime=1800.06
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 62231 0 1 0 179937 69 0 0 20 0 12 0 22998113 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203539 55621 1434 9 0 200866 0
[pid=19693/tid=19695] ppid=19691 vsize=814156 CPUtime=1741.56
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 19402 0 1 0 174136 20 0 0 25 0 12 0 22998115 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4109902326 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19696] ppid=19691 vsize=814156 CPUtime=28.04
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 15388 0 0 0 2790 14 0 0 17 0 12 0 22998116 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19697] ppid=19691 vsize=814156 CPUtime=28.05
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 22018 0 0 0 2792 13 0 0 17 0 12 0 22998116 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19698] ppid=19691 vsize=814156 CPUtime=0.51
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 33 18 0 0 16 0 12 0 22998118 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19699] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=814156 CPUtime=0.71
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 720 0 0 0 71 0 0 0 16 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=814156 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 814156

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1807.5 s]
/proc/loadavg: 1.99 2.02 1.95 3/97 19753
/proc/meminfo: memFree=1517280/2055920 swapFree=4192812/4192956
[pid=19693] ppid=19691 vsize=814156 CPUtime=1800.06
/proc/19693/stat : 19693 (java) S 19691 19693 18083 0 -1 0 62231 0 1 0 179937 69 0 0 20 0 12 0 22998113 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/19693/statm: 203539 55621 1434 9 0 200866 0
[pid=19693/tid=19695] ppid=19691 vsize=814156 CPUtime=1741.56
/proc/19693/task/19695/stat : 19695 (java) R 19691 19693 18083 0 -1 64 19402 0 1 0 174136 20 0 0 25 0 12 0 22998115 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4109902326 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19696] ppid=19691 vsize=814156 CPUtime=28.04
/proc/19693/task/19696/stat : 19696 (java) S 19691 19693 18083 0 -1 64 15388 0 0 0 2790 14 0 0 17 0 12 0 22998116 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19697] ppid=19691 vsize=814156 CPUtime=28.05
/proc/19693/task/19697/stat : 19697 (java) S 19691 19693 18083 0 -1 64 22018 0 0 0 2792 13 0 0 17 0 12 0 22998116 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19698] ppid=19691 vsize=814156 CPUtime=0.51
/proc/19693/task/19698/stat : 19698 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 33 18 0 0 16 0 12 0 22998118 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19699] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19699/stat : 19699 (java) S 19691 19693 18083 0 -1 64 11 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19700] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19700/stat : 19700 (java) S 19691 19693 18083 0 -1 64 7 0 0 0 0 0 0 0 16 0 12 0 22998118 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19701] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19701/stat : 19701 (java) S 19691 19693 18083 0 -1 64 0 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19702] ppid=19691 vsize=814156 CPUtime=0.71
/proc/19693/task/19702/stat : 19702 (java) S 19691 19693 18083 0 -1 64 720 0 0 0 71 0 0 0 16 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19703] ppid=19691 vsize=814156 CPUtime=1.13
/proc/19693/task/19703/stat : 19703 (java) S 19691 19693 18083 0 -1 64 3951 0 0 0 112 1 0 0 19 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19693/tid=19704] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19704/stat : 19704 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 25 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19693/tid=19705] ppid=19691 vsize=814156 CPUtime=0
/proc/19693/task/19705/stat : 19705 (java) S 19691 19693 18083 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 22998122 833695744 55621 996147200 134512640 134550932 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 814156

Child status: 143
Real time (s): 1807.58
CPU time (s): 1800.14
CPU user time (s): 1799.42
CPU system time (s): 0.727889
CPU usage (%): 99.5885
Max. virtual memory (cumulated for all children) (KiB): 814156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.42
system time used= 0.727889
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 62256
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 71101
involuntary context switches= 75603

runsolver used 2.22066 second user time and 6.01708 second system time

The end

Launcher Data 

Begin job on node86 at 2009-07-12 02:42:08
IDJOB=2074826
IDBENCH=56142
IDSOLVER=731
FILE ID=node86/2074826-1247359328
PBS_JOBID= 9506955
Free space on /tmp= 66304 MiB

SOLVER NAME= SAT4J CSP 2.1.1
BENCH NAME= CPAI08/csp/wordsPuzzle/normalized-crossword-m1-words-puzzle08.xml
COMMAND LINE= java6 -server -Xms650m -Xmx650m -jar HOME/sat4j-csp.jar BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2074826-1247359328/watcher-2074826-1247359328 -o /tmp/evaluation-result-2074826-1247359328/solver-2074826-1247359328 -C 1800 -W 2000 -M 900  java6 -server -Xms650m -Xmx650m -jar HOME/sat4j-csp.jar HOME/instance-2074826-1247359328.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= f1369e2d264736f03a1eaa99e48651c1
RANDOM SEED=427420915

node86.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1859296 kB
Buffers:         21912 kB
Cached:          94436 kB
SwapCached:          0 kB
Active:         114012 kB
Inactive:        35576 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1859296 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            2720 kB
Writeback:           0 kB
Mapped:          53660 kB
Slab:            32108 kB
Committed_AS:   203344 kB
PageTables:       1968 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66300 MiB
End job on node86 at 2009-07-12 03:12:18