Trace number 1095556

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT4J CSP 2008-06-13? (TO) 1800.19 1809.41

General information on the benchmark

Namecsp/rand-3-28-28-fcd/
normalized-rand-3-28-28-93-632-fcd-28_ext.xml
MD5SUMbe33620531af9f514a9f83480278f903
Bench CategoryN-ARY-EXT (n-ary constraints in extension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables28
Number of constraints93
Maximum constraint arity3
Maximum domain size28
Number of constraints which are defined in extension93
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.28/0.32	c SAT4J: a SATisfiability library for Java (c) 2004-2008 Daniel Le Berre
0.28/0.32	c This is free software under the dual EPL/GNU LGPL licenses.
0.28/0.32	c See www.sat4j.org for details.
0.28/0.32	c That software uses the Rhino library from the Mozilla project.
0.28/0.36	c version 9.9.9.token
0.28/0.36	c sun.arch.data.model	32
0.28/0.36	c java.version	1.6.0_06
0.28/0.36	c os.name	Linux
0.28/0.36	c os.version	2.6.9-22.EL.rootsmp
0.28/0.36	c os.arch	i386
0.28/0.36	c Free memory 669864272
0.28/0.36	c Max memory 672137216
0.28/0.36	c Total memory 672137216
0.28/0.36	c Number of processors 2
0.38/0.41	c c --- Begin Solver configuration ---
0.38/0.41	c Stops conflict analysis at the first Unique Implication Point
0.38/0.41	c org.sat4j.minisat.constraints.MixedDataStructureDaniel@1d2068d
0.38/0.41	c Learn all clauses as in MiniSAT
0.38/0.41	c claDecay=0.999 varDecay=0.95 conflictBoundIncFactor=1.5 initConflictBound=100 
0.38/0.41	c VSIDS like heuristics from MiniSAT using a heap phase appearing in latest learned clause
0.38/0.41	c Expensive reason simplification
0.38/0.41	c MiniSAT restarts strategy
0.38/0.41	c timeout=2147483s
0.38/0.41	c DB Simplification allowed=false
0.38/0.41	c --- End Solver configuration ---
0.38/0.41	c solving HOME/instance-1095556-1215256540.xml
0.38/0.41	c reading problem ... 
0.57/0.69	c reading problem named null
0.57/0.69	c reading domains done.
0.57/0.70	c reading variables done.
0.67/0.74	c reading relations done.
5.54/5.63	c reading constraints
7.82/7.79	c done with constraints.
7.82/7.80	c ... done. Wall clock time 7.38s.
7.82/7.80	c #vars     784
7.82/7.80	c #constraints  1290245
7.82/7.80	c constraints type 
7.82/7.80	c org.sat4j.minisat.constraints.cnf.OriginalWLClause => 1290217
7.82/7.80	c org.sat4j.minisat.constraints.card.AtLeast => 28
1800.08/1809.31	c starts		: 21
1800.08/1809.31	c conflicts		: 885079
1800.08/1809.31	c decisions		: 1531083
1800.08/1809.31	c propagations		: 60956541
1800.08/1809.31	c inspects		: 5535170019
1800.08/1809.31	c learnt literals	: 0
1800.08/1809.31	c learnt binary clauses	: 9
1800.08/1809.31	c learnt ternary clauses	: 917
1800.08/1809.31	c learnt clauses	: 885079
1800.08/1809.31	c ignored clauses	: 0
1800.08/1809.31	c root simplifications	: 0
1800.08/1809.31	c removed literals (reason simplification)	: 36445059
1800.08/1809.31	c reason swapping (by a shorter reason)	: 0
1800.08/1809.31	c Calls to reduceDB	: 0
1800.08/1809.31	c speed (assignments/second)	: 33836.20979640503
1800.08/1809.31	c non guided choices	284
1800.08/1809.31	s UNKNOWN
1800.08/1809.31	c Total wall clock time (in seconds) : 1808.901

Verifier Data (download as text)

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: UNKNOWN

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1095556-1215256540/watcher-1095556-1215256540 -o /tmp/evaluation-result-1095556-1215256540/solver-1095556-1215256540 -C 1800 -W 2200 -M 900 --output-limit 1,15 java6 -server -Xms650m -Xmx650m -jar HOME/sat4jcsp.jar HOME/instance-1095556-1215256540.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2200 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 2.00 1.99 3/80 4000
/proc/meminfo: memFree=1612936/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=18572 CPUtime=0
/proc/4000/stat : 4000 (runsolver) R 3998 4000 3348 0 -1 4194368 16 0 0 0 0 0 0 0 19 0 1 0 2004628641 19017728 292 996147200 4194304 4296836 548682068416 18446744073709551615 237788261671 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/4000/statm: 4643 292 257 25 0 2626 0

[startup+0.046837 s]
/proc/loadavg: 1.93 2.00 1.99 3/80 4000
/proc/meminfo: memFree=1612936/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=801432 CPUtime=0.03
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 2464 0 1 0 1 2 0 0 18 0 5 0 2004628641 820666368 2202 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16784584 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 200358 2202 936 9 0 197741 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 801432

[startup+0.10249 s]
/proc/loadavg: 1.93 2.00 1.99 3/80 4000
/proc/meminfo: memFree=1612936/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=804612 CPUtime=0.08
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 2990 0 1 0 5 3 0 0 18 0 12 0 2004628641 823922688 2723 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 201153 2723 1047 9 0 198522 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 804612

[startup+0.30151 s]
/proc/loadavg: 1.93 2.00 1.99 3/80 4000
/proc/meminfo: memFree=1612936/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=808276 CPUtime=0.28
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 4916 0 1 0 24 4 0 0 18 0 12 0 2004628641 827674624 4243 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 202069 4243 1297 9 0 199438 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 808276

[startup+0.701547 s]
/proc/loadavg: 1.93 2.00 1.99 3/80 4000
/proc/meminfo: memFree=1612936/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=808304 CPUtime=0.67
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 6348 0 1 0 62 5 0 0 18 0 12 0 2004628641 827703296 5476 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 202076 5476 1335 9 0 199438 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 808304

[startup+1.50264 s]
/proc/loadavg: 1.93 2.00 1.99 4/92 4012
/proc/meminfo: memFree=1593384/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=811696 CPUtime=1.47
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 10173 0 1 0 140 7 0 0 18 0 12 0 2004628641 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 202924 8320 1349 9 0 200286 0
[pid=4000/tid=4002] ppid=3998 vsize=811696 CPUtime=0.66
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 5757 0 1 0 61 5 0 0 20 0 12 0 2004628643 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4109173706 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 12 0 2004628644 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 12 0 2004628644 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 17 0 12 0 2004628645 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 9 0 0 0 0 0 0 0 21 0 12 0 2004628646 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 4 0 0 0 0 0 0 0 22 0 12 0 2004628646 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 12 0 2004628650 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=811696 CPUtime=0.39
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 775 0 0 0 39 0 0 0 16 0 12 0 2004628650 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=811696 CPUtime=0.4
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2878 0 0 0 39 1 0 0 16 0 12 0 2004628650 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 12 0 2004628650 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 2004628650 831176704 8320 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 811696

[startup+3.1018 s]
/proc/loadavg: 1.93 2.00 1.99 3/92 4012
/proc/meminfo: memFree=1536104/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=811696 CPUtime=3.05
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 25070 0 1 0 290 15 0 0 18 0 12 0 2004628641 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 202924 23213 1357 9 0 200286 0
[pid=4000/tid=4002] ppid=3998 vsize=811696 CPUtime=1.89
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 16971 0 1 0 178 11 0 0 25 0 12 0 2004628643 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4109661278 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=811696 CPUtime=0.07
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 2056 0 0 0 6 1 0 0 16 0 12 0 2004628644 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=811696 CPUtime=0.08
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 1505 0 0 0 8 0 0 0 16 0 12 0 2004628644 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 109 0 0 0 0 0 0 0 16 0 12 0 2004628645 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 12 0 2004628646 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 12 0 2004628646 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 12 0 2004628650 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=811696 CPUtime=0.49
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 784 0 0 0 49 0 0 0 16 0 12 0 2004628650 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=811696 CPUtime=0.48
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2883 0 0 0 47 1 0 0 16 0 12 0 2004628650 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 12 0 2004628650 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=811696 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 2004628650 831176704 23213 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 811696

[startup+6.30214 s]
/proc/loadavg: 1.93 2.00 1.99 3/92 4012
/proc/meminfo: memFree=1501800/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=811632 CPUtime=6.22
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 31198 0 1 0 603 19 0 0 18 0 12 0 2004628641 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 202908 29314 1361 9 0 200270 0
[pid=4000/tid=4002] ppid=3998 vsize=811632 CPUtime=4.26
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 16986 0 1 0 414 12 0 0 25 0 12 0 2004628643 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4109721748 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=811632 CPUtime=0.29
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 4637 0 0 0 27 2 0 0 16 0 12 0 2004628644 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=811632 CPUtime=0.31
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 4965 0 0 0 29 2 0 0 16 0 12 0 2004628644 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=811632 CPUtime=0
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 0 0 0 0 16 0 12 0 2004628645 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=811632 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 12 0 2004628646 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=811632 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 12 0 2004628646 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=811632 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 12 0 2004628650 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=811632 CPUtime=0.71
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 824 0 0 0 71 0 0 0 16 0 12 0 2004628650 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=811632 CPUtime=0.58
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2888 0 0 0 57 1 0 0 16 0 12 0 2004628650 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=811632 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 12 0 2004628650 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=811632 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 12 0 2004628650 831111168 29314 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 811632

[startup+12.7018 s]
/proc/loadavg: 1.94 2.00 1.99 3/93 4013
/proc/meminfo: memFree=1420832/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=822204 CPUtime=12.83
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 53862 0 1 0 1253 30 0 0 18 0 13 0 2004628641 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 205551 49149 1384 9 0 202913 0
[pid=4000/tid=4002] ppid=3998 vsize=822204 CPUtime=9.12
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 17006 0 1 0 900 12 0 0 25 0 13 0 2004628643 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4109813667 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=822204 CPUtime=0.85
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 14583 0 0 0 78 7 0 0 17 0 13 0 2004628644 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=4000/tid=4004] ppid=3998 vsize=822204 CPUtime=0.88
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 17592 0 0 0 80 8 0 0 16 0 13 0 2004628644 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 0 0 0 0 17 0 13 0 2004628645 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 13 0 2004628650 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=822204 CPUtime=0.96
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 848 0 0 0 96 0 0 0 16 0 13 0 2004628650 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=822204 CPUtime=0.97
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2928 0 0 0 96 1 0 0 16 0 13 0 2004628650 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 13 0 2004628650 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 2004628650 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4013] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4013/stat : 4013 (java) S 3998 4000 3348 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 2004629421 841936896 49149 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.83
Current children cumulated vsize (KiB) 822204

[startup+25.5021 s]
/proc/loadavg: 2.02 2.02 2.00 3/93 4013
/proc/meminfo: memFree=1420896/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=822204 CPUtime=25.51
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 53865 0 1 0 2521 30 0 0 18 0 13 0 2004628641 841936896 49151 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 205551 49151 1384 9 0 202913 0
[pid=4000/tid=4002] ppid=3998 vsize=822204 CPUtime=21.76
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 17007 0 1 0 2164 12 0 0 25 0 13 0 2004628643 841936896 49151 996147200 134512640 134550740 4294956016 18446744073709551615 4109813828 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=822204 CPUtime=0.85
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 14583 0 0 0 78 7 0 0 17 0 13 0 2004628644 841936896 49151 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=4000/tid=4004] ppid=3998 vsize=822204 CPUtime=0.88
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 17592 0 0 0 80 8 0 0 16 0 13 0 2004628644 841936896 49151 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 0 0 0 0 16 0 13 0 2004628645 841936896 49151 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 49151 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 49151 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0

################
# More data... #
################

[pid=4000] ppid=3998 vsize=822204 CPUtime=1655.95
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 120023 0 1 0 165532 63 0 0 18 0 13 0 2004628641 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 205551 110412 1384 9 0 202913 0
[pid=4000/tid=4002] ppid=3998 vsize=822204 CPUtime=1648.08
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 17018 0 1 0 164791 17 0 0 25 0 13 0 2004628643 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4109823711 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=822204 CPUtime=2.91
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 49152 0 0 0 270 21 0 0 18 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=822204 CPUtime=2.9
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 49169 0 0 0 269 21 0 0 19 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=822204 CPUtime=0.01
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 1 0 0 0 16 0 13 0 2004628645 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=822204 CPUtime=0.97
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 849 0 0 0 97 0 0 0 16 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=822204 CPUtime=1.02
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2930 0 0 0 101 1 0 0 17 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=4000/tid=4013] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4013/stat : 4013 (java) S 3998 4000 3348 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 2004629421 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1655.95
Current children cumulated vsize (KiB) 822204

[startup+1722.3 s]
/proc/loadavg: 2.01 2.08 2.03 3/106 4072
/proc/meminfo: memFree=1168632/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=822204 CPUtime=1714.78
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 120023 0 1 0 171415 63 0 0 18 0 13 0 2004628641 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 205551 110412 1384 9 0 202913 0
[pid=4000/tid=4002] ppid=3998 vsize=822204 CPUtime=1706.91
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 17018 0 1 0 170674 17 0 0 25 0 13 0 2004628643 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4109823711 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=822204 CPUtime=2.91
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 49152 0 0 0 270 21 0 0 18 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=822204 CPUtime=2.9
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 49169 0 0 0 269 21 0 0 19 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=822204 CPUtime=0.01
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 1 0 0 0 16 0 13 0 2004628645 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=822204 CPUtime=0.97
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 849 0 0 0 97 0 0 0 16 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=822204 CPUtime=1.02
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2930 0 0 0 101 1 0 0 17 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=4000/tid=4013] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4013/stat : 4013 (java) S 3998 4000 3348 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 2004629421 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1714.78
Current children cumulated vsize (KiB) 822204

[startup+1782.3 s]
/proc/loadavg: 2.00 2.06 2.02 3/106 4072
/proc/meminfo: memFree=1168568/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=822204 CPUtime=1773.61
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 120023 0 1 0 177298 63 0 0 18 0 13 0 2004628641 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 205551 110412 1384 9 0 202913 0
[pid=4000/tid=4002] ppid=3998 vsize=822204 CPUtime=1765.74
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 17018 0 1 0 176557 17 0 0 25 0 13 0 2004628643 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4109823684 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=822204 CPUtime=2.91
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 49152 0 0 0 270 21 0 0 18 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=822204 CPUtime=2.9
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 49169 0 0 0 269 21 0 0 19 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=822204 CPUtime=0.01
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 1 0 0 0 16 0 13 0 2004628645 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=822204 CPUtime=0.97
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 849 0 0 0 97 0 0 0 16 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=822204 CPUtime=1.02
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2930 0 0 0 101 1 0 0 17 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=4000/tid=4013] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4013/stat : 4013 (java) S 3998 4000 3348 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 2004629421 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1773.61
Current children cumulated vsize (KiB) 822204



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1809.3 s]
/proc/loadavg: 2.07 2.07 2.02 3/106 4072
/proc/meminfo: memFree=1168568/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=822204 CPUtime=1800.08
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 120023 0 1 0 179945 63 0 0 18 0 13 0 2004628641 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 205551 110412 1384 9 0 202913 0
[pid=4000/tid=4002] ppid=3998 vsize=822204 CPUtime=1792.21
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 17018 0 1 0 179204 17 0 0 25 0 13 0 2004628643 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4109873294 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=822204 CPUtime=2.91
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 49152 0 0 0 270 21 0 0 18 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=822204 CPUtime=2.9
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 49169 0 0 0 269 21 0 0 19 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=822204 CPUtime=0.01
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 1 0 0 0 16 0 13 0 2004628645 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=822204 CPUtime=0.97
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 849 0 0 0 97 0 0 0 16 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=822204 CPUtime=1.02
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2930 0 0 0 101 1 0 0 17 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=4000/tid=4013] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4013/stat : 4013 (java) S 3998 4000 3348 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 2004629421 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 822204

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1809.3 s]
/proc/loadavg: 2.07 2.07 2.02 3/106 4072
/proc/meminfo: memFree=1168568/2055920 swapFree=4180448/4192956
[pid=4000] ppid=3998 vsize=822204 CPUtime=1800.08
/proc/4000/stat : 4000 (java) S 3998 4000 3348 0 -1 0 120023 0 1 0 179945 63 0 0 18 0 13 0 2004628641 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/4000/statm: 205551 110412 1384 9 0 202913 0
[pid=4000/tid=4002] ppid=3998 vsize=822204 CPUtime=1792.21
/proc/4000/task/4002/stat : 4002 (java) R 3998 4000 3348 0 -1 64 17018 0 1 0 179204 17 0 0 25 0 13 0 2004628643 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4109873294 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4003] ppid=3998 vsize=822204 CPUtime=2.91
/proc/4000/task/4003/stat : 4003 (java) S 3998 4000 3348 0 -1 64 49152 0 0 0 270 21 0 0 18 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4004] ppid=3998 vsize=822204 CPUtime=2.9
/proc/4000/task/4004/stat : 4004 (java) S 3998 4000 3348 0 -1 64 49169 0 0 0 269 21 0 0 19 0 13 0 2004628644 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4005] ppid=3998 vsize=822204 CPUtime=0.01
/proc/4000/task/4005/stat : 4005 (java) S 3998 4000 3348 0 -1 64 136 0 0 0 1 0 0 0 16 0 13 0 2004628645 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4006] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4006/stat : 4006 (java) S 3998 4000 3348 0 -1 64 10 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4007] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4007/stat : 4007 (java) S 3998 4000 3348 0 -1 64 5 0 0 0 0 0 0 0 16 0 13 0 2004628646 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4008] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4008/stat : 4008 (java) S 3998 4000 3348 0 -1 64 2 0 0 0 0 0 0 0 18 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4009] ppid=3998 vsize=822204 CPUtime=0.97
/proc/4000/task/4009/stat : 4009 (java) S 3998 4000 3348 0 -1 64 849 0 0 0 97 0 0 0 16 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4010] ppid=3998 vsize=822204 CPUtime=1.02
/proc/4000/task/4010/stat : 4010 (java) S 3998 4000 3348 0 -1 64 2930 0 0 0 101 1 0 0 17 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4011] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4011/stat : 4011 (java) S 3998 4000 3348 0 -1 64 0 0 0 0 0 0 0 0 19 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=4000/tid=4012] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4012/stat : 4012 (java) S 3998 4000 3348 0 -1 64 1 0 0 0 0 0 0 0 15 0 13 0 2004628650 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=4000/tid=4013] ppid=3998 vsize=822204 CPUtime=0
/proc/4000/task/4013/stat : 4013 (java) S 3998 4000 3348 0 -1 64 7 0 0 0 0 0 0 0 16 0 13 0 2004629421 841936896 110412 996147200 134512640 134550740 4294956016 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 822204

Child status: 143
Real time (s): 1809.41
CPU time (s): 1800.19
CPU user time (s): 1799.49
CPU system time (s): 0.706892
CPU usage (%): 99.4906
Max. virtual memory (cumulated for all children) (KiB): 822204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.49
system time used= 0.706892
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 120041
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37712
involuntary context switches= 58442

runsolver used 2.51162 second user time and 5.80012 second system time

The end

Launcher Data (download as text)

Begin job on node24 at 2008-07-05 13:15:41
IDJOB=1095556
IDBENCH=58914
IDSOLVER=344
FILE ID=node24/1095556-1215256540
PBS_JOBID= 7882079
Free space on /tmp= 66448 MiB

SOLVER NAME= SAT4J CSP 2008-06-13
BENCH NAME= CPAI08/csp/rand-3-28-28-fcd/normalized-rand-3-28-28-93-632-fcd-28_ext.xml
COMMAND LINE= java6 -server -Xms650m -Xmx650m -jar HOME/sat4jcsp.jar BENCHNAME
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1095556-1215256540/watcher-1095556-1215256540 -o /tmp/evaluation-result-1095556-1215256540/solver-1095556-1215256540 -C 1800 -W 2200 -M 900 --output-limit 1,15  java6 -server -Xms650m -Xmx650m -jar HOME/sat4jcsp.jar HOME/instance-1095556-1215256540.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= be33620531af9f514a9f83480278f903
RANDOM SEED=2017925605

node24.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1613416 kB
Buffers:         17252 kB
Cached:         220012 kB
SwapCached:       6856 kB
Active:         291988 kB
Inactive:        97984 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1613416 kB
SwapTotal:     4192956 kB
SwapFree:      4180448 kB
Dirty:            6912 kB
Writeback:           0 kB
Mapped:         165944 kB
Slab:            37380 kB
Committed_AS:  4396916 kB
PageTables:       2116 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66428 MiB
End job on node24 at 2008-07-05 13:45:52