Trace number 1076314

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 112v4 AC? (TO) 1800.04 1809.14

General information on the benchmark

Namecsp/ogdVg/
normalized-crossword-m1c-ogd-vg9-12_ext.xml
MD5SUM7b8f18265e9fe9d12868e89463d2e25f
Bench CategoryN-ARY-EXT (n-ary constraints in extension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables108
Number of constraints21
Maximum constraint arity12
Maximum domain size26
Number of constraints which are defined in extension21
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.05/0.09	
0.05/0.09	Abscon 112 (May, 2008)
0.16/0.27	
0.16/0.27	   configuration
0.16/0.27	     name=mac.xml
0.26/0.34	   
0.26/0.34	   instance
0.26/0.34	     name=HOME/instance-1076314-1215186532.xml
0.26/0.37	   
0.26/0.37	   domains being loaded...
0.26/0.39	   
0.26/0.39	   variables being loaded...
0.32/0.43	     nbVariables=108  nbDomainTypes=1  minDomainSize=26  maxDomainSize=26  nbTotalValues=2808
0.32/0.43	       =>  wckTime=0.154  cpuTime=0.11  mem=7M919
0.32/0.43	   
0.32/0.43	   relations being loaded...
0.83/0.93	   
0.83/0.93	   constraints being loaded...
0.93/1.07	   Too large in ConstraintConflictsSTructure
1.03/1.17	   Too large in ConstraintConflictsSTructure
1.13/1.25	     nbConstraints=21  nbRelationTypes=2  nbGlobalConstraints=21  nbExtensionStructures=2
1.13/1.25	     nbSharedExtensionStructures=19  nbUnbuiltConflictsStructures=2  nbSharedBinaryRepresentations=0  minDegree=2
1.13/1.25	     maxDegree=2  minArity=9  avgArity=10.29  maxArity=12  nbGenerators=0  nbFusions=0  symmetryWckTime=0.065
1.13/1.25	     symmetryCpuTime=0.03
1.13/1.25	       =>  wckTime=0.975  cpuTime=0.79  mem=45M469
1.22/1.39	   
1.22/1.39	   solver IterativeSystematicSolver being built... 
1.31/1.47	   
1.31/1.47	   INFO : Forward propagation technique limited 
1.41/1.55	       =>  wckTime=1.272  cpuTime=0.91  mem=41M269
1.82/1.91	   
1.82/1.91	   preprocessing
1.82/1.91	     nbConstraintChecks=0  nbValidityChecks=3504914  nbPropagations=112  nbRevisions=0  nbUselessRevisions=0
1.82/1.91	     nbRemovedValues=84  detectedInconsistency=no
1.82/1.91	       =>  wckTime=0.359  cpuTime=0.35  mem=42M112
18.21/18.46	   
18.21/18.46	   INFO : Stopping use of transposition table (mapSize=101, nbTooLargekeys=0, mem=42M938)

Verifier Data (download as text)

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1076314-1215186532/watcher-1076314-1215186532 -o /tmp/evaluation-result-1076314-1215186532/solver-1076314-1215186532 -C 1800 -W 2200 -M 900 --output-limit 1,15 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-1076314-1215186532.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2200 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.88 1.72 2.43 4/90 2252
/proc/meminfo: memFree=1763736/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=18572 CPUtime=0
/proc/2252/stat : 2252 (runsolver) R 2250 2252 32765 0 -1 4194368 16 0 0 0 0 0 0 0 20 0 1 0 1997620373 19017728 292 996147200 4194304 4296836 548682068304 18446744073709551615 251601153319 0 2147483391 4096 24578 0 0 0 17 0 0 0
/proc/2252/statm: 4643 292 257 25 0 2626 0

[startup+0.0709509 s]
/proc/loadavg: 0.88 1.72 2.43 4/90 2252
/proc/meminfo: memFree=1763736/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=864076 CPUtime=0.05
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 2854 0 1 0 3 2 0 0 21 0 9 0 1997620373 884813824 2380 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216019 2380 1137 9 0 210976 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 864076

[startup+0.101952 s]
/proc/loadavg: 0.88 1.72 2.43 4/90 2252
/proc/meminfo: memFree=1763736/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=865884 CPUtime=0.08
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 3685 0 1 0 6 2 0 0 21 0 9 0 1997620373 886665216 3160 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216471 3160 1681 9 0 211026 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 865884

[startup+0.301976 s]
/proc/loadavg: 0.88 1.72 2.43 4/90 2252
/proc/meminfo: memFree=1763736/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=866204 CPUtime=0.26
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 5496 0 2 0 22 4 0 0 21 0 9 0 1997620373 886992896 4920 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216551 4920 1884 9 0 211099 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 866204

[startup+0.70104 s]
/proc/loadavg: 0.88 1.72 2.43 4/90 2252
/proc/meminfo: memFree=1763736/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=866400 CPUtime=0.63
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 13624 0 2 0 53 10 0 0 21 0 9 0 1997620373 887193600 12995 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216600 12995 1969 9 0 211128 0
Current children cumulated CPU time (s) 0.63
Current children cumulated vsize (KiB) 866400

[startup+1.50112 s]
/proc/loadavg: 0.88 1.72 2.43 3/99 2261
/proc/meminfo: memFree=1610576/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=1.41
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 32210 273 2 0 122 18 0 1 21 0 9 0 1997620373 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24147 2630 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=1.07
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 18588 273 2 0 94 12 0 1 18 0 9 0 1997620374 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 101444704 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12275 273 0 0 14 4 0 1 17 0 9 0 1997620376 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.14
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 506 273 0 0 13 0 0 1 15 0 9 0 1997620378 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24147 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 867264

[startup+3.10129 s]
/proc/loadavg: 0.88 1.72 2.43 4/99 2265
/proc/meminfo: memFree=1582608/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=3.01
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33604 273 2 0 281 19 0 1 21 0 9 0 1997620373 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24201 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=2.61
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19950 273 2 0 248 12 0 1 25 0 9 0 1997620374 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4126780723 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 17 0 9 0 1997620376 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 537 273 0 0 18 0 0 1 15 0 9 0 1997620378 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24201 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.01
Current children cumulated vsize (KiB) 867264

[startup+6.30438 s]
/proc/loadavg: 1.13 1.76 2.44 4/99 2265
/proc/meminfo: memFree=1580176/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=6.19
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33614 273 2 0 599 19 0 1 21 0 9 0 1997620373 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24207 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=5.78
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19954 273 2 0 565 12 0 1 25 0 9 0 1997620374 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4126780329 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.2
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 543 273 0 0 19 0 0 1 15 0 9 0 1997620378 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24207 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 867264

[startup+12.7024 s]
/proc/loadavg: 1.28 1.78 2.44 3/99 2265
/proc/meminfo: memFree=1486992/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=12.55
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33621 273 2 0 1234 20 0 1 21 0 9 0 1997620373 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24211 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=12.14
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19957 273 2 0 1200 13 0 1 25 0 9 0 1997620374 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4126780482 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.2
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 547 273 0 0 19 0 0 1 15 0 9 0 1997620378 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24211 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 867264

[startup+25.5028 s]
/proc/loadavg: 1.66 1.84 2.45 3/99 2305
/proc/meminfo: memFree=1625800/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=25.27
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33630 273 2 0 2504 22 0 1 21 0 9 0 1997620373 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24214 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=24.85
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19960 273 2 0 2469 15 0 1 25 0 9 0 1997620374 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4126780466 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.21
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 553 273 0 0 20 0 0 1 16 0 9 0 1997620378 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.27
Current children cumulated vsize (KiB) 867264

[startup+51.1027 s]
/proc/loadavg: 1.77 1.85 2.44 3/99 2305
/proc/meminfo: memFree=1625864/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=50.74
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33632 273 2 0 5051 22 0 1 21 0 9 0 1997620373 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24214 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=50.32
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19960 273 2 0 5016 15 0 1 25 0 9 0 1997620374 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4126780482 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.21
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 555 273 0 0 20 0 0 1 16 0 9 0 1997620378 888078336 24214 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01

################
# More data... #
################

/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.26
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 581 273 0 0 24 1 0 1 16 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1534.52
Current children cumulated vsize (KiB) 867264

[startup+1602.3 s]
/proc/loadavg: 2.00 1.97 2.05 3/99 2311
/proc/meminfo: memFree=1619016/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=1594.22
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33664 273 2 0 159395 26 0 1 21 0 9 0 1997620373 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24232 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=1593.76
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19966 273 2 0 159356 19 0 1 25 0 9 0 1997620374 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4126780492 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.26
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 581 273 0 0 24 1 0 1 16 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1594.22
Current children cumulated vsize (KiB) 867264

[startup+1662.3 s]
/proc/loadavg: 2.00 1.97 2.05 3/99 2311
/proc/meminfo: memFree=1619080/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=1653.92
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33664 273 2 0 165365 26 0 1 21 0 9 0 1997620373 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24232 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=1653.46
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19966 273 2 0 165326 19 0 1 25 0 9 0 1997620374 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4126780299 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.26
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 581 273 0 0 24 1 0 1 16 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1653.92
Current children cumulated vsize (KiB) 867264

[startup+1722.3 s]
/proc/loadavg: 2.10 2.00 2.05 3/99 2311
/proc/meminfo: memFree=1619080/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=1713.63
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33664 273 2 0 171335 27 0 1 21 0 9 0 1997620373 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24232 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=1713.16
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19966 273 2 0 171296 19 0 1 25 0 9 0 1997620374 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4126780325 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.26
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 581 273 0 0 24 1 0 1 16 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1713.63
Current children cumulated vsize (KiB) 867264

[startup+1782.3 s]
/proc/loadavg: 2.11 2.02 2.05 3/99 2311
/proc/meminfo: memFree=1618888/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=1773.33
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33664 273 2 0 177305 27 0 1 21 0 9 0 1997620373 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24232 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=1772.87
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19966 273 2 0 177266 20 0 1 25 0 9 0 1997620374 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4126769977 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.26
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 581 273 0 0 24 1 0 1 16 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1773.33
Current children cumulated vsize (KiB) 867264



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1809.1 s]
/proc/loadavg: 2.07 2.01 2.05 3/99 2311
/proc/meminfo: memFree=1618888/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=1800
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33664 273 2 0 179972 27 0 1 21 0 9 0 1997620373 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24232 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=1799.54
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19966 273 2 0 179933 20 0 1 25 0 9 0 1997620374 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4126780299 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.26
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 581 273 0 0 24 1 0 1 16 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 867264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1809.1 s]
/proc/loadavg: 2.07 2.01 2.05 3/99 2311
/proc/meminfo: memFree=1618888/2055920 swapFree=4176360/4192956
[pid=2252] ppid=2250 vsize=867264 CPUtime=1800
/proc/2252/stat : 2252 (java) S 2250 2252 32765 0 -1 0 33664 273 2 0 179972 27 0 1 21 0 9 0 1997620373 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/2252/statm: 216816 24232 2634 9 0 211322 0
[pid=2252/tid=2254] ppid=2250 vsize=867264 CPUtime=1799.54
/proc/2252/task/2254/stat : 2254 (java) R 2250 2252 32765 0 -1 64 19966 273 2 0 179933 20 0 1 25 0 9 0 1997620374 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4126780299 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2255] ppid=2250 vsize=867264 CPUtime=0.19
/proc/2252/task/2255/stat : 2255 (java) S 2250 2252 32765 0 -1 64 12276 273 0 0 14 4 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2256] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2256/stat : 2256 (java) S 2250 2252 32765 0 -1 64 16 273 0 0 0 0 0 1 17 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2257] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2257/stat : 2257 (java) S 2250 2252 32765 0 -1 64 9 273 0 0 0 0 0 1 16 0 9 0 1997620376 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2252/tid=2258] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2258/stat : 2258 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2259] ppid=2250 vsize=867264 CPUtime=0.26
/proc/2252/task/2259/stat : 2259 (java) S 2250 2252 32765 0 -1 64 581 273 0 0 24 1 0 1 16 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2260] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2260/stat : 2260 (java) S 2250 2252 32765 0 -1 64 1 273 0 0 0 0 0 1 25 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2252/tid=2261] ppid=2250 vsize=867264 CPUtime=0.01
/proc/2252/task/2261/stat : 2261 (java) S 2250 2252 32765 0 -1 64 6 273 0 0 0 0 0 1 15 0 9 0 1997620378 888078336 24232 996147200 134512640 134550740 4294955936 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 867264

Child status: 143
Real time (s): 1809.14
CPU time (s): 1800.04
CPU user time (s): 1799.74
CPU system time (s): 0.301954
CPU usage (%): 99.4973
Max. virtual memory (cumulated for all children) (KiB): 867264

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.74
system time used= 0.301954
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33970
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37935
involuntary context switches= 41841

runsolver used 2.12668 second user time and 6.16306 second system time

The end

Launcher Data (download as text)

Begin job on node91 at 2008-07-04 17:48:53
IDJOB=1076314
IDBENCH=56579
IDSOLVER=363
FILE ID=node91/1076314-1215186532
PBS_JOBID= 7881615
Free space on /tmp= 66456 MiB

SOLVER NAME= Abscon 112v4 AC
BENCH NAME= CPAI08/csp/ogdVg/normalized-crossword-m1c-ogd-vg9-12_ext.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax BENCHNAME
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1076314-1215186532/watcher-1076314-1215186532 -o /tmp/evaluation-result-1076314-1215186532/solver-1076314-1215186532 -C 1800 -W 2200 -M 900 --output-limit 1,15  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-1076314-1215186532.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= 7b8f18265e9fe9d12868e89463d2e25f
RANDOM SEED=1961179518

node91.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1765688 kB
Buffers:          6952 kB
Cached:         181500 kB
SwapCached:       7456 kB
Active:         158068 kB
Inactive:        85628 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1765688 kB
SwapTotal:     4192956 kB
SwapFree:      4176360 kB
Dirty:           64000 kB
Writeback:           0 kB
Mapped:          68636 kB
Slab:            31008 kB
Committed_AS: 12519976 kB
PageTables:       2380 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66444 MiB
End job on node91 at 2008-07-04 18:19:04