Trace number 1064306

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 112v4 ESAC? (TO) 1800.09 1801.77

General information on the benchmark

Namecsp/tdsp/
normalized-C4-3-61.xml
MD5SUMd06c404729772397116756d2a12b34b6
Bench CategoryN-ARY-INT (n-ary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark12.2371
Satisfiable
(Un)Satisfiability was proved
Number of variables149
Number of constraints1274
Maximum constraint arity6
Maximum domain size62
Number of constraints which are defined in extension0
Number of constraints which are defined in intension1274
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03/0.09	
0.03/0.09	Abscon 112 (May, 2008)
0.20/0.25	
0.20/0.25	   configuration
0.20/0.25	     name=esac.xml
0.20/0.29	   
0.20/0.29	   instance
0.20/0.29	     name=HOME/instance-1064306-1215140504.xml
0.29/0.32	   
0.29/0.32	   domains being loaded...
0.29/0.33	   
0.29/0.33	   variables being loaded...
0.29/0.38	     nbVariables=149  nbDomainTypes=5  minDomainSize=1  maxDomainSize=62  nbTotalValues=6127
0.29/0.38	       =>  wckTime=0.128  cpuTime=0.11  mem=7M919
0.29/0.38	   
0.29/0.38	   predicates being loaded...
0.39/0.45	   
0.39/0.45	   constraints being loaded...
2.68/2.70	     nbConstraints=1274  nbSingletonDomainVariables=2  nbConflictsStructures=84  nbSharedConflictsStructures=14
2.68/2.70	     nbUnbuiltConflictsStructures=910  nbSharedBinaryRepresentations=0  nbEvaluationManagers=994
2.68/2.70	     nbSharedEvaluationManagers=280  minDegree=49  maxDegree=50  minArity=3  avgArity=5.77  maxArity=6  nbGenerators=0
2.68/2.70	     nbFusions=0  symmetryWckTime=0.197  symmetryCpuTime=0.12
2.68/2.70	       =>  wckTime=2.447  cpuTime=2.07  mem=20M376
2.78/2.81	   
2.78/2.81	   solver IterativeSystematicSolver being built... 
2.89/2.98	   
2.89/2.99	   INFO : Forward propagation technique limited 
2.98/3.05	       =>  wckTime=2.795  cpuTime=2.31  mem=53M948
3.98/4.04	   
3.98/4.04	   preprocessing
3.98/4.04	     nbConstraintChecks=633613  nbValidityChecks=112968  nbPropagations=541  nbRevisions=9554  nbUselessRevisions=8963
3.98/4.04	     nbSingletonTests=153  nbEffectiveSingletonTests=0  nbACRemovals=468  nbFoundSingletons=0  nbRemovedValues=468
3.98/4.04	     detectedInconsistency=no
3.98/4.04	       =>  wckTime=0.983  cpuTime=0.96  mem=53M948
63.12/63.30	   
63.12/63.30	   INFO : Stopping use of transposition table (mapSize=101, nbTooLargekeys=0, mem=27M53)

Verifier Data (download as text)

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1064306-1215140504/watcher-1064306-1215140504 -o /tmp/evaluation-result-1064306-1215140504/solver-1064306-1215140504 -C 1800 -W 2200 -M 900 --output-limit 1,15 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution esac.xml 1 XSax HOME/instance-1064306-1215140504.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2200 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.06 2.02 2.00 3/81 19890
/proc/meminfo: memFree=1040464/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=10616 CPUtime=0
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 676 0 0 0 0 0 0 0 18 0 2 0 1993019247 10870784 472 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 2654 472 209 9 0 1184 0
[pid=19890/tid=19891] ppid=19888 vsize=10616 CPUtime=0
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 0 0 0 0 0 0 0 0 19 0 2 0 1993019248 10870784 472 996147200 134512640 134550740 4294955968 18446744073709551615 9261016 0 0 4096 0 0 0 0 -1 1 0 0

[startup+0.042244 s]
/proc/loadavg: 2.06 2.02 2.00 3/81 19890
/proc/meminfo: memFree=1040464/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=861876 CPUtime=0.03
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 2272 0 1 0 1 2 0 0 18 0 5 0 1993019247 882561024 1879 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800971 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 215469 1879 860 9 0 210448 0
[pid=19890/tid=19891] ppid=19888 vsize=862716 CPUtime=0.03
/proc/19890/task/19891/stat : 19891 (java) S 19888 19890 18713 0 -1 64 1686 0 1 0 2 1 0 0 18 0 7 0 1993019248 883421184 1961 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 861876

[startup+0.108387 s]
/proc/loadavg: 2.06 2.02 2.00 3/81 19890
/proc/meminfo: memFree=1040464/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=865884 CPUtime=0.1
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 3758 0 1 0 7 3 0 0 18 0 9 0 1993019247 886665216 3216 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 216471 3216 1709 9 0 211026 0
[pid=19890/tid=19891] ppid=19888 vsize=865884 CPUtime=0.07
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 2845 0 1 0 5 2 0 0 18 0 9 0 1993019248 886665216 3216 996147200 134512640 134550740 4294955968 18446744073709551615 4160643169 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 865884

[startup+0.301422 s]
/proc/loadavg: 2.06 2.02 2.00 3/81 19890
/proc/meminfo: memFree=1040464/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=866368 CPUtime=0.29
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 5828 0 1 0 24 5 0 0 18 0 9 0 1993019247 887160832 5202 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 216592 5202 1953 9 0 211120 0
[pid=19890/tid=19891] ppid=19888 vsize=866368 CPUtime=0.24
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 4876 0 1 0 20 4 0 0 18 0 9 0 1993019248 887160832 5202 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 866368

[startup+0.701497 s]
/proc/loadavg: 2.06 2.02 2.00 3/81 19890
/proc/meminfo: memFree=1040464/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=867636 CPUtime=0.69
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 9501 0 1 0 62 7 0 0 18 0 9 0 1993019247 888459264 8861 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 216909 8862 2010 9 0 211415 0
[pid=19890/tid=19891] ppid=19888 vsize=867636 CPUtime=0.53
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 8173 0 1 0 47 6 0 0 19 0 9 0 1993019248 888459264 8863 996147200 134512640 134550740 4294955968 18446744073709551615 4126539130 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 867636

[startup+1.50164 s]
/proc/loadavg: 2.06 2.02 2.00 3/90 19899
/proc/meminfo: memFree=998792/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=867548 CPUtime=1.49
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 17893 0 1 0 136 13 0 0 18 0 9 0 1993019247 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 216887 17228 2003 9 0 211415 0
[pid=19890/tid=19891] ppid=19888 vsize=867548 CPUtime=1.23
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 15789 0 1 0 111 12 0 0 20 0 9 0 1993019248 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4126520455 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=867548 CPUtime=0.02
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 722 0 0 0 2 0 0 0 17 0 9 0 1993019250 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19894] ppid=19888 vsize=867548 CPUtime=0
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 1993019250 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=867548 CPUtime=0
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 1993019250 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=867548 CPUtime=0
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 1993019252 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=867548 CPUtime=0.21
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 685 0 0 0 21 0 0 0 15 0 9 0 1993019252 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=867548 CPUtime=0
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 0 0 0 0 0 0 0 19 0 9 0 1993019252 888369152 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=867552 CPUtime=0
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 1993019252 888373248 17228 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 867548

[startup+3.10292 s]
/proc/loadavg: 2.06 2.02 2.00 3/90 19899
/proc/meminfo: memFree=975048/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869104 CPUtime=3.09
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 36160 434 1 0 282 23 3 1 18 0 9 0 1993019247 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217276 20680 2637 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869104 CPUtime=2.59
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 27801 434 1 0 237 18 3 1 18 0 9 0 1993019248 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4125967985 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869104 CPUtime=0.22
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 6634 434 0 0 16 2 3 1 17 0 9 0 1993019250 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869104 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869104 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869104 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869104 CPUtime=0.32
/proc/19890/task/19897/stat : 19897 (java) R 19888 19890 18713 0 -1 64 887 434 0 0 28 0 3 1 15 0 9 0 1993019252 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869104 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869104 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 15 0 9 0 1993019252 889962496 20680 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 869104

[startup+6.3015 s]
/proc/loadavg: 2.06 2.02 2.00 3/90 19903
/proc/meminfo: memFree=953608/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=6.29
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 40898 434 1 0 599 26 3 1 18 0 9 0 1993019247 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24133 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=5.66
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28013 434 1 0 543 19 3 1 25 0 9 0 1993019248 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4126860983 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.36
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 914 434 0 0 32 0 3 1 16 0 9 0 1993019252 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24133 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 869016

[startup+12.7026 s]
/proc/loadavg: 2.05 2.02 2.00 3/90 19903
/proc/meminfo: memFree=953480/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=12.69
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 40920 434 1 0 1239 26 3 1 18 0 9 0 1993019247 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24150 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=12.04
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28017 434 1 0 1181 19 3 1 25 0 9 0 1993019248 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4126862223 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.38
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 932 434 0 0 34 0 3 1 15 0 9 0 1993019252 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24150 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 869016

[startup+25.5019 s]
/proc/loadavg: 2.04 2.01 2.00 3/90 19903
/proc/meminfo: memFree=953288/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=25.47
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 40982 434 1 0 2517 26 3 1 18 0 9 0 1993019247 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24206 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=24.8
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28024 434 1 0 2457 19 3 1 25 0 9 0 1993019248 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4126860519 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.4
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 987 434 0 0 36 0 3 1 16 0 9 0 1993019252 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24206 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 869016

[startup+51.1016 s]
/proc/loadavg: 2.03 2.01 2.00 3/90 19903
/proc/meminfo: memFree=953224/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=51.04
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 40992 434 1 0 5074 26 3 1 18 0 9 0 1993019247 889872384 24214 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24214 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=50.35
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28025 434 1 0 5012 19 3 1 25 0 9 0 1993019248 889872384 24214 996147200 134512640 134550740 4294955968 18446744073709551615 4126859210 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31

################
# More data... #
################

/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.42
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 1001 434 0 0 38 0 3 1 16 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1540.83
Current children cumulated vsize (KiB) 869016

[startup+1602.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/93 19951
/proc/meminfo: memFree=1650424/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=1600.77
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 41001 434 1 0 160040 33 3 1 18 0 9 0 1993019247 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24218 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=1600.08
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28029 434 1 0 159978 26 3 1 25 0 9 0 1993019248 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4127202087 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.42
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 1001 434 0 0 38 0 3 1 16 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1600.77
Current children cumulated vsize (KiB) 869016

[startup+1662.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/93 19951
/proc/meminfo: memFree=1650424/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=1660.72
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 41001 434 1 0 166035 33 3 1 18 0 9 0 1993019247 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24218 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=1660.02
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28029 434 1 0 165972 26 3 1 25 0 9 0 1993019248 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4126095759 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.42
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 1001 434 0 0 38 0 3 1 16 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1660.72
Current children cumulated vsize (KiB) 869016

[startup+1722.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/93 19951
/proc/meminfo: memFree=1650360/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=1720.67
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 41001 434 1 0 172029 34 3 1 18 0 9 0 1993019247 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24218 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=1719.97
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28029 434 1 0 171967 26 3 1 25 0 9 0 1993019248 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4126860983 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.42
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 1001 434 0 0 38 0 3 1 16 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1720.67
Current children cumulated vsize (KiB) 869016

[startup+1782.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/93 19951
/proc/meminfo: memFree=1650232/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=1780.62
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 41001 434 1 0 178024 34 3 1 18 0 9 0 1993019247 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24218 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=1779.92
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28029 434 1 0 177962 26 3 1 25 0 9 0 1993019248 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4127190183 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.42
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 1001 434 0 0 38 0 3 1 16 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1780.62
Current children cumulated vsize (KiB) 869016



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.7 s]
/proc/loadavg: 1.99 1.98 1.99 3/93 19951
/proc/meminfo: memFree=1650232/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=1800.01
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 41001 434 1 0 179963 34 3 1 18 0 9 0 1993019247 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24218 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=1799.31
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28029 434 1 0 179901 26 3 1 25 0 9 0 1993019248 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4126856094 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.42
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 1001 434 0 0 38 0 3 1 16 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 869016

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1801.7 s]
/proc/loadavg: 1.99 1.98 1.99 3/93 19951
/proc/meminfo: memFree=1650232/2055920 swapFree=4110824/4192956
[pid=19890] ppid=19888 vsize=869016 CPUtime=1800.01
/proc/19890/stat : 19890 (java) S 19888 19890 18713 0 -1 0 41001 434 1 0 179963 34 3 1 18 0 9 0 1993019247 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19890/statm: 217254 24218 2615 9 0 211782 0
[pid=19890/tid=19891] ppid=19888 vsize=869016 CPUtime=1799.31
/proc/19890/task/19891/stat : 19891 (java) R 19888 19890 18713 0 -1 64 28029 434 1 0 179901 26 3 1 25 0 9 0 1993019248 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4126856094 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19893] ppid=19888 vsize=869016 CPUtime=0.31
/proc/19890/task/19893/stat : 19893 (java) S 19888 19890 18713 0 -1 64 11103 434 0 0 23 4 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19894] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19894/stat : 19894 (java) S 19888 19890 18713 0 -1 64 18 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19895] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19895/stat : 19895 (java) S 19888 19890 18713 0 -1 64 8 434 0 0 0 0 3 1 16 0 9 0 1993019250 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19896] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19896/stat : 19896 (java) S 19888 19890 18713 0 -1 64 0 434 0 0 0 0 3 1 18 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19897] ppid=19888 vsize=869016 CPUtime=0.42
/proc/19890/task/19897/stat : 19897 (java) S 19888 19890 18713 0 -1 64 1001 434 0 0 38 0 3 1 16 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19890/tid=19898] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19898/stat : 19898 (java) S 19888 19890 18713 0 -1 64 2 434 0 0 0 0 3 1 19 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=19890/tid=19899] ppid=19888 vsize=869016 CPUtime=0.04
/proc/19890/task/19899/stat : 19899 (java) S 19888 19890 18713 0 -1 64 38 434 0 0 0 0 3 1 15 0 9 0 1993019252 889872384 24218 996147200 134512640 134550740 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 869016

Child status: 143
Real time (s): 1801.77
CPU time (s): 1800.09
CPU user time (s): 1799.72
CPU system time (s): 0.375942
CPU usage (%): 99.9069
Max. virtual memory (cumulated for all children) (KiB): 869104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.72
system time used= 0.375942
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 41465
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38203
involuntary context switches= 22976

runsolver used 2.16167 second user time and 6.05608 second system time

The end

Launcher Data (download as text)

Begin job on node70 at 2008-07-04 05:01:44
IDJOB=1064306
IDBENCH=54935
IDSOLVER=364
FILE ID=node70/1064306-1215140504
PBS_JOBID= 7877374
Free space on /tmp= 66448 MiB

SOLVER NAME= Abscon 112v4 ESAC
BENCH NAME= CPAI08/csp/tdsp/normalized-C4-3-61.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution esac.xml 1 XSax BENCHNAME
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1064306-1215140504/watcher-1064306-1215140504 -o /tmp/evaluation-result-1064306-1215140504/solver-1064306-1215140504 -C 1800 -W 2200 -M 900 --output-limit 1,15  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution esac.xml 1 XSax HOME/instance-1064306-1215140504.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= d06c404729772397116756d2a12b34b6
RANDOM SEED=766498741

node70.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.256
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.256
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1040944 kB
Buffers:          6724 kB
Cached:          97800 kB
SwapCached:      76424 kB
Active:         926116 kB
Inactive:        32620 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1040944 kB
SwapTotal:     4192956 kB
SwapFree:      4110824 kB
Dirty:            2232 kB
Writeback:           0 kB
Mapped:         869876 kB
Slab:            39792 kB
Committed_AS:  4885292 kB
PageTables:       3460 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66424 MiB
End job on node70 at 2008-07-04 05:31:48