Trace number 200838

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.1 1808.85

General information on the benchmark

Namefapp/fapp11-15/fapp14/
fapp14-2500-9.xml
MD5SUM5aac2eb20b7fc7710efc477fa975869f
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark506.936
SatisfiableYES
(Un)Satisfiability was provedYES
Number of variables2500
Number of constraints40767
Maximum constraint arity2
Maximum domain size362
Number of constraints which are defined in extension0
Number of constraints which are defined in intension40767
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=esac.xml
0.35	   
0.35	   instance
0.35	     name=/tmp/evaluation/200838-1168143843/unknown.xml
0.38	   
0.38	   domains being loaded...
0.42	   
0.42	   variables being loaded...
0.71	     nbVariables=2500  nbDomainTypes=30  minDomainSize=42  maxDomainSize=362
0.71	       =>  wckTime=0.392  cpuTime=0.3  mem=35M193
0.71	   
0.71	   predicates being loaded...
0.72	   
0.72	   constraints being loaded...
202.65	   
202.65	   INFO : Stopping converting binary constraints (cpu=200.06, mem = 139M723)
207.02	     nbConstraints=21610  nbMergedConstraints=19157  nbConvertedConstraints=3877  nbConvertConstraintsChecks=329231084
207.02	     nbExtensionStructures=3251  nbSharedExtensionStructures=626  nbConflictsStructures=3251
207.02	     nbSharedConflictsStructures=626  nbSharedBinaryRepresentations=1559930  nbEvaluationManagers=12691
207.02	     nbSharedEvaluationManagers=5042  maxDegree=27  maxArity=2
207.02	       =>  wckTime=206.704  cpuTime=203.84  mem=163M65
207.49	   
207.49	   solver IterativeSystematicSolver being built... 
208.11	       =>  wckTime=207.795  cpuTime=204.29  mem=223M803
316.54	   
316.54	   INFO : Stopping ESAC
316.54	   
316.54	   preprocessing
316.54	     nbConstraintChecks=202740081  nbValidityChecks=45824302  nbPropagations=20756  nbRevisions=304822
316.54	     nbUselessRevisions=281629  nbSingletonTests=438  nbEffectiveSingletonTests=1  nbESACBranches=5
316.54	     nbRemovedValues=247976  detectedInconsistency=no
316.54	       =>  wckTime=108.404  cpuTime=107.84  mem=223M803
327.10	   
327.10	   search
327.10	     run=0  nbConstraintChecks=17605607  nbValidityChecks=12840043  nbPropagations=26319  nbRevisions=390877
327.10	     nbUselessRevisions=359305  nbAssignments=127  nbFailedAssignments=10  nbBacktracks=13  nbVisitedNodes=144
327.10	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=117
327.10	       =>  wckTime=118.96  cpuTime=118.26  mem=201M699
333.02	   
333.02	   search
333.02	     run=1  nbConstraintChecks=29262499  nbValidityChecks=26683752  nbPropagations=58631  nbRevisions=875870
333.02	     nbUselessRevisions=803391  nbAssignments=258  nbFailedAssignments=16  nbBacktracks=29  nbVisitedNodes=283
333.02	     nbRestartNogoods=1  mapSize=0  nbInferences=0  nbTooLargeKeys=237
333.02	       =>  wckTime=124.885  cpuTime=124.15  mem=201M699
344.61	   
344.61	   search
344.61	     run=2  nbConstraintChecks=50794145  nbValidityChecks=47734318  nbPropagations=101319  nbRevisions=1518124
344.61	     nbUselessRevisions=1390193  nbAssignments=547  nbFailedAssignments=58  nbBacktracks=52  nbVisitedNodes=627
344.61	     nbRestartNogoods=3  mapSize=0  nbInferences=0  nbTooLargeKeys=484
344.61	       =>  wckTime=136.471  cpuTime=135.68  mem=201M699
374.46	   
374.46	   search
374.46	     run=3  nbConstraintChecks=110944452  nbValidityChecks=105983028  nbPropagations=172100  nbRevisions=2592728
374.46	     nbUselessRevisions=2372901  nbAssignments=1211  nbFailedAssignments=141  nbBacktracks=85  nbVisitedNodes=1083
374.46	     nbRestartNogoods=21  mapSize=0  nbInferences=0  nbTooLargeKeys=756
374.46	       =>  wckTime=166.325  cpuTime=165.38  mem=201M699
383.71	   
383.71	   search
383.71	     run=4  nbConstraintChecks=128035571  nbValidityChecks=126043494  nbPropagations=252817  nbRevisions=3851502
383.71	     nbUselessRevisions=3512439  nbAssignments=1469  nbFailedAssignments=269  nbBacktracks=135  nbVisitedNodes=1500
383.71	     nbRestartNogoods=25  mapSize=0  nbInferences=0  nbTooLargeKeys=886
383.71	       =>  wckTime=175.572  cpuTime=174.58  mem=201M699
439.92	   
439.92	   INFO : Stopping hyperNogood (mapSize=6, nbTooLargekeys=2224, mem=210M851)
440.63	   
440.63	   search
440.63	     run=5  nbConstraintChecks=237262427  nbValidityChecks=215490905  nbPropagations=386518  nbRevisions=5902315
440.64	     nbUselessRevisions=5367527  nbAssignments=3399  nbFailedAssignments=442  nbBacktracks=210  nbVisitedNodes=3461
440.64	     nbRestartNogoods=50
440.64	       =>  wckTime=232.499  cpuTime=231.22  mem=210M851
1031.58	   
1031.58	   search
1031.58	     run=6  nbConstraintChecks=1507406340  nbValidityChecks=1796093106  nbPropagations=1494170  nbRevisions=21350822
1031.58	     nbUselessRevisions=19561050  nbAssignments=43217  nbFailedAssignments=1026  nbBacktracks=323  nbVisitedNodes=5859
1031.59	     nbRestartNogoods=120
1031.59	       =>  wckTime=823.448  cpuTime=819.36  mem=211M790
1461.21	   
1461.21	   search
1461.21	     run=7  nbConstraintChecks=2430550237  nbValidityChecks=2850852406  nbPropagations=3186109  nbRevisions=45207065
1461.21	     nbUselessRevisions=41399687  nbAssignments=62144  nbFailedAssignments=2715  nbBacktracks=494  nbVisitedNodes=10498
1461.21	     nbRestartNogoods=148
1461.21	       =>  wckTime=1253.072  cpuTime=1246.47  mem=211M790
1764.93	   
1764.93	   search
1764.93	     run=8  nbConstraintChecks=3096415747  nbValidityChecks=3687845021  nbPropagations=5339299  nbRevisions=75626830
1764.94	     nbUselessRevisions=69285355  nbAssignments=79023  nbFailedAssignments=3082  nbBacktracks=750  nbVisitedNodes=12785
1764.94	     nbRestartNogoods=172
1764.94	       =>  wckTime=1556.798  cpuTime=1549.12  mem=211M790

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node25/watcher-200838-1168143843 -o ROOT/results/node25/solver-200838-1168143843 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200838-1168143843/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.11 1.98 1.93 4/86 25692
/proc/meminfo: memFree=1180240/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=18540 CPUtime=0
/proc/25691/stat : 25691 (runsolver) R 25689 25691 25088 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 162776769 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 215781797159 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/25691/statm: 4635 279 244 17 0 2626 0

[startup+0.103975 s]
/proc/loadavg: 2.11 1.98 1.93 4/86 25692
/proc/meminfo: memFree=1180240/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=914988 CPUtime=0.08
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 2957 0 1 0 6 2 0 0 19 0 8 0 162776769 936947712 2703 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155583138 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228747 2703 1415 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.512045 s]
/proc/loadavg: 2.11 1.98 1.93 4/86 25692
/proc/meminfo: memFree=1180240/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915328 CPUtime=0.48
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 7371 0 1 0 43 5 0 0 18 0 8 0 162776769 937295872 7110 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4154517342 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228832 7110 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 915328

[startup+1.33319 s]
/proc/loadavg: 2.11 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1099864/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=1.3
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 24469 0 1 0 116 14 0 0 24 0 8 0 162776769 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153380175 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228912 24206 2160 14 0 215382 0
[pid=25691/tid=25693] ppid=25689 vsize=915648 CPUtime=0.09
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 7925 0 0 0 7 2 0 0 16 0 8 0 162776774 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915648 CPUtime=0.17
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 410 0 0 0 16 1 0 0 16 0 8 0 162776777 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937623552 24206 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915648

[startup+2.97346 s]
/proc/loadavg: 2.11 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1085080/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=2.93
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 26190 0 1 0 277 16 0 0 25 0 8 0 162776769 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835816 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228912 25924 2180 14 0 215382 0
[pid=25691/tid=25693] ppid=25689 vsize=915648 CPUtime=0.2
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 9569 0 0 0 17 3 0 0 16 0 8 0 162776774 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915648 CPUtime=0.19
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 423 0 0 0 18 1 0 0 16 0 8 0 162776777 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937623552 25924 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 915648

[startup+6.27102 s]
/proc/loadavg: 2.10 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1084632/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=6.22
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 26206 0 1 0 605 17 0 0 25 0 8 0 162776769 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073830908 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228912 25939 2181 14 0 215382 0
[pid=25691/tid=25693] ppid=25689 vsize=915648 CPUtime=0.2
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 9569 0 0 0 17 3 0 0 16 0 8 0 162776774 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915648 CPUtime=0.2
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 437 0 0 0 19 1 0 0 15 0 8 0 162776777 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937623552 25939 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 915648

[startup+12.7481 s]
/proc/loadavg: 2.09 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1084640/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=12.65
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 26209 0 1 0 1248 17 0 0 25 0 8 0 162776769 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073840027 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228912 25942 2181 14 0 215382 0
[pid=25691/tid=25693] ppid=25689 vsize=915648 CPUtime=0.2
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 9569 0 0 0 17 3 0 0 16 0 8 0 162776774 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915648 CPUtime=0.21
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 440 0 0 0 20 1 0 0 16 0 8 0 162776777 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937623552 25942 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 915648

[startup+25.6113 s]
/proc/loadavg: 2.07 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1074016/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=25.46
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 28951 0 1 0 2526 20 0 0 25 0 8 0 162776769 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073833748 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228912 28681 2181 14 0 215382 0
[pid=25691/tid=25693] ppid=25689 vsize=915648 CPUtime=0.33
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 12307 0 0 0 29 4 0 0 17 0 8 0 162776774 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915648 CPUtime=0.21
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 441 0 0 0 20 1 0 0 15 0 8 0 162776777 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937623552 28681 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 915648

[startup+51.2217 s]
/proc/loadavg: 2.05 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1074016/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=50.95
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 28958 0 1 0 5073 22 0 0 25 0 8 0 162776769 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073833750 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228912 28687 2181 14 0 215382 0
[pid=25691/tid=25693] ppid=25689 vsize=915648 CPUtime=0.33
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 12307 0 0 0 29 4 0 0 16 0 8 0 162776774 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915648 CPUtime=0.22
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 447 0 0 0 21 1 0 0 16 0 8 0 162776777 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937623552 28687 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 915648

[startup+102.438 s]
/proc/loadavg: 2.02 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1043552/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=101.92
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 36591 0 1 0 10160 32 0 0 25 0 8 0 162776769 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073838504 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/25691/statm: 228912 36316 2181 14 0 215382 0
[pid=25691/tid=25693] ppid=25689 vsize=915648 CPUtime=0.77
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 19929 0 0 0 68 9 0 0 16 0 8 0 162776774 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 17 0 8 0 162776774 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915648 CPUtime=0.24
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 454 0 0 0 23 1 0 0 15 0 8 0 162776777 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915648 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937623552 36316 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.92
Current children cumulated vsize (KiB) 915648

[startup+162.504 s]
/proc/loadavg: 2.00 1.98 1.93 3/93 25699
/proc/meminfo: memFree=1031328/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915648 CPUtime=161.71
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 39623 0 1 0 16132 39 0 0 25 0 8 0 162776769 937623552 39347 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073837031 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1415.64
Current children cumulated vsize (KiB) 915936

[startup+1482.93 s]
/proc/loadavg: 2.30 2.13 2.01 3/101 25826
/proc/meminfo: memFree=862880/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915936 CPUtime=1475.46
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 67959 0 1 0 147472 74 0 0 25 0 8 0 162776769 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073834616 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/25691/statm: 228984 67602 2548 14 0 215454 0
[pid=25691/tid=25693] ppid=25689 vsize=915936 CPUtime=2.28
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 50640 0 0 0 207 21 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915936 CPUtime=0.45
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 628 0 0 0 43 2 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1475.46
Current children cumulated vsize (KiB) 915936

[startup+1542.95 s]
/proc/loadavg: 2.19 2.12 2.01 3/101 25826
/proc/meminfo: memFree=807136/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915936 CPUtime=1535.42
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 67959 0 1 0 153468 74 0 0 25 0 8 0 162776769 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074225545 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/25691/statm: 228984 67602 2548 14 0 215454 0
[pid=25691/tid=25693] ppid=25689 vsize=915936 CPUtime=2.28
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 50640 0 0 0 207 21 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915936 CPUtime=0.45
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 628 0 0 0 43 2 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1535.42
Current children cumulated vsize (KiB) 915936

[startup+1602.95 s]
/proc/loadavg: 2.06 2.09 2.00 3/101 25826
/proc/meminfo: memFree=768160/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915936 CPUtime=1595.36
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 67959 0 1 0 159462 74 0 0 25 0 8 0 162776769 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074216152 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/25691/statm: 228984 67602 2548 14 0 215454 0
[pid=25691/tid=25693] ppid=25689 vsize=915936 CPUtime=2.28
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 50640 0 0 0 207 21 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915936 CPUtime=0.45
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 628 0 0 0 43 2 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1595.36
Current children cumulated vsize (KiB) 915936

[startup+1662.97 s]
/proc/loadavg: 2.02 2.07 2.00 3/101 25826
/proc/meminfo: memFree=733344/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915936 CPUtime=1655.05
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 67959 0 1 0 165430 75 0 0 25 0 8 0 162776769 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831026 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/25691/statm: 228984 67602 2548 14 0 215454 0
[pid=25691/tid=25693] ppid=25689 vsize=915936 CPUtime=2.28
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 50640 0 0 0 207 21 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915936 CPUtime=0.45
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 628 0 0 0 43 2 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1655.05
Current children cumulated vsize (KiB) 915936

[startup+1723 s]
/proc/loadavg: 2.01 2.06 2.00 3/101 25826
/proc/meminfo: memFree=708640/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915936 CPUtime=1714.74
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 67959 0 1 0 171399 75 0 0 25 0 8 0 162776769 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074213886 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/25691/statm: 228984 67602 2548 14 0 215454 0
[pid=25691/tid=25693] ppid=25689 vsize=915936 CPUtime=2.28
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 50640 0 0 0 207 21 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915936 CPUtime=0.45
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 628 0 0 0 43 2 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1714.74
Current children cumulated vsize (KiB) 915936

[startup+1783.02 s]
/proc/loadavg: 2.06 2.06 2.00 3/101 25826
/proc/meminfo: memFree=686816/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915936 CPUtime=1774.42
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 67959 0 1 0 177367 75 0 0 25 0 8 0 162776769 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832807 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/25691/statm: 228984 67602 2548 14 0 215454 0
[pid=25691/tid=25693] ppid=25689 vsize=915936 CPUtime=2.28
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 50640 0 0 0 207 21 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915936 CPUtime=0.45
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 628 0 0 0 43 2 0 0 16 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1774.42
Current children cumulated vsize (KiB) 915936



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.76 s]
/proc/loadavg: 2.04 2.06 2.00 3/101 25826
/proc/meminfo: memFree=677792/2055920 swapFree=4192812/4192956
[pid=25691] ppid=25689 vsize=915936 CPUtime=1800.01
/proc/25691/stat : 25691 (java) R 25689 25691 25088 0 -1 0 67959 0 1 0 179926 75 0 0 25 0 8 0 162776769 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074213879 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/25691/statm: 228984 67602 2548 14 0 215454 0
[pid=25691/tid=25693] ppid=25689 vsize=915936 CPUtime=2.28
/proc/25691/task/25693/stat : 25693 (java) S 25689 25691 25088 0 -1 64 50640 0 0 0 207 21 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25694] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25694/stat : 25694 (java) S 25689 25691 25088 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25695] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25695/stat : 25695 (java) S 25689 25691 25088 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162776774 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25696] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25696/stat : 25696 (java) S 25689 25691 25088 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25697] ppid=25689 vsize=915936 CPUtime=0.45
/proc/25691/task/25697/stat : 25697 (java) S 25689 25691 25088 0 -1 64 628 0 0 0 43 2 0 0 16 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=25691/tid=25698] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25698/stat : 25698 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=25691/tid=25699] ppid=25689 vsize=915936 CPUtime=0
/proc/25691/task/25699/stat : 25699 (java) S 25689 25691 25088 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162776777 937918464 67602 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 915936

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1808.85
CPU time (s): 1800.1
CPU user time (s): 1799.3
CPU system time (s): 0.797878
CPU usage (%): 99.5162
Max. virtual memory (cumulated for all children) (KiB): 915936

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.3
system time used= 0.797878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 67977
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38634
involuntary context switches= 66526

runsolver used 2.34664 s user time and 5.72813 s system time

The end

Launcher Data (download as text)

Begin job on node25 on Sun Jan  7 04:24:04 UTC 2007


IDJOB= 200838
IDBENCH= 3730
FILE ID= node25/200838-1168143843

PBS_JOBID= 3478125

Free space on /tmp= 66543 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp14/fapp14-2500-9.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200838-1168143843/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node25/watcher-200838-1168143843 -o ROOT/results/node25/solver-200838-1168143843 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200838-1168143843/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  5aac2eb20b7fc7710efc477fa975869f

RANDOM SEED= 213113705

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1180720 kB
Buffers:         57524 kB
Cached:         614724 kB
SwapCached:          0 kB
Active:         307244 kB
Inactive:       489400 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1180720 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            7376 kB
Writeback:           0 kB
Mapped:         146780 kB
Slab:            63164 kB
Committed_AS:  3369780 kB
PageTables:       2532 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66544 MiB



End job on node25 on Sun Jan  7 04:54:13 UTC 2007