Trace number 201127

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.07 1808.55

General information on the benchmark

Namefapp/fapp11-15/fapp15/
fapp15-3000-5.xml
MD5SUMcbf1a33575819e47024f404c59ea6857
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1205.71
SatisfiableYES
(Un)Satisfiability was proved
Number of variables3000
Number of constraints33021
Maximum constraint arity2
Maximum domain size182
Number of constraints which are defined in extension0
Number of constraints which are defined in intension33021
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=esac.xml
0.35	   
0.35	   instance
0.35	     name=/tmp/evaluation/201127-1168145396/unknown.xml
0.38	   
0.38	   domains being loaded...
0.41	   
0.41	   variables being loaded...
0.68	     nbVariables=3000  nbDomainTypes=23  minDomainSize=42  maxDomainSize=182
0.68	       =>  wckTime=0.364  cpuTime=0.28  mem=27M376
0.68	   
0.68	   predicates being loaded...
0.68	   
0.68	   constraints being loaded...
163.17	     nbConstraints=17754  nbMergedConstraints=15267  nbConvertedConstraints=17754  nbConvertConstraintsChecks=265246084
163.17	     nbExtensionStructures=9726  nbSharedExtensionStructures=8028  nbConflictsStructures=9726
163.17	     nbSharedConflictsStructures=8028  nbSharedBinaryRepresentations=3013359  maxDegree=15  maxArity=2
163.17	       =>  wckTime=162.849  cpuTime=160.97  mem=115M537
163.54	   
163.54	   solver IterativeSystematicSolver being built... 
163.87	       =>  wckTime=163.555  cpuTime=161.22  mem=118M675
205.57	   
205.57	   INFO : Stopping ESAC
205.58	   
205.58	   preprocessing
205.58	     nbConstraintChecks=175058116  nbPropagations=335451  nbRevisions=1582179  nbUselessRevisions=1226191
205.58	     nbSingletonTests=4829  nbEffectiveSingletonTests=26  nbESACBranches=46  nbRemovedValues=209583
205.58	     detectedInconsistency=no
205.58	       =>  wckTime=41.683  cpuTime=41.44  mem=118M675
208.11	   
208.11	   search
208.11	     run=0  nbConstraintChecks=8324608  nbPropagations=352154  nbRevisions=1663324  nbUselessRevisions=1289999
208.11	     nbAssignments=351  nbFailedAssignments=8  nbBacktracks=10  nbVisitedNodes=367  nbRestartNogoods=0  mapSize=0
208.11	     nbInferences=0  nbTooLargeKeys=343
208.11	       =>  wckTime=44.223  cpuTime=43.96  mem=120M669
209.93	   
209.93	   search
209.93	     run=1  nbConstraintChecks=16662621  nbPropagations=721006  nbRevisions=3408325  nbUselessRevisions=2644430
209.93	     nbAssignments=699  nbFailedAssignments=27  nbBacktracks=25  nbVisitedNodes=739  nbRestartNogoods=3  mapSize=0
209.93	     nbInferences=0  nbTooLargeKeys=672
209.93	       =>  wckTime=46.045  cpuTime=45.77  mem=120M669
212.51	   
212.51	   search
212.51	     run=2  nbConstraintChecks=28422270  nbPropagations=1113617  nbRevisions=5287282  nbUselessRevisions=4101920
212.51	     nbAssignments=1187  nbFailedAssignments=48  nbBacktracks=49  nbVisitedNodes=1254  nbRestartNogoods=5  mapSize=0
212.51	     nbInferences=0  nbTooLargeKeys=1139
212.51	       =>  wckTime=48.625  cpuTime=48.34  mem=120M669
226.73	   
226.73	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1595, mem=120M669)
227.57	   
227.57	   search
227.57	     run=3  nbConstraintChecks=131165854  nbPropagations=1714343  nbRevisions=8183926  nbUselessRevisions=6356716
227.57	     nbAssignments=5374  nbFailedAssignments=73  nbBacktracks=82  nbVisitedNodes=1802  nbRestartNogoods=13
227.57	       =>  wckTime=63.681  cpuTime=63.29  mem=120M669
235.31	   
235.31	   search
235.31	     run=4  nbConstraintChecks=180784285  nbPropagations=2416664  nbRevisions=11597479  nbUselessRevisions=9013827
235.31	     nbAssignments=7746  nbFailedAssignments=438  nbBacktracks=133  nbVisitedNodes=3056  nbRestartNogoods=20
235.31	       =>  wckTime=71.418  cpuTime=71.0  mem=120M669
246.20	   
246.20	   search
246.20	     run=5  nbConstraintChecks=251459628  nbPropagations=3262414  nbRevisions=15859802  nbUselessRevisions=12323445
246.20	     nbAssignments=10386  nbFailedAssignments=511  nbBacktracks=210  nbVisitedNodes=3704  nbRestartNogoods=27
246.20	       =>  wckTime=82.315  cpuTime=81.84  mem=120M669
255.34	   
255.34	   search
255.34	     run=6  nbConstraintChecks=308963337  nbPropagations=4224451  nbRevisions=20848412  nbUselessRevisions=16194491
255.34	     nbAssignments=12256  nbFailedAssignments=616  nbBacktracks=327  nbVisitedNodes=4458  nbRestartNogoods=33
255.34	       =>  wckTime=91.448  cpuTime=90.93  mem=120M669
258.39	   
258.39	   search
258.39	     run=7  nbConstraintChecks=326730126  nbPropagations=5222340  nbRevisions=26076850  nbUselessRevisions=20249406
258.39	     nbAssignments=12837  nbFailedAssignments=700  nbBacktracks=498  nbVisitedNodes=5177  nbRestartNogoods=35
258.39	       =>  wckTime=94.501  cpuTime=93.96  mem=120M669
273.98	   
273.98	   search
273.98	     run=8  nbConstraintChecks=428761994  nbPropagations=6411057  nbRevisions=32555641  nbUselessRevisions=25215935
273.98	     nbAssignments=15752  nbFailedAssignments=1189  nbBacktracks=759  nbVisitedNodes=6842  nbRestartNogoods=42
273.98	       =>  wckTime=110.088  cpuTime=109.47  mem=120M669
305.84	   
305.84	   search
305.84	     run=9  nbConstraintChecks=653798636  nbPropagations=8013417  nbRevisions=41554172  nbUselessRevisions=32057491
305.84	     nbAssignments=21905  nbFailedAssignments=1580  nbBacktracks=1145  nbVisitedNodes=8505  nbRestartNogoods=66
305.84	       =>  wckTime=141.948  cpuTime=141.18  mem=120M669
330.73	   
330.73	   search
330.73	     run=10  nbConstraintChecks=821338618  nbPropagations=9963778  nbRevisions=52615144  nbUselessRevisions=40498047
330.73	     nbAssignments=27957  nbFailedAssignments=1810  nbBacktracks=1725  nbVisitedNodes=10096  nbRestartNogoods=80
330.73	       =>  wckTime=166.845  cpuTime=165.96  mem=120M669
353.58	   
353.58	   search
353.58	     run=11  nbConstraintChecks=956864061  nbPropagations=12202842  nbRevisions=65637147  nbUselessRevisions=50452596
353.58	     nbAssignments=32549  nbFailedAssignments=2604  nbBacktracks=2591  nbVisitedNodes=13329  nbRestartNogoods=92
353.58	       =>  wckTime=189.688  cpuTime=188.69  mem=120M669
440.18	   
440.18	   search
440.18	     run=12  nbConstraintChecks=1473760133  nbPropagations=15621059  nbRevisions=86651142  nbUselessRevisions=66690668
440.18	     nbAssignments=49362  nbFailedAssignments=3599  nbBacktracks=3891  nbVisitedNodes=17332  nbRestartNogoods=114
440.18	       =>  wckTime=276.29  cpuTime=274.89  mem=120M669
499.30	   
499.30	   search
499.30	     run=13  nbConstraintChecks=1780121849  nbPropagations=19600541  nbRevisions=113005509  nbUselessRevisions=86762487
499.30	     nbAssignments=54030  nbFailedAssignments=4677  nbBacktracks=5840  nbVisitedNodes=22116  nbRestartNogoods=121
499.30	       =>  wckTime=335.41  cpuTime=333.73  mem=120M669
613.75	   
613.75	   search
613.75	     run=14  nbConstraintChecks=2382199288  nbPropagations=24835646  nbRevisions=150353550  nbUselessRevisions=115270299
613.75	     nbAssignments=63054  nbFailedAssignments=6909  nbBacktracks=8759  nbVisitedNodes=30474  nbRestartNogoods=137
613.75	       =>  wckTime=449.859  cpuTime=447.6  mem=121M665
880.99	   
880.99	   search
880.99	     run=15  nbConstraintChecks=3766949000  nbPropagations=32439441  nbRevisions=210736436  nbUselessRevisions=160845843
880.99	     nbAssignments=74123  nbFailedAssignments=10997  nbBacktracks=13140  nbVisitedNodes=44561  nbRestartNogoods=152
880.99	       =>  wckTime=717.098  cpuTime=713.48  mem=121M665
1302.48	   
1302.48	   search
1302.48	     run=16  nbConstraintChecks=5885463278  nbPropagations=43539933  nbRevisions=305503844  nbUselessRevisions=231930206
1302.48	     nbAssignments=88401  nbFailedAssignments=16935  nbBacktracks=19708  nbVisitedNodes=65017  nbRestartNogoods=171
1302.48	       =>  wckTime=1138.596  cpuTime=1133.07  mem=121M665

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node48/watcher-201127-1168145396 -o ROOT/results/node48/solver-201127-1168145396 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201127-1168145396/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.57 2.14 1.90 4/75 20698
/proc/meminfo: memFree=1108416/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=906644 CPUtime=0.02
/proc/20697/stat : 20697 (java) S 20695 20697 20133 0 -1 0 2068 0 1 0 1 1 0 0 18 0 2 0 162938303 928403456 1817 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 7368 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 226661 1817 1036 14 0 214244 0
[pid=20697/tid=20699] ppid=20695 vsize=906644 CPUtime=0
/proc/20697/task/20699/stat : 20699 (java) R 20695 20697 20133 0 -1 64 3 0 0 0 0 0 0 0 19 0 2 0 162938307 928403456 1817 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 7368 0 0 0 -1 1 0 0

[startup+0.10293 s]
/proc/loadavg: 2.57 2.14 1.90 4/75 20698
/proc/meminfo: memFree=1108416/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=914988 CPUtime=0.08
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 2979 0 1 0 7 1 0 0 18 0 8 0 162938303 936947712 2725 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072916832 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228747 2725 1423 14 0 215242 0
[pid=20697/tid=20699] ppid=20695 vsize=914988 CPUtime=0
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 18 0 8 0 162938307 936947712 2725 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.511967 s]
/proc/loadavg: 2.57 2.14 1.90 4/75 20698
/proc/meminfo: memFree=1108416/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915328 CPUtime=0.49
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 6997 0 1 0 45 4 0 0 18 0 8 0 162938303 937295872 6736 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072942731 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228832 6736 2138 14 0 215302 0
[pid=20697/tid=20699] ppid=20695 vsize=915328 CPUtime=0
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 18 0 8 0 162938307 937295872 6736 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 915328

[startup+1.34105 s]
/proc/loadavg: 2.52 2.14 1.90 3/82 20705
/proc/meminfo: memFree=1034568/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915648 CPUtime=1.32
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 22847 0 1 0 119 13 0 0 23 0 8 0 162938303 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073576446 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228912 22584 2160 14 0 215382 0
[pid=20697/tid=20699] ppid=20695 vsize=915648 CPUtime=0.09
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 6305 0 0 0 7 2 0 0 16 0 8 0 162938307 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915648 CPUtime=0.16
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 409 0 0 0 16 0 0 0 16 0 8 0 162938311 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937623552 22584 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 915648

[startup+2.98819 s]
/proc/loadavg: 2.52 2.14 1.90 3/82 20705
/proc/meminfo: memFree=1021704/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915648 CPUtime=2.95
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 24038 0 1 0 281 14 0 0 25 0 8 0 162938303 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073837083 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228912 23772 2180 14 0 215382 0
[pid=20697/tid=20699] ppid=20695 vsize=915648 CPUtime=0.17
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 7409 0 0 0 14 3 0 0 17 0 8 0 162938307 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915648 CPUtime=0.19
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 432 0 0 0 19 0 0 0 16 0 8 0 162938311 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937623552 23772 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 915648

[startup+6.26749 s]
/proc/loadavg: 2.52 2.14 1.90 3/82 20705
/proc/meminfo: memFree=1021448/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915648 CPUtime=6.22
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 24047 0 1 0 607 15 0 0 25 0 8 0 162938303 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835890 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228912 23780 2181 14 0 215382 0
[pid=20697/tid=20699] ppid=20695 vsize=915648 CPUtime=0.17
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 7409 0 0 0 14 3 0 0 17 0 8 0 162938307 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915648 CPUtime=0.21
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 439 0 0 0 21 0 0 0 16 0 8 0 162938311 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937623552 23780 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 915648

[startup+12.7571 s]
/proc/loadavg: 2.44 2.13 1.90 3/82 20705
/proc/meminfo: memFree=1015560/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915648 CPUtime=12.68
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 25561 0 1 0 1250 18 0 0 25 0 8 0 162938303 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228912 25291 2181 14 0 215382 0
[pid=20697/tid=20699] ppid=20695 vsize=915648 CPUtime=0.25
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 8913 0 0 0 22 3 0 0 17 0 8 0 162938307 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915648 CPUtime=0.22
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 446 0 0 0 22 0 0 0 16 0 8 0 162938311 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937623552 25291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 915648

[startup+25.6053 s]
/proc/loadavg: 2.37 2.13 1.90 3/82 20705
/proc/meminfo: memFree=1015752/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915648 CPUtime=25.46
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 25567 0 1 0 2525 21 0 0 25 0 8 0 162938303 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228912 25296 2181 14 0 215382 0
[pid=20697/tid=20699] ppid=20695 vsize=915648 CPUtime=0.25
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 8913 0 0 0 22 3 0 0 16 0 8 0 162938307 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915648 CPUtime=0.22
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 451 0 0 0 22 0 0 0 15 0 8 0 162938311 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937623552 25296 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 915648

[startup+51.2146 s]
/proc/loadavg: 2.23 2.11 1.90 3/82 20705
/proc/meminfo: memFree=1000264/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915648 CPUtime=50.94
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 29454 0 1 0 5062 32 0 0 25 0 8 0 162938303 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228912 29180 2181 14 0 215382 0
[pid=20697/tid=20699] ppid=20695 vsize=915648 CPUtime=0.46
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 12794 0 0 0 41 5 0 0 16 0 8 0 162938307 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915648 CPUtime=0.23
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 454 0 0 0 23 0 0 0 16 0 8 0 162938311 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937623552 29180 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 915648

[startup+102.43 s]
/proc/loadavg: 2.10 2.09 1.91 3/82 20705
/proc/meminfo: memFree=983752/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915648 CPUtime=101.93
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 33579 0 1 0 10135 58 0 0 25 0 8 0 162938303 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835232 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20697/statm: 228912 33302 2181 14 0 215382 0
[pid=20697/tid=20699] ppid=20695 vsize=915648 CPUtime=0.67
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 16916 0 0 0 60 7 0 0 16 0 8 0 162938307 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915648 CPUtime=0.23
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 454 0 0 0 23 0 0 0 16 0 8 0 162938311 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915648 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) R 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937623552 33302 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.93
Current children cumulated vsize (KiB) 915648

################
# More data... #
################

Current children cumulated CPU time (s) 1417.11
Current children cumulated vsize (KiB) 915916

[startup+1483.91 s]
/proc/loadavg: 2.01 2.00 1.93 3/81 20971
/proc/meminfo: memFree=959952/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915916 CPUtime=1476.89
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 40460 0 1 0 147565 124 0 0 25 0 8 0 162938303 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074195264 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20697/statm: 228979 40119 2545 14 0 215449 0
[pid=20697/tid=20699] ppid=20695 vsize=915916 CPUtime=1.27
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 23175 0 0 0 117 10 0 0 16 0 8 0 162938307 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915916 CPUtime=0.44
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 598 0 0 0 43 1 0 0 16 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1476.89
Current children cumulated vsize (KiB) 915916

[startup+1543.98 s]
/proc/loadavg: 2.00 2.00 1.93 3/82 20972
/proc/meminfo: memFree=959880/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915916 CPUtime=1536.69
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 40460 0 1 0 153545 124 0 0 25 0 8 0 162938303 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074211904 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20697/statm: 228979 40119 2545 14 0 215449 0
[pid=20697/tid=20699] ppid=20695 vsize=915916 CPUtime=1.27
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 23175 0 0 0 117 10 0 0 16 0 8 0 162938307 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915916 CPUtime=0.44
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 598 0 0 0 43 1 0 0 16 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1536.69
Current children cumulated vsize (KiB) 915916

[startup+1604.04 s]
/proc/loadavg: 2.00 2.00 1.93 3/82 20972
/proc/meminfo: memFree=959880/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915916 CPUtime=1596.49
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 40460 0 1 0 159525 124 0 0 25 0 8 0 162938303 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074228964 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20697/statm: 228979 40119 2545 14 0 215449 0
[pid=20697/tid=20699] ppid=20695 vsize=915916 CPUtime=1.27
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 23175 0 0 0 117 10 0 0 16 0 8 0 162938307 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915916 CPUtime=0.44
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 598 0 0 0 43 1 0 0 16 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1596.49
Current children cumulated vsize (KiB) 915916

[startup+1664.1 s]
/proc/loadavg: 2.00 2.00 1.93 4/82 20972
/proc/meminfo: memFree=959880/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915916 CPUtime=1656.26
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 40460 0 1 0 165502 124 0 0 25 0 8 0 162938303 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074237402 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20697/statm: 228979 40119 2545 14 0 215449 0
[pid=20697/tid=20699] ppid=20695 vsize=915916 CPUtime=1.27
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 23175 0 0 0 117 10 0 0 16 0 8 0 162938307 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915916 CPUtime=0.44
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 598 0 0 0 43 1 0 0 16 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1656.26
Current children cumulated vsize (KiB) 915916

[startup+1724.16 s]
/proc/loadavg: 2.00 2.00 1.93 3/82 20974
/proc/meminfo: memFree=959880/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915916 CPUtime=1716.06
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 40460 0 1 0 171482 124 0 0 25 0 8 0 162938303 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074195907 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20697/statm: 228979 40119 2545 14 0 215449 0
[pid=20697/tid=20699] ppid=20695 vsize=915916 CPUtime=1.27
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 23175 0 0 0 117 10 0 0 16 0 8 0 162938307 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915916 CPUtime=0.44
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 598 0 0 0 43 1 0 0 16 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1716.06
Current children cumulated vsize (KiB) 915916

[startup+1784.22 s]
/proc/loadavg: 2.00 2.00 1.93 3/82 20974
/proc/meminfo: memFree=959880/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915916 CPUtime=1775.85
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 40460 0 1 0 177461 124 0 0 25 0 8 0 162938303 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074221438 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20697/statm: 228979 40119 2545 14 0 215449 0
[pid=20697/tid=20699] ppid=20695 vsize=915916 CPUtime=1.27
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 23175 0 0 0 117 10 0 0 16 0 8 0 162938307 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915916 CPUtime=0.44
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 598 0 0 0 43 1 0 0 16 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1775.85
Current children cumulated vsize (KiB) 915916



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.5 s]
/proc/loadavg: 2.00 2.00 1.93 3/82 20974
/proc/meminfo: memFree=959880/2055920 swapFree=4192812/4192956
[pid=20697] ppid=20695 vsize=915916 CPUtime=1800.02
/proc/20697/stat : 20697 (java) R 20695 20697 20133 0 -1 0 40460 0 1 0 179878 124 0 0 25 0 8 0 162938303 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074197561 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20697/statm: 228979 40119 2545 14 0 215449 0
[pid=20697/tid=20699] ppid=20695 vsize=915916 CPUtime=1.27
/proc/20697/task/20699/stat : 20699 (java) S 20695 20697 20133 0 -1 64 23175 0 0 0 117 10 0 0 16 0 8 0 162938307 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20700] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20700/stat : 20700 (java) S 20695 20697 20133 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20701] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20701/stat : 20701 (java) S 20695 20697 20133 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 162938308 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20702] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20702/stat : 20702 (java) S 20695 20697 20133 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20703] ppid=20695 vsize=915916 CPUtime=0.44
/proc/20697/task/20703/stat : 20703 (java) S 20695 20697 20133 0 -1 64 598 0 0 0 43 1 0 0 16 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20704] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20704/stat : 20704 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20697/tid=20705] ppid=20695 vsize=915916 CPUtime=0
/proc/20697/task/20705/stat : 20705 (java) S 20695 20697 20133 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162938311 937897984 40119 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 915916

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1808.55
CPU time (s): 1800.07
CPU user time (s): 1798.8
CPU system time (s): 1.27081
CPU usage (%): 99.5311
Max. virtual memory (cumulated for all children) (KiB): 915916

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.8
system time used= 1.27081
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 40478
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38508
involuntary context switches= 36512

runsolver used 2.21266 s user time and 5.80112 s system time

The end

Launcher Data (download as text)

Begin job on node48 on Sun Jan  7 04:49:56 UTC 2007


IDJOB= 201127
IDBENCH= 3745
FILE ID= node48/201127-1168145396

PBS_JOBID= 3478122

Free space on /tmp= 66548 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp15/fapp15-3000-5.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201127-1168145396/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node48/watcher-201127-1168145396 -o ROOT/results/node48/solver-201127-1168145396 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201127-1168145396/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  cbf1a33575819e47024f404c59ea6857

RANDOM SEED= 296630432

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.218
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.218
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1108896 kB
Buffers:         51696 kB
Cached:         660672 kB
SwapCached:          0 kB
Active:         394240 kB
Inactive:       476060 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1108896 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            6268 kB
Writeback:           0 kB
Mapped:         169496 kB
Slab:            61888 kB
Committed_AS:  3586668 kB
PageTables:       2060 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66552 MiB



End job on node48 on Sun Jan  7 05:20:05 UTC 2007