Trace number 248492

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.06 1803.54

General information on the benchmark

Nameprimes/primes-30/
primes-30-40-3-3.xml
MD5SUM5651b6d1b7917bf8008d399785c6ab34
Bench CategoryN-ARY-INT (n-ary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark16.9404
SatisfiableYES
(Un)Satisfiability was proved
Number of variables100
Number of constraints40
Maximum constraint arity6
Maximum domain size112
Number of constraints which are defined in extension0
Number of constraints which are defined in intension40
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=esac.xml
0.35	   
0.35	   instance
0.35	     name=/tmp/evaluation/248492-1168400208/unknown.xml
0.38	   
0.38	   domains being loaded...
0.38	   
0.38	   variables being loaded...
0.43	     nbVariables=100  nbDomainTypes=1  minDomainSize=112  maxDomainSize=112
0.43	       =>  wckTime=0.112  cpuTime=0.1  mem=7M927
0.43	   
0.43	   predicates being loaded...
0.46	   
0.46	   constraints being loaded...
0.55	     nbConstraints=40  nbSingletonDomainVariables=16  nbDisconnectedVariables=16  nbUnbuiltConflictsStructures=40
0.55	     nbSharedBinaryRepresentations=0  nbEvaluationManagers=40  nbSharedEvaluationManagers=0  maxDegree=5  maxArity=6
0.55	       =>  wckTime=0.23  cpuTime=0.19  mem=9M878
0.58	   
0.58	   solver IterativeSystematicSolver being built... 
0.76	       =>  wckTime=0.447  cpuTime=0.34  mem=15M644
4.38	   
4.38	   preprocessing
4.38	     nbConstraintChecks=8626846  nbValidityChecks=1910  nbPropagations=251  nbRevisions=64  nbUselessRevisions=14
4.38	     nbSingletonTests=127  nbEffectiveSingletonTests=0  nbESACBranches=11  nbRemovedValues=778  detectedInconsistency=no
4.38	       =>  wckTime=3.613  cpuTime=3.56  mem=15M644
4.65	   
4.65	   search
4.65	     run=0  nbConstraintChecks=407590  nbValidityChecks=3543  nbPropagations=330  nbRevisions=151  nbUselessRevisions=43
4.65	     nbAssignments=33  nbFailedAssignments=8  nbBacktracks=10  nbVisitedNodes=42  nbRestartNogoods=0  mapSize=8
4.65	     nbInferences=0  nbTooLargeKeys=0
4.65	       =>  wckTime=3.885  cpuTime=3.81  mem=16M685
5.65	   
5.65	   search
5.65	     run=1  nbConstraintChecks=2282624  nbValidityChecks=27974  nbPropagations=1106  nbRevisions=769
5.65	     nbUselessRevisions=191  nbAssignments=182  nbFailedAssignments=44  nbBacktracks=30  nbVisitedNodes=149
5.65	     nbRestartNogoods=8  mapSize=26  nbInferences=0  nbTooLargeKeys=0
5.65	       =>  wckTime=4.883  cpuTime=4.79  mem=16M685
14.50	   
14.50	   search
14.50	     run=2  nbConstraintChecks=17400038  nbValidityChecks=106525  nbPropagations=4636  nbRevisions=3764
14.50	     nbUselessRevisions=854  nbAssignments=1419  nbFailedAssignments=699  nbBacktracks=52  nbVisitedNodes=1497
14.50	     nbRestartNogoods=42  mapSize=42  nbInferences=0  nbTooLargeKeys=0
14.50	       =>  wckTime=13.736  cpuTime=13.51  mem=16M685
20.04	   
20.04	   search
20.04	     run=3  nbConstraintChecks=28252667  nbValidityChecks=220798  nbPropagations=12557  nbRevisions=10806
20.04	     nbUselessRevisions=3062  nbAssignments=3203  nbFailedAssignments=881  nbBacktracks=87  nbVisitedNodes=1905
20.04	     nbRestartNogoods=138  mapSize=65  nbInferences=0  nbTooLargeKeys=0
20.04	       =>  wckTime=19.276  cpuTime=19.0  mem=16M685
21.29	   
21.29	   search
21.29	     run=4  nbConstraintChecks=30548203  nbValidityChecks=244415  nbPropagations=21427  nbRevisions=18713
21.29	     nbUselessRevisions=5499  nbAssignments=3515  nbFailedAssignments=937  nbBacktracks=139  nbVisitedNodes=2077
21.29	     nbRestartNogoods=167  mapSize=104  nbInferences=0  nbTooLargeKeys=0
21.29	       =>  wckTime=20.526  cpuTime=20.23  mem=16M685
22.66	   
22.66	   search
22.66	     run=5  nbConstraintChecks=33013379  nbValidityChecks=259053  nbPropagations=31033  nbRevisions=27334
22.66	     nbUselessRevisions=8101  nbAssignments=3731  nbFailedAssignments=1017  nbBacktracks=215  nbVisitedNodes=2321
22.66	     nbRestartNogoods=184  mapSize=168  nbInferences=0  nbTooLargeKeys=0
22.66	       =>  wckTime=21.898  cpuTime=21.59  mem=16M685
31.91	   
31.91	   search
31.91	     run=6  nbConstraintChecks=47695323  nbValidityChecks=327667  nbPropagations=43688  nbRevisions=38456
31.91	     nbUselessRevisions=10965  nbAssignments=4601  nbFailedAssignments=1759  nbBacktracks=328  nbVisitedNodes=3933
31.91	     nbRestartNogoods=200  mapSize=251  nbInferences=0  nbTooLargeKeys=0
31.91	       =>  wckTime=31.145  cpuTime=30.73  mem=16M685
46.01	   
46.01	   search
46.01	     run=7  nbConstraintChecks=69883727  nbValidityChecks=494313  nbPropagations=62311  nbRevisions=54856
46.01	     nbUselessRevisions=15086  nbAssignments=6665  nbFailedAssignments=2766  nbBacktracks=498  nbVisitedNodes=6131
46.01	     nbRestartNogoods=325  mapSize=417  nbInferences=0  nbTooLargeKeys=0
46.01	       =>  wckTime=45.244  cpuTime=44.76  mem=16M685
61.76	   
61.76	   search
61.76	     run=8  nbConstraintChecks=95555909  nbValidityChecks=695180  nbPropagations=89131  nbRevisions=77849
61.76	     nbUselessRevisions=20040  nbAssignments=9518  nbFailedAssignments=3892  nbBacktracks=755  nbVisitedNodes=8656
61.76	     nbRestartNogoods=499  mapSize=670  nbInferences=0  nbTooLargeKeys=0
61.76	       =>  wckTime=60.997  cpuTime=60.44  mem=16M685
71.12	   
71.12	   INFO : Stopping hyperNogood (mapSize=1012, nbTooLargekeys=0, mem=17M660)
71.58	   
71.58	   search
71.58	     run=9  nbConstraintChecks=113095121  nbValidityChecks=925360  nbPropagations=123154  nbRevisions=108119
71.58	     nbUselessRevisions=27293  nbAssignments=11680  nbFailedAssignments=4383  nbBacktracks=1139  nbVisitedNodes=10040
71.58	     nbRestartNogoods=666
71.58	       =>  wckTime=70.817  cpuTime=70.22  mem=17M660
80.44	   
80.44	   search
80.44	     run=10  nbConstraintChecks=128305080  nbValidityChecks=1061771  nbPropagations=161615  nbRevisions=142873
80.44	     nbUselessRevisions=35612  nbAssignments=12942  nbFailedAssignments=4903  nbBacktracks=1716  nbVisitedNodes=11672
80.44	     nbRestartNogoods=734
80.44	       =>  wckTime=79.67  cpuTime=79.02  mem=17M660
98.54	   
98.54	   search
98.54	     run=11  nbConstraintChecks=157838375  nbValidityChecks=1353988  nbPropagations=206697  nbRevisions=184489
98.54	     nbUselessRevisions=45176  nbAssignments=14730  nbFailedAssignments=5813  nbBacktracks=2580  nbVisitedNodes=14370
98.54	     nbRestartNogoods=796
98.54	       =>  wckTime=97.779  cpuTime=97.04  mem=17M660
136.11	   
136.11	   search
136.11	     run=12  nbConstraintChecks=218788940  nbValidityChecks=2091881  nbPropagations=263846  nbRevisions=238326
136.11	     nbUselessRevisions=56771  nbAssignments=18091  nbFailedAssignments=7160  nbBacktracks=3878  nbVisitedNodes=18376
136.11	     nbRestartNogoods=855
136.11	       =>  wckTime=135.342  cpuTime=134.43  mem=17M660
220.33	   
220.33	   search
220.33	     run=13  nbConstraintChecks=352320885  nbValidityChecks=3233545  nbPropagations=345957  nbRevisions=313433
220.33	     nbUselessRevisions=71314  nbAssignments=26942  nbFailedAssignments=13299  nbBacktracks=5825  nbVisitedNodes=32616
220.33	     nbRestartNogoods=940
220.33	       =>  wckTime=219.568  cpuTime=218.26  mem=17M660
586.16	   
586.16	   search
586.16	     run=14  nbConstraintChecks=904506531  nbValidityChecks=6493580  nbPropagations=492742  nbRevisions=458246
586.16	     nbUselessRevisions=88671  nbAssignments=56159  nbFailedAssignments=38913  nbBacktracks=8745  nbVisitedNodes=86787
586.16	     nbRestartNogoods=990
586.16	       =>  wckTime=585.396  cpuTime=583.17  mem=17M660
653.92	   
653.92	   search
653.92	     run=15  nbConstraintChecks=1022942986  nbValidityChecks=7712750  nbPropagations=669121  nbRevisions=629284
653.92	     nbUselessRevisions=110445  nbAssignments=67250  nbFailedAssignments=42096  nbBacktracks=13125  nbVisitedNodes=97562
653.92	     nbRestartNogoods=1300
653.92	       =>  wckTime=653.15  cpuTime=650.84  mem=17M660
748.96	   
748.96	   search
748.96	     run=16  nbConstraintChecks=1183936538  nbValidityChecks=9241959  nbPropagations=880144  nbRevisions=832352
748.96	     nbUselessRevisions=137119  nbAssignments=81079  nbFailedAssignments=46994  nbBacktracks=19693
748.96	     nbVisitedNodes=113947  nbRestartNogoods=1463
748.96	       =>  wckTime=748.198  cpuTime=745.79  mem=17M660
943.86	   
943.86	   search
943.86	     run=17  nbConstraintChecks=1480073246  nbValidityChecks=12019362  nbPropagations=1162963  nbRevisions=1098633
943.86	     nbUselessRevisions=173826  nbAssignments=105331  nbFailedAssignments=59429  nbBacktracks=29545
943.86	     nbVisitedNodes=148690  nbRestartNogoods=1550
943.86	       =>  wckTime=943.092  cpuTime=940.49  mem=17M660
1045.92	   
1045.92	   search
1045.92	     run=18  nbConstraintChecks=1643546436  nbValidityChecks=13699325  nbPropagations=1496951  nbRevisions=1407838
1045.92	     nbUselessRevisions=221661  nbAssignments=125016  nbFailedAssignments=63045  nbBacktracks=44335
1045.92	     nbVisitedNodes=170731  nbRestartNogoods=1672
1045.92	       =>  wckTime=1045.151  cpuTime=1042.44  mem=17M660
1206.16	   
1206.16	   search
1206.16	     run=19  nbConstraintChecks=1896567398  nbValidityChecks=16456944  nbPropagations=1906463  nbRevisions=1781939
1206.16	     nbUselessRevisions=286698  nbAssignments=153471  nbFailedAssignments=69104  nbBacktracks=66503
1206.16	     nbVisitedNodes=205053  nbRestartNogoods=1753
1206.16	       =>  wckTime=1205.396  cpuTime=1202.51  mem=17M660

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node20/watcher-248492-1168400208 -o ROOT/results/node20/solver-248492-1168400208 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/248492-1168400208/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.62 2.23 2.08 4/94 15112
/proc/meminfo: memFree=1496448/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=11868 CPUtime=0
/proc/15111/stat : 15111 (java) D 15109 15111 14239 0 -1 0 765 0 1 0 0 0 0 0 16 0 1 0 188415351 12152832 515 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 7619364 0 2147483391 0 7368 18446744072099781622 0 0 17 1 0 0
/proc/15111/statm: 2967 515 425 14 0 1602 0

[startup+0.103563 s]
/proc/loadavg: 2.62 2.23 2.08 4/94 15112
/proc/meminfo: memFree=1496448/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=914988 CPUtime=0.08
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 2958 0 1 0 7 1 0 0 19 0 8 0 188415351 936947712 2704 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153570392 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228747 2704 1416 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.512608 s]
/proc/loadavg: 2.62 2.23 2.08 4/94 15112
/proc/meminfo: memFree=1496448/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=0.49
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 6679 0 1 0 44 5 0 0 18 0 8 0 188415351 937431040 6418 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072941831 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 6418 2165 14 0 215335 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 915460

[startup+1.3397 s]
/proc/loadavg: 2.65 2.24 2.08 3/101 15119
/proc/meminfo: memFree=1471944/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1.3
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 8867 0 1 0 124 6 0 0 25 0 8 0 188415351 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073723040 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 8605 2540 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.13
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 340 0 0 0 13 0 0 0 16 0 8 0 188415359 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 8605 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915460

[startup+2.9829 s]
/proc/loadavg: 2.65 2.24 2.08 3/101 15119
/proc/meminfo: memFree=1471880/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=2.93
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 8869 0 1 0 287 6 0 0 25 0 8 0 188415351 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 8606 2540 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 17 0 8 0 188415355 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.13
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 341 0 0 0 13 0 0 0 16 0 8 0 188415359 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 8606 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 915460

[startup+6.26229 s]
/proc/loadavg: 2.59 2.23 2.08 3/101 15119
/proc/meminfo: memFree=1471304/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=6.18
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9011 0 1 0 610 8 0 0 25 0 8 0 188415351 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 8744 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.18
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 363 0 0 0 17 1 0 0 15 0 8 0 188415359 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 8744 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 915460

[startup+12.7501 s]
/proc/loadavg: 2.55 2.23 2.08 3/101 15119
/proc/meminfo: memFree=1471248/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=12.59
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9025 0 1 0 1251 8 0 0 25 0 8 0 188415351 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073732279 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 8754 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.19
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 371 0 0 0 18 1 0 0 15 0 8 0 188415359 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 8754 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 915460

[startup+25.5986 s]
/proc/loadavg: 2.46 2.22 2.08 3/101 15119
/proc/meminfo: memFree=1470928/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=25.32
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9105 0 1 0 2524 8 0 0 25 0 8 0 188415351 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073735127 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 8827 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.21
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 385 0 0 0 20 1 0 0 16 0 8 0 188415359 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 8827 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.32
Current children cumulated vsize (KiB) 915460

[startup+51.2067 s]
/proc/loadavg: 2.28 2.20 2.08 3/101 15119
/proc/meminfo: memFree=1470736/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=50.76
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9173 0 1 0 5068 8 0 0 25 0 8 0 188415351 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073727376 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 8889 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.22
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 396 0 0 0 21 1 0 0 16 0 8 0 188415359 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 8889 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.76
Current children cumulated vsize (KiB) 915460

[startup+102.413 s]
/proc/loadavg: 2.17 2.18 2.08 3/101 15119
/proc/meminfo: memFree=1470224/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=101.74
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9311 0 1 0 10165 9 0 0 25 0 8 0 188415351 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073728180 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15111/statm: 228865 9027 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.23
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 400 0 0 0 21 2 0 0 16 0 8 0 188415359 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9027 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.74
Current children cumulated vsize (KiB) 915460

[startup+162.462 s]
/proc/loadavg: 2.06 2.15 2.07 4/101 15119
/proc/meminfo: memFree=1470224/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=161.5
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9316 0 1 0 16141 9 0 0 25 0 8 0 188415351 937431040 9032 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073727360 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1420.47
Current children cumulated vsize (KiB) 915460

[startup+1483.61 s]
/proc/loadavg: 2.00 2.02 2.00 3/107 15309
/proc/meminfo: memFree=1468560/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1480.48
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9376 0 1 0 148031 17 0 0 25 0 8 0 188415351 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073719857 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15111/statm: 228865 9091 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.24
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 401 0 0 0 22 2 0 0 16 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1480.48
Current children cumulated vsize (KiB) 915460

[startup+1543.62 s]
/proc/loadavg: 2.00 2.01 2.00 3/107 15369
/proc/meminfo: memFree=1468640/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1540.4
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9376 0 1 0 154018 22 0 0 25 0 8 0 188415351 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073723541 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15111/statm: 228865 9091 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.24
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 401 0 0 0 22 2 0 0 16 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1540.4
Current children cumulated vsize (KiB) 915460

[startup+1603.7 s]
/proc/loadavg: 2.00 2.01 2.00 3/101 15391
/proc/meminfo: memFree=1469584/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1600.41
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9376 0 1 0 160019 22 0 0 25 0 8 0 188415351 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073721762 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15111/statm: 228865 9091 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.24
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 401 0 0 0 22 2 0 0 16 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1600.41
Current children cumulated vsize (KiB) 915460

[startup+1663.75 s]
/proc/loadavg: 2.00 2.00 2.00 3/101 15391
/proc/meminfo: memFree=1469584/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1660.4
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9376 0 1 0 166018 22 0 0 25 0 8 0 188415351 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073721775 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15111/statm: 228865 9091 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.24
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 401 0 0 0 22 2 0 0 16 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1660.4
Current children cumulated vsize (KiB) 915460

[startup+1723.79 s]
/proc/loadavg: 2.07 2.02 2.00 3/101 15391
/proc/meminfo: memFree=1469584/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1720.37
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9376 0 1 0 172015 22 0 0 25 0 8 0 188415351 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073721735 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15111/statm: 228865 9091 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.24
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 401 0 0 0 22 2 0 0 16 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1720.37
Current children cumulated vsize (KiB) 915460

[startup+1783.86 s]
/proc/loadavg: 2.06 2.02 2.00 3/101 15391
/proc/meminfo: memFree=1469584/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1780.37
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9376 0 1 0 178015 22 0 0 25 0 8 0 188415351 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073732380 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15111/statm: 228865 9091 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.24
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 401 0 0 0 22 2 0 0 16 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1780.37
Current children cumulated vsize (KiB) 915460



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1803.51 s]
/proc/loadavg: 2.04 2.02 2.00 3/101 15391
/proc/meminfo: memFree=1469584/2055920 swapFree=4170216/4192956
[pid=15111] ppid=15109 vsize=915460 CPUtime=1800.02
/proc/15111/stat : 15111 (java) R 15109 15111 14239 0 -1 0 9376 0 1 0 179980 22 0 0 25 0 8 0 188415351 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073724482 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15111/statm: 228865 9091 2543 14 0 215335 0
[pid=15111/tid=15113] ppid=15109 vsize=915460 CPUtime=0.02
/proc/15111/task/15113/stat : 15113 (java) S 15109 15111 14239 0 -1 64 205 0 0 0 2 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15114] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15114/stat : 15114 (java) S 15109 15111 14239 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 188415355 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15115] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15115/stat : 15115 (java) S 15109 15111 14239 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 188415356 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15116] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15116/stat : 15116 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15117] ppid=15109 vsize=915460 CPUtime=0.24
/proc/15111/task/15117/stat : 15117 (java) S 15109 15111 14239 0 -1 64 401 0 0 0 22 2 0 0 16 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15111/tid=15118] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15118/stat : 15118 (java) S 15109 15111 14239 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15111/tid=15119] ppid=15109 vsize=915460 CPUtime=0
/proc/15111/task/15119/stat : 15119 (java) S 15109 15111 14239 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 188415359 937431040 9091 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 915460

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1803.54
CPU time (s): 1800.06
CPU user time (s): 1799.82
CPU system time (s): 0.233964
CPU usage (%): 99.8068
Max. virtual memory (cumulated for all children) (KiB): 915460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.82
system time used= 0.233964
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9394
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37631
involuntary context switches= 49954

runsolver used 2.56061 s user time and 5.47617 s system time

The end

Launcher Data (download as text)

Begin job on node20 on Wed Jan 10 03:36:48 UTC 2007


IDJOB= 248492
IDBENCH= 11711
FILE ID= node20/248492-1168400208

PBS_JOBID= 3522914

Free space on /tmp= 66560 MiB

BENCH NAME= HOME/pub/bench/CPAI06/primes/primes-30/primes-30-40-3-3.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/248492-1168400208/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node20/watcher-248492-1168400208 -o ROOT/results/node20/solver-248492-1168400208 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/248492-1168400208/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  5651b6d1b7917bf8008d399785c6ab34

RANDOM SEED= 212239053

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.216
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1496864 kB
Buffers:         50404 kB
Cached:         374956 kB
SwapCached:       3584 kB
Active:         231476 kB
Inactive:       268304 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1496864 kB
SwapTotal:     4192956 kB
SwapFree:      4170216 kB
Dirty:            1684 kB
Writeback:           0 kB
Mapped:          97812 kB
Slab:            43736 kB
Committed_AS:  4804112 kB
PageTables:       2572 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66560 MiB



End job on node20 on Wed Jan 10 04:06:52 UTC 2007