Trace number 200784

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.16 1808.8

General information on the benchmark

Namefapp/fapp11-15/fapp14/
fapp14-2500-6.xml
MD5SUMc4aad964ca56982478fecd918c7cf516
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2500
Number of constraints40767
Maximum constraint arity2
Maximum domain size362
Number of constraints which are defined in extension0
Number of constraints which are defined in intension40767
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=mac.xml
0.34	   
0.34	   instance
0.34	     name=/tmp/evaluation/200784-1168072209/unknown.xml
0.37	   
0.37	   domains being loaded...
0.41	   
0.41	   variables being loaded...
0.70	     nbVariables=2500  nbDomainTypes=30  minDomainSize=42  maxDomainSize=362
0.70	       =>  wckTime=0.394  cpuTime=0.3  mem=35M193
0.70	   
0.70	   predicates being loaded...
0.71	   
0.71	   constraints being loaded...
4.69	   
4.69	   INFO : Stopping converting binary constraints (cpu=4.04, mem = 61M647)
10.13	     nbConstraints=21610  nbMergedConstraints=19157  nbConvertedConstraints=44  nbConvertConstraintsChecks=3952534
10.13	     nbExtensionStructures=44  nbSharedExtensionStructures=0  nbConflictsStructures=44  nbSharedConflictsStructures=0
10.13	     nbSharedBinaryRepresentations=14118  nbEvaluationManagers=15917  nbSharedEvaluationManagers=5649  maxDegree=27
10.13	     maxArity=2
10.13	       =>  wckTime=9.819  cpuTime=8.83  mem=80M183
10.40	   
10.40	   solver IterativeSystematicSolver being built... 
11.11	       =>  wckTime=10.8  cpuTime=9.29  mem=147M574
85.99	   
85.99	   preprocessing
85.99	     nbConstraintChecks=134431073  nbValidityChecks=4204356  nbPropagations=3307  nbRevisions=68388
85.99	     nbUselessRevisions=61668  nbRemovedValues=407566  detectedInconsistency=no
85.99	       =>  wckTime=74.848  cpuTime=74.47  mem=147M574
106.87	   
106.87	   search
106.87	     run=0  nbConstraintChecks=32137832  nbValidityChecks=23414795  nbPropagations=16824  nbRevisions=286082
106.87	     nbUselessRevisions=263256  nbAssignments=309  nbFailedAssignments=13  nbBacktracks=14  nbVisitedNodes=330
106.88	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=296
106.88	       =>  wckTime=95.74  cpuTime=95.23  mem=149M610
117.52	   
117.52	   search
117.52	     run=1  nbConstraintChecks=46731220  nbValidityChecks=52206689  nbPropagations=52003  nbRevisions=870061
117.52	     nbUselessRevisions=801276  nbAssignments=755  nbFailedAssignments=41  nbBacktracks=29  nbVisitedNodes=810
117.52	     nbRestartNogoods=6  mapSize=0  nbInferences=0  nbTooLargeKeys=714
117.52	       =>  wckTime=106.391  cpuTime=105.83  mem=149M610
130.16	   
130.16	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1222, mem=149M610)
130.42	   
130.42	   search
130.42	     run=2  nbConstraintChecks=64588978  nbValidityChecks=84786753  nbPropagations=109133  nbRevisions=1797958
130.42	     nbUselessRevisions=1657342  nbAssignments=1291  nbFailedAssignments=69  nbBacktracks=53  nbVisitedNodes=1380
130.42	     nbRestartNogoods=24
130.42	       =>  wckTime=119.287  cpuTime=118.66  mem=149M610
140.55	   
140.55	   search
140.55	     run=3  nbConstraintChecks=78274235  nbValidityChecks=119621511  nbPropagations=191602  nbRevisions=3117142
140.55	     nbUselessRevisions=2872321  nbAssignments=1888  nbFailedAssignments=91  nbBacktracks=90  nbVisitedNodes=2011
140.55	     nbRestartNogoods=44
140.55	       =>  wckTime=129.414  cpuTime=128.72  mem=149M610
150.52	   
150.52	   search
150.52	     run=4  nbConstraintChecks=91180801  nbValidityChecks=157066948  nbPropagations=303406  nbRevisions=4895610
150.52	     nbUselessRevisions=4501531  nbAssignments=2519  nbFailedAssignments=124  nbBacktracks=140  nbVisitedNodes=2693
150.52	     nbRestartNogoods=52
150.52	       =>  wckTime=139.386  cpuTime=138.64  mem=149M610
160.78	   
160.78	   search
160.78	     run=5  nbConstraintChecks=104405496  nbValidityChecks=194582426  nbPropagations=444294  nbRevisions=7134106
160.78	     nbUselessRevisions=6548087  nbAssignments=3182  nbFailedAssignments=174  nbBacktracks=215  nbVisitedNodes=3434
160.78	     nbRestartNogoods=56
160.78	       =>  wckTime=149.646  cpuTime=148.85  mem=149M610
173.00	   
173.00	   search
173.01	     run=6  nbConstraintChecks=119535690  nbValidityChecks=237653120  nbPropagations=624134  nbRevisions=9982377
173.01	     nbUselessRevisions=9135739  nbAssignments=3918  nbFailedAssignments=228  nbBacktracks=330  nbVisitedNodes=4269
173.01	     nbRestartNogoods=59
173.01	       =>  wckTime=161.872  cpuTime=161.03  mem=149M610
184.18	   
184.18	   search
184.18	     run=7  nbConstraintChecks=134301645  nbValidityChecks=261675777  nbPropagations=821736  nbRevisions=13157565
184.18	     nbUselessRevisions=12002119  nbAssignments=4351  nbFailedAssignments=462  nbBacktracks=501  nbVisitedNodes=5028
184.18	     nbRestartNogoods=66
184.18	       =>  wckTime=173.046  cpuTime=172.14  mem=149M610
209.39	   
209.39	   search
209.39	     run=8  nbConstraintChecks=172668527  nbValidityChecks=330281409  nbPropagations=1061361  nbRevisions=17077694
209.39	     nbUselessRevisions=15539403  nbAssignments=4757  nbFailedAssignments=596  nbBacktracks=757  nbVisitedNodes=5649
209.39	     nbRestartNogoods=91
209.39	       =>  wckTime=198.259  cpuTime=197.23  mem=149M610
249.56	   
249.56	   search
249.56	     run=9  nbConstraintChecks=231709681  nbValidityChecks=447755689  nbPropagations=1372803  nbRevisions=22266183
249.56	     nbUselessRevisions=20220869  nbAssignments=5432  nbFailedAssignments=878  nbBacktracks=1142  nbVisitedNodes=6754
249.56	     nbRestartNogoods=101
249.56	       =>  wckTime=238.432  cpuTime=237.21  mem=149M610
313.82	   
313.82	   search
313.82	     run=10  nbConstraintChecks=320764281  nbValidityChecks=588943327  nbPropagations=1775366  nbRevisions=29285579
313.82	     nbUselessRevisions=26471382  nbAssignments=7260  nbFailedAssignments=2055  nbBacktracks=1719  nbVisitedNodes=10039
313.82	     nbRestartNogoods=126
313.82	       =>  wckTime=302.691  cpuTime=301.16  mem=149M610
374.40	   
374.40	   search
374.40	     run=11  nbConstraintChecks=394933600  nbValidityChecks=729952694  nbPropagations=2329290  nbRevisions=38900642
374.40	     nbUselessRevisions=34933006  nbAssignments=9576  nbFailedAssignments=3196  nbBacktracks=2586  nbVisitedNodes=13809
374.40	     nbRestartNogoods=165
374.40	       =>  wckTime=363.264  cpuTime=361.45  mem=149M610
544.66	   
544.66	   search
544.66	     run=12  nbConstraintChecks=596162129  nbValidityChecks=1123599990  nbPropagations=3244437  nbRevisions=54872521
544.66	     nbUselessRevisions=48511353  nbAssignments=13939  nbFailedAssignments=6099  nbBacktracks=3887  nbVisitedNodes=21791
544.66	     nbRestartNogoods=220
544.66	       =>  wckTime=533.531  cpuTime=530.91  mem=149M610
677.59	   
677.59	   search
677.59	     run=13  nbConstraintChecks=750873542  nbValidityChecks=1406010482  nbPropagations=4531289  nbRevisions=76806663
677.59	     nbUselessRevisions=67143550  nbAssignments=20492  nbFailedAssignments=10153  nbBacktracks=5835
677.59	     nbVisitedNodes=32929  nbRestartNogoods=228
677.59	       =>  wckTime=666.46  cpuTime=663.21  mem=149M610
878.46	   
878.46	   search
878.46	     run=14  nbConstraintChecks=981730001  nbValidityChecks=1903212009  nbPropagations=6283142  nbRevisions=108040508
878.46	     nbUselessRevisions=93836493  nbAssignments=30969  nbFailedAssignments=17222  nbBacktracks=8757
878.46	     nbVisitedNodes=51982  nbRestartNogoods=273
878.46	       =>  wckTime=867.33  cpuTime=863.14  mem=149M610
1193.11	   
1193.11	   search
1193.11	     run=15  nbConstraintChecks=1348427875  nbValidityChecks=2705333401  nbPropagations=9071021  nbRevisions=156943729
1193.11	     nbUselessRevisions=135847746  nbAssignments=46277  nbFailedAssignments=27602  nbBacktracks=13138
1193.11	     nbVisitedNodes=79779  nbRestartNogoods=376
1193.11	       =>  wckTime=1181.973  cpuTime=1176.45  mem=149M610
1523.67	   
1523.67	   search
1523.67	     run=16  nbConstraintChecks=1722061692  nbValidityChecks=3575613890  nbPropagations=13119421  nbRevisions=228656646
1523.67	     nbUselessRevisions=197931029  nbAssignments=63242  nbFailedAssignments=37504  nbBacktracks=19706
1523.67	     nbVisitedNodes=109339  nbRestartNogoods=502
1523.67	       =>  wckTime=1512.54  cpuTime=1505.44  mem=149M610

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node9/watcher-200784-1168072209 -o ROOT/results/node9/solver-200784-1168072209 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/200784-1168072209/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.70 1.94 1.93 4/93 15251
/proc/meminfo: memFree=1258856/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=18540 CPUtime=0
/proc/15250/stat : 15250 (runsolver) R 15248 15250 15127 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 155616319 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 215418989863 0 2147483391 4096 24578 0 0 0 17 0 0 0
/proc/15250/statm: 4635 279 244 17 0 2626 0

[startup+0.107953 s]
/proc/loadavg: 1.70 1.94 1.93 4/93 15251
/proc/meminfo: memFree=1258856/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=914988 CPUtime=0.09
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 3019 0 1 0 8 1 0 0 17 0 8 0 155616319 936947712 2765 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228747 2767 1435 14 0 215242 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 914988

[startup+0.519995 s]
/proc/loadavg: 1.70 1.94 1.93 4/93 15251
/proc/meminfo: memFree=1258856/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915328 CPUtime=0.49
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 7615 0 1 0 45 4 0 0 18 0 8 0 155616319 937295872 7354 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4152819938 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228832 7356 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 915328

[startup+1.34409 s]
/proc/loadavg: 1.80 1.96 1.94 4/100 15258
/proc/meminfo: memFree=1178416/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915620 CPUtime=1.32
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 24469 0 1 0 119 13 0 0 18 0 8 0 155616319 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073595936 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228905 24206 2160 14 0 215375 0
[pid=15250/tid=15252] ppid=15248 vsize=915620 CPUtime=0.09
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 7926 0 0 0 6 3 0 0 16 0 8 0 155616323 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155616323 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915620 CPUtime=0.16
/proc/15250/task/15256/stat : 15256 (java) R 15248 15250 15127 0 -1 64 407 0 0 0 16 0 0 0 19 0 8 0 155616327 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937594880 24206 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 915620

[startup+2.98128 s]
/proc/loadavg: 1.80 1.96 1.94 3/100 15258
/proc/meminfo: memFree=1163632/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915620 CPUtime=2.94
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 26189 0 1 0 280 14 0 0 25 0 8 0 155616319 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073830908 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228905 25923 2180 14 0 215375 0
[pid=15250/tid=15252] ppid=15248 vsize=915620 CPUtime=0.21
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 9570 0 0 0 17 4 0 0 16 0 8 0 155616323 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155616323 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915620 CPUtime=0.18
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 420 0 0 0 18 0 0 0 16 0 8 0 155616327 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937594880 25923 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.94
Current children cumulated vsize (KiB) 915620

[startup+6.26665 s]
/proc/loadavg: 1.82 1.96 1.94 3/100 15258
/proc/meminfo: memFree=1153520/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915620 CPUtime=6.22
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 29450 0 1 0 607 15 0 0 25 0 8 0 155616319 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073595945 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228905 29180 2181 14 0 215375 0
[pid=15250/tid=15252] ppid=15248 vsize=915620 CPUtime=0.37
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 12799 0 0 0 33 4 0 0 16 0 8 0 155616323 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155616323 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915620 CPUtime=0.22
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 447 0 0 0 22 0 0 0 16 0 8 0 155616327 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915620 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937594880 29180 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 915620

[startup+12.7534 s]
/proc/loadavg: 1.83 1.96 1.94 3/100 15258
/proc/meminfo: memFree=1070192/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=12.68
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49869 0 1 0 1243 25 0 0 25 0 8 0 155616319 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073837093 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228971 49554 2533 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.15
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32665 0 0 0 103 12 0 0 17 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.36
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 552 0 0 0 35 1 0 0 15 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 915884

[startup+25.6208 s]
/proc/loadavg: 1.86 1.96 1.94 3/100 15258
/proc/meminfo: memFree=1070384/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=25.48
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49872 0 1 0 2523 25 0 0 25 0 8 0 155616319 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073832096 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228971 49554 2533 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.15
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32665 0 0 0 103 12 0 0 16 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.36
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 554 0 0 0 35 1 0 0 16 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 915884

[startup+51.2377 s]
/proc/loadavg: 1.91 1.97 1.94 3/100 15258
/proc/meminfo: memFree=1070384/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=50.98
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49872 0 1 0 5073 25 0 0 25 0 8 0 155616319 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073830890 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228971 49554 2533 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.15
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32665 0 0 0 103 12 0 0 16 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.36
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 554 0 0 0 35 1 0 0 16 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49554 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 915884

[startup+102.473 s]
/proc/loadavg: 1.96 1.97 1.94 3/100 15258
/proc/meminfo: memFree=1070384/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=101.96
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49889 0 1 0 10171 25 0 0 25 0 8 0 155616319 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073834599 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/15250/statm: 228971 49567 2535 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.15
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 103 12 0 0 16 0 8 0 155616323 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.38
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 565 0 0 0 37 1 0 0 15 0 8 0 155616327 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49567 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.96
Current children cumulated vsize (KiB) 915884

[startup+162.558 s]
/proc/loadavg: 1.98 1.97 1.94 3/100 15258
/proc/meminfo: memFree=1070384/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=161.77
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49923 0 1 0 16151 26 0 0 25 0 8 0 155616319 937865216 49592 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074216080 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1417.58
Current children cumulated vsize (KiB) 915884

[startup+1484.21 s]
/proc/loadavg: 1.97 1.81 1.83 3/100 16718
/proc/meminfo: memFree=953784/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=1477.35
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49934 0 1 0 147686 49 0 0 25 0 8 0 155616319 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074188694 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15250/statm: 228971 49598 2537 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.16
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 104 12 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.44
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 595 0 0 0 42 2 0 0 16 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1477.35
Current children cumulated vsize (KiB) 915884

[startup+1544.29 s]
/proc/loadavg: 1.99 1.84 1.83 3/100 16718
/proc/meminfo: memFree=953720/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=1537.1
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49934 0 1 0 153660 50 0 0 25 0 8 0 155616319 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073838552 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15250/statm: 228971 49598 2537 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.16
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 104 12 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.44
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 595 0 0 0 42 2 0 0 16 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1537.1
Current children cumulated vsize (KiB) 915884

[startup+1604.38 s]
/proc/loadavg: 2.14 1.91 1.85 3/100 16718
/proc/meminfo: memFree=953784/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=1596.86
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49934 0 1 0 159636 50 0 0 25 0 8 0 155616319 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073832104 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15250/statm: 228971 49598 2537 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.16
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 104 12 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.44
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 595 0 0 0 42 2 0 0 16 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1596.86
Current children cumulated vsize (KiB) 915884

[startup+1664.47 s]
/proc/loadavg: 2.10 1.94 1.87 3/100 16718
/proc/meminfo: memFree=953720/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=1656.63
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49934 0 1 0 165613 50 0 0 25 0 8 0 155616319 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074195012 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15250/statm: 228971 49598 2537 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.16
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 104 12 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.44
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 595 0 0 0 42 2 0 0 16 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1656.63
Current children cumulated vsize (KiB) 915884

[startup+1724.55 s]
/proc/loadavg: 2.15 1.98 1.88 3/100 16718
/proc/meminfo: memFree=953720/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=1716.38
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49934 0 1 0 171588 50 0 0 25 0 8 0 155616319 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074189892 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15250/statm: 228971 49598 2537 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.16
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 104 12 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.44
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 595 0 0 0 42 2 0 0 16 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1716.38
Current children cumulated vsize (KiB) 915884

[startup+1784.64 s]
/proc/loadavg: 2.05 1.98 1.89 3/100 16718
/proc/meminfo: memFree=953784/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=1776.15
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49934 0 1 0 177565 50 0 0 25 0 8 0 155616319 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073835819 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15250/statm: 228971 49598 2537 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.16
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 104 12 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.44
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 595 0 0 0 42 2 0 0 16 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1776.15
Current children cumulated vsize (KiB) 915884



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.72 s]
/proc/loadavg: 2.03 1.98 1.89 3/100 16718
/proc/meminfo: memFree=953784/2055920 swapFree=4191880/4192956
[pid=15250] ppid=15248 vsize=915884 CPUtime=1800.09
/proc/15250/stat : 15250 (java) R 15248 15250 15127 0 -1 0 49934 0 1 0 179959 50 0 0 25 0 8 0 155616319 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073831066 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/15250/statm: 228971 49598 2537 14 0 215441 0
[pid=15250/tid=15252] ppid=15248 vsize=915884 CPUtime=1.16
/proc/15250/task/15252/stat : 15252 (java) S 15248 15250 15127 0 -1 64 32666 0 0 0 104 12 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15253] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15253/stat : 15253 (java) S 15248 15250 15127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15254] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15254/stat : 15254 (java) S 15248 15250 15127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155616323 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15255] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15255/stat : 15255 (java) S 15248 15250 15127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15256] ppid=15248 vsize=915884 CPUtime=0.44
/proc/15250/task/15256/stat : 15256 (java) S 15248 15250 15127 0 -1 64 595 0 0 0 42 2 0 0 16 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=15250/tid=15257] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15257/stat : 15257 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=15250/tid=15258] ppid=15248 vsize=915884 CPUtime=0
/proc/15250/task/15258/stat : 15258 (java) S 15248 15250 15127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616327 937865216 49598 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 915884

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1808.8
CPU time (s): 1800.16
CPU user time (s): 1799.63
CPU system time (s): 0.537918
CPU usage (%): 99.5227
Max. virtual memory (cumulated for all children) (KiB): 915884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.63
system time used= 0.537918
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49951
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38309
involuntary context switches= 62877

runsolver used 2.09268 s user time and 5.75413 s system time

The end

Launcher Data (download as text)

Begin job on node9 on Sat Jan  6 08:30:11 UTC 2007


IDJOB= 200784
IDBENCH= 3727
FILE ID= node9/200784-1168072209

PBS_JOBID= 3475747

Free space on /tmp= 66536 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp14/fapp14-2500-6.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/200784-1168072209/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node9/watcher-200784-1168072209 -o ROOT/results/node9/solver-200784-1168072209 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/200784-1168072209/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  c4aad964ca56982478fecd918c7cf516

RANDOM SEED= 31489527

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1259216 kB
Buffers:         83240 kB
Cached:         521760 kB
SwapCached:        268 kB
Active:         351592 kB
Inactive:       342964 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1259216 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:            7376 kB
Writeback:           0 kB
Mapped:         111280 kB
Slab:            86724 kB
Committed_AS:  4691048 kB
PageTables:       2428 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66531 MiB



End job on node9 on Sat Jan  6 09:00:21 UTC 2007