Trace number 200768

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.17 1812.54

General information on the benchmark

Namefapp/fapp11-15/fapp14/
fapp14-2500-8.xml
MD5SUMd6ce1f8e3582b18bc2617fcf582120b7
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2500
Number of constraints40767
Maximum constraint arity2
Maximum domain size362
Number of constraints which are defined in extension0
Number of constraints which are defined in intension40767
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=mac.xml
0.41	   
0.41	   instance
0.41	     name=/tmp/evaluation/200768-1168072206/unknown.xml
0.44	   
0.44	   domains being loaded...
0.47	   
0.47	   variables being loaded...
0.77	     nbVariables=2500  nbDomainTypes=30  minDomainSize=42  maxDomainSize=362
0.77	       =>  wckTime=0.455  cpuTime=0.29  mem=35M193
0.77	   
0.77	   predicates being loaded...
0.78	   
0.78	   constraints being loaded...
4.82	   
4.82	   INFO : Stopping converting binary constraints (cpu=4.08, mem = 61M643)
10.31	     nbConstraints=21610  nbMergedConstraints=19157  nbConvertedConstraints=43  nbConvertConstraintsChecks=3863482
10.31	     nbExtensionStructures=43  nbSharedExtensionStructures=0  nbConflictsStructures=43  nbSharedConflictsStructures=0
10.31	     nbSharedBinaryRepresentations=14103  nbEvaluationManagers=15542  nbSharedEvaluationManagers=6025  maxDegree=27
10.31	     maxArity=2
10.31	       =>  wckTime=9.995  cpuTime=8.87  mem=74M11
10.58	   
10.58	   solver IterativeSystematicSolver being built... 
11.31	       =>  wckTime=10.994  cpuTime=9.35  mem=147M317
90.99	   
90.99	   preprocessing
90.99	     nbConstraintChecks=145880365  nbValidityChecks=3960312  nbPropagations=3102  nbRevisions=63590
90.99	     nbUselessRevisions=58383  nbRemovedValues=325576  detectedInconsistency=no
90.99	       =>  wckTime=79.641  cpuTime=78.87  mem=147M317
123.75	   
123.75	   search
123.75	     run=0  nbConstraintChecks=51709399  nbValidityChecks=31178325  nbPropagations=18940  nbRevisions=312230
123.75	     nbUselessRevisions=288614  nbAssignments=411  nbFailedAssignments=12  nbBacktracks=10  nbVisitedNodes=430
123.75	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=399
123.75	       =>  wckTime=112.405  cpuTime=111.32  mem=149M348
133.66	   
133.66	   search
133.66	     run=1  nbConstraintChecks=66290939  nbValidityChecks=62926165  nbPropagations=54043  nbRevisions=878900
133.66	     nbUselessRevisions=812738  nbAssignments=826  nbFailedAssignments=21  nbBacktracks=25  nbVisitedNodes=863
133.66	     nbRestartNogoods=7  mapSize=0  nbInferences=0  nbTooLargeKeys=805
133.66	       =>  wckTime=122.316  cpuTime=121.13  mem=149M348
143.45	   
143.45	   search
143.45	     run=2  nbConstraintChecks=80924822  nbValidityChecks=94910024  nbPropagations=105535  nbRevisions=1704180
143.45	     nbUselessRevisions=1575654  nbAssignments=1249  nbFailedAssignments=34  nbBacktracks=48  nbVisitedNodes=1312
143.45	     nbRestartNogoods=9  mapSize=0  nbInferences=0  nbTooLargeKeys=1215
143.45	       =>  wckTime=132.105  cpuTime=130.82  mem=149M348
152.74	   
152.74	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1608, mem=149M348)
154.66	   
154.66	   search
154.66	     run=3  nbConstraintChecks=97291801  nbValidityChecks=129229765  nbPropagations=175642  nbRevisions=2825022
154.66	     nbUselessRevisions=2607822  nbAssignments=1747  nbFailedAssignments=92  nbBacktracks=82  nbVisitedNodes=1887
154.66	     nbRestartNogoods=10
154.66	       =>  wckTime=143.318  cpuTime=141.91  mem=149M348
175.78	   
175.78	   search
175.78	     run=4  nbConstraintChecks=129392950  nbValidityChecks=171952220  nbPropagations=268868  nbRevisions=4339785
175.78	     nbUselessRevisions=3991406  nbAssignments=2277  nbFailedAssignments=148  nbBacktracks=133  nbVisitedNodes=2505
175.78	     nbRestartNogoods=16
175.78	       =>  wckTime=164.434  cpuTime=162.83  mem=149M348
189.13	   
189.13	   search
189.13	     run=5  nbConstraintChecks=148606145  nbValidityChecks=211903772  nbPropagations=383872  nbRevisions=6222343
189.13	     nbUselessRevisions=5702590  nbAssignments=2819  nbFailedAssignments=191  nbBacktracks=212  nbVisitedNodes=3129
189.13	     nbRestartNogoods=44
189.13	       =>  wckTime=177.794  cpuTime=176.06  mem=149M348
217.12	   
217.12	   search
217.12	     run=6  nbConstraintChecks=191223929  nbValidityChecks=264200931  nbPropagations=526232  nbRevisions=8619310
217.12	     nbUselessRevisions=7863455  nbAssignments=3226  nbFailedAssignments=459  nbBacktracks=325  nbVisitedNodes=3870
217.12	     nbRestartNogoods=45
217.12	       =>  wckTime=205.781  cpuTime=203.8  mem=149M348
236.52	   
236.52	   search
236.52	     run=7  nbConstraintChecks=218799753  nbValidityChecks=299240776  nbPropagations=689810  nbRevisions=11432378
236.52	     nbUselessRevisions=10391399  nbAssignments=3796  nbFailedAssignments=681  nbBacktracks=495  nbVisitedNodes=4780
236.52	     nbRestartNogoods=82
236.52	       =>  wckTime=225.184  cpuTime=223.03  mem=149M348
248.50	   
248.50	   search
248.50	     run=8  nbConstraintChecks=232985463  nbValidityChecks=327199209  nbPropagations=878034  nbRevisions=14715156
248.50	     nbUselessRevisions=13322990  nbAssignments=4637  nbFailedAssignments=1250  nbBacktracks=751  nbVisitedNodes=6287
248.50	     nbRestartNogoods=98
248.50	       =>  wckTime=237.158  cpuTime=234.88  mem=149M348
299.46	   
299.46	   search
299.46	     run=9  nbConstraintChecks=303468869  nbValidityChecks=416102517  nbPropagations=1132292  nbRevisions=19149421
299.46	     nbUselessRevisions=17248460  nbAssignments=6853  nbFailedAssignments=2427  nbBacktracks=1135  nbVisitedNodes=9841
299.46	     nbRestartNogoods=116
299.46	       =>  wckTime=288.115  cpuTime=285.37  mem=149M348
363.15	   
363.15	   search
363.15	     run=10  nbConstraintChecks=392602790  nbValidityChecks=528131901  nbPropagations=1453395  nbRevisions=24934459
363.15	     nbUselessRevisions=22332869  nbAssignments=8801  nbFailedAssignments=3441  nbBacktracks=1714  nbVisitedNodes=13059
363.15	     nbRestartNogoods=162
363.15	       =>  wckTime=351.813  cpuTime=348.48  mem=149M348
429.04	   
429.04	   search
429.04	     run=11  nbConstraintChecks=475382913  nbValidityChecks=666356207  nbPropagations=1895620  nbRevisions=32669179
429.04	     nbUselessRevisions=29080229  nbAssignments=12645  nbFailedAssignments=5929  nbBacktracks=2580  nbVisitedNodes=19839
429.04	     nbRestartNogoods=194
429.04	       =>  wckTime=417.698  cpuTime=413.76  mem=149M348
525.94	   
525.94	   search
525.94	     run=12  nbConstraintChecks=593085755  nbValidityChecks=893611623  nbPropagations=2506642  nbRevisions=43204827
525.94	     nbUselessRevisions=38174403  nbAssignments=16923  nbFailedAssignments=8432  nbBacktracks=3877  nbVisitedNodes=27206
525.94	     nbRestartNogoods=224
525.94	       =>  wckTime=514.603  cpuTime=509.77  mem=149M348
672.67	   
672.67	   search
672.67	     run=13  nbConstraintChecks=770704628  nbValidityChecks=1171237740  nbPropagations=3405077  nbRevisions=58600245
672.67	     nbUselessRevisions=51315760  nbAssignments=24057  nbFailedAssignments=12439  nbBacktracks=5825
672.67	     nbVisitedNodes=39110  nbRestartNogoods=297
672.67	       =>  wckTime=661.33  cpuTime=655.15  mem=149M348
1100.39	   
1100.39	   search
1100.39	     run=14  nbConstraintChecks=1331060072  nbValidityChecks=2151547008  nbPropagations=4968327  nbRevisions=86508640
1100.39	     nbUselessRevisions=75235462  nbAssignments=35285  nbFailedAssignments=20696  nbBacktracks=8745
1100.39	     nbVisitedNodes=60408  nbRestartNogoods=443
1100.39	       =>  wckTime=1089.05  cpuTime=1078.95  mem=150M364
1655.38	   
1655.38	   search
1655.38	     run=15  nbConstraintChecks=2147043857  nbValidityChecks=3461697582  nbPropagations=7273591  nbRevisions=128554599
1655.38	     nbUselessRevisions=111386158  nbAssignments=51808  nbFailedAssignments=31898  nbBacktracks=13123
1655.38	     nbVisitedNodes=90583  nbRestartNogoods=486
1655.38	       =>  wckTime=1644.041  cpuTime=1631.91  mem=150M364

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node10/watcher-200768-1168072206 -o ROOT/results/node10/solver-200768-1168072206 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/200768-1168072206/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.85 1.96 1.90 4/93 27314
/proc/meminfo: memFree=1581096/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=89776 CPUtime=0
/proc/27313/stat : 27313 (java) D 27311 27313 26906 0 -1 0 1273 0 1 0 0 0 0 0 17 0 1 0 155616117 91930624 1022 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 2147483391 0 7368 18446744072099781622 0 0 17 1 0 0
/proc/27313/statm: 22444 1022 811 14 0 10027 0
[pid=27313/tid=27315] ppid=27311 vsize=906644 CPUtime=0
/proc/27313/task/27315/stat : 27315 (java) R 27311 27313 26906 0 -1 64 3 0 0 0 0 0 0 0 19 0 2 0 155616121 928403456 1817 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 7368 0 0 0 -1 1 0 0

[startup+0.102684 s]
/proc/loadavg: 1.85 1.96 1.90 4/93 27314
/proc/meminfo: memFree=1581096/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=914988 CPUtime=0.08
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 2978 0 1 0 7 1 0 0 19 0 8 0 155616117 936947712 2724 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4072927149 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228747 2724 1423 14 0 215242 0
[pid=27313/tid=27315] ppid=27311 vsize=914988 CPUtime=0
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 6 0 0 0 0 0 0 0 18 0 8 0 155616121 936947712 2724 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.513738 s]
/proc/loadavg: 1.85 1.96 1.90 4/93 27314
/proc/meminfo: memFree=1581096/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915328 CPUtime=0.42
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 6211 0 1 0 39 3 0 0 18 0 8 0 155616117 937295872 5950 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228832 5950 2138 14 0 215302 0
[pid=27313/tid=27315] ppid=27311 vsize=915328 CPUtime=0
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 6 0 0 0 0 0 0 0 18 0 8 0 155616121 937295872 5950 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 915328

[startup+1.34285 s]
/proc/loadavg: 1.85 1.96 1.90 3/100 27321
/proc/meminfo: memFree=1500656/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915620 CPUtime=1.25
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 24467 0 1 0 113 12 0 0 24 0 8 0 155616117 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4153380220 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228905 24204 2160 14 0 215375 0
[pid=27313/tid=27315] ppid=27311 vsize=915620 CPUtime=0.1
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 7925 0 0 0 8 2 0 0 16 0 8 0 155616121 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 155616121 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915620 CPUtime=0.16
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 409 0 0 0 16 0 0 0 16 0 8 0 155616125 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937594880 24204 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 915620

[startup+2.98607 s]
/proc/loadavg: 1.86 1.97 1.90 4/100 27321
/proc/meminfo: memFree=1487152/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915620 CPUtime=2.88
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 26188 0 1 0 275 13 0 0 25 0 8 0 155616117 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073833762 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228905 25922 2180 14 0 215375 0
[pid=27313/tid=27315] ppid=27311 vsize=915620 CPUtime=0.21
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 9569 0 0 0 19 2 0 0 16 0 8 0 155616121 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 155616121 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915620 CPUtime=0.18
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 422 0 0 0 18 0 0 0 15 0 8 0 155616125 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937594880 25922 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.88
Current children cumulated vsize (KiB) 915620

[startup+6.26852 s]
/proc/loadavg: 1.86 1.97 1.90 3/100 27321
/proc/meminfo: memFree=1481712/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915620 CPUtime=6.13
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 28669 0 1 0 598 15 0 0 25 0 8 0 155616117 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073915351 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228905 28400 2182 14 0 215375 0
[pid=27313/tid=27315] ppid=27311 vsize=915620 CPUtime=0.34
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 12019 0 0 0 30 4 0 0 16 0 8 0 155616121 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 155616121 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915620 CPUtime=0.23
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 449 0 0 0 23 0 0 0 15 0 8 0 155616125 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915620 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937594880 28400 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.13
Current children cumulated vsize (KiB) 915620

[startup+12.7624 s]
/proc/loadavg: 1.89 1.97 1.91 3/100 27321
/proc/meminfo: memFree=1392816/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=12.57
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49764 0 1 0 1230 27 0 0 25 0 8 0 155616117 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228976 49448 2533 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32561 0 0 0 105 13 0 0 17 0 8 0 155616121 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.36
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 558 0 0 0 35 1 0 0 15 0 8 0 155616125 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49448 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 915904

[startup+25.6176 s]
/proc/loadavg: 1.90 1.97 1.91 3/100 27321
/proc/meminfo: memFree=1392944/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=25.3
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49769 0 1 0 2503 27 0 0 25 0 8 0 155616117 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073833681 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228976 49450 2533 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32561 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.37
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 563 0 0 0 36 1 0 0 16 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.3
Current children cumulated vsize (KiB) 915904

[startup+51.2346 s]
/proc/loadavg: 1.93 1.97 1.91 3/100 27321
/proc/meminfo: memFree=1393008/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=50.68
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49769 0 1 0 5041 27 0 0 25 0 8 0 155616117 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073479193 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228976 49450 2533 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32561 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.37
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 563 0 0 0 36 1 0 0 16 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49450 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 915904

[startup+102.471 s]
/proc/loadavg: 1.97 1.97 1.91 3/100 27321
/proc/meminfo: memFree=1393008/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=101.45
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49787 0 1 0 10117 28 0 0 25 0 8 0 155616117 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073832103 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/27313/statm: 228976 49463 2535 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.38
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 576 0 0 0 37 1 0 0 16 0 8 0 155616125 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49463 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.45
Current children cumulated vsize (KiB) 915904

################
# More data... #
################

Current children cumulated CPU time (s) 1410.8
Current children cumulated vsize (KiB) 915904

[startup+1482.77 s]
/proc/loadavg: 2.04 2.03 1.95 3/100 27469
/proc/meminfo: memFree=1339376/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=1470.75
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49830 0 1 0 147029 46 0 0 25 0 8 0 155616117 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073832103 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27313/statm: 228976 49490 2537 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.44
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 607 0 0 0 43 1 0 0 16 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1470.75
Current children cumulated vsize (KiB) 915904

[startup+1542.78 s]
/proc/loadavg: 2.01 2.02 1.95 3/100 27469
/proc/meminfo: memFree=1339376/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=1530.69
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49830 0 1 0 153023 46 0 0 25 0 8 0 155616117 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074201289 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27313/statm: 228976 49490 2537 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.44
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 607 0 0 0 43 1 0 0 16 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1530.69
Current children cumulated vsize (KiB) 915904

[startup+1602.79 s]
/proc/loadavg: 2.00 2.02 1.95 3/100 27469
/proc/meminfo: memFree=1339376/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=1590.64
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49830 0 1 0 159018 46 0 0 25 0 8 0 155616117 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074189933 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27313/statm: 228976 49490 2537 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.44
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 607 0 0 0 43 1 0 0 16 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) R 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1590.64
Current children cumulated vsize (KiB) 915904

[startup+1662.8 s]
/proc/loadavg: 2.00 2.01 1.95 3/100 27469
/proc/meminfo: memFree=1339376/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=1650.59
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49830 0 1 0 165013 46 0 0 25 0 8 0 155616117 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073833675 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27313/statm: 228976 49490 2537 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.44
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 607 0 0 0 43 1 0 0 16 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1650.59
Current children cumulated vsize (KiB) 915904

[startup+1722.81 s]
/proc/loadavg: 2.00 2.00 1.95 3/100 27469
/proc/meminfo: memFree=1339312/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=1710.53
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49830 0 1 0 171007 46 0 0 25 0 8 0 155616117 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074194967 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27313/statm: 228976 49490 2537 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.44
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 607 0 0 0 43 1 0 0 16 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1710.53
Current children cumulated vsize (KiB) 915904

[startup+1782.82 s]
/proc/loadavg: 2.00 2.00 1.95 3/100 27469
/proc/meminfo: memFree=1339376/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=1770.49
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49830 0 1 0 177003 46 0 0 25 0 8 0 155616117 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074273946 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27313/statm: 228976 49490 2537 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.44
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 607 0 0 0 43 1 0 0 16 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1770.49
Current children cumulated vsize (KiB) 915904



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1812.46 s]
/proc/loadavg: 2.07 2.02 1.95 3/100 27469
/proc/meminfo: memFree=1339312/2055920 swapFree=4178332/4192956
[pid=27313] ppid=27311 vsize=915904 CPUtime=1800.09
/proc/27313/stat : 27313 (java) R 27311 27313 26906 0 -1 0 49830 0 1 0 179963 46 0 0 25 0 8 0 155616117 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074273991 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/27313/statm: 228976 49490 2537 14 0 215446 0
[pid=27313/tid=27315] ppid=27311 vsize=915904 CPUtime=1.18
/proc/27313/task/27315/stat : 27315 (java) S 27311 27313 26906 0 -1 64 32562 0 0 0 105 13 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27316] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27316/stat : 27316 (java) S 27311 27313 26906 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27317] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27317/stat : 27317 (java) S 27311 27313 26906 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 155616121 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27318] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27318/stat : 27318 (java) S 27311 27313 26906 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27319] ppid=27311 vsize=915904 CPUtime=0.44
/proc/27313/task/27319/stat : 27319 (java) S 27311 27313 26906 0 -1 64 607 0 0 0 43 1 0 0 16 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=27313/tid=27320] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27320/stat : 27320 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=27313/tid=27321] ppid=27311 vsize=915904 CPUtime=0
/proc/27313/task/27321/stat : 27321 (java) S 27311 27313 26906 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155616125 937885696 49490 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 915904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1812.54
CPU time (s): 1800.17
CPU user time (s): 1799.67
CPU system time (s): 0.499924
CPU usage (%): 99.3176
Max. virtual memory (cumulated for all children) (KiB): 915904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.67
system time used= 0.499924
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49847
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38560
involuntary context switches= 76140

runsolver used 2.40363 s user time and 5.62315 s system time

The end

Launcher Data (download as text)

Begin job on node10 on Sat Jan  6 08:30:08 UTC 2007


IDJOB= 200768
IDBENCH= 3726
FILE ID= node10/200768-1168072206

PBS_JOBID= 3475733

Free space on /tmp= 66348 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp14/fapp14-2500-8.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/200768-1168072206/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node10/watcher-200768-1168072206 -o ROOT/results/node10/solver-200768-1168072206 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/200768-1168072206/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  d6ce1f8e3582b18bc2617fcf582120b7

RANDOM SEED= 257736845

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1581512 kB
Buffers:         45408 kB
Cached:         222472 kB
SwapCached:       2420 kB
Active:         178028 kB
Inactive:       208320 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1581512 kB
SwapTotal:     4192956 kB
SwapFree:      4178332 kB
Dirty:            7404 kB
Writeback:           0 kB
Mapped:         137976 kB
Slab:            72772 kB
Committed_AS:  4334100 kB
PageTables:       2424 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66345 MiB



End job on node10 on Sat Jan  6 09:00:22 UTC 2007