Trace number 201214

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.11 1803.8

General information on the benchmark

Namefapp/fapp11-15/fapp12/
fapp12-1500-7.xml
MD5SUMd701de3dbc42c3b54216de5304316644
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1014.59
SatisfiableYES
(Un)Satisfiability was proved
Number of variables1500
Number of constraints25409
Maximum constraint arity2
Maximum domain size310
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25409
Global constraints used (with number of constraints)

Solver Data (download as text)

0.32	   
0.32	Abscon 109 (November, 2006)
0.32	   
0.32	   configuration
0.32	     name=esac.xml
0.36	   
0.36	   instance
0.36	     name=/tmp/evaluation/201214-1168146124/unknown.xml
0.39	   
0.39	   domains being loaded...
0.43	   
0.43	   variables being loaded...
0.68	     nbVariables=1500  nbDomainTypes=13  minDomainSize=42  maxDomainSize=310
0.68	       =>  wckTime=0.362  cpuTime=0.25  mem=22M513
0.69	   
0.69	   predicates being loaded...
0.69	   
0.69	   constraints being loaded...
203.79	   
203.79	   INFO : Stopping converting binary constraints (cpu=200.04, mem = 88M422)
206.03	     nbConstraints=13439  nbMergedConstraints=11970  nbConvertedConstraints=4774  nbConvertConstraintsChecks=326420598
206.03	     nbExtensionStructures=3799  nbSharedExtensionStructures=975  nbConflictsStructures=3799
206.03	     nbSharedConflictsStructures=975  nbSharedBinaryRepresentations=1821257  nbEvaluationManagers=6482
206.03	     nbSharedEvaluationManagers=2183  maxDegree=22  maxArity=2
206.03	       =>  wckTime=205.705  cpuTime=201.98  mem=145M113
206.51	   
206.51	   solver IterativeSystematicSolver being built... 
207.00	       =>  wckTime=206.678  cpuTime=202.35  mem=149M531
276.29	   
276.29	   INFO : Stopping ESAC
276.30	   
276.30	   preprocessing
276.30	     nbConstraintChecks=136274985  nbValidityChecks=58717753  nbPropagations=41016  nbRevisions=571389
276.30	     nbUselessRevisions=518921  nbSingletonTests=542  nbEffectiveSingletonTests=8  nbESACBranches=31
276.30	     nbRemovedValues=202539  detectedInconsistency=no
276.30	       =>  wckTime=69.275  cpuTime=68.0  mem=149M531
283.47	   
283.47	   search
283.47	     run=0  nbConstraintChecks=15568690  nbValidityChecks=10120486  nbPropagations=49237  nbRevisions=683101
283.47	     nbUselessRevisions=620456  nbAssignments=169  nbFailedAssignments=13  nbBacktracks=10  nbVisitedNodes=188
283.47	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=156
283.47	       =>  wckTime=76.449  cpuTime=75.16  mem=150M535
301.30	   
301.30	   search
301.30	     run=1  nbConstraintChecks=63451924  nbValidityChecks=57461358  nbPropagations=133589  nbRevisions=1850276
301.30	     nbUselessRevisions=1678470  nbAssignments=715  nbFailedAssignments=110  nbBacktracks=25  nbVisitedNodes=493
301.30	     nbRestartNogoods=8  mapSize=0  nbInferences=0  nbTooLargeKeys=256
301.30	       =>  wckTime=94.278  cpuTime=92.99  mem=150M535
309.78	   
309.78	   search
309.78	     run=2  nbConstraintChecks=83655894  nbValidityChecks=72319764  nbPropagations=231998  nbRevisions=3211426
309.78	     nbUselessRevisions=2908984  nbAssignments=994  nbFailedAssignments=146  nbBacktracks=47  nbVisitedNodes=819
309.78	     nbRestartNogoods=11  mapSize=14  nbInferences=0  nbTooLargeKeys=452
309.78	       =>  wckTime=102.762  cpuTime=101.46  mem=152M257
345.61	   
345.61	   search
345.61	     run=3  nbConstraintChecks=178889651  nbValidityChecks=166453060  nbPropagations=404381  nbRevisions=5564566
345.61	     nbUselessRevisions=5047662  nbAssignments=2291  nbFailedAssignments=187  nbBacktracks=80  nbVisitedNodes=1130
345.61	     nbRestartNogoods=27  mapSize=20  nbInferences=0  nbTooLargeKeys=658
345.61	       =>  wckTime=138.588  cpuTime=137.26  mem=153M260
392.13	   
392.13	   search
392.13	     run=4  nbConstraintChecks=311439741  nbValidityChecks=308644975  nbPropagations=692038  nbRevisions=9496897
392.13	     nbUselessRevisions=8620451  nbAssignments=4252  nbFailedAssignments=451  nbBacktracks=132  nbVisitedNodes=1960
392.13	     nbRestartNogoods=36  mapSize=37  nbInferences=0  nbTooLargeKeys=883
392.13	       =>  wckTime=185.107  cpuTime=183.76  mem=154M986
470.74	   
470.74	   INFO : Stopping hyperNogood (mapSize=49, nbTooLargekeys=1080, mem=161M985)
472.51	   
472.51	   search
472.51	     run=5  nbConstraintChecks=537228033  nbValidityChecks=551528477  nbPropagations=1162788  nbRevisions=15912809
472.51	     nbUselessRevisions=14466332  nbAssignments=7550  nbFailedAssignments=503  nbBacktracks=208  nbVisitedNodes=2927
472.51	     nbRestartNogoods=78
472.51	       =>  wckTime=265.491  cpuTime=264.11  mem=161M985
573.89	   
573.89	   search
573.89	     run=6  nbConstraintChecks=830544423  nbValidityChecks=840572100  nbPropagations=1956077  nbRevisions=26682429
573.89	     nbUselessRevisions=24306122  nbAssignments=15104  nbFailedAssignments=561  nbBacktracks=321  nbVisitedNodes=3515
573.89	     nbRestartNogoods=94
573.89	       =>  wckTime=366.873  cpuTime=365.47  mem=162M988
585.46	   
585.46	   search
585.46	     run=7  nbConstraintChecks=863035817  nbValidityChecks=872119057  nbPropagations=2788895  nbRevisions=37979775
585.46	     nbUselessRevisions=34616247  nbAssignments=16046  nbFailedAssignments=744  nbBacktracks=492  nbVisitedNodes=4574
585.46	     nbRestartNogoods=105
585.46	       =>  wckTime=378.444  cpuTime=377.04  mem=162M988
697.44	   
697.44	   search
697.44	     run=8  nbConstraintChecks=1200044651  nbValidityChecks=1231584304  nbPropagations=4000713  nbRevisions=54348253
697.44	     nbUselessRevisions=49579298  nbAssignments=24916  nbFailedAssignments=932  nbBacktracks=752  nbVisitedNodes=5995
697.44	     nbRestartNogoods=123
697.44	       =>  wckTime=490.425  cpuTime=488.99  mem=162M988
810.11	   
810.11	   search
810.11	     run=9  nbConstraintChecks=1534896057  nbValidityChecks=1565970053  nbPropagations=5603529  nbRevisions=76017600
810.11	     nbUselessRevisions=69380989  nbAssignments=34462  nbFailedAssignments=1267  nbBacktracks=1140  nbVisitedNodes=7602
810.11	     nbRestartNogoods=145
810.11	       =>  wckTime=603.094  cpuTime=601.62  mem=162M988
953.13	   
953.13	   search
953.13	     run=10  nbConstraintChecks=1952716013  nbValidityChecks=1965407833  nbPropagations=7660097  nbRevisions=104210342
953.13	     nbUselessRevisions=94952444  nbAssignments=41371  nbFailedAssignments=2674  nbBacktracks=1716  nbVisitedNodes=11608
953.13	     nbRestartNogoods=161
953.13	       =>  wckTime=746.115  cpuTime=744.6  mem=162M988
1069.76	   
1069.76	   search
1069.76	     run=11  nbConstraintChecks=2309774863  nbValidityChecks=2265673639  nbPropagations=10104365  nbRevisions=138222928
1069.76	     nbUselessRevisions=125473056  nbAssignments=46479  nbFailedAssignments=5417  nbBacktracks=2581
1069.76	     nbVisitedNodes=18658  nbRestartNogoods=178
1069.76	       =>  wckTime=862.742  cpuTime=861.2  mem=162M988
1198.15	   
1198.15	   search
1198.15	     run=12  nbConstraintChecks=2694266506  nbValidityChecks=2629880707  nbPropagations=12974327  nbRevisions=178573044
1198.15	     nbUselessRevisions=161654111  nbAssignments=53455  nbFailedAssignments=6860  nbBacktracks=3879
1198.15	     nbVisitedNodes=23399  nbRestartNogoods=204
1198.15	       =>  wckTime=991.137  cpuTime=989.56  mem=162M988
1405.67	   
1405.67	   search
1405.67	     run=13  nbConstraintChecks=3342627343  nbValidityChecks=3153338616  nbPropagations=16525315  nbRevisions=229866807
1405.67	     nbUselessRevisions=207322728  nbAssignments=61106  nbFailedAssignments=10474  nbBacktracks=5826
1405.67	     nbVisitedNodes=33710  nbRestartNogoods=236
1405.67	       =>  wckTime=1198.651  cpuTime=1197.02  mem=162M988
1657.81	   
1657.81	   search
1657.81	     run=14  nbConstraintChecks=4104904559  nbValidityChecks=3803843321  nbPropagations=20824997  nbRevisions=292826139
1657.81	     nbUselessRevisions=263065699  nbAssignments=71439  nbFailedAssignments=14487  nbBacktracks=8746
1657.81	     nbVisitedNodes=46172  nbRestartNogoods=274
1657.81	       =>  wckTime=1450.791  cpuTime=1449.06  mem=162M988

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node47/watcher-201214-1168146124 -o ROOT/results/node47/solver-201214-1168146124 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201214-1168146124/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.92 1.98 1.99 4/87 28222
/proc/meminfo: memFree=933944/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=47976 CPUtime=0.01
/proc/28221/stat : 28221 (java) D 28219 28221 27211 0 -1 0 1223 0 1 0 0 1 0 0 18 0 1 0 163011746 49127424 972 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 2147483391 0 7368 18446744072099781622 0 0 17 1 0 0
/proc/28221/statm: 11994 972 769 14 0 1707 0

[startup+0.103684 s]
/proc/loadavg: 1.92 1.98 1.99 4/87 28222
/proc/meminfo: memFree=933944/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=914988 CPUtime=0.09
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 2972 0 1 0 7 2 0 0 18 0 8 0 163011746 936947712 2718 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4160643145 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228747 2718 1421 14 0 215242 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 914988

[startup+0.511732 s]
/proc/loadavg: 1.92 1.98 1.99 4/87 28222
/proc/meminfo: memFree=933944/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915328 CPUtime=0.48
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 6902 0 1 0 44 4 0 0 18 0 8 0 163011746 937295872 6641 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228832 6641 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 915328

[startup+1.33581 s]
/proc/loadavg: 1.92 1.98 1.99 3/94 28229
/proc/meminfo: memFree=862528/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1.29
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 20133 0 1 0 116 13 0 0 24 0 8 0 163011746 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073760147 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228912 19871 2160 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=0.06
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 3590 0 0 0 4 2 0 0 17 0 8 0 163011750 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 163011750 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.19
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 409 0 0 0 18 1 0 0 16 0 8 0 163011754 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 19871 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 915648

[startup+2.98899 s]
/proc/loadavg: 1.92 1.98 1.99 3/94 28229
/proc/meminfo: memFree=853888/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=2.94
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 22254 0 1 0 278 16 0 0 25 0 8 0 163011746 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073834366 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228912 21989 2180 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=0.14
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 5634 0 0 0 11 3 0 0 17 0 8 0 163011750 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 163011750 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.22
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 422 0 0 0 21 1 0 0 16 0 8 0 163011754 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.94
Current children cumulated vsize (KiB) 915648

[startup+6.18933 s]
/proc/loadavg: 2.01 2.00 2.00 3/94 28231
/proc/meminfo: memFree=853440/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=6.09
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 22269 0 1 0 593 16 0 0 25 0 8 0 163011746 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839799 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228912 22004 2181 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=0.14
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 5634 0 0 0 11 3 0 0 16 0 8 0 163011750 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 163011750 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.23
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 436 0 0 0 22 1 0 0 16 0 8 0 163011754 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.09
Current children cumulated vsize (KiB) 915648

[startup+12.671 s]
/proc/loadavg: 2.01 2.00 2.00 3/94 28241
/proc/meminfo: memFree=852480/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=12.5
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 22271 0 1 0 1233 17 0 0 25 0 8 0 163011746 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835346 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228912 22006 2181 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=0.14
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 5634 0 0 0 11 3 0 0 16 0 8 0 163011750 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 163011750 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.23
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 438 0 0 0 22 1 0 0 17 0 8 0 163011754 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.5
Current children cumulated vsize (KiB) 915648

[startup+25.5264 s]
/proc/loadavg: 2.00 2.00 2.00 3/94 28249
/proc/meminfo: memFree=836416/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=25.22
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 25566 0 1 0 2502 20 0 0 25 0 8 0 163011746 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835405 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228912 25298 2181 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=0.32
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 8925 0 0 0 27 5 0 0 16 0 8 0 163011750 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 163011750 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.24
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 439 0 0 0 23 1 0 0 16 0 8 0 163011754 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 25298 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.22
Current children cumulated vsize (KiB) 915648

[startup+51.1431 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 28271
/proc/meminfo: memFree=833592/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=50.56
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 25573 0 1 0 5034 22 0 0 25 0 8 0 163011746 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073833448 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228912 25304 2181 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=0.32
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 8925 0 0 0 27 5 0 0 16 0 8 0 163011750 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 163011750 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.25
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 445 0 0 0 24 1 0 0 16 0 8 0 163011754 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 25304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.56
Current children cumulated vsize (KiB) 915648

[startup+102.379 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 28271
/proc/meminfo: memFree=804024/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=101.33
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 32083 0 1 0 10102 31 0 0 25 0 8 0 163011746 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073848801 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/28221/statm: 228912 31810 2181 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=0.81
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 15423 0 0 0 73 8 0 0 16 0 8 0 163011750 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 163011750 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.26
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 453 0 0 0 25 1 0 0 15 0 8 0 163011754 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 31810 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.33
Current children cumulated vsize (KiB) 915648

[startup+162.456 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 28271
/proc/meminfo: memFree=788024/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=160.86
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 34390 0 1 0 16046 40 0 0 25 0 8 0 163011746 937623552 34116 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835879 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1419.35
Current children cumulated vsize (KiB) 915648

[startup+1482.89 s]
/proc/loadavg: 1.00 1.00 1.24 2/72 28343
/proc/meminfo: memFree=1242776/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1479.35
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 47853 0 1 0 147873 62 0 0 25 0 8 0 163011746 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/28221/statm: 228912 47535 2548 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=2.02
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 30614 0 0 0 186 16 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.47
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 563 0 0 0 45 2 0 0 16 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1479.35
Current children cumulated vsize (KiB) 915648

[startup+1542.9 s]
/proc/loadavg: 1.00 1.00 1.22 2/72 28343
/proc/meminfo: memFree=1242776/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1539.34
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 47853 0 1 0 153872 62 0 0 25 0 8 0 163011746 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074170669 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/28221/statm: 228912 47535 2548 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=2.02
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 30614 0 0 0 186 16 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.47
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 563 0 0 0 45 2 0 0 16 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1539.34
Current children cumulated vsize (KiB) 915648

[startup+1602.92 s]
/proc/loadavg: 1.00 1.00 1.21 2/72 28343
/proc/meminfo: memFree=1242712/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1599.32
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 47853 0 1 0 159870 62 0 0 25 0 8 0 163011746 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074174783 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/28221/statm: 228912 47535 2548 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=2.02
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 30614 0 0 0 186 16 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.47
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 563 0 0 0 45 2 0 0 16 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1599.32
Current children cumulated vsize (KiB) 915648

[startup+1662.93 s]
/proc/loadavg: 1.00 1.00 1.19 2/72 28343
/proc/meminfo: memFree=1242776/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1659.3
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 47853 0 1 0 165868 62 0 0 25 0 8 0 163011746 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074162809 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/28221/statm: 228912 47535 2548 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=2.02
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 30614 0 0 0 186 16 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.47
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 563 0 0 0 45 2 0 0 16 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1659.3
Current children cumulated vsize (KiB) 915648

[startup+1722.94 s]
/proc/loadavg: 1.00 1.00 1.18 2/72 28343
/proc/meminfo: memFree=1242712/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1719.28
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 47853 0 1 0 171866 62 0 0 25 0 8 0 163011746 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074170713 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/28221/statm: 228912 47535 2548 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=2.02
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 30614 0 0 0 186 16 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.47
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 563 0 0 0 45 2 0 0 16 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1719.28
Current children cumulated vsize (KiB) 915648

[startup+1782.96 s]
/proc/loadavg: 1.00 1.00 1.16 2/72 28343
/proc/meminfo: memFree=1242712/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1779.27
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 47853 0 1 0 177864 63 0 0 25 0 8 0 163011746 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074035649 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/28221/statm: 228912 47535 2548 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=2.02
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 30614 0 0 0 186 16 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.47
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 563 0 0 0 45 2 0 0 16 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1779.27
Current children cumulated vsize (KiB) 915648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1803.72 s]
/proc/loadavg: 1.00 1.00 1.16 2/72 28343
/proc/meminfo: memFree=1242712/2055920 swapFree=4183928/4192956
[pid=28221] ppid=28219 vsize=915648 CPUtime=1800.03
/proc/28221/stat : 28221 (java) R 28219 28221 27211 0 -1 0 47853 0 1 0 179940 63 0 0 25 0 8 0 163011746 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074169264 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/28221/statm: 228912 47535 2548 14 0 215382 0
[pid=28221/tid=28223] ppid=28219 vsize=915648 CPUtime=2.02
/proc/28221/task/28223/stat : 28223 (java) S 28219 28221 27211 0 -1 64 30614 0 0 0 186 16 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28224] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28224/stat : 28224 (java) S 28219 28221 27211 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28225] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28225/stat : 28225 (java) S 28219 28221 27211 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163011750 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28226] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28226/stat : 28226 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28227] ppid=28219 vsize=915648 CPUtime=0.47
/proc/28221/task/28227/stat : 28227 (java) S 28219 28221 27211 0 -1 64 563 0 0 0 45 2 0 0 16 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28228] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28228/stat : 28228 (java) S 28219 28221 27211 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=28221/tid=28229] ppid=28219 vsize=915648 CPUtime=0
/proc/28221/task/28229/stat : 28229 (java) S 28219 28221 27211 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163011754 937623552 47535 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 915648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1803.8
CPU time (s): 1800.11
CPU user time (s): 1799.45
CPU system time (s): 0.659899
CPU usage (%): 99.7952
Max. virtual memory (cumulated for all children) (KiB): 915652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.45
system time used= 0.659899
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 47870
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38370
involuntary context switches= 48185

runsolver used 2.11268 s user time and 4.52031 s system time

The end

Launcher Data (download as text)

Begin job on node47 on Sun Jan  7 05:02:05 UTC 2007


IDJOB= 201214
IDBENCH= 3750
FILE ID= node47/201214-1168146124

PBS_JOBID= 3478098

Free space on /tmp= 66542 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp12/fapp12-1500-7.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201214-1168146124/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node47/watcher-201214-1168146124 -o ROOT/results/node47/solver-201214-1168146124 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201214-1168146124/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  d701de3dbc42c3b54216de5304316644

RANDOM SEED= 72583352

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        934424 kB
Buffers:         33360 kB
Cached:         537192 kB
SwapCached:       3708 kB
Active:         627652 kB
Inactive:       435884 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        934424 kB
SwapTotal:     4192956 kB
SwapFree:      4183928 kB
Dirty:            5188 kB
Writeback:           0 kB
Mapped:         507504 kB
Slab:            41892 kB
Committed_AS:  3909744 kB
PageTables:       3120 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66550 MiB



End job on node47 on Sun Jan  7 05:32:09 UTC 2007