Trace number 201246

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.16 1810.49

General information on the benchmark

Namefapp/fapp11-15/fapp12/
fapp12-1500-2.xml
MD5SUMa9559a77dc2a348044495e00f4dfba11
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of constraints25409
Maximum constraint arity2
Maximum domain size310
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25409
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=esac.xml
0.34	   
0.34	   instance
0.34	     name=/tmp/evaluation/201246-1168146437/unknown.xml
0.37	   
0.37	   domains being loaded...
0.40	   
0.40	   variables being loaded...
0.65	     nbVariables=1500  nbDomainTypes=13  minDomainSize=42  maxDomainSize=310
0.65	       =>  wckTime=0.337  cpuTime=0.23  mem=22M513
0.65	   
0.65	   predicates being loaded...
0.65	   
0.65	   constraints being loaded...
203.09	   
203.09	   INFO : Stopping converting binary constraints (cpu=200.01, mem = 81M738)
205.34	     nbConstraints=13439  nbMergedConstraints=11970  nbConvertedConstraints=4864  nbConvertConstraintsChecks=339638826
205.34	     nbExtensionStructures=3946  nbSharedExtensionStructures=918  nbConflictsStructures=3946
205.34	     nbSharedConflictsStructures=918  nbSharedBinaryRepresentations=1960522  nbEvaluationManagers=6558
205.34	     nbSharedEvaluationManagers=2017  maxDegree=22  maxArity=2
205.34	       =>  wckTime=205.026  cpuTime=201.94  mem=94M521
205.68	   
205.68	   solver IterativeSystematicSolver being built... 
206.11	       =>  wckTime=205.802  cpuTime=202.25  mem=140M858
270.82	   
270.82	   INFO : Stopping ESAC
270.83	   
270.83	   preprocessing
270.83	     nbConstraintChecks=136571124  nbValidityChecks=61352587  nbPropagations=59330  nbRevisions=917428
270.83	     nbUselessRevisions=827375  nbSingletonTests=674  nbEffectiveSingletonTests=70  nbESACBranches=35
270.83	     nbRemovedValues=272508  detectedInconsistency=no
270.83	       =>  wckTime=64.696  cpuTime=64.18  mem=140M858
276.34	   
276.34	   search
276.34	     run=0  nbConstraintChecks=12611134  nbValidityChecks=8371139  nbPropagations=69924  nbRevisions=1078221
276.34	     nbUselessRevisions=971954  nbAssignments=144  nbFailedAssignments=13  nbBacktracks=10  nbVisitedNodes=167
276.34	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=131
276.34	       =>  wckTime=70.21  cpuTime=69.65  mem=141M874
298.77	   
298.77	   search
298.77	     run=1  nbConstraintChecks=75743027  nbValidityChecks=65478462  nbPropagations=203964  nbRevisions=3109649
298.77	     nbUselessRevisions=2817568  nbAssignments=813  nbFailedAssignments=24  nbBacktracks=29  nbVisitedNodes=350
298.77	     nbRestartNogoods=9  mapSize=0  nbInferences=0  nbTooLargeKeys=277
298.77	       =>  wckTime=92.646  cpuTime=91.97  mem=141M874
302.41	   
302.41	   search
302.41	     run=2  nbConstraintChecks=86423243  nbValidityChecks=75052352  nbPropagations=350937  nbRevisions=5341009
302.41	     nbUselessRevisions=4841976  nbAssignments=991  nbFailedAssignments=41  nbBacktracks=51  nbVisitedNodes=565
302.41	     nbRestartNogoods=11  mapSize=0  nbInferences=0  nbTooLargeKeys=438
302.41	       =>  wckTime=96.286  cpuTime=95.59  mem=141M874
305.99	   
305.99	   search
305.99	     run=3  nbConstraintChecks=96743952  nbValidityChecks=84764219  nbPropagations=511025  nbRevisions=7771142
305.99	     nbUselessRevisions=7047331  nbAssignments=1180  nbFailedAssignments=60  nbBacktracks=84  nbVisitedNodes=801
305.99	     nbRestartNogoods=15  mapSize=0  nbInferences=0  nbTooLargeKeys=608
305.99	       =>  wckTime=99.859  cpuTime=99.15  mem=141M874
309.94	   
309.94	   search
309.94	     run=4  nbConstraintChecks=108166218  nbValidityChecks=95366325  nbPropagations=685971  nbRevisions=10427126
309.94	     nbUselessRevisions=9457653  nbAssignments=1395  nbFailedAssignments=88  nbBacktracks=137  nbVisitedNodes=1084
309.94	     nbRestartNogoods=19  mapSize=0  nbInferences=0  nbTooLargeKeys=795
309.94	       =>  wckTime=103.811  cpuTime=103.08  mem=141M874
316.20	   
316.20	   search
316.20	     run=5  nbConstraintChecks=124315705  nbValidityChecks=107851290  nbPropagations=876276  nbRevisions=13340451
316.20	     nbUselessRevisions=12093214  nbAssignments=1596  nbFailedAssignments=151  nbBacktracks=213  nbVisitedNodes=1379
316.20	     nbRestartNogoods=21  mapSize=0  nbInferences=0  nbTooLargeKeys=933
316.20	       =>  wckTime=110.076  cpuTime=109.28  mem=141M874
321.19	   
321.19	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1028, mem=141M874)
324.48	   
324.48	   search
324.48	     run=6  nbConstraintChecks=146728387  nbValidityChecks=127976753  nbPropagations=1089105  nbRevisions=16600694
324.48	     nbUselessRevisions=15038542  nbAssignments=1978  nbFailedAssignments=325  nbBacktracks=326  nbVisitedNodes=1952
324.48	     nbRestartNogoods=26
324.48	       =>  wckTime=118.355  cpuTime=117.53  mem=141M874
335.91	   
335.91	   search
335.91	     run=7  nbConstraintChecks=177583923  nbValidityChecks=149390553  nbPropagations=1331903  nbRevisions=20397516
335.91	     nbUselessRevisions=18444566  nbAssignments=2361  nbFailedAssignments=489  nbBacktracks=497  nbVisitedNodes=2579
335.91	     nbRestartNogoods=33
335.91	       =>  wckTime=129.788  cpuTime=128.9  mem=141M874
357.96	   
357.96	   search
357.96	     run=8  nbConstraintChecks=238922410  nbValidityChecks=196736940  nbPropagations=1647970  nbRevisions=25454294
357.96	     nbUselessRevisions=22965076  nbAssignments=3013  nbFailedAssignments=718  nbBacktracks=760  nbVisitedNodes=3497
357.96	     nbRestartNogoods=42
357.96	       =>  wckTime=151.835  cpuTime=150.8  mem=141M874
403.19	   
403.19	   search
403.19	     run=9  nbConstraintChecks=368224114  nbValidityChecks=306700695  nbPropagations=2097265  nbRevisions=32648124
403.19	     nbUselessRevisions=29388318  nbAssignments=4552  nbFailedAssignments=1156  nbBacktracks=1145  nbVisitedNodes=5021
403.19	     nbRestartNogoods=57
403.19	       =>  wckTime=197.059  cpuTime=195.78  mem=141M874
454.95	   
454.95	   search
454.95	     run=10  nbConstraintChecks=516472350  nbValidityChecks=423637217  nbPropagations=2723904  nbRevisions=42852001
454.95	     nbUselessRevisions=38468732  nbAssignments=6027  nbFailedAssignments=1829  nbBacktracks=1721  nbVisitedNodes=7204
454.95	     nbRestartNogoods=69
454.95	       =>  wckTime=248.825  cpuTime=247.28  mem=141M874
547.79	   
547.79	   search
547.79	     run=11  nbConstraintChecks=781977878  nbValidityChecks=641645562  nbPropagations=3618535  nbRevisions=57369184
547.79	     nbUselessRevisions=51350151  nbAssignments=9441  nbFailedAssignments=3429  nbBacktracks=2587  nbVisitedNodes=11730
547.79	     nbRestartNogoods=84
547.79	       =>  wckTime=341.663  cpuTime=339.62  mem=141M874
639.29	   
639.29	   search
639.29	     run=12  nbConstraintChecks=1031892604  nbValidityChecks=815929080  nbPropagations=4830752  nbRevisions=77647791
639.29	     nbUselessRevisions=69127337  nbAssignments=12861  nbFailedAssignments=5406  nbBacktracks=3885  nbVisitedNodes=17545
639.29	     nbRestartNogoods=103
639.29	       =>  wckTime=433.162  cpuTime=430.63  mem=141M874
881.90	   
881.90	   search
881.90	     run=13  nbConstraintChecks=1726510909  nbValidityChecks=1403434967  nbPropagations=6815262  nbRevisions=111089105
881.90	     nbUselessRevisions=98525910  nbAssignments=18631  nbFailedAssignments=7840  nbBacktracks=5833  nbVisitedNodes=25456
881.90	     nbRestartNogoods=126
881.90	       =>  wckTime=675.777  cpuTime=671.97  mem=141M874
1137.61	   
1137.61	   search
1137.61	     run=14  nbConstraintChecks=2463504528  nbValidityChecks=1946862898  nbPropagations=9686800  nbRevisions=160266634
1137.61	     nbUselessRevisions=141524775  nbAssignments=25945  nbFailedAssignments=12118  nbBacktracks=8753
1137.61	     nbVisitedNodes=38432  nbRestartNogoods=132
1137.61	       =>  wckTime=931.486  cpuTime=926.35  mem=141M874
1507.85	   
1507.85	   search
1507.85	     run=15  nbConstraintChecks=3534463243  nbValidityChecks=2787159412  nbPropagations=13824343  nbRevisions=231776317
1507.85	     nbUselessRevisions=203839263  nbAssignments=37906  nbFailedAssignments=18067  nbBacktracks=13131
1507.85	     nbVisitedNodes=56734  nbRestartNogoods=185
1507.85	       =>  wckTime=1301.723  cpuTime=1294.63  mem=141M874

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node16/watcher-201246-1168146437 -o ROOT/results/node16/solver-201246-1168146437 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201246-1168146437/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.32 2.11 2.03 5/86 12755
/proc/meminfo: memFree=1359312/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=906644 CPUtime=0.03
/proc/12754/stat : 12754 (java) S 12752 12754 12127 0 -1 0 2068 0 1 0 2 1 0 0 18 0 2 0 163038552 928403456 1817 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 7368 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 226661 1817 1036 14 0 214244 0
[pid=12754/tid=12756] ppid=12752 vsize=906644 CPUtime=0
/proc/12754/task/12756/stat : 12756 (java) R 12752 12754 12127 0 -1 64 3 0 0 0 0 0 0 0 19 0 2 0 163038556 928403456 1817 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 7368 0 0 0 -1 1 0 0

[startup+0.104124 s]
/proc/loadavg: 2.32 2.11 2.03 5/86 12755
/proc/meminfo: memFree=1359312/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=914988 CPUtime=0.09
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 3005 0 1 0 8 1 0 0 20 0 8 0 163038552 936947712 2751 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4152820096 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228747 2751 1430 14 0 215242 0
[pid=12754/tid=12756] ppid=12752 vsize=914988 CPUtime=0
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 7 0 0 0 0 0 0 0 18 0 8 0 163038556 936947712 2751 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 914988

[startup+0.512047 s]
/proc/loadavg: 2.32 2.11 2.03 5/86 12755
/proc/meminfo: memFree=1359312/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915328 CPUtime=0.5
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 7350 0 1 0 46 4 0 0 18 0 8 0 163038552 937295872 7089 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4154646874 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228832 7089 2138 14 0 215302 0
[pid=12754/tid=12756] ppid=12752 vsize=915328 CPUtime=0
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 7 0 0 0 0 0 0 0 18 0 8 0 163038556 937295872 7089 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 915328

[startup+1.3389 s]
/proc/loadavg: 2.32 2.11 2.03 3/93 12762
/proc/meminfo: memFree=1288216/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1.31
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 22179 0 1 0 119 12 0 0 24 0 8 0 163038552 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073537455 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228912 21916 2160 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=0.08
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 5636 0 0 0 6 2 0 0 16 0 8 0 163038556 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.16
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 409 0 0 0 16 0 0 0 15 0 8 0 163038560 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 21916 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 915648

[startup+2.98959 s]
/proc/loadavg: 2.32 2.11 2.03 4/93 12762
/proc/meminfo: memFree=1279832/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=2.95
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 22256 0 1 0 282 13 0 0 25 0 8 0 163038552 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073833447 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228912 21991 2180 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=0.11
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 5636 0 0 0 9 2 0 0 17 0 8 0 163038556 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.19
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 423 0 0 0 19 0 0 0 15 0 8 0 163038560 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 21991 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 915648

[startup+6.268 s]
/proc/loadavg: 2.30 2.11 2.03 3/93 12762
/proc/meminfo: memFree=1279640/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=6.2
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 22271 0 1 0 606 14 0 0 25 0 8 0 163038552 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073837671 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228912 22006 2181 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=0.11
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 5636 0 0 0 9 2 0 0 16 0 8 0 163038556 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.2
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 437 0 0 0 20 0 0 0 15 0 8 0 163038560 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 22006 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 915648

[startup+12.7568 s]
/proc/loadavg: 2.27 2.11 2.03 3/93 12762
/proc/meminfo: memFree=1279704/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=12.63
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 22274 0 1 0 1249 14 0 0 25 0 8 0 163038552 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073836919 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228912 22008 2181 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=0.11
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 5636 0 0 0 9 2 0 0 16 0 8 0 163038556 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.21
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 439 0 0 0 21 0 0 0 16 0 8 0 163038560 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 22008 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.63
Current children cumulated vsize (KiB) 915648

[startup+25.5955 s]
/proc/loadavg: 2.23 2.10 2.03 3/93 12762
/proc/meminfo: memFree=1267032/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=25.37
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 25463 0 1 0 2519 18 0 0 25 0 8 0 163038552 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073836465 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228912 25196 2181 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=0.24
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 8823 0 0 0 21 3 0 0 16 0 8 0 163038556 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.21
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 440 0 0 0 21 0 0 0 15 0 8 0 163038560 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 25196 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 915648

[startup+51.1988 s]
/proc/loadavg: 2.14 2.09 2.03 3/93 12762
/proc/meminfo: memFree=1267032/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=50.75
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 25470 0 1 0 5054 21 0 0 25 0 8 0 163038552 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073479184 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228912 25202 2181 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=0.24
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 8823 0 0 0 21 3 0 0 16 0 8 0 163038556 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.22
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 446 0 0 0 22 0 0 0 16 0 8 0 163038560 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 25202 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.75
Current children cumulated vsize (KiB) 915648

[startup+102.406 s]
/proc/loadavg: 2.06 2.08 2.02 3/93 12762
/proc/meminfo: memFree=1243032/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=101.53
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 31484 0 1 0 10124 29 0 0 25 0 8 0 163038552 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073831586 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/12754/statm: 228912 31212 2181 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=0.58
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 14825 0 0 0 53 5 0 0 16 0 8 0 163038556 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.23
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 454 0 0 0 23 0 0 0 16 0 8 0 163038560 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 31212 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.53
Current children cumulated vsize (KiB) 915648

################
# More data... #
################

Current children cumulated CPU time (s) 1414.91
Current children cumulated vsize (KiB) 915648

[startup+1483.19 s]
/proc/loadavg: 2.03 2.07 2.03 3/101 12945
/proc/meminfo: memFree=725016/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1474.6
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 45927 0 1 0 147397 63 0 0 25 0 8 0 163038552 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074275582 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/12754/statm: 228912 45619 2547 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=1.53
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 28700 0 0 0 141 12 0 0 16 0 8 0 163038556 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.44
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 561 0 0 0 42 2 0 0 16 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1474.6
Current children cumulated vsize (KiB) 915648

[startup+1543.23 s]
/proc/loadavg: 2.01 2.05 2.02 3/101 12945
/proc/meminfo: memFree=684632/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1534.32
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 45927 0 1 0 153369 63 0 0 25 0 8 0 163038552 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4072918564 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/12754/statm: 228912 45619 2547 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=1.53
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 28700 0 0 0 141 12 0 0 16 0 8 0 163038556 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.44
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 561 0 0 0 42 2 0 0 16 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1534.32
Current children cumulated vsize (KiB) 915648

[startup+1603.25 s]
/proc/loadavg: 2.05 2.06 2.02 3/101 12945
/proc/meminfo: memFree=660376/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1594.03
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 45927 0 1 0 159340 63 0 0 25 0 8 0 163038552 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073839095 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/12754/statm: 228912 45619 2547 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=1.53
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 28700 0 0 0 141 12 0 0 16 0 8 0 163038556 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.44
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 561 0 0 0 42 2 0 0 16 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1594.03
Current children cumulated vsize (KiB) 915648

[startup+1663.28 s]
/proc/loadavg: 2.02 2.04 2.02 4/101 12945
/proc/meminfo: memFree=639896/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1653.72
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 45927 0 1 0 165309 63 0 0 25 0 8 0 163038552 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073336169 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/12754/statm: 228912 45619 2547 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=1.53
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 28700 0 0 0 141 12 0 0 16 0 8 0 163038556 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.44
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 561 0 0 0 42 2 0 0 16 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1653.72
Current children cumulated vsize (KiB) 915648

[startup+1723.3 s]
/proc/loadavg: 2.00 2.03 2.01 3/101 12945
/proc/meminfo: memFree=615640/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1713.43
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 45927 0 1 0 171279 64 0 0 25 0 8 0 163038552 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074161977 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/12754/statm: 228912 45619 2547 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=1.53
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 28700 0 0 0 141 12 0 0 16 0 8 0 163038556 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.44
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 561 0 0 0 42 2 0 0 16 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1713.43
Current children cumulated vsize (KiB) 915648

[startup+1783.32 s]
/proc/loadavg: 2.00 2.03 2.00 3/101 12945
/proc/meminfo: memFree=593176/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1773.13
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 45927 0 1 0 177249 64 0 0 25 0 8 0 163038552 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074172880 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/12754/statm: 228912 45619 2547 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=1.53
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 28700 0 0 0 141 12 0 0 16 0 8 0 163038556 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.44
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 561 0 0 0 42 2 0 0 16 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1773.13
Current children cumulated vsize (KiB) 915648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1810.39 s]
/proc/loadavg: 2.07 2.04 2.01 3/101 12945
/proc/meminfo: memFree=580632/2055920 swapFree=4191880/4192956
[pid=12754] ppid=12752 vsize=915648 CPUtime=1800.05
/proc/12754/stat : 12754 (java) R 12752 12754 12127 0 -1 0 45927 0 1 0 179941 64 0 0 25 0 8 0 163038552 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073480240 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/12754/statm: 228912 45619 2547 14 0 215382 0
[pid=12754/tid=12756] ppid=12752 vsize=915648 CPUtime=1.53
/proc/12754/task/12756/stat : 12756 (java) S 12752 12754 12127 0 -1 64 28700 0 0 0 141 12 0 0 16 0 8 0 163038556 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12757] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12757/stat : 12757 (java) S 12752 12754 12127 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12758] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12758/stat : 12758 (java) S 12752 12754 12127 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163038557 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12759] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12759/stat : 12759 (java) S 12752 12754 12127 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12760] ppid=12752 vsize=915648 CPUtime=0.44
/proc/12754/task/12760/stat : 12760 (java) S 12752 12754 12127 0 -1 64 561 0 0 0 42 2 0 0 16 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=12754/tid=12761] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12761/stat : 12761 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=12754/tid=12762] ppid=12752 vsize=915648 CPUtime=0
/proc/12754/task/12762/stat : 12762 (java) S 12752 12754 12127 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163038560 937623552 45619 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 915648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1810.49
CPU time (s): 1800.16
CPU user time (s): 1799.48
CPU system time (s): 0.676897
CPU usage (%): 99.4292
Max. virtual memory (cumulated for all children) (KiB): 915652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.48
system time used= 0.676897
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 45944
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38588
involuntary context switches= 82052

runsolver used 2.10168 s user time and 5.9181 s system time

The end

Launcher Data (download as text)

Begin job on node16 on Sun Jan  7 05:07:17 UTC 2007


IDJOB= 201246
IDBENCH= 3752
FILE ID= node16/201246-1168146437

PBS_JOBID= 3477876

Free space on /tmp= 66504 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp12/fapp12-1500-2.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201246-1168146437/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node16/watcher-201246-1168146437 -o ROOT/results/node16/solver-201246-1168146437 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201246-1168146437/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  a9559a77dc2a348044495e00f4dfba11

RANDOM SEED= 506739167

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1359728 kB
Buffers:         70872 kB
Cached:         443848 kB
SwapCached:        448 kB
Active:         254852 kB
Inactive:       373720 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1359728 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:            5124 kB
Writeback:           0 kB
Mapped:         135484 kB
Slab:            51980 kB
Committed_AS:  4343940 kB
PageTables:       2604 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66506 MiB



End job on node16 on Sun Jan  7 05:37:28 UTC 2007