Trace number 201262

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.12 1815.22

General information on the benchmark

Namefapp/fapp11-15/fapp12/
fapp12-1500-6.xml
MD5SUMeb2dbda2391814cf18e943c437e26072
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of constraints25409
Maximum constraint arity2
Maximum domain size310
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25409
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=esac.xml
0.34	   
0.34	   instance
0.34	     name=/tmp/evaluation/201262-1168146563/unknown.xml
0.37	   
0.37	   domains being loaded...
0.40	   
0.40	   variables being loaded...
0.62	     nbVariables=1500  nbDomainTypes=13  minDomainSize=42  maxDomainSize=310
0.62	       =>  wckTime=0.314  cpuTime=0.23  mem=22M513
0.62	   
0.62	   predicates being loaded...
0.63	   
0.63	   constraints being loaded...
203.57	   
203.57	   INFO : Stopping converting binary constraints (cpu=200.05, mem = 103M610)
205.78	     nbConstraints=13439  nbMergedConstraints=11970  nbConvertedConstraints=5149  nbConvertConstraintsChecks=352604570
205.78	     nbExtensionStructures=4106  nbSharedExtensionStructures=1043  nbConflictsStructures=4106
205.78	     nbSharedConflictsStructures=1043  nbSharedBinaryRepresentations=2000162  nbEvaluationManagers=6310
205.78	     nbSharedEvaluationManagers=1980  maxDegree=22  maxArity=2
205.78	       =>  wckTime=205.471  cpuTime=201.82  mem=113M441
206.26	   
206.26	   solver IterativeSystematicSolver being built... 
206.68	       =>  wckTime=206.373  cpuTime=202.15  mem=148M313
275.13	   
275.13	   INFO : Stopping ESAC
275.13	   
275.13	   preprocessing
275.14	     nbConstraintChecks=139637735  nbValidityChecks=59252752  nbPropagations=45724  nbRevisions=634288
275.14	     nbUselessRevisions=573208  nbSingletonTests=612  nbEffectiveSingletonTests=45  nbESACBranches=20
275.14	     nbRemovedValues=216733  detectedInconsistency=no
275.14	       =>  wckTime=68.427  cpuTime=67.58  mem=148M313
278.34	   
278.34	   search
278.34	     run=0  nbConstraintChecks=6605360  nbValidityChecks=4973462  nbPropagations=49851  nbRevisions=694301
278.34	     nbUselessRevisions=626247  nbAssignments=54  nbFailedAssignments=12  nbBacktracks=12  nbVisitedNodes=73
278.34	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=42
278.34	       =>  wckTime=71.638  cpuTime=70.74  mem=149M328
286.35	   
286.35	   search
286.35	     run=1  nbConstraintChecks=27842884  nbValidityChecks=26326221  nbPropagations=116204  nbRevisions=1614422
286.35	     nbUselessRevisions=1456896  nbAssignments=222  nbFailedAssignments=28  nbBacktracks=29  nbVisitedNodes=160
286.35	     nbRestartNogoods=6  mapSize=0  nbInferences=0  nbTooLargeKeys=89
286.35	       =>  wckTime=79.654  cpuTime=78.66  mem=150M349
294.87	   
294.87	   search
294.87	     run=2  nbConstraintChecks=47673899  nbValidityChecks=40210081  nbPropagations=196376  nbRevisions=2734444
294.87	     nbUselessRevisions=2467797  nbAssignments=459  nbFailedAssignments=53  nbBacktracks=53  nbVisitedNodes=429
294.87	     nbRestartNogoods=10  mapSize=13  nbInferences=0  nbTooLargeKeys=277
294.87	       =>  wckTime=88.172  cpuTime=87.06  mem=150M599
345.35	   
345.35	   search
345.35	     run=3  nbConstraintChecks=179900933  nbValidityChecks=165362207  nbPropagations=384668  nbRevisions=5309136
345.35	     nbUselessRevisions=4808780  nbAssignments=2386  nbFailedAssignments=78  nbBacktracks=88  nbVisitedNodes=820
345.35	     nbRestartNogoods=23  mapSize=36  nbInferences=0  nbTooLargeKeys=473
345.35	       =>  wckTime=138.655  cpuTime=136.9  mem=156M961
404.40	   
404.40	   search
404.40	     run=4  nbConstraintChecks=339380969  nbValidityChecks=314575700  nbPropagations=723545  nbRevisions=9919133
404.40	     nbUselessRevisions=9014410  nbAssignments=5032  nbFailedAssignments=101  nbBacktracks=139  nbVisitedNodes=1229
404.40	     nbRestartNogoods=34  mapSize=64  nbInferences=0  nbTooLargeKeys=669
404.40	       =>  wckTime=197.695  cpuTime=195.19  mem=164M243
441.90	   
441.90	   search
441.90	     run=5  nbConstraintChecks=445394753  nbValidityChecks=415404476  nbPropagations=1175114  nbRevisions=16088393
441.90	     nbUselessRevisions=14636975  nbAssignments=6763  nbFailedAssignments=160  nbBacktracks=215  nbVisitedNodes=1643
441.90	     nbRestartNogoods=41  mapSize=96  nbInferences=0  nbTooLargeKeys=874
441.90	       =>  wckTime=235.202  cpuTime=232.31  mem=168M302
458.44	   
458.44	   INFO : Stopping hyperNogood (mapSize=124, nbTooLargekeys=1070, mem=144M202)
463.36	   
463.36	   search
463.36	     run=6  nbConstraintChecks=506831190  nbValidityChecks=468671653  nbPropagations=1696630  nbRevisions=23298932
463.36	     nbUselessRevisions=21163451  nbAssignments=7715  nbFailedAssignments=456  nbBacktracks=332  nbVisitedNodes=2627
463.36	     nbRestartNogoods=46
463.37	       =>  wckTime=256.664  cpuTime=253.46  mem=144M202
522.74	   
522.74	   search
522.74	     run=7  nbConstraintChecks=673944977  nbValidityChecks=630440975  nbPropagations=2355052  nbRevisions=32404892
522.74	     nbUselessRevisions=29411331  nbAssignments=9385  nbFailedAssignments=578  nbBacktracks=504  nbVisitedNodes=3109
522.74	     nbRestartNogoods=65
522.74	       =>  wckTime=316.043  cpuTime=312.25  mem=144M202
541.14	   
541.14	   search
541.14	     run=8  nbConstraintChecks=721650883  nbValidityChecks=666999068  nbPropagations=3048816  nbRevisions=42020729
541.14	     nbUselessRevisions=38114162  nbAssignments=9986  nbFailedAssignments=699  nbBacktracks=762  nbVisitedNodes=3909
541.14	     nbRestartNogoods=70
541.14	       =>  wckTime=334.441  cpuTime=330.45  mem=145M89
551.87	   
551.87	   search
551.87	     run=9  nbConstraintChecks=750825357  nbValidityChecks=693350394  nbPropagations=3779729  nbRevisions=52211604
551.87	     nbUselessRevisions=47319253  nbAssignments=10927  nbFailedAssignments=992  nbBacktracks=1150  nbVisitedNodes=5178
551.87	     nbRestartNogoods=76
551.87	       =>  wckTime=345.168  cpuTime=341.07  mem=145M89
571.19	   
571.19	   search
571.19	     run=10  nbConstraintChecks=803887767  nbValidityChecks=731231985  nbPropagations=4585378  nbRevisions=63556419
571.19	     nbUselessRevisions=57519675  nbAssignments=11997  nbFailedAssignments=1234  nbBacktracks=1733  nbVisitedNodes=6688
571.19	     nbRestartNogoods=77
571.19	       =>  wckTime=364.49  cpuTime=360.19  mem=145M89
607.44	   
607.44	   search
607.44	     run=11  nbConstraintChecks=908150777  nbValidityChecks=801602903  nbPropagations=5510568  nbRevisions=76934546
607.44	     nbUselessRevisions=69442008  nbAssignments=13593  nbFailedAssignments=1806  nbBacktracks=2602  nbVisitedNodes=9151
607.44	     nbRestartNogoods=79
607.44	       =>  wckTime=400.741  cpuTime=396.01  mem=145M89
664.72	   
664.72	   search
664.72	     run=12  nbConstraintChecks=1076439670  nbValidityChecks=918810797  nbPropagations=6626952  nbRevisions=93406008
664.72	     nbUselessRevisions=83983736  nbAssignments=15834  nbFailedAssignments=2550  nbBacktracks=3901  nbVisitedNodes=12568
664.72	     nbRestartNogoods=81
664.72	       =>  wckTime=458.016  cpuTime=452.59  mem=145M89
835.56	   
835.56	   search
835.56	     run=13  nbConstraintChecks=1587801582  nbValidityChecks=1342271875  nbPropagations=8341603  nbRevisions=118924438
835.56	     nbUselessRevisions=106444064  nbAssignments=22647  nbFailedAssignments=3619  nbBacktracks=5853
835.56	     nbVisitedNodes=17405  nbRestartNogoods=103
835.56	       =>  wckTime=628.858  cpuTime=621.95  mem=145M89
1100.19	   
1100.19	   search
1100.19	     run=14  nbConstraintChecks=2443531262  nbValidityChecks=2002580585  nbPropagations=11028203  nbRevisions=160371584
1100.19	     nbUselessRevisions=142754808  nbAssignments=31243  nbFailedAssignments=7602  nbBacktracks=8774
1100.19	     nbVisitedNodes=29999  nbRestartNogoods=119
1100.19	       =>  wckTime=893.494  cpuTime=884.1  mem=145M89
1310.34	   
1310.34	   search
1310.34	     run=15  nbConstraintChecks=3115819526  nbValidityChecks=2444260580  nbPropagations=14697923  nbRevisions=218321763
1310.34	     nbUselessRevisions=193168551  nbAssignments=43582  nbFailedAssignments=14609  nbBacktracks=13152
1310.34	     nbVisitedNodes=50154  nbRestartNogoods=143
1310.34	       =>  wckTime=1103.644  cpuTime=1093.08  mem=145M89
1656.87	   
1656.88	   search
1656.88	     run=16  nbConstraintChecks=4221872642  nbValidityChecks=3369342890  nbPropagations=19706319  nbRevisions=297218114
1656.88	     nbUselessRevisions=261931357  nbAssignments=62245  nbFailedAssignments=21776  nbBacktracks=19721
1656.88	     nbVisitedNodes=73944  nbRestartNogoods=205
1656.88	       =>  wckTime=1450.175  cpuTime=1437.76  mem=145M89

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node72/watcher-201262-1168146563 -o ROOT/results/node72/solver-201262-1168146563 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201262-1168146563/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 0.92 0.98 0.99 4/81 22630
/proc/meminfo: memFree=1366088/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=18540 CPUtime=0
/proc/22629/stat : 22629 (runsolver) R 22625 22629 22522 0 -1 4194368 17 0 0 0 0 0 0 0 20 0 1 0 163065116 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 234517753127 0 0 4096 24578 0 0 0 17 1 0 0
/proc/22629/statm: 4635 279 244 17 0 2626 0

[startup+0.103249 s]
/proc/loadavg: 0.92 0.98 0.99 4/81 22630
/proc/meminfo: memFree=1366088/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=914988 CPUtime=0.08
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 2979 0 1 0 6 2 0 0 23 0 8 0 163065116 936947712 2725 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072923466 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228747 2725 1423 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.511289 s]
/proc/loadavg: 0.92 0.98 0.99 4/81 22630
/proc/meminfo: memFree=1366088/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915328 CPUtime=0.48
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 7714 0 1 0 44 4 0 0 25 0 8 0 163065116 937295872 7453 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072917395 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228832 7453 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 915328

[startup+1.33236 s]
/proc/loadavg: 1.09 1.02 1.01 5/101 22663
/proc/meminfo: memFree=1248616/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1.3
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 22178 0 1 0 117 13 0 0 25 0 8 0 163065116 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073573603 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 21915 2160 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=0.09
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 5634 0 0 0 7 2 0 0 16 0 8 0 163065120 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.14
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 409 0 0 0 14 0 0 0 16 0 8 0 163065124 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915648

[startup+2.9695 s]
/proc/loadavg: 1.09 1.02 1.01 3/101 22663
/proc/meminfo: memFree=1232552/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=2.93
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 22254 0 1 0 279 14 0 0 25 0 8 0 163065116 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 21989 2180 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=0.12
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 5634 0 0 0 10 2 0 0 17 0 8 0 163065120 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.17
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 422 0 0 0 17 0 0 0 15 0 8 0 163065124 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 21989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 915648

[startup+6.2658 s]
/proc/loadavg: 1.24 1.05 1.02 4/101 22663
/proc/meminfo: memFree=1208616/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=6.21
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 22269 0 1 0 607 14 0 0 25 0 8 0 163065116 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831384 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 22004 2181 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=0.12
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 5634 0 0 0 10 2 0 0 16 0 8 0 163065120 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.19
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 436 0 0 0 19 0 0 0 15 0 8 0 163065124 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 22004 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 915648

[startup+12.7384 s]
/proc/loadavg: 1.38 1.08 1.03 4/101 22663
/proc/meminfo: memFree=1178928/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=12.64
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 22272 0 1 0 1249 15 0 0 25 0 8 0 163065116 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831586 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 22006 2181 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=0.12
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 5634 0 0 0 10 2 0 0 16 0 8 0 163065120 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.19
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 438 0 0 0 19 0 0 0 16 0 8 0 163065124 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.64
Current children cumulated vsize (KiB) 915648

[startup+25.6066 s]
/proc/loadavg: 1.55 1.13 1.04 3/101 22663
/proc/meminfo: memFree=1129136/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=25.4
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 25505 0 1 0 2521 19 0 0 25 0 8 0 163065116 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073837733 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 25238 2181 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=0.26
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 8861 0 0 0 21 5 0 0 16 0 8 0 163065120 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.2
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 443 0 0 0 20 0 0 0 15 0 8 0 163065124 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 25238 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 915648

[startup+51.2099 s]
/proc/loadavg: 1.78 1.22 1.08 3/101 22663
/proc/meminfo: memFree=1070000/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=50.72
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 25508 0 1 0 5050 22 0 0 25 0 8 0 163065116 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831548 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 25240 2181 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=0.26
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 8861 0 0 0 21 5 0 0 16 0 8 0 163065120 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.2
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 445 0 0 0 20 0 0 0 16 0 8 0 163065124 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 25240 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 50.72
Current children cumulated vsize (KiB) 915648

[startup+102.428 s]
/proc/loadavg: 1.90 1.34 1.12 3/101 22663
/proc/meminfo: memFree=958832/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=101.44
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 31899 0 1 0 10112 32 0 0 25 0 8 0 163065116 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839976 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 31627 2181 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=0.69
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 15240 0 0 0 61 8 0 0 16 0 8 0 163065120 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.22
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 453 0 0 0 22 0 0 0 15 0 8 0 163065124 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 31627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 101.44
Current children cumulated vsize (KiB) 915648

[startup+162.514 s]
/proc/loadavg: 2.07 1.49 1.18 3/101 22663
/proc/meminfo: memFree=865072/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=160.93
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 36298 0 1 0 16052 41 0 0 25 0 8 0 163065116 937623552 36024 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073833524 0 4 0 23759 18446744073709551615 0 0 17 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1410.9
Current children cumulated vsize (KiB) 915648

[startup+1483.95 s]
/proc/loadavg: 2.00 2.00 1.79 3/93 23024
/proc/meminfo: memFree=1126560/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1470.64
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 53556 0 1 0 146994 70 0 0 25 0 8 0 163065116 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835943 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 53242 2548 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=2.03
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 36322 0 0 0 185 18 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.42
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 560 0 0 0 41 1 0 0 17 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1470.64
Current children cumulated vsize (KiB) 915648

[startup+1544.03 s]
/proc/loadavg: 2.00 2.00 1.80 3/93 23024
/proc/meminfo: memFree=1126496/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1530.41
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 53556 0 1 0 152971 70 0 0 25 0 8 0 163065116 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074161977 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 53242 2548 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=2.03
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 36322 0 0 0 185 18 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.42
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 560 0 0 0 41 1 0 0 17 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1530.41
Current children cumulated vsize (KiB) 915648

[startup+1604.11 s]
/proc/loadavg: 2.00 2.00 1.81 3/93 23024
/proc/meminfo: memFree=1126560/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1590.17
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 53556 0 1 0 158947 70 0 0 25 0 8 0 163065116 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073834357 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 53242 2548 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=2.03
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 36322 0 0 0 185 18 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.42
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 560 0 0 0 41 1 0 0 17 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1590.17
Current children cumulated vsize (KiB) 915648

[startup+1664.2 s]
/proc/loadavg: 2.00 2.00 1.82 3/93 23024
/proc/meminfo: memFree=1126560/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1649.91
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 53556 0 1 0 164921 70 0 0 25 0 8 0 163065116 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832743 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 53242 2548 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=2.03
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 36322 0 0 0 185 18 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.42
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 560 0 0 0 41 1 0 0 17 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1649.91
Current children cumulated vsize (KiB) 915648

[startup+1724.28 s]
/proc/loadavg: 2.07 2.02 1.83 3/93 23024
/proc/meminfo: memFree=1126496/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1709.67
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 53556 0 1 0 170897 70 0 0 25 0 8 0 163065116 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835879 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 53242 2548 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=2.03
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 36322 0 0 0 185 18 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.42
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 560 0 0 0 41 1 0 0 17 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1709.67
Current children cumulated vsize (KiB) 915648

[startup+1784.36 s]
/proc/loadavg: 2.08 2.03 1.84 3/93 23024
/proc/meminfo: memFree=1126496/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1769.43
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 53556 0 1 0 176873 70 0 0 25 0 8 0 163065116 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074161977 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 53242 2548 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=2.03
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 36322 0 0 0 185 18 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.42
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 560 0 0 0 41 1 0 0 17 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1769.43
Current children cumulated vsize (KiB) 915648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1815.13 s]
/proc/loadavg: 2.11 2.04 1.85 3/93 23024
/proc/meminfo: memFree=1126496/2055920 swapFree=4191880/4192956
[pid=22629] ppid=22625 vsize=915648 CPUtime=1800.02
/proc/22629/stat : 22629 (java) R 22625 22629 22522 0 -1 0 53556 0 1 0 179932 70 0 0 25 0 8 0 163065116 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839799 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/22629/statm: 228912 53242 2548 14 0 215382 0
[pid=22629/tid=22648] ppid=22625 vsize=915648 CPUtime=2.03
/proc/22629/task/22648/stat : 22648 (java) S 22625 22629 22522 0 -1 64 36322 0 0 0 185 18 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22649] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22649/stat : 22649 (java) S 22625 22629 22522 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22650] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22650/stat : 22650 (java) S 22625 22629 22522 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163065120 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22653] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22653/stat : 22653 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 21 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22654] ppid=22625 vsize=915648 CPUtime=0.42
/proc/22629/task/22654/stat : 22654 (java) S 22625 22629 22522 0 -1 64 560 0 0 0 41 1 0 0 17 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22655] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22655/stat : 22655 (java) S 22625 22629 22522 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=22629/tid=22656] ppid=22625 vsize=915648 CPUtime=0
/proc/22629/task/22656/stat : 22656 (java) S 22625 22629 22522 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163065124 937623552 53242 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 915648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1815.22
CPU time (s): 1800.12
CPU user time (s): 1799.38
CPU system time (s): 0.740887
CPU usage (%): 99.1682
Max. virtual memory (cumulated for all children) (KiB): 915652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.38
system time used= 0.740887
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 53573
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38769
involuntary context switches= 89102

runsolver used 2.54461 s user time and 6.29704 s system time

The end

Launcher Data (download as text)

Begin job on node72 on Sun Jan  7 05:09:23 UTC 2007


IDJOB= 201262
IDBENCH= 3753
FILE ID= node72/201262-1168146563

PBS_JOBID= 3478391

Free space on /tmp= 66546 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp12/fapp12-1500-6.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201262-1168146563/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node72/watcher-201262-1168146563 -o ROOT/results/node72/solver-201262-1168146563 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201262-1168146563/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  eb2dbda2391814cf18e943c437e26072

RANDOM SEED= 67483133

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.223
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.223
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1366496 kB
Buffers:         42644 kB
Cached:         525020 kB
SwapCached:        408 kB
Active:         187912 kB
Inactive:       427208 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1366496 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:           12168 kB
Writeback:           0 kB
Mapped:          64704 kB
Slab:            59280 kB
Committed_AS:  2889876 kB
PageTables:       2196 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66547 MiB



End job on node72 on Sun Jan  7 05:39:38 UTC 2007