Trace number 201334

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.1 1808.63

General information on the benchmark

Namefapp/fapp11-15/fapp12/
fapp12-1500-4.xml
MD5SUMb32f7f4672e7944a90a054382f67ae51
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of constraints25409
Maximum constraint arity2
Maximum domain size310
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25409
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=mac.xml
0.34	   
0.34	   instance
0.34	     name=/tmp/evaluation/201334-1168072330/unknown.xml
0.37	   
0.37	   domains being loaded...
0.41	   
0.41	   variables being loaded...
0.65	     nbVariables=1500  nbDomainTypes=13  minDomainSize=42  maxDomainSize=310
0.66	       =>  wckTime=0.342  cpuTime=0.24  mem=22M513
0.66	   
0.66	   predicates being loaded...
0.66	   
0.66	   constraints being loaded...
4.63	   
4.63	   INFO : Stopping converting binary constraints (cpu=4.04, mem = 44M314)
7.95	     nbConstraints=13439  nbMergedConstraints=11970  nbConvertedConstraints=60  nbConvertConstraintsChecks=4887460
7.95	     nbExtensionStructures=53  nbSharedExtensionStructures=7  nbConflictsStructures=53  nbSharedConflictsStructures=7
7.95	     nbSharedBinaryRepresentations=17269  nbEvaluationManagers=9630  nbSharedEvaluationManagers=3749  maxDegree=22
7.95	     maxArity=2
7.95	       =>  wckTime=7.635  cpuTime=6.9  mem=65M245
8.14	   
8.14	   solver IterativeSystematicSolver being built... 
8.66	       =>  wckTime=8.348  cpuTime=7.25  mem=84M869
49.23	   
49.23	   preprocessing
49.23	     nbConstraintChecks=70127869  nbValidityChecks=2385985  nbPropagations=2023  nbRevisions=42727
49.23	     nbUselessRevisions=38229  nbRemovedValues=241493  detectedInconsistency=no
49.23	       =>  wckTime=40.547  cpuTime=40.14  mem=84M869
59.57	   
59.57	   search
59.57	     run=0  nbConstraintChecks=15862682  nbValidityChecks=12147531  nbPropagations=9179  nbRevisions=166827
59.57	     nbUselessRevisions=152437  nbAssignments=86  nbFailedAssignments=17  nbBacktracks=10  nbVisitedNodes=111
59.57	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=69
59.57	       =>  wckTime=50.897  cpuTime=50.37  mem=85M871
62.97	   
62.97	   search
62.97	     run=1  nbConstraintChecks=20292941  nbValidityChecks=24570727  nbPropagations=25713  nbRevisions=461496
62.97	     nbUselessRevisions=422484  nbAssignments=179  nbFailedAssignments=35  nbBacktracks=25  nbVisitedNodes=230
62.97	     nbRestartNogoods=8  mapSize=0  nbInferences=0  nbTooLargeKeys=144
62.97	       =>  wckTime=54.298  cpuTime=53.74  mem=85M871
66.62	   
66.62	   search
66.62	     run=2  nbConstraintChecks=25024571  nbValidityChecks=37432721  nbPropagations=50000  nbRevisions=890577
66.62	     nbUselessRevisions=815301  nbAssignments=279  nbFailedAssignments=58  nbBacktracks=48  nbVisitedNodes=364
66.62	     nbRestartNogoods=10  mapSize=0  nbInferences=0  nbTooLargeKeys=221
66.62	       =>  wckTime=57.943  cpuTime=57.35  mem=85M871
72.20	   
72.20	   search
72.20	     run=3  nbConstraintChecks=32047995  nbValidityChecks=56028271  nbPropagations=86265  nbRevisions=1529415
72.20	     nbUselessRevisions=1396695  nbAssignments=434  nbFailedAssignments=120  nbBacktracks=82  nbVisitedNodes=601
72.20	     nbRestartNogoods=11  mapSize=0  nbInferences=0  nbTooLargeKeys=314
72.20	       =>  wckTime=63.526  cpuTime=62.88  mem=85M871
82.75	   
82.75	   search
82.75	     run=4  nbConstraintChecks=46452222  nbValidityChecks=82881558  nbPropagations=140135  nbRevisions=2481566
82.75	     nbUselessRevisions=2258987  nbAssignments=623  nbFailedAssignments=180  nbBacktracks=134  nbVisitedNodes=875
82.75	     nbRestartNogoods=16  mapSize=0  nbInferences=0  nbTooLargeKeys=443
82.75	       =>  wckTime=74.073  cpuTime=73.33  mem=85M871
97.12	   
97.12	   search
97.12	     run=5  nbConstraintChecks=66048447  nbValidityChecks=111000250  nbPropagations=216600  nbRevisions=3857371
97.12	     nbUselessRevisions=3498473  nbAssignments=854  nbFailedAssignments=245  nbBacktracks=213  nbVisitedNodes=1194
97.12	     nbRestartNogoods=27  mapSize=0  nbInferences=0  nbTooLargeKeys=609
97.12	       =>  wckTime=88.44  cpuTime=87.56  mem=85M871
105.65	   
105.65	   search
105.65	     run=6  nbConstraintChecks=75991998  nbValidityChecks=137080570  nbPropagations=315674  nbRevisions=5667295
105.65	     nbUselessRevisions=5122605  nbAssignments=1101  nbFailedAssignments=287  nbBacktracks=332  nbVisitedNodes=1529
105.65	     nbRestartNogoods=39  mapSize=0  nbInferences=0  nbTooLargeKeys=814
105.65	       =>  wckTime=96.972  cpuTime=96.02  mem=85M871
113.39	   
113.39	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1022, mem=85M871)
114.84	   
114.84	   search
114.84	     run=7  nbConstraintChecks=86639145  nbValidityChecks=166736977  nbPropagations=440734  nbRevisions=7972775
114.84	     nbUselessRevisions=7182490  nbAssignments=1447  nbFailedAssignments=370  nbBacktracks=504  nbVisitedNodes=2038
114.84	     nbRestartNogoods=42
114.84	       =>  wckTime=106.164  cpuTime=105.12  mem=85M871
165.24	   
165.24	   search
165.24	     run=8  nbConstraintChecks=151699684  nbValidityChecks=304018529  nbPropagations=665165  nbRevisions=12178400
165.24	     nbUselessRevisions=10873299  nbAssignments=2709  nbFailedAssignments=1355  nbBacktracks=763  nbVisitedNodes=4436
165.24	     nbRestartNogoods=47
165.24	       =>  wckTime=156.559  cpuTime=155.04  mem=85M871
244.11	   
244.11	   search
244.12	     run=9  nbConstraintChecks=261201153  nbValidityChecks=471001082  nbPropagations=988799  nbRevisions=18337795
244.12	     nbUselessRevisions=16226826  nbAssignments=4251  nbFailedAssignments=2490  nbBacktracks=1147  nbVisitedNodes=7326
244.12	     nbRestartNogoods=49
244.12	       =>  wckTime=235.439  cpuTime=233.19  mem=85M871
304.00	   
304.00	   search
304.00	     run=10  nbConstraintChecks=339994620  nbValidityChecks=607148935  nbPropagations=1411264  nbRevisions=26352486
304.00	     nbUselessRevisions=23158743  nbAssignments=5919  nbFailedAssignments=3467  nbBacktracks=1724  nbVisitedNodes=10242
304.00	     nbRestartNogoods=103
304.00	       =>  wckTime=295.32  cpuTime=292.52  mem=86M872
359.65	   
359.65	   search
359.65	     run=11  nbConstraintChecks=407658003  nbValidityChecks=768527136  nbPropagations=1972066  nbRevisions=36886126
359.65	     nbUselessRevisions=32272238  nbAssignments=7563  nbFailedAssignments=4172  nbBacktracks=2592  nbVisitedNodes=12874
359.65	     nbRestartNogoods=141
359.65	       =>  wckTime=350.973  cpuTime=347.67  mem=86M872
484.36	   
484.36	   search
484.36	     run=12  nbConstraintChecks=546967812  nbValidityChecks=1105353206  nbPropagations=2911325  nbRevisions=54684761
484.36	     nbUselessRevisions=47622133  nbAssignments=10913  nbFailedAssignments=6120  nbBacktracks=3891  nbVisitedNodes=18841
484.36	     nbRestartNogoods=157
484.36	       =>  wckTime=475.681  cpuTime=471.24  mem=86M872
559.11	   
559.11	   search
559.12	     run=13  nbConstraintChecks=632429514  nbValidityChecks=1316931242  nbPropagations=4068404  nbRevisions=76544984
559.12	     nbUselessRevisions=66519485  nbAssignments=14605  nbFailedAssignments=7762  nbBacktracks=5840  nbVisitedNodes=24879
559.12	     nbRestartNogoods=176
559.12	       =>  wckTime=550.439  cpuTime=545.31  mem=86M872
703.82	   
703.82	   search
703.82	     run=14  nbConstraintChecks=781188556  nbValidityChecks=1720073941  nbPropagations=5791048  nbRevisions=108968644
703.82	     nbUselessRevisions=94660841  nbAssignments=19637  nbFailedAssignments=9727  nbBacktracks=8760  nbVisitedNodes=32708
703.82	     nbRestartNogoods=275
703.82	       =>  wckTime=695.145  cpuTime=688.7  mem=86M872
1057.96	   
1057.96	   search
1057.96	     run=15  nbConstraintChecks=1152096961  nbValidityChecks=2733177227  nbPropagations=9013416  nbRevisions=169702843
1057.96	     nbUselessRevisions=147487253  nbAssignments=30825  nbFailedAssignments=16418  nbBacktracks=13143
1057.96	     nbVisitedNodes=52327  nbRestartNogoods=332
1057.96	       =>  wckTime=1049.281  cpuTime=1041.2  mem=86M872

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node42/watcher-201334-1168072330 -o ROOT/results/node42/solver-201334-1168072330 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201334-1168072330/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.92 1.98 1.95 4/80 21950
/proc/meminfo: memFree=1330704/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=9948 CPUtime=0
/proc/21949/stat : 21949 (java) S 21947 21949 21279 0 -1 0 723 0 0 0 0 0 0 0 18 0 1 0 155632223 10186752 472 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 7368 0 0 0 17 1 0 0
/proc/21949/statm: 2487 472 386 14 0 1142 0

[startup+0.104218 s]
/proc/loadavg: 1.92 1.98 1.95 4/80 21950
/proc/meminfo: memFree=1330704/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=914988 CPUtime=0.08
/proc/21949/stat : 21949 (java) S 21947 21949 21279 0 -1 0 2995 0 1 0 7 1 0 0 17 0 8 0 155632223 936947712 2741 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228747 2741 1427 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.512265 s]
/proc/loadavg: 1.92 1.98 1.95 4/80 21950
/proc/meminfo: memFree=1330704/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915328 CPUtime=0.49
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 7290 0 1 0 43 6 0 0 18 0 8 0 155632223 937295872 7029 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072897901 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228832 7029 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 915328

[startup+1.33336 s]
/proc/loadavg: 1.92 1.98 1.95 3/87 21957
/proc/meminfo: memFree=1259416/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1.3
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 22178 0 1 0 117 13 0 0 22 0 8 0 155632223 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073452462 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228905 21915 2160 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.08
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 5635 0 0 0 6 2 0 0 16 0 8 0 155632227 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.17
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 407 0 0 0 16 1 0 0 16 0 8 0 155632231 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915620

[startup+2.97153 s]
/proc/loadavg: 1.92 1.98 1.95 3/87 21957
/proc/meminfo: memFree=1251032/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=2.93
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 22255 0 1 0 279 14 0 0 25 0 8 0 155632223 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839799 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228905 21990 2181 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.1
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 5636 0 0 0 8 2 0 0 17 0 8 0 155632227 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.2
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 420 0 0 0 19 1 0 0 16 0 8 0 155632231 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 915620

[startup+6.17189 s]
/proc/loadavg: 2.01 2.00 1.95 3/87 21957
/proc/meminfo: memFree=1238296/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=6.09
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 26152 0 1 0 593 16 0 0 25 0 8 0 155632223 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153987704 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228905 25884 2182 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.29
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 9502 0 0 0 24 5 0 0 16 0 8 0 155632227 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.23
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 447 0 0 0 22 1 0 0 16 0 8 0 155632231 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 25884 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.09
Current children cumulated vsize (KiB) 915620

[startup+12.6426 s]
/proc/loadavg: 2.09 2.02 1.96 3/87 21957
/proc/meminfo: memFree=1190872/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=12.51
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37621 0 1 0 1228 23 0 0 25 0 8 0 155632223 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831590 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228905 37345 2533 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20493 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.34
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 507 0 0 0 32 2 0 0 16 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.51
Current children cumulated vsize (KiB) 915620

[startup+25.507 s]
/proc/loadavg: 2.07 2.02 1.96 3/87 21957
/proc/meminfo: memFree=1191000/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=25.26
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37622 0 1 0 2503 23 0 0 25 0 8 0 155632223 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831548 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228905 37345 2533 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20493 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.34
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 508 0 0 0 32 2 0 0 16 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37345 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.26
Current children cumulated vsize (KiB) 915620

[startup+51.1199 s]
/proc/loadavg: 2.04 2.01 1.96 3/87 21957
/proc/meminfo: memFree=1191000/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=50.63
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37635 0 1 0 5040 23 0 0 25 0 8 0 155632223 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839124 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228905 37355 2534 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20493 0 0 0 64 9 0 0 17 0 8 0 155632227 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.36
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 517 0 0 0 34 2 0 0 15 0 8 0 155632231 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37355 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.63
Current children cumulated vsize (KiB) 915620

[startup+102.373 s]
/proc/loadavg: 2.02 2.01 1.96 3/87 21957
/proc/meminfo: memFree=1191000/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=101.41
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37660 0 1 0 10118 23 0 0 25 0 8 0 155632223 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831552 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21949/statm: 228905 37372 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.38
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 533 0 0 0 36 2 0 0 16 0 8 0 155632231 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37372 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.41
Current children cumulated vsize (KiB) 915620

[startup+162.474 s]
/proc/loadavg: 2.00 2.00 1.96 3/87 21957
/proc/meminfo: memFree=1190936/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=160.97
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37680 0 1 0 16073 24 0 0 25 0 8 0 155632223 937594880 37381 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831580 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1414.56
Current children cumulated vsize (KiB) 915620

[startup+1482.88 s]
/proc/loadavg: 1.00 1.12 1.48 2/72 22029
/proc/meminfo: memFree=1226408/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1474.54
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37685 0 1 0 147427 27 0 0 25 0 8 0 155632223 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074164167 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/21949/statm: 228905 37385 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.41
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 557 0 0 0 39 2 0 0 16 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1474.54
Current children cumulated vsize (KiB) 915620

[startup+1542.89 s]
/proc/loadavg: 1.00 1.10 1.44 2/72 22029
/proc/meminfo: memFree=1226344/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1534.52
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37685 0 1 0 153425 27 0 0 25 0 8 0 155632223 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832744 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/21949/statm: 228905 37385 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.41
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 557 0 0 0 39 2 0 0 16 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1534.52
Current children cumulated vsize (KiB) 915620

[startup+1602.9 s]
/proc/loadavg: 1.00 1.08 1.41 2/72 22029
/proc/meminfo: memFree=1226344/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1594.49
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37685 0 1 0 159422 27 0 0 25 0 8 0 155632223 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839229 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/21949/statm: 228905 37385 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.41
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 557 0 0 0 39 2 0 0 16 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1594.49
Current children cumulated vsize (KiB) 915620

[startup+1662.92 s]
/proc/loadavg: 1.00 1.06 1.39 2/72 22029
/proc/meminfo: memFree=1226344/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1654.47
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37685 0 1 0 165420 27 0 0 25 0 8 0 155632223 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073833447 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/21949/statm: 228905 37385 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.41
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 557 0 0 0 39 2 0 0 16 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1654.47
Current children cumulated vsize (KiB) 915620

[startup+1722.93 s]
/proc/loadavg: 1.00 1.05 1.36 2/72 22029
/proc/meminfo: memFree=1226344/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1714.44
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37685 0 1 0 171417 27 0 0 25 0 8 0 155632223 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074229753 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/21949/statm: 228905 37385 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.41
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 557 0 0 0 39 2 0 0 16 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1714.44
Current children cumulated vsize (KiB) 915620

[startup+1782.97 s]
/proc/loadavg: 1.00 1.03 1.33 2/78 22175
/proc/meminfo: memFree=1225080/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1774.44
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37685 0 1 0 177404 40 0 0 25 0 8 0 155632223 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074150537 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/21949/statm: 228905 37385 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.41
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 557 0 0 0 39 2 0 0 16 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1774.44
Current children cumulated vsize (KiB) 915620



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.56 s]
/proc/loadavg: 1.00 1.03 1.32 2/78 22197
/proc/meminfo: memFree=1225016/2055920 swapFree=4191892/4192956
[pid=21949] ppid=21947 vsize=915620 CPUtime=1800.04
/proc/21949/stat : 21949 (java) R 21947 21949 21279 0 -1 0 37685 0 1 0 179960 44 0 0 25 0 8 0 155632223 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074150592 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/21949/statm: 228905 37385 2537 14 0 215375 0
[pid=21949/tid=21951] ppid=21947 vsize=915620 CPUtime=0.73
/proc/21949/task/21951/stat : 21951 (java) S 21947 21949 21279 0 -1 64 20494 0 0 0 64 9 0 0 16 0 8 0 155632227 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21952] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21952/stat : 21952 (java) S 21947 21949 21279 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21953] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21953/stat : 21953 (java) S 21947 21949 21279 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155632228 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21954] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21954/stat : 21954 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21955] ppid=21947 vsize=915620 CPUtime=0.41
/proc/21949/task/21955/stat : 21955 (java) S 21947 21949 21279 0 -1 64 557 0 0 0 39 2 0 0 16 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21956] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21956/stat : 21956 (java) S 21947 21949 21279 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21949/tid=21957] ppid=21947 vsize=915620 CPUtime=0
/proc/21949/task/21957/stat : 21957 (java) S 21947 21949 21279 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155632231 937594880 37385 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 915620

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1808.63
CPU time (s): 1800.1
CPU user time (s): 1799.64
CPU system time (s): 0.464929
CPU usage (%): 99.5285
Max. virtual memory (cumulated for all children) (KiB): 915620

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.64
system time used= 0.464929
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37700
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38320
involuntary context switches= 57407

runsolver used 2.03669 s user time and 5.17121 s system time

The end

Launcher Data (download as text)

Begin job on node42 on Sat Jan  6 08:32:10 UTC 2007


IDJOB= 201334
IDBENCH= 3757
FILE ID= node42/201334-1168072330

PBS_JOBID= 3475892

Free space on /tmp= 66538 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp12/fapp12-1500-4.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201334-1168072330/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node42/watcher-201334-1168072330 -o ROOT/results/node42/solver-201334-1168072330 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201334-1168072330/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  b32f7f4672e7944a90a054382f67ae51

RANDOM SEED= 961445703

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.229
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.229
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1331120 kB
Buffers:         49308 kB
Cached:         552360 kB
SwapCached:        268 kB
Active:         131740 kB
Inactive:       517940 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1331120 kB
SwapTotal:     4192956 kB
SwapFree:      4191892 kB
Dirty:            5100 kB
Writeback:           0 kB
Mapped:          67028 kB
Slab:            60464 kB
Committed_AS:  3431696 kB
PageTables:       1884 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66540 MiB



End job on node42 on Sat Jan  6 09:02:19 UTC 2007