Trace number 201652

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.08 1801.15

General information on the benchmark

Namefapp/fapp11-15/fapp13/
fapp13-2000-3.xml
MD5SUM7f084eb3a66440e5445613ae031b39b2
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of constraints25652
Maximum constraint arity2
Maximum domain size190
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25652
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=mac.xml
0.35	   
0.35	   instance
0.35	     name=/tmp/evaluation/201652-1168072440/unknown.xml
0.38	   
0.38	   domains being loaded...
0.42	   
0.42	   variables being loaded...
0.64	     nbVariables=2000  nbDomainTypes=49  minDomainSize=42  maxDomainSize=190
0.64	       =>  wckTime=0.328  cpuTime=0.23  mem=20M547
0.65	   
0.65	   predicates being loaded...
0.65	   
0.65	   constraints being loaded...
4.60	   
4.60	   INFO : Stopping converting binary constraints (cpu=4.01, mem = 44M687)
7.96	     nbConstraints=13669  nbMergedConstraints=11983  nbConvertedConstraints=204  nbConvertConstraintsChecks=4595282
7.96	     nbExtensionStructures=190  nbSharedExtensionStructures=14  nbConflictsStructures=190
7.96	     nbSharedConflictsStructures=14  nbSharedBinaryRepresentations=34873  nbEvaluationManagers=9781
7.96	     nbSharedEvaluationManagers=3684  maxDegree=17  maxArity=2
7.96	       =>  wckTime=7.639  cpuTime=6.9  mem=61M343
8.15	   
8.15	   solver IterativeSystematicSolver being built... 
8.61	       =>  wckTime=8.29  cpuTime=7.25  mem=94M514
24.58	   
24.58	   preprocessing
24.58	     nbConstraintChecks=26729992  nbValidityChecks=1672863  nbPropagations=2988  nbRevisions=47275
24.58	     nbUselessRevisions=41350  nbRemovedValues=175621  detectedInconsistency=no
24.58	       =>  wckTime=15.956  cpuTime=15.79  mem=94M514
30.25	   
30.25	   search
30.25	     run=0  nbConstraintChecks=7085810  nbValidityChecks=7637088  nbPropagations=14857  nbRevisions=202800
30.25	     nbUselessRevisions=179265  nbAssignments=177  nbFailedAssignments=15  nbBacktracks=12  nbVisitedNodes=199
30.25	     nbRestartNogoods=0  mapSize=10  nbInferences=0  nbTooLargeKeys=0
30.25	       =>  wckTime=21.625  cpuTime=21.31  mem=72M267
32.83	   
32.83	   search
32.83	     run=1  nbConstraintChecks=9691080  nbValidityChecks=15316114  nbPropagations=41787  nbRevisions=562486
32.83	     nbUselessRevisions=499238  nbAssignments=355  nbFailedAssignments=22  nbBacktracks=29  nbVisitedNodes=391
32.83	     nbRestartNogoods=10  mapSize=17  nbInferences=0  nbTooLargeKeys=0
32.83	       =>  wckTime=24.211  cpuTime=23.87  mem=79M539
35.36	   
35.37	   search
35.37	     run=2  nbConstraintChecks=12169482  nbValidityChecks=23217718  nbPropagations=81290  nbRevisions=1086053
35.37	     nbUselessRevisions=966013  nbAssignments=538  nbFailedAssignments=28  nbBacktracks=52  nbVisitedNodes=592
35.37	     nbRestartNogoods=16  mapSize=29  nbInferences=0  nbTooLargeKeys=0
35.37	       =>  wckTime=26.745  cpuTime=26.37  mem=87M174
38.30	   
38.30	   search
38.30	     run=3  nbConstraintChecks=15248675  nbValidityChecks=32736368  nbPropagations=137126  nbRevisions=1826630
38.30	     nbUselessRevisions=1623449  nbAssignments=735  nbFailedAssignments=46  nbBacktracks=85  nbVisitedNodes=818
38.30	     nbRestartNogoods=20  mapSize=46  nbInferences=0  nbTooLargeKeys=0
38.30	       =>  wckTime=29.68  cpuTime=29.3  mem=94M894
43.13	   
43.13	   search
43.13	     run=4  nbConstraintChecks=20530486  nbValidityChecks=44996237  nbPropagations=214082  nbRevisions=2862330
43.13	     nbUselessRevisions=2531138  nbAssignments=978  nbFailedAssignments=84  nbBacktracks=135  nbVisitedNodes=1119
43.13	     nbRestartNogoods=23  mapSize=85  nbInferences=0  nbTooLargeKeys=0
43.13	       =>  wckTime=34.508  cpuTime=34.12  mem=104M19
47.42	   
47.42	   search
47.42	     run=5  nbConstraintChecks=25191336  nbValidityChecks=57113354  nbPropagations=312227  nbRevisions=4186836
47.42	     nbUselessRevisions=3688824  nbAssignments=1253  nbFailedAssignments=137  nbBacktracks=216  nbVisitedNodes=1471
47.42	     nbRestartNogoods=28  mapSize=133  nbInferences=0  nbTooLargeKeys=0
47.42	       =>  wckTime=38.802  cpuTime=38.4  mem=113M695
56.52	   
56.52	   search
56.52	     run=6  nbConstraintChecks=34433524  nbValidityChecks=80074282  nbPropagations=451839  nbRevisions=6080568
56.52	     nbUselessRevisions=5277763  nbAssignments=1804  nbFailedAssignments=446  nbBacktracks=329  nbVisitedNodes=2385
56.52	     nbRestartNogoods=33  mapSize=219  nbInferences=0  nbTooLargeKeys=0
56.52	       =>  wckTime=47.901  cpuTime=47.44  mem=85M27
63.35	   
63.35	   search
63.35	     run=7  nbConstraintChecks=42376689  nbValidityChecks=94437943  nbPropagations=617286  nbRevisions=8314212
63.35	     nbUselessRevisions=7162875  nbAssignments=2195  nbFailedAssignments=521  nbBacktracks=499  nbVisitedNodes=2907
63.35	     nbRestartNogoods=43  mapSize=322  nbInferences=0  nbTooLargeKeys=0
63.35	       =>  wckTime=54.73  cpuTime=54.23  mem=98M251
73.25	   
73.25	   search
73.25	     run=8  nbConstraintChecks=52223822  nbValidityChecks=118702059  nbPropagations=838351  nbRevisions=11277541
73.25	     nbUselessRevisions=9676728  nbAssignments=3133  nbFailedAssignments=1012  nbBacktracks=755  nbVisitedNodes=4473
73.25	     nbRestartNogoods=54  mapSize=521  nbInferences=0  nbTooLargeKeys=0
73.25	       =>  wckTime=64.629  cpuTime=64.11  mem=117M84
102.65	   
102.65	   search
102.65	     run=9  nbConstraintChecks=85762634  nbValidityChecks=183795467  nbPropagations=1181311  nbRevisions=16009635
102.65	     nbUselessRevisions=13626259  nbAssignments=4083  nbFailedAssignments=1448  nbBacktracks=1143  nbVisitedNodes=6040
102.65	     nbRestartNogoods=79  mapSize=791  nbInferences=0  nbTooLargeKeys=0
102.65	       =>  wckTime=94.026  cpuTime=93.45  mem=113M168
124.03	   
124.03	   INFO : Stopping hyperNogood (mapSize=1031, nbTooLargekeys=0, mem=130M502)
152.33	   
152.33	   search
152.33	     run=10  nbConstraintChecks=145180369  nbValidityChecks=299237053  nbPropagations=1725928  nbRevisions=23702010
152.33	     nbUselessRevisions=19987570  nbAssignments=5599  nbFailedAssignments=2309  nbBacktracks=1719  nbVisitedNodes=8686
152.33	     nbRestartNogoods=106
152.33	       =>  wckTime=143.713  cpuTime=143.11  mem=130M502
195.44	   
195.44	   search
195.44	     run=11  nbConstraintChecks=194817125  nbValidityChecks=412003094  nbPropagations=2490101  nbRevisions=34518908
195.44	     nbUselessRevisions=29025736  nbAssignments=7710  nbFailedAssignments=3426  nbBacktracks=2584  nbVisitedNodes=12200
195.44	     nbRestartNogoods=122
195.44	       =>  wckTime=186.821  cpuTime=186.2  mem=130M502
333.30	   
333.30	   search
333.30	     run=12  nbConstraintChecks=351199135  nbValidityChecks=778851659  nbPropagations=3896216  nbRevisions=54739241
333.30	     nbUselessRevisions=45919778  nbAssignments=12836  nbFailedAssignments=7177  nbBacktracks=3882  nbVisitedNodes=21914
333.30	     nbRestartNogoods=158
333.30	       =>  wckTime=324.678  cpuTime=324.0  mem=131M128
464.94	   
464.94	   search
464.94	     run=13  nbConstraintChecks=491883518  nbValidityChecks=1071733540  nbPropagations=5935858  nbRevisions=84321284
464.94	     nbUselessRevisions=70465594  nbAssignments=17199  nbFailedAssignments=9487  nbBacktracks=5829  nbVisitedNodes=29347
464.94	     nbRestartNogoods=164
464.94	       =>  wckTime=456.322  cpuTime=455.6  mem=131M128
599.50	   
599.50	   search
599.50	     run=14  nbConstraintChecks=615825959  nbValidityChecks=1397182454  nbPropagations=8801827  nbRevisions=125958523
599.50	     nbUselessRevisions=104748590  nbAssignments=22940  nbFailedAssignments=12213  nbBacktracks=8749
599.50	     nbVisitedNodes=39229  nbRestartNogoods=185
599.50	       =>  wckTime=590.879  cpuTime=590.11  mem=131M128
997.69	   
997.69	   search
997.69	     run=15  nbConstraintChecks=1010719043  nbValidityChecks=2376532302  nbPropagations=13862769  nbRevisions=200028479
997.69	     nbUselessRevisions=166133210  nbAssignments=33079  nbFailedAssignments=17886  nbBacktracks=13127
997.69	     nbVisitedNodes=56903  nbRestartNogoods=198
997.69	       =>  wckTime=989.066  cpuTime=988.16  mem=131M128
1380.53	   
1380.53	   search
1380.53	     run=16  nbConstraintChecks=1329634722  nbValidityChecks=3278282111  nbPropagations=21704967  nbRevisions=314417562
1380.53	     nbUselessRevisions=260888212  nbAssignments=50820  nbFailedAssignments=28989  nbBacktracks=19698
1380.53	     nbVisitedNodes=89152  nbRestartNogoods=215
1380.53	       =>  wckTime=1371.911  cpuTime=1370.86  mem=131M128

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node23/watcher-201652-1168072440 -o ROOT/results/node23/solver-201652-1168072440 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201652-1168072440/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.92 1.40 1.15 4/93 19766
/proc/meminfo: memFree=1419064/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=18540 CPUtime=0
/proc/19765/stat : 19765 (runsolver) R 19763 19765 19481 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 155638431 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 238487661863 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/19765/statm: 4635 279 244 17 0 2626 0

[startup+0.103035 s]
/proc/loadavg: 1.92 1.40 1.15 4/93 19766
/proc/meminfo: memFree=1419064/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=914988 CPUtime=0.08
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 2954 0 1 0 7 1 0 0 17 0 8 0 155638431 936947712 2700 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155060593 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/19765/statm: 228747 2700 1414 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.511115 s]
/proc/loadavg: 1.92 1.40 1.15 4/93 19766
/proc/meminfo: memFree=1419064/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915328 CPUtime=0.48
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 6854 0 1 0 45 3 0 0 18 0 8 0 155638431 937295872 6593 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072916835 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/19765/statm: 228832 6593 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 915328

[startup+1.33428 s]
/proc/loadavg: 1.92 1.41 1.15 3/100 19773
/proc/meminfo: memFree=1350656/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1.3
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 21467 0 1 0 120 10 0 0 24 0 8 0 155638431 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073551169 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/19765/statm: 228912 21204 2160 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.08
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 4923 0 0 0 6 2 0 0 16 0 8 0 155638435 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.16
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 409 0 0 0 16 0 0 0 16 0 8 0 155638439 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 21204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915648

[startup+2.98259 s]
/proc/loadavg: 1.92 1.41 1.15 3/100 19773
/proc/meminfo: memFree=1342208/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=2.92
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 21556 0 1 0 281 11 0 0 25 0 8 0 155638431 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073834513 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/19765/statm: 228912 21291 2181 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.11
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 4923 0 0 0 9 2 0 0 17 0 8 0 155638435 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.19
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 434 0 0 0 19 0 0 0 16 0 8 0 155638439 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 21291 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.92
Current children cumulated vsize (KiB) 915648

[startup+6.27323 s]
/proc/loadavg: 1.93 1.42 1.15 3/100 19773
/proc/meminfo: memFree=1329088/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=6.19
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 25582 0 1 0 604 15 0 0 25 0 8 0 155638431 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155890573 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/19765/statm: 228912 25313 2183 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.29
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 8931 0 0 0 25 4 0 0 16 0 8 0 155638435 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.21
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 447 0 0 0 21 0 0 0 15 0 8 0 155638439 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 25313 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 915648

[startup+12.7635 s]
/proc/loadavg: 1.93 1.43 1.16 3/100 19773
/proc/meminfo: memFree=1304192/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=12.62
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 31371 0 1 0 1244 18 0 0 25 0 8 0 155638431 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073837072 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/19765/statm: 228912 31095 2534 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.68
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 14242 0 0 0 61 7 0 0 17 0 8 0 155638435 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155638436 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.33
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 508 0 0 0 32 1 0 0 16 0 8 0 155638439 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 31095 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 915648

[startup+25.612 s]
/proc/loadavg: 1.94 1.44 1.17 3/100 19773
/proc/meminfo: memFree=1304256/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=25.35
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 31390 0 1 0 2516 19 0 0 25 0 8 0 155638431 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074143279 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/19765/statm: 228912 31109 2535 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.68
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 14242 0 0 0 61 7 0 0 17 0 8 0 155638435 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155638436 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.35
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 520 0 0 0 34 1 0 0 15 0 8 0 155638439 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 31109 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.35
Current children cumulated vsize (KiB) 915648

[startup+51.2299 s]
/proc/loadavg: 1.82 1.46 1.18 2/88 19840
/proc/meminfo: memFree=1424536/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=50.84
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 38537 0 1 0 5062 22 0 0 25 0 8 0 155638431 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074230257 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 38247 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.77
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 21364 0 0 0 68 9 0 0 17 0 8 0 155638435 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.38
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 536 0 0 0 37 1 0 0 16 0 8 0 155638439 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 38247 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.84
Current children cumulated vsize (KiB) 915648

[startup+102.44 s]
/proc/loadavg: 1.35 1.39 1.17 2/85 19955
/proc/meminfo: memFree=1406792/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=101.99
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44184 0 1 0 10172 27 0 0 25 0 8 0 155638431 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832743 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43883 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.4
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 548 0 0 0 39 1 0 0 16 0 8 0 155638439 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43883 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.99
Current children cumulated vsize (KiB) 915648

[startup+162.46 s]
/proc/loadavg: 1.13 1.32 1.16 2/85 19955
/proc/meminfo: memFree=1406792/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=161.99
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44186 0 1 0 16172 27 0 0 25 0 8 0 155638431 937623552 43885 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835360 0 4 0 23759 18446744073709551615 0 0 17 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1421.99
Current children cumulated vsize (KiB) 915648

[startup+1482.94 s]
/proc/loadavg: 1.00 1.00 1.01 2/85 19955
/proc/meminfo: memFree=1406472/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1481.98
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44188 0 1 0 148168 30 0 0 25 0 8 0 155638431 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074145138 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43886 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.4
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 551 0 0 0 39 1 0 0 16 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1481.98
Current children cumulated vsize (KiB) 915648

[startup+1542.96 s]
/proc/loadavg: 1.03 1.01 1.01 2/85 19955
/proc/meminfo: memFree=1406472/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1541.98
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44188 0 1 0 154168 30 0 0 25 0 8 0 155638431 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073836930 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43886 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.4
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 551 0 0 0 39 1 0 0 16 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1541.98
Current children cumulated vsize (KiB) 915648

[startup+1602.98 s]
/proc/loadavg: 1.01 1.01 1.01 2/85 19955
/proc/meminfo: memFree=1406408/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1601.98
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44188 0 1 0 160168 30 0 0 25 0 8 0 155638431 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074175597 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43886 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.4
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 551 0 0 0 39 1 0 0 16 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1601.98
Current children cumulated vsize (KiB) 915648

[startup+1663.02 s]
/proc/loadavg: 1.00 1.00 1.00 2/91 20093
/proc/meminfo: memFree=1405272/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1661.98
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44188 0 1 0 166159 39 0 0 25 0 8 0 155638431 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835360 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43886 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.41
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 551 0 0 0 40 1 0 0 16 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1661.98
Current children cumulated vsize (KiB) 915648

[startup+1723.06 s]
/proc/loadavg: 1.00 1.00 1.00 2/85 20153
/proc/meminfo: memFree=1406024/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1722.01
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44188 0 1 0 172153 48 0 0 25 0 8 0 155638431 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074138581 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43886 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.41
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 551 0 0 0 40 1 0 0 16 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 915648

[startup+1783.09 s]
/proc/loadavg: 1.00 1.00 1.00 2/85 20153
/proc/meminfo: memFree=1406088/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1782.01
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44188 0 1 0 178153 48 0 0 25 0 8 0 155638431 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074162064 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43886 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.41
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 551 0 0 0 40 1 0 0 16 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 915648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.08 s]
/proc/loadavg: 1.00 1.00 1.00 2/85 20153
/proc/meminfo: memFree=1406088/2055920 swapFree=4192812/4192956
[pid=19765] ppid=19763 vsize=915648 CPUtime=1800
/proc/19765/stat : 19765 (java) R 19763 19765 19481 0 -1 0 44188 0 1 0 179952 48 0 0 25 0 8 0 155638431 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831644 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/19765/statm: 228912 43886 2539 14 0 215382 0
[pid=19765/tid=19767] ppid=19763 vsize=915648 CPUtime=0.82
/proc/19765/task/19767/stat : 19767 (java) S 19763 19765 19481 0 -1 64 26992 0 0 0 70 12 0 0 16 0 8 0 155638435 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19768] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19768/stat : 19768 (java) S 19763 19765 19481 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19769] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19769/stat : 19769 (java) S 19763 19765 19481 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155638436 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19770] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19770/stat : 19770 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19771] ppid=19763 vsize=915648 CPUtime=0.41
/proc/19765/task/19771/stat : 19771 (java) S 19763 19765 19481 0 -1 64 551 0 0 0 40 1 0 0 16 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=19765/tid=19772] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19772/stat : 19772 (java) S 19763 19765 19481 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=19765/tid=19773] ppid=19763 vsize=915648 CPUtime=0
/proc/19765/task/19773/stat : 19773 (java) S 19763 19765 19481 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155638439 937623552 43886 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 915648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1801.15
CPU time (s): 1800.08
CPU user time (s): 1799.57
CPU system time (s): 0.510922
CPU usage (%): 99.9402
Max. virtual memory (cumulated for all children) (KiB): 915648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.57
system time used= 0.510922
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 44204
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38290
involuntary context switches= 11478

runsolver used 1.81872 s user time and 4.71928 s system time

The end

Launcher Data (download as text)

Begin job on node23 on Sat Jan  6 08:34:01 UTC 2007


IDJOB= 201652
IDBENCH= 3776
FILE ID= node23/201652-1168072440

PBS_JOBID= 3475977

Free space on /tmp= 66543 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp13/fapp13-2000-3.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201652-1168072440/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node23/watcher-201652-1168072440 -o ROOT/results/node23/solver-201652-1168072440 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201652-1168072440/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  7f084eb3a66440e5445613ae031b39b2

RANDOM SEED= 273593734

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1419480 kB
Buffers:         42548 kB
Cached:         310780 kB
SwapCached:          0 kB
Active:         267752 kB
Inactive:       291272 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1419480 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            5300 kB
Writeback:           0 kB
Mapped:         234748 kB
Slab:            61916 kB
Committed_AS:  3735208 kB
PageTables:       2608 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66546 MiB



End job on node23 on Sat Jan  6 09:04:02 UTC 2007