Trace number 201549

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.16 1802.29

General information on the benchmark

Namefapp/fapp11-15/fapp13/
fapp13-2000-5.xml
MD5SUMffb4cc3cc68459b6d1c6c34b1a6e5ea5
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of constraints25652
Maximum constraint arity2
Maximum domain size190
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25652
Global constraints used (with number of constraints)

Solver Data (download as text)

0.29	   
0.29	Abscon 109 (November, 2006)
0.29	   
0.29	   configuration
0.29	     name=mac.xml
0.32	   
0.32	   instance
0.32	     name=/tmp/evaluation/201549-1168072388/unknown.xml
0.35	   
0.35	   domains being loaded...
0.38	   
0.38	   variables being loaded...
0.59	     nbVariables=2000  nbDomainTypes=49  minDomainSize=42  maxDomainSize=190
0.59	       =>  wckTime=0.301  cpuTime=0.21  mem=20M547
0.59	   
0.59	   predicates being loaded...
0.60	   
0.60	   constraints being loaded...
4.52	   
4.52	   INFO : Stopping converting binary constraints (cpu=4.01, mem = 46M735)
7.64	     nbConstraints=13669  nbMergedConstraints=11983  nbConvertedConstraints=226  nbConvertConstraintsChecks=5117050
7.64	     nbExtensionStructures=210  nbSharedExtensionStructures=16  nbConflictsStructures=210
7.64	     nbSharedConflictsStructures=16  nbSharedBinaryRepresentations=38622  nbEvaluationManagers=9760
7.64	     nbSharedEvaluationManagers=3683  maxDegree=17  maxArity=2
7.64	       =>  wckTime=7.348  cpuTime=6.68  mem=62M697
7.83	   
7.83	   solver IterativeSystematicSolver being built... 
8.25	       =>  wckTime=7.956  cpuTime=7.01  mem=93M973
23.65	   
23.65	   preprocessing
23.65	     nbConstraintChecks=28817963  nbValidityChecks=1443167  nbPropagations=2660  nbRevisions=41743
23.66	     nbUselessRevisions=37225  nbRemovedValues=143527  detectedInconsistency=no
23.66	       =>  wckTime=15.391  cpuTime=15.36  mem=93M973
30.28	   
30.28	   search
30.28	     run=0  nbConstraintChecks=9889866  nbValidityChecks=9019234  nbPropagations=14307  nbRevisions=191317
30.28	     nbUselessRevisions=171886  nbAssignments=173  nbFailedAssignments=12  nbBacktracks=10  nbVisitedNodes=193
30.28	     nbRestartNogoods=0  mapSize=8  nbInferences=0  nbTooLargeKeys=0
30.28	       =>  wckTime=22.016  cpuTime=21.9  mem=72M782
32.71	   
32.71	   search
32.71	     run=1  nbConstraintChecks=12922426  nbValidityChecks=17486267  nbPropagations=39414  nbRevisions=519394
32.71	     nbUselessRevisions=467782  nbAssignments=336  nbFailedAssignments=16  nbBacktracks=29  nbVisitedNodes=367
32.71	     nbRestartNogoods=10  mapSize=18  nbInferences=0  nbTooLargeKeys=0
32.71	       =>  wckTime=24.452  cpuTime=24.33  mem=79M374
35.34	   
35.34	   search
35.34	     run=2  nbConstraintChecks=16132649  nbValidityChecks=26521769  nbPropagations=76333  nbRevisions=998914
35.34	     nbUselessRevisions=899988  nbAssignments=516  nbFailedAssignments=28  nbBacktracks=58  nbVisitedNodes=572
35.34	     nbRestartNogoods=11  mapSize=38  nbInferences=0  nbTooLargeKeys=0
35.34	       =>  wckTime=27.081  cpuTime=26.95  mem=86M328
38.31	   
38.31	   search
38.31	     run=3  nbConstraintChecks=19685523  nbValidityChecks=36716753  nbPropagations=127150  nbRevisions=1657581
38.31	     nbUselessRevisions=1492752  nbAssignments=718  nbFailedAssignments=47  nbBacktracks=94  nbVisitedNodes=811
38.31	     nbRestartNogoods=12  mapSize=64  nbInferences=0  nbTooLargeKeys=0
38.31	       =>  wckTime=30.049  cpuTime=29.91  mem=94M689
43.43	   
43.43	   search
43.43	     run=4  nbConstraintChecks=26272567  nbValidityChecks=47722333  nbPropagations=194384  nbRevisions=2532851
43.43	     nbUselessRevisions=2273284  nbAssignments=975  nbFailedAssignments=78  nbBacktracks=146  nbVisitedNodes=1121
43.43	     nbRestartNogoods=19  mapSize=105  nbInferences=0  nbTooLargeKeys=0
43.43	       =>  wckTime=35.169  cpuTime=35.03  mem=103M534
49.26	   
49.26	   search
49.26	     run=5  nbConstraintChecks=33598900  nbValidityChecks=61451245  nbPropagations=283133  nbRevisions=3701835
49.26	     nbUselessRevisions=3309100  nbAssignments=1262  nbFailedAssignments=104  nbBacktracks=221  nbVisitedNodes=1460
49.26	     nbRestartNogoods=28  mapSize=141  nbInferences=0  nbTooLargeKeys=0
49.26	       =>  wckTime=41.0  cpuTime=40.85  mem=114M424
55.58	   
55.58	   search
55.58	     run=6  nbConstraintChecks=41394092  nbValidityChecks=75121135  nbPropagations=390546  nbRevisions=5132525
55.58	     nbUselessRevisions=4561605  nbAssignments=1643  nbFailedAssignments=304  nbBacktracks=335  nbVisitedNodes=2085
55.58	     nbRestartNogoods=38  mapSize=234  nbInferences=0  nbTooLargeKeys=0
55.58	       =>  wckTime=47.316  cpuTime=47.09  mem=87M10
70.72	   
70.72	   search
70.72	     run=7  nbConstraintChecks=58938201  nbValidityChecks=108735099  nbPropagations=555112  nbRevisions=7355071
70.72	     nbUselessRevisions=6425156  nbAssignments=2255  nbFailedAssignments=572  nbBacktracks=505  nbVisitedNodes=3048
70.72	     nbRestartNogoods=40  mapSize=395  nbInferences=0  nbTooLargeKeys=0
70.72	       =>  wckTime=62.462  cpuTime=62.23  mem=101M284
82.85	   
82.85	   search
82.85	     run=8  nbConstraintChecks=73166640  nbValidityChecks=134256108  nbPropagations=767300  nbRevisions=10232920
82.85	     nbUselessRevisions=8829636  nbAssignments=2830  nbFailedAssignments=704  nbBacktracks=770  nbVisitedNodes=3861
82.85	     nbRestartNogoods=44  mapSize=556  nbInferences=0  nbTooLargeKeys=0
82.85	       =>  wckTime=74.592  cpuTime=74.34  mem=119M735
111.46	   
111.46	   search
111.46	     run=9  nbConstraintChecks=110019360  nbValidityChecks=200524387  nbPropagations=1067498  nbRevisions=14303971
111.46	     nbUselessRevisions=12214181  nbAssignments=4254  nbFailedAssignments=1572  nbBacktracks=1154  nbVisitedNodes=6341
111.46	     nbRestartNogoods=52  mapSize=860  nbInferences=0  nbTooLargeKeys=0
111.46	       =>  wckTime=103.197  cpuTime=102.86  mem=118M435
138.25	   
138.25	   INFO : Stopping hyperNogood (mapSize=1002, nbTooLargekeys=0, mem=132M427)
156.45	   
156.45	   search
156.45	     run=10  nbConstraintChecks=164731464  nbValidityChecks=301436631  nbPropagations=1530585  nbRevisions=20768474
156.45	     nbUselessRevisions=17525606  nbAssignments=5743  nbFailedAssignments=2347  nbBacktracks=1736  nbVisitedNodes=8824
156.45	     nbRestartNogoods=83
156.45	       =>  wckTime=148.193  cpuTime=147.81  mem=132M427
170.46	   
170.46	   search
170.46	     run=11  nbConstraintChecks=180525719  nbValidityChecks=334632098  nbPropagations=2060777  nbRevisions=28165544
170.46	     nbUselessRevisions=23614225  nbAssignments=7109  nbFailedAssignments=2759  nbBacktracks=2614  nbVisitedNodes=10821
170.46	     nbRestartNogoods=113
170.46	       =>  wckTime=162.203  cpuTime=161.81  mem=132M899
201.51	   
201.51	   search
201.51	     run=12  nbConstraintChecks=211194552  nbValidityChecks=412932025  nbPropagations=2758276  nbRevisions=38040729
201.51	     nbUselessRevisions=31736833  nbAssignments=9005  nbFailedAssignments=3242  nbBacktracks=3913  nbVisitedNodes=13464
201.51	     nbRestartNogoods=117
201.51	       =>  wckTime=193.246  cpuTime=192.81  mem=132M899
314.76	   
314.76	   search
314.76	     run=13  nbConstraintChecks=319681413  nbValidityChecks=715082048  nbPropagations=4131688  nbRevisions=57880023
314.76	     nbUselessRevisions=47986129  nbAssignments=13378  nbFailedAssignments=5559  nbBacktracks=5863  nbVisitedNodes=20938
314.76	     nbRestartNogoods=133
314.76	       =>  wckTime=306.501  cpuTime=305.96  mem=132M899
588.04	   
588.04	   search
588.04	     run=14  nbConstraintChecks=642389240  nbValidityChecks=1379691934  nbPropagations=6690751  nbRevisions=94466653
588.04	     nbUselessRevisions=77944563  nbAssignments=24437  nbFailedAssignments=13599  nbBacktracks=8784
588.04	     nbVisitedNodes=41210  nbRestartNogoods=141
588.04	       =>  wckTime=579.779  cpuTime=578.74  mem=132M899
910.96	   
910.96	   search
910.96	     run=15  nbConstraintChecks=970480678  nbValidityChecks=2148134905  nbPropagations=11015660  nbRevisions=156298189
910.96	     nbUselessRevisions=128608534  nbAssignments=36894  nbFailedAssignments=21498  nbBacktracks=13162
910.96	     nbVisitedNodes=63524  nbRestartNogoods=172
910.96	       =>  wckTime=902.703  cpuTime=901.32  mem=132M899
1304.20	   
1304.20	   search
1304.20	     run=16  nbConstraintChecks=1359037845  nbValidityChecks=3118879512  nbPropagations=17511119  nbRevisions=248980516
1304.20	     nbUselessRevisions=203950753  nbAssignments=57324  nbFailedAssignments=35239  nbBacktracks=19739
1304.20	     nbVisitedNodes=100895  nbRestartNogoods=216
1304.20	       =>  wckTime=1295.945  cpuTime=1294.19  mem=132M899

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node72/watcher-201549-1168072388 -o ROOT/results/node72/solver-201549-1168072388 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201549-1168072388/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.86 1.32 1.11 4/93 32070
/proc/meminfo: memFree=1318632/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=172 CPUtime=0
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 217 0 0 0 0 0 0 0 18 0 1 0 155647823 176128 24 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 2536228 0 0 4096 0 0 0 0 17 0 0 0
/proc/32069/statm: 43 24 18 14 0 3 0

[startup+0.108055 s]
/proc/loadavg: 1.86 1.32 1.11 4/93 32070
/proc/meminfo: memFree=1318632/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=914988 CPUtime=0.08
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 3078 0 1 0 7 1 0 0 24 0 8 0 155647823 936947712 2824 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072944238 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228747 2824 1455 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.516096 s]
/proc/loadavg: 1.86 1.32 1.11 4/93 32070
/proc/meminfo: memFree=1318632/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915328 CPUtime=0.5
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 7625 0 1 0 45 5 0 0 25 0 8 0 155647823 937295872 7365 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073657531 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228832 7366 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 915328

[startup+1.33717 s]
/proc/loadavg: 1.87 1.33 1.12 3/100 32077
/proc/meminfo: memFree=1250288/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1.31
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 21468 0 1 0 119 12 0 0 25 0 8 0 155647823 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073757263 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 21205 2160 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.07
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 4923 0 0 0 6 1 0 0 16 0 8 0 155647827 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.15
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 410 0 0 0 15 0 0 0 16 0 8 0 155647830 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 915648

[startup+2.97432 s]
/proc/loadavg: 1.87 1.33 1.12 3/100 32077
/proc/meminfo: memFree=1241904/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=2.95
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 21557 0 1 0 282 13 0 0 25 0 8 0 155647823 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073842430 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 21292 2181 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.1
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 4923 0 0 0 9 1 0 0 17 0 8 0 155647827 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.18
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 435 0 0 0 18 0 0 0 15 0 8 0 155647830 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 21292 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 915648

[startup+6.17461 s]
/proc/loadavg: 1.88 1.34 1.12 3/100 32077
/proc/meminfo: memFree=1228656/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=6.15
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 25661 0 1 0 599 16 0 0 25 0 8 0 155647823 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4154170980 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 25392 2181 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.28
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 9011 0 0 0 25 3 0 0 16 0 8 0 155647827 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.21
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 447 0 0 0 20 1 0 0 15 0 8 0 155647830 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 25392 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 915648

[startup+12.6492 s]
/proc/loadavg: 1.89 1.35 1.12 3/100 32077
/proc/meminfo: memFree=1203696/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=12.6
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 31459 0 1 0 1239 21 0 0 25 0 8 0 155647823 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074152878 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 31183 2533 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.65
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 14331 0 0 0 59 6 0 0 16 0 8 0 155647827 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155647827 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.32
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 508 0 0 0 30 2 0 0 16 0 8 0 155647830 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 31183 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 915648

[startup+25.5314 s]
/proc/loadavg: 1.91 1.37 1.13 3/100 32077
/proc/meminfo: memFree=1203760/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=25.48
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 31474 0 1 0 2527 21 0 0 25 0 8 0 155647823 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074138535 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 31195 2534 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.65
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 14331 0 0 0 59 6 0 0 16 0 8 0 155647827 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155647827 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.34
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 519 0 0 0 32 2 0 0 15 0 8 0 155647830 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 31195 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 915648

[startup+51.1627 s]
/proc/loadavg: 1.94 1.43 1.16 3/100 32077
/proc/meminfo: memFree=1184816/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=51.09
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 36239 0 1 0 5086 23 0 0 25 0 8 0 155647823 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831743 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 35954 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.71
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 19073 0 0 0 64 7 0 0 16 0 8 0 155647827 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.36
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 531 0 0 0 34 2 0 0 16 0 8 0 155647830 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 35954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 915648

[startup+102.418 s]
/proc/loadavg: 2.09 1.56 1.22 3/100 32077
/proc/meminfo: memFree=1147696/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=102.28
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45540 0 1 0 10200 28 0 0 25 0 8 0 155647823 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074140462 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45246 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 543 0 0 0 37 2 0 0 15 0 8 0 155647830 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45246 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 915648

[startup+162.422 s]
/proc/loadavg: 2.03 1.64 1.26 3/100 32077
/proc/meminfo: memFree=1147632/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=162.22
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45544 0 1 0 16194 28 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832796 0 4 0 23759 18446744073709551615 0 0 17 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1421.04
Current children cumulated vsize (KiB) 915648

[startup+1482.75 s]
/proc/loadavg: 2.00 1.99 1.79 3/100 32245
/proc/meminfo: memFree=1164600/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1481
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45545 0 1 0 148067 33 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831568 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45249 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 547 0 0 0 37 2 0 0 16 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1481
Current children cumulated vsize (KiB) 915648

[startup+1542.76 s]
/proc/loadavg: 2.00 1.99 1.81 3/100 32245
/proc/meminfo: memFree=1164600/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1540.95
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45545 0 1 0 154061 34 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074144691 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45249 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 547 0 0 0 37 2 0 0 16 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1540.95
Current children cumulated vsize (KiB) 915648

[startup+1602.78 s]
/proc/loadavg: 2.00 1.99 1.82 3/100 32245
/proc/meminfo: memFree=1164600/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1600.9
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45545 0 1 0 160056 34 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074133518 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45249 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 547 0 0 0 37 2 0 0 16 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1600.9
Current children cumulated vsize (KiB) 915648

[startup+1662.79 s]
/proc/loadavg: 2.00 1.99 1.82 3/100 32245
/proc/meminfo: memFree=1164600/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1660.87
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45545 0 1 0 166053 34 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835239 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45249 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 547 0 0 0 37 2 0 0 16 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1660.87
Current children cumulated vsize (KiB) 915648

[startup+1722.83 s]
/proc/loadavg: 2.00 1.99 1.83 3/106 32391
/proc/meminfo: memFree=1163192/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1720.76
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45545 0 1 0 172032 44 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074133508 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45249 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 547 0 0 0 37 2 0 0 16 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1720.76
Current children cumulated vsize (KiB) 915648

[startup+1782.86 s]
/proc/loadavg: 2.07 2.00 1.84 3/100 32447
/proc/meminfo: memFree=1164208/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1780.73
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45545 0 1 0 178022 51 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831606 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45249 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 547 0 0 0 37 2 0 0 16 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1780.73
Current children cumulated vsize (KiB) 915648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1802.22 s]
/proc/loadavg: 2.05 2.00 1.84 3/100 32447
/proc/meminfo: memFree=1164208/2055920 swapFree=4192812/4192956
[pid=32069] ppid=32067 vsize=915648 CPUtime=1800.08
/proc/32069/stat : 32069 (java) R 32067 32069 31841 0 -1 0 45545 0 1 0 179957 51 0 0 25 0 8 0 155647823 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074171347 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/32069/statm: 228912 45249 2538 14 0 215382 0
[pid=32069/tid=32071] ppid=32067 vsize=915648 CPUtime=0.79
/proc/32069/task/32071/stat : 32071 (java) S 32067 32069 31841 0 -1 64 28356 0 0 0 68 11 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32072] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32072/stat : 32072 (java) S 32067 32069 31841 0 -1 64 11 0 0 0 0 0 0 0 17 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32073] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32073/stat : 32073 (java) S 32067 32069 31841 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155647827 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32074] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32074/stat : 32074 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32075] ppid=32067 vsize=915648 CPUtime=0.39
/proc/32069/task/32075/stat : 32075 (java) S 32067 32069 31841 0 -1 64 547 0 0 0 37 2 0 0 16 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32076] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32076/stat : 32076 (java) S 32067 32069 31841 0 -1 64 0 0 0 0 0 0 0 0 23 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=32069/tid=32077] ppid=32067 vsize=915648 CPUtime=0
/proc/32069/task/32077/stat : 32077 (java) S 32067 32069 31841 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155647830 937623552 45249 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 915648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1802.29
CPU time (s): 1800.16
CPU user time (s): 1799.62
CPU system time (s): 0.538918
CPU usage (%): 99.8816
Max. virtual memory (cumulated for all children) (KiB): 915648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.62
system time used= 0.538918
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 45561
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38374
involuntary context switches= 65316

runsolver used 2.49462 s user time and 5.49316 s system time

The end

Launcher Data (download as text)

Begin job on node72 on Sat Jan  6 08:33:10 UTC 2007


IDJOB= 201549
IDBENCH= 3770
FILE ID= node72/201549-1168072388

PBS_JOBID= 3475973

Free space on /tmp= 66543 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp13/fapp13-2000-5.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201549-1168072388/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node72/watcher-201549-1168072388 -o ROOT/results/node72/solver-201549-1168072388 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201549-1168072388/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  ffb4cc3cc68459b6d1c6c34b1a6e5ea5

RANDOM SEED= 13403527

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.223
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.223
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1319048 kB
Buffers:         40164 kB
Cached:         436244 kB
SwapCached:          0 kB
Active:         277972 kB
Inactive:       385852 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1319048 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            5344 kB
Writeback:           0 kB
Mapped:         216396 kB
Slab:            57340 kB
Committed_AS:  3374040 kB
PageTables:       2588 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66541 MiB



End job on node72 on Sat Jan  6 09:03:13 UTC 2007