Trace number 200909

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.2 1802.93

General information on the benchmark

Namefapp/fapp11-15/fapp14/
fapp14-2500-5.xml
MD5SUMba29a6849ceab0326ca9029d495b4371
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2500
Number of constraints40767
Maximum constraint arity2
Maximum domain size362
Number of constraints which are defined in extension0
Number of constraints which are defined in intension40767
Global constraints used (with number of constraints)

Solver Data (download as text)

0.32	   
0.32	Abscon 109 (November, 2006)
0.32	   
0.32	   configuration
0.32	     name=esac.xml
0.45	   
0.45	   instance
0.45	     name=/tmp/evaluation/200909-1168144267/unknown.xml
0.48	   
0.48	   domains being loaded...
0.51	   
0.51	   variables being loaded...
0.79	     nbVariables=2500  nbDomainTypes=30  minDomainSize=42  maxDomainSize=362
0.79	       =>  wckTime=0.467  cpuTime=0.27  mem=35M193
0.79	   
0.79	   predicates being loaded...
0.79	   
0.79	   constraints being loaded...
202.79	   
202.79	   INFO : Stopping converting binary constraints (cpu=200.04, mem = 111M769)
207.15	     nbConstraints=21610  nbMergedConstraints=19157  nbConvertedConstraints=3979  nbConvertConstraintsChecks=353601824
207.15	     nbExtensionStructures=3457  nbSharedExtensionStructures=522  nbConflictsStructures=3457
207.15	     nbSharedConflictsStructures=522  nbSharedBinaryRepresentations=1713091  nbEvaluationManagers=13364
207.15	     nbSharedEvaluationManagers=4267  maxDegree=27  maxArity=2
207.15	       =>  wckTime=206.824  cpuTime=203.74  mem=139M153
207.70	   
207.70	   solver IterativeSystematicSolver being built... 
208.37	       =>  wckTime=208.048  cpuTime=204.2  mem=223M897
306.83	   
306.83	   INFO : Stopping ESAC
306.84	   
306.84	   preprocessing
306.84	     nbConstraintChecks=175869513  nbValidityChecks=55062185  nbPropagations=38156  nbRevisions=580769
306.84	     nbUselessRevisions=533308  nbSingletonTests=576  nbEffectiveSingletonTests=12  nbESACBranches=11
306.84	     nbRemovedValues=427562  detectedInconsistency=no
306.84	       =>  wckTime=98.435  cpuTime=98.3  mem=223M897
313.35	   
313.35	   search
313.35	     run=0  nbConstraintChecks=11265075  nbValidityChecks=10491096  nbPropagations=45495  nbRevisions=692455
313.35	     nbUselessRevisions=635713  nbAssignments=171  nbFailedAssignments=17  nbBacktracks=15  nbVisitedNodes=194
313.35	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=154
313.35	       =>  wckTime=104.961  cpuTime=104.78  mem=225M926
323.35	   
323.35	   search
323.35	     run=1  nbConstraintChecks=32052617  nbValidityChecks=38127652  nbPropagations=109371  nbRevisions=1673546
323.35	     nbUselessRevisions=1536878  nbAssignments=491  nbFailedAssignments=33  nbBacktracks=32  nbVisitedNodes=391
323.35	     nbRestartNogoods=8  mapSize=0  nbInferences=0  nbTooLargeKeys=313
323.35	       =>  wckTime=114.961  cpuTime=114.77  mem=225M926
326.68	   
326.68	   search
326.68	     run=2  nbConstraintChecks=38481061  nbValidityChecks=49621198  nbPropagations=181623  nbRevisions=2779894
326.68	     nbUselessRevisions=2552656  nbAssignments=691  nbFailedAssignments=60  nbBacktracks=56  nbVisitedNodes=626
326.68	     nbRestartNogoods=9  mapSize=0  nbInferences=0  nbTooLargeKeys=486
326.68	       =>  wckTime=118.285  cpuTime=118.1  mem=225M926
337.94	   
337.94	   search
337.94	     run=3  nbConstraintChecks=62164230  nbValidityChecks=81795375  nbPropagations=274497  nbRevisions=4205364
337.94	     nbUselessRevisions=3863148  nbAssignments=1143  nbFailedAssignments=86  nbBacktracks=90  nbVisitedNodes=869
337.94	     nbRestartNogoods=14  mapSize=0  nbInferences=0  nbTooLargeKeys=665
337.94	       =>  wckTime=129.548  cpuTime=129.35  mem=225M926
344.92	   
344.92	   search
344.92	     run=4  nbConstraintChecks=76374205  nbValidityChecks=101989740  nbPropagations=380374  nbRevisions=5828697
344.92	     nbUselessRevisions=5356524  nbAssignments=1481  nbFailedAssignments=102  nbBacktracks=141  nbVisitedNodes=1113
344.92	     nbRestartNogoods=23  mapSize=0  nbInferences=0  nbTooLargeKeys=861
344.92	       =>  wckTime=136.528  cpuTime=136.32  mem=225M926
351.35	   
351.35	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1110, mem=225M926)
353.21	   
353.21	   search
353.21	     run=5  nbConstraintChecks=92904145  nbValidityChecks=124142278  nbPropagations=502950  nbRevisions=7750613
353.21	     nbUselessRevisions=7115336  nbAssignments=1856  nbFailedAssignments=206  nbBacktracks=216  nbVisitedNodes=1620
353.21	     nbRestartNogoods=28
353.21	       =>  wckTime=144.813  cpuTime=144.59  mem=225M926
384.89	   
384.90	   search
384.90	     run=6  nbConstraintChecks=164332386  nbValidityChecks=189451918  nbPropagations=678022  nbRevisions=10720848
384.90	     nbUselessRevisions=9764600  nbAssignments=2544  nbFailedAssignments=603  nbBacktracks=329  nbVisitedNodes=2779
384.90	     nbRestartNogoods=40
384.90	       =>  wckTime=176.502  cpuTime=176.24  mem=225M926
448.04	   
448.04	   search
448.04	     run=7  nbConstraintChecks=297985283  nbValidityChecks=305057438  nbPropagations=939469  nbRevisions=15427418
448.04	     nbUselessRevisions=13904236  nbAssignments=3822  nbFailedAssignments=1533  nbBacktracks=499  nbVisitedNodes=4964
448.04	     nbRestartNogoods=58
448.04	       =>  wckTime=239.65  cpuTime=239.28  mem=225M926
477.06	   
477.07	   search
477.07	     run=8  nbConstraintChecks=353846969  nbValidityChecks=360422866  nbPropagations=1257839  nbRevisions=21094505
477.07	     nbUselessRevisions=18895016  nbAssignments=5057  nbFailedAssignments=2047  nbBacktracks=755  nbVisitedNodes=6785
477.07	     nbRestartNogoods=83
477.07	       =>  wckTime=268.672  cpuTime=268.29  mem=225M926
614.36	   
614.36	   search
614.36	     run=9  nbConstraintChecks=646511852  nbValidityChecks=744765059  nbPropagations=1881439  nbRevisions=31499381
614.36	     nbUselessRevisions=28195321  nbAssignments=11289  nbFailedAssignments=2732  nbBacktracks=1144  nbVisitedNodes=9142
614.36	     nbRestartNogoods=115
614.36	       =>  wckTime=405.971  cpuTime=405.45  mem=225M926
831.36	   
831.36	   search
831.36	     run=10  nbConstraintChecks=1108952861  nbValidityChecks=1379628671  nbPropagations=3067540  nbRevisions=50371698
831.36	     nbUselessRevisions=45123609  nbAssignments=21204  nbFailedAssignments=3303  nbBacktracks=1727  nbVisitedNodes=11535
831.36	     nbRestartNogoods=145
831.36	       =>  wckTime=622.967  cpuTime=622.21  mem=226M679
1032.14	   
1032.14	   search
1032.14	     run=11  nbConstraintChecks=1563458244  nbValidityChecks=1982374761  nbPropagations=4751195  nbRevisions=77436001
1032.14	     nbUselessRevisions=69487514  nbAssignments=29758  nbFailedAssignments=4835  nbBacktracks=2591  nbVisitedNodes=16104
1032.14	     nbRestartNogoods=184
1032.14	       =>  wckTime=823.751  cpuTime=822.76  mem=226M679
1222.78	   
1222.78	   search
1222.78	     run=12  nbConstraintChecks=1980300505  nbValidityChecks=2408311687  nbPropagations=6823062  nbRevisions=111754195
1222.78	     nbUselessRevisions=100214359  nbAssignments=34591  nbFailedAssignments=8067  nbBacktracks=3888
1222.78	     nbVisitedNodes=24924  nbRestartNogoods=220
1222.78	       =>  wckTime=1014.383  cpuTime=1013.19  mem=226M679
1316.62	   
1316.62	   search
1316.62	     run=13  nbConstraintChecks=2174162535  nbValidityChecks=2635688669  nbPropagations=9160007  nbRevisions=150244294
1316.62	     nbUselessRevisions=134544954  nbAssignments=39841  nbFailedAssignments=10939  nbBacktracks=5835
1316.62	     nbVisitedNodes=33748  nbRestartNogoods=253
1316.62	       =>  wckTime=1108.226  cpuTime=1106.95  mem=226M679

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node43/watcher-200909-1168144267 -o ROOT/results/node43/solver-200909-1168144267 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200909-1168144267/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.09 1.02 1.16 2/68 2165
/proc/meminfo: memFree=1471872/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=1784 CPUtime=0
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 169 0 0 0 0 0 0 0 20 0 1 0 162825929 1826816 140 18446744073709551615 134512640 134570532 4294956624 18446744073709551615 4294960144 0 2147483391 4096 0 0 0 0 17 0 0 0
/proc/2164/statm: 446 140 106 14 0 91 0

[startup+0.103443 s]
/proc/loadavg: 1.09 1.02 1.16 2/68 2165
/proc/meminfo: memFree=1471872/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=913068 CPUtime=0.08
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 2876 0 1 0 7 1 0 0 20 0 8 0 162825929 934981632 2622 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2164/statm: 228267 2622 1396 14 0 215168 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 913068

[startup+0.512509 s]
/proc/loadavg: 1.09 1.02 1.16 2/68 2165
/proc/meminfo: memFree=1471872/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916108 CPUtime=0.39
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 5908 0 1 0 35 4 0 0 18 0 8 0 162825929 938094592 5648 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073573550 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229027 5650 2108 14 0 215497 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 916108

[startup+1.34065 s]
/proc/loadavg: 1.09 1.02 1.16 3/88 2186
/proc/meminfo: memFree=1360608/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=1.21
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 24486 0 1 0 109 12 0 0 23 0 8 0 162825929 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073626261 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229107 24223 2160 14 0 215577 0
[pid=2164/tid=2173] ppid=2161 vsize=916428 CPUtime=0.09
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 7926 0 0 0 7 2 0 0 16 0 8 0 162825934 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916428 CPUtime=0.15
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 407 0 0 0 14 1 0 0 16 0 8 0 162825938 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938422272 24223 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 916428

[startup+2.98192 s]
/proc/loadavg: 1.09 1.02 1.16 4/88 2186
/proc/meminfo: memFree=1328032/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=2.85
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 26207 0 1 0 271 14 0 0 25 0 8 0 162825929 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229107 25941 2180 14 0 215577 0
[pid=2164/tid=2173] ppid=2161 vsize=916428 CPUtime=0.2
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 9571 0 0 0 17 3 0 0 16 0 8 0 162825934 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916428 CPUtime=0.17
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 420 0 0 0 16 1 0 0 16 0 8 0 162825938 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938422272 25941 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.85
Current children cumulated vsize (KiB) 916428

[startup+6.19245 s]
/proc/loadavg: 1.24 1.05 1.17 3/88 2186
/proc/meminfo: memFree=1272360/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=6.04
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 26223 0 1 0 589 15 0 0 25 0 8 0 162825929 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479196 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229107 25956 2181 14 0 215577 0
[pid=2164/tid=2173] ppid=2161 vsize=916428 CPUtime=0.2
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 9571 0 0 0 17 3 0 0 16 0 8 0 162825934 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916428 CPUtime=0.19
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 434 0 0 0 18 1 0 0 15 0 8 0 162825938 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938422272 25956 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 916428

[startup+12.6175 s]
/proc/loadavg: 1.30 1.06 1.18 3/88 2186
/proc/meminfo: memFree=1182504/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=12.43
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 26226 0 1 0 1228 15 0 0 25 0 8 0 162825929 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073479187 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229107 25959 2181 14 0 215577 0
[pid=2164/tid=2173] ppid=2161 vsize=916428 CPUtime=0.2
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 9571 0 0 0 17 3 0 0 16 0 8 0 162825934 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916428 CPUtime=0.19
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 437 0 0 0 18 1 0 0 16 0 8 0 162825938 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938422272 25959 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 916428

[startup+25.4887 s]
/proc/loadavg: 1.45 1.11 1.19 3/88 2186
/proc/meminfo: memFree=1051752/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=25.24
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 28956 0 1 0 2507 17 0 0 25 0 8 0 162825929 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839159 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229107 28686 2181 14 0 215577 0
[pid=2164/tid=2173] ppid=2161 vsize=916428 CPUtime=0.33
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 12297 0 0 0 29 4 0 0 16 0 8 0 162825934 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916428 CPUtime=0.19
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 438 0 0 0 18 1 0 0 15 0 8 0 162825938 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938422272 28686 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 916428

[startup+51.1229 s]
/proc/loadavg: 1.71 1.20 1.22 3/88 2186
/proc/meminfo: memFree=899304/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=50.72
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 28963 0 1 0 5053 19 0 0 25 0 8 0 162825929 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073834610 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229107 28692 2181 14 0 215577 0
[pid=2164/tid=2173] ppid=2161 vsize=916428 CPUtime=0.33
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 12297 0 0 0 29 4 0 0 16 0 8 0 162825934 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916428 CPUtime=0.21
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 444 0 0 0 20 1 0 0 16 0 8 0 162825938 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938422272 28692 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.72
Current children cumulated vsize (KiB) 916428

[startup+102.411 s]
/proc/loadavg: 1.91 1.33 1.26 4/88 2186
/proc/meminfo: memFree=661224/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=101.75
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 36472 0 1 0 10146 29 0 0 25 0 8 0 162825929 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073834737 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229107 36197 2181 14 0 215577 0
[pid=2164/tid=2173] ppid=2161 vsize=916428 CPUtime=0.75
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 19795 0 0 0 67 8 0 0 16 0 8 0 162825934 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162825934 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916428 CPUtime=0.22
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 451 0 0 0 21 1 0 0 16 0 8 0 162825938 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916428 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938422272 36197 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.75
Current children cumulated vsize (KiB) 916428

[startup+162.423 s]
/proc/loadavg: 2.17 1.51 1.32 2/75 2198
/proc/meminfo: memFree=1329488/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916428 CPUtime=161.46
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 39362 0 1 0 16110 36 0 0 25 0 8 0 162825929 938422272 39086 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832096 0 4 0 23759 18446744073709551615 0 0 17 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1421.32
Current children cumulated vsize (KiB) 916588

[startup+1483.76 s]
/proc/loadavg: 2.07 2.02 1.83 3/80 2486
/proc/meminfo: memFree=1155752/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916588 CPUtime=1481.36
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 62370 0 1 0 148073 63 0 0 25 0 8 0 162825929 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074213879 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229147 62019 2547 14 0 215617 0
[pid=2164/tid=2173] ppid=2161 vsize=916588 CPUtime=2.51
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 45061 0 0 0 230 21 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916588 CPUtime=0.43
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 614 0 0 0 41 2 0 0 16 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1481.36
Current children cumulated vsize (KiB) 916588

[startup+1543.85 s]
/proc/loadavg: 2.02 2.01 1.84 3/80 2486
/proc/meminfo: memFree=1155752/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916588 CPUtime=1541.38
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 62370 0 1 0 154075 63 0 0 25 0 8 0 162825929 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074228120 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229147 62019 2547 14 0 215617 0
[pid=2164/tid=2173] ppid=2161 vsize=916588 CPUtime=2.51
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 45061 0 0 0 230 21 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916588 CPUtime=0.43
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 614 0 0 0 41 2 0 0 16 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1541.38
Current children cumulated vsize (KiB) 916588

[startup+1603.94 s]
/proc/loadavg: 2.06 2.02 1.85 3/80 2486
/proc/meminfo: memFree=1155688/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916588 CPUtime=1601.43
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 62370 0 1 0 160080 63 0 0 25 0 8 0 162825929 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832103 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229147 62019 2547 14 0 215617 0
[pid=2164/tid=2173] ppid=2161 vsize=916588 CPUtime=2.51
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 45061 0 0 0 230 21 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916588 CPUtime=0.43
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 614 0 0 0 41 2 0 0 16 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1601.43
Current children cumulated vsize (KiB) 916588

[startup+1664.04 s]
/proc/loadavg: 2.02 2.01 1.85 3/80 2486
/proc/meminfo: memFree=1155752/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916588 CPUtime=1661.46
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 62370 0 1 0 166083 63 0 0 25 0 8 0 162825929 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073830902 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229147 62019 2547 14 0 215617 0
[pid=2164/tid=2173] ppid=2161 vsize=916588 CPUtime=2.51
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 45061 0 0 0 230 21 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916588 CPUtime=0.43
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 614 0 0 0 41 2 0 0 16 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1661.46
Current children cumulated vsize (KiB) 916588

[startup+1724.14 s]
/proc/loadavg: 2.01 2.01 1.86 3/80 2486
/proc/meminfo: memFree=1155688/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916588 CPUtime=1721.49
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 62370 0 1 0 172086 63 0 0 25 0 8 0 162825929 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074240569 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229147 62019 2547 14 0 215617 0
[pid=2164/tid=2173] ppid=2161 vsize=916588 CPUtime=2.51
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 45061 0 0 0 230 21 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916588 CPUtime=0.43
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 614 0 0 0 41 2 0 0 16 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1721.49
Current children cumulated vsize (KiB) 916588

[startup+1784.24 s]
/proc/loadavg: 2.00 2.00 1.86 3/80 2486
/proc/meminfo: memFree=1155688/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916588 CPUtime=1781.55
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 62370 0 1 0 178091 64 0 0 25 0 8 0 162825929 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832807 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229147 62019 2547 14 0 215617 0
[pid=2164/tid=2173] ppid=2161 vsize=916588 CPUtime=2.51
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 45061 0 0 0 230 21 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916588 CPUtime=0.43
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 614 0 0 0 41 2 0 0 16 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1781.55
Current children cumulated vsize (KiB) 916588



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1802.76 s]
/proc/loadavg: 2.00 2.00 1.87 3/86 2552
/proc/meminfo: memFree=1154528/2055920 swapFree=4192812/4192956
[pid=2164] ppid=2161 vsize=916588 CPUtime=1800.03
/proc/2164/stat : 2164 (java) R 2161 2164 2005 0 -1 0 62370 0 1 0 179939 64 0 0 25 0 8 0 162825929 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074240433 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2164/statm: 229147 62019 2547 14 0 215617 0
[pid=2164/tid=2173] ppid=2161 vsize=916588 CPUtime=2.51
/proc/2164/task/2173/stat : 2173 (java) S 2161 2164 2005 0 -1 64 45061 0 0 0 230 21 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2175] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2175/stat : 2175 (java) S 2161 2164 2005 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2176] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2176/stat : 2176 (java) S 2161 2164 2005 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 162825934 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2180] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2180/stat : 2180 (java) S 2161 2164 2005 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2182] ppid=2161 vsize=916588 CPUtime=0.43
/proc/2164/task/2182/stat : 2182 (java) S 2161 2164 2005 0 -1 64 614 0 0 0 41 2 0 0 16 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2164/tid=2184] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2184/stat : 2184 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2164/tid=2186] ppid=2161 vsize=916588 CPUtime=0
/proc/2164/task/2186/stat : 2186 (java) S 2161 2164 2005 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 162825938 938586112 62019 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 916588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1802.93
CPU time (s): 1800.2
CPU user time (s): 1799.48
CPU system time (s): 0.716891
CPU usage (%): 99.8486
Max. virtual memory (cumulated for all children) (KiB): 917104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.48
system time used= 0.716891
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 68017
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38540
involuntary context switches= 27258

runsolver used 2.01669 s user time and 6.03908 s system time

The end

Launcher Data (download as text)

Begin job on node43 on Sun Jan  7 04:31:08 UTC 2007


IDJOB= 200909
IDBENCH= 3734
FILE ID= node43/200909-1168144267

PBS_JOBID= 3478368

Free space on /tmp= 66481 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp14/fapp14-2500-5.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200909-1168144267/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node43/watcher-200909-1168144267 -o ROOT/results/node43/solver-200909-1168144267 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200909-1168144267/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  ba29a6849ceab0326ca9029d495b4371

RANDOM SEED= 135808049

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.278
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.278
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1472344 kB
Buffers:         60612 kB
Cached:         440548 kB
SwapCached:          0 kB
Active:         249504 kB
Inactive:       271752 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1472344 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:           13352 kB
Writeback:           0 kB
Mapped:          30236 kB
Slab:            48044 kB
Committed_AS:  3233816 kB
PageTables:       1628 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66479 MiB



End job on node43 on Sun Jan  7 05:01:11 UTC 2007