Trace number 201278

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.16 1812.87

General information on the benchmark

Namefapp/fapp11-15/fapp12/
fapp12-1500-5.xml
MD5SUMadf10fdc6d350a6af7b358d510ea8438
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of constraints25409
Maximum constraint arity2
Maximum domain size310
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25409
Global constraints used (with number of constraints)

Solver Data (download as text)

0.31	   
0.31	Abscon 109 (November, 2006)
0.31	   
0.31	   configuration
0.31	     name=esac.xml
0.34	   
0.34	   instance
0.34	     name=/tmp/evaluation/201278-1168146688/unknown.xml
0.38	   
0.38	   domains being loaded...
0.41	   
0.41	   variables being loaded...
0.64	     nbVariables=1500  nbDomainTypes=13  minDomainSize=42  maxDomainSize=310
0.64	       =>  wckTime=0.329  cpuTime=0.23  mem=22M513
0.65	   
0.65	   predicates being loaded...
0.65	   
0.65	   constraints being loaded...
203.18	   
203.18	   INFO : Stopping converting binary constraints (cpu=200.02, mem = 84M596)
205.37	     nbConstraints=13439  nbMergedConstraints=11970  nbConvertedConstraints=4841  nbConvertConstraintsChecks=336660330
205.37	     nbExtensionStructures=3912  nbSharedExtensionStructures=929  nbConflictsStructures=3912
205.37	     nbSharedConflictsStructures=929  nbSharedBinaryRepresentations=1910834  nbEvaluationManagers=6542
205.37	     nbSharedEvaluationManagers=2056  maxDegree=22  maxArity=2
205.37	       =>  wckTime=205.056  cpuTime=201.9  mem=96M227
205.71	   
205.71	   solver IterativeSystematicSolver being built... 
206.13	       =>  wckTime=205.816  cpuTime=202.2  mem=143M605
274.41	   
274.41	   INFO : Stopping ESAC
274.41	   
274.41	   preprocessing
274.41	     nbConstraintChecks=135648332  nbValidityChecks=59732608  nbPropagations=46687  nbRevisions=665944
274.41	     nbUselessRevisions=603767  nbSingletonTests=475  nbEffectiveSingletonTests=13  nbESACBranches=29
274.41	     nbRemovedValues=230663  detectedInconsistency=no
274.41	       =>  wckTime=68.26  cpuTime=67.63  mem=143M605
278.01	   
278.01	   search
278.01	     run=0  nbConstraintChecks=7274224  nbValidityChecks=5476605  nbPropagations=51239  nbRevisions=733007
278.01	     nbUselessRevisions=664254  nbAssignments=43  nbFailedAssignments=9  nbBacktracks=12  nbVisitedNodes=60
278.01	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=34
278.01	       =>  wckTime=71.863  cpuTime=71.19  mem=144M621
282.14	   
282.14	   search
282.14	     run=1  nbConstraintChecks=17341455  nbValidityChecks=14516254  nbPropagations=110602  nbRevisions=1585012
282.14	     nbUselessRevisions=1436175  nbAssignments=166  nbFailedAssignments=36  nbBacktracks=28  nbVisitedNodes=219
282.14	     nbRestartNogoods=3  mapSize=0  nbInferences=0  nbTooLargeKeys=130
282.14	       =>  wckTime=75.989  cpuTime=75.27  mem=144M621
289.90	   
289.90	   search
289.90	     run=2  nbConstraintChecks=37856909  nbValidityChecks=34943804  nbPropagations=187360  nbRevisions=2686485
289.90	     nbUselessRevisions=2436401  nbAssignments=410  nbFailedAssignments=62  nbBacktracks=50  nbVisitedNodes=369
289.90	     nbRestartNogoods=11  mapSize=0  nbInferences=0  nbTooLargeKeys=215
289.90	       =>  wckTime=83.758  cpuTime=82.97  mem=144M621
303.05	   
303.05	   search
303.05	     run=3  nbConstraintChecks=71984379  nbValidityChecks=67902809  nbPropagations=291998  nbRevisions=4220306
303.05	     nbUselessRevisions=3811838  nbAssignments=757  nbFailedAssignments=347  nbBacktracks=84  nbVisitedNodes=1025
303.05	     nbRestartNogoods=15  mapSize=0  nbInferences=0  nbTooLargeKeys=277
303.05	       =>  wckTime=96.904  cpuTime=96.0  mem=144M621
325.58	   
325.58	   search
325.58	     run=4  nbConstraintChecks=129597043  nbValidityChecks=115879150  nbPropagations=439843  nbRevisions=6402942
325.58	     nbUselessRevisions=5771501  nbAssignments=1155  nbFailedAssignments=397  nbBacktracks=135  nbVisitedNodes=1283
325.58	     nbRestartNogoods=35  mapSize=0  nbInferences=0  nbTooLargeKeys=421
325.58	       =>  wckTime=119.427  cpuTime=118.31  mem=144M621
388.79	   
388.79	   search
388.79	     run=5  nbConstraintChecks=298457050  nbValidityChecks=281712486  nbPropagations=731628  nbRevisions=10639412
388.79	     nbUselessRevisions=9610855  nbAssignments=2649  nbFailedAssignments=421  nbBacktracks=212  nbVisitedNodes=1507
388.79	     nbRestartNogoods=55  mapSize=0  nbInferences=0  nbTooLargeKeys=584
388.79	       =>  wckTime=182.645  cpuTime=180.95  mem=144M621
395.50	   
395.50	   search
395.50	     run=6  nbConstraintChecks=317315543  nbValidityChecks=298761659  nbPropagations=1043001  nbRevisions=15190456
395.50	     nbUselessRevisions=13727023  nbAssignments=2902  nbFailedAssignments=464  nbBacktracks=334  nbVisitedNodes=1823
395.50	     nbRestartNogoods=58  mapSize=0  nbInferences=0  nbTooLargeKeys=794
395.50	       =>  wckTime=189.349  cpuTime=187.59  mem=144M621
418.60	   
418.60	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1054, mem=144M621)
418.64	   
418.64	   search
418.64	     run=7  nbConstraintChecks=382164015  nbValidityChecks=362009260  nbPropagations=1417087  nbRevisions=20684116
418.64	     nbUselessRevisions=18690762  nbAssignments=3629  nbFailedAssignments=537  nbBacktracks=506  nbVisitedNodes=2258
418.64	     nbRestartNogoods=64
418.64	       =>  wckTime=212.492  cpuTime=210.52  mem=144M621
462.02	   
462.02	   search
462.02	     run=8  nbConstraintChecks=503493524  nbValidityChecks=465617020  nbPropagations=1902118  nbRevisions=27999865
462.02	     nbUselessRevisions=25220400  nbAssignments=4851  nbFailedAssignments=1009  nbBacktracks=763  nbVisitedNodes=3693
462.02	     nbRestartNogoods=74
462.02	       =>  wckTime=255.873  cpuTime=253.49  mem=144M621
526.72	   
526.72	   search
526.72	     run=9  nbConstraintChecks=675403617  nbValidityChecks=592291514  nbPropagations=2556282  nbRevisions=38265113
526.72	     nbUselessRevisions=34206998  nbAssignments=7161  nbFailedAssignments=2511  nbBacktracks=1156  nbVisitedNodes=7346
526.72	     nbRestartNogoods=81
526.72	       =>  wckTime=320.569  cpuTime=317.59  mem=144M621
579.00	   
579.00	   search
579.00	     run=10  nbConstraintChecks=820717001  nbValidityChecks=727345886  nbPropagations=3345077  nbRevisions=50626096
579.00	     nbUselessRevisions=45044735  nbAssignments=8958  nbFailedAssignments=2727  nbBacktracks=1741  nbVisitedNodes=8647
579.00	     nbRestartNogoods=98
579.00	       =>  wckTime=372.851  cpuTime=369.41  mem=144M621
681.53	   
681.53	   search
681.53	     run=11  nbConstraintChecks=1116069931  nbValidityChecks=963305567  nbPropagations=4403830  nbRevisions=67541307
681.53	     nbUselessRevisions=59752900  nbAssignments=11943  nbFailedAssignments=4295  nbBacktracks=2605  nbVisitedNodes=13162
681.53	     nbRestartNogoods=113
681.53	       =>  wckTime=475.388  cpuTime=471.02  mem=144M621
760.53	   
760.53	   search
760.53	     run=12  nbConstraintChecks=1341583968  nbValidityChecks=1149586438  nbPropagations=5731935  nbRevisions=88696130
760.53	     nbUselessRevisions=78136106  nbAssignments=15058  nbFailedAssignments=5965  nbBacktracks=3902  nbVisitedNodes=18357
760.53	     nbRestartNogoods=126
760.53	       =>  wckTime=554.387  cpuTime=549.31  mem=144M621
969.51	   
969.51	   search
969.51	     run=13  nbConstraintChecks=1957050679  nbValidityChecks=1661332266  nbPropagations=7616468  nbRevisions=119026372
969.51	     nbUselessRevisions=104419562  nbAssignments=24153  nbFailedAssignments=10478  nbBacktracks=5850
969.51	     nbVisitedNodes=30190  nbRestartNogoods=176
969.51	       =>  wckTime=763.367  cpuTime=756.62  mem=144M621
1178.74	   
1178.74	   search
1178.74	     run=14  nbConstraintChecks=2543397467  nbValidityChecks=2212427410  nbPropagations=10199538  nbRevisions=160120531
1178.74	     nbUselessRevisions=140290265  nbAssignments=32170  nbFailedAssignments=11966  nbBacktracks=8771
1178.74	     nbVisitedNodes=37022  nbRestartNogoods=231
1178.74	       =>  wckTime=972.594  cpuTime=964.86  mem=144M621
1595.30	   
1595.30	   search
1595.30	     run=15  nbConstraintChecks=3817750287  nbValidityChecks=3345227676  nbPropagations=14473143  nbRevisions=227467640
1595.30	     nbUselessRevisions=199239840  nbAssignments=55872  nbFailedAssignments=20220  nbBacktracks=13153
1595.30	     nbVisitedNodes=60465  nbRestartNogoods=289
1595.30	       =>  wckTime=1389.156  cpuTime=1379.32  mem=144M621

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node26/watcher-201278-1168146688 -o ROOT/results/node26/solver-201278-1168146688 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201278-1168146688/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.98 1.98 1.86 4/86 10036
/proc/meminfo: memFree=1520032/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=18540 CPUtime=0
/proc/10035/stat : 10035 (runsolver) R 10033 10035 8900 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 163063045 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 269028486439 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/10035/statm: 4635 279 244 17 0 2626 0

[startup+0.102924 s]
/proc/loadavg: 1.98 1.98 1.86 4/86 10036
/proc/meminfo: memFree=1520032/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=914988 CPUtime=0.08
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 2955 0 1 0 6 2 0 0 17 0 8 0 163063045 936947712 2701 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 13059038 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228747 2701 1414 14 0 215242 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 914988

[startup+0.510969 s]
/proc/loadavg: 1.98 1.98 1.86 4/86 10036
/proc/meminfo: memFree=1520032/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915328 CPUtime=0.48
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 7342 0 1 0 44 4 0 0 18 0 8 0 163063045 937295872 7081 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4152819938 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228832 7081 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 915328

[startup+1.33204 s]
/proc/loadavg: 1.98 1.98 1.86 3/93 10043
/proc/meminfo: memFree=1448808/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1.29
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 22179 0 1 0 118 11 0 0 23 0 8 0 163063045 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073605024 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228912 21916 2160 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=0.08
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 5635 0 0 0 6 2 0 0 16 0 8 0 163063049 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.17
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 409 0 0 0 16 1 0 0 16 0 8 0 163063053 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 21916 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.29
Current children cumulated vsize (KiB) 915648

[startup+2.96919 s]
/proc/loadavg: 1.98 1.98 1.86 3/93 10043
/proc/meminfo: memFree=1440360/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=2.92
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 22256 0 1 0 280 12 0 0 25 0 8 0 163063045 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073835879 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228912 21991 2180 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=0.11
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 5635 0 0 0 9 2 0 0 17 0 8 0 163063049 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.19
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 423 0 0 0 18 1 0 0 16 0 8 0 163063053 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 21991 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.92
Current children cumulated vsize (KiB) 915648

[startup+6.26649 s]
/proc/loadavg: 1.98 1.98 1.86 3/93 10043
/proc/meminfo: memFree=1440104/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=6.19
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 22271 0 1 0 606 13 0 0 25 0 8 0 163063045 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073834424 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228912 22006 2181 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=0.11
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 5635 0 0 0 9 2 0 0 16 0 8 0 163063049 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.21
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 437 0 0 0 20 1 0 0 16 0 8 0 163063053 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 22006 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 915648

[startup+12.7381 s]
/proc/loadavg: 1.98 1.98 1.86 3/93 10043
/proc/meminfo: memFree=1440240/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=12.6
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 22274 0 1 0 1247 13 0 0 25 0 8 0 163063045 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073839925 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228912 22008 2181 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=0.11
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 5635 0 0 0 9 2 0 0 16 0 8 0 163063049 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.21
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 439 0 0 0 20 1 0 0 16 0 8 0 163063053 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 22008 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 915648

[startup+25.6073 s]
/proc/loadavg: 1.98 1.98 1.87 3/93 10043
/proc/meminfo: memFree=1427568/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=25.36
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 25491 0 1 0 2520 16 0 0 25 0 8 0 163063045 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831586 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228912 25224 2181 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=0.24
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 8850 0 0 0 21 3 0 0 16 0 8 0 163063049 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.21
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 440 0 0 0 20 1 0 0 16 0 8 0 163063053 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 25224 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 915648

[startup+51.2207 s]
/proc/loadavg: 1.99 1.98 1.87 3/93 10043
/proc/meminfo: memFree=1427632/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=50.75
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 25498 0 1 0 5056 19 0 0 25 0 8 0 163063045 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073833447 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228912 25230 2181 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=0.24
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 8850 0 0 0 21 3 0 0 16 0 8 0 163063049 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.23
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 446 0 0 0 22 1 0 0 16 0 8 0 163063053 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 25230 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.75
Current children cumulated vsize (KiB) 915648

[startup+102.437 s]
/proc/loadavg: 1.99 1.98 1.87 3/93 10043
/proc/meminfo: memFree=1402352/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=101.53
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 31826 0 1 0 10125 28 0 0 25 0 8 0 163063045 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832768 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/10035/statm: 228912 31554 2181 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=0.59
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 15166 0 0 0 54 5 0 0 16 0 8 0 163063049 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.24
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 454 0 0 0 23 1 0 0 15 0 8 0 163063053 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 31554 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.53
Current children cumulated vsize (KiB) 915648

[startup+162.495 s]
/proc/loadavg: 1.99 1.98 1.88 3/93 10043
/proc/meminfo: memFree=1393264/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=161.09
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 34073 0 1 0 16073 36 0 0 25 0 8 0 163063045 937623552 33800 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073838539 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1412.19
Current children cumulated vsize (KiB) 915648

[startup+1482.83 s]
/proc/loadavg: 2.06 2.02 1.94 3/94 10109
/proc/meminfo: memFree=1327392/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1471.95
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 46566 0 1 0 147135 60 0 0 25 0 8 0 163063045 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072918486 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/10035/statm: 228912 46256 2547 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=1.55
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 29336 0 0 0 145 10 0 0 16 0 8 0 163063049 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.44
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 560 0 0 0 42 2 0 0 16 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1471.95
Current children cumulated vsize (KiB) 915648

[startup+1542.92 s]
/proc/loadavg: 2.02 2.02 1.94 3/94 10109
/proc/meminfo: memFree=1327328/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1531.7
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 46566 0 1 0 153110 60 0 0 25 0 8 0 163063045 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831586 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/10035/statm: 228912 46256 2547 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=1.55
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 29336 0 0 0 145 10 0 0 16 0 8 0 163063049 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.44
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 560 0 0 0 42 2 0 0 16 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1531.7
Current children cumulated vsize (KiB) 915648

[startup+1603 s]
/proc/loadavg: 2.01 2.01 1.94 3/94 10109
/proc/meminfo: memFree=1327392/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1591.46
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 46566 0 1 0 159086 60 0 0 25 0 8 0 163063045 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074180343 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/10035/statm: 228912 46256 2547 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=1.55
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 29336 0 0 0 145 10 0 0 16 0 8 0 163063049 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.44
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 560 0 0 0 42 2 0 0 16 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1591.46
Current children cumulated vsize (KiB) 915648

[startup+1663.08 s]
/proc/loadavg: 2.04 2.02 1.94 3/94 10109
/proc/meminfo: memFree=1327328/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1651.2
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 46566 0 1 0 165060 60 0 0 25 0 8 0 163063045 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831533 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/10035/statm: 228912 46256 2547 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=1.55
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 29336 0 0 0 145 10 0 0 16 0 8 0 163063049 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.44
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 560 0 0 0 42 2 0 0 16 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1651.2
Current children cumulated vsize (KiB) 915648

[startup+1723.16 s]
/proc/loadavg: 2.08 2.03 1.95 3/94 10109
/proc/meminfo: memFree=1327328/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1710.94
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 46566 0 1 0 171034 60 0 0 25 0 8 0 163063045 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832743 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/10035/statm: 228912 46256 2547 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=1.55
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 29336 0 0 0 145 10 0 0 16 0 8 0 163063049 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.44
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 560 0 0 0 42 2 0 0 16 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1710.94
Current children cumulated vsize (KiB) 915648

[startup+1783.25 s]
/proc/loadavg: 2.08 2.04 1.95 3/94 10109
/proc/meminfo: memFree=1327328/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1770.72
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 46566 0 1 0 177011 61 0 0 25 0 8 0 163063045 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074183808 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/10035/statm: 228912 46256 2547 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=1.55
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 29336 0 0 0 145 10 0 0 16 0 8 0 163063049 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.44
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 560 0 0 0 42 2 0 0 16 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1770.72
Current children cumulated vsize (KiB) 915648



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1812.77 s]
/proc/loadavg: 2.05 2.03 1.95 3/94 10109
/proc/meminfo: memFree=1327264/2055920 swapFree=4192812/4192956
[pid=10035] ppid=10033 vsize=915648 CPUtime=1800.07
/proc/10035/stat : 10035 (java) R 10033 10035 8900 0 -1 0 46566 0 1 0 179946 61 0 0 25 0 8 0 163063045 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074168459 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/10035/statm: 228912 46256 2547 14 0 215382 0
[pid=10035/tid=10037] ppid=10033 vsize=915648 CPUtime=1.55
/proc/10035/task/10037/stat : 10037 (java) S 10033 10035 8900 0 -1 64 29336 0 0 0 145 10 0 0 16 0 8 0 163063049 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10038] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10038/stat : 10038 (java) S 10033 10035 8900 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10039] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10039/stat : 10039 (java) S 10033 10035 8900 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 163063050 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10040] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10040/stat : 10040 (java) S 10033 10035 8900 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10041] ppid=10033 vsize=915648 CPUtime=0.44
/proc/10035/task/10041/stat : 10041 (java) S 10033 10035 8900 0 -1 64 560 0 0 0 42 2 0 0 16 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10042] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10042/stat : 10042 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=10035/tid=10043] ppid=10033 vsize=915648 CPUtime=0
/proc/10035/task/10043/stat : 10043 (java) S 10033 10035 8900 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 163063053 937623552 46256 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 915648

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1812.87
CPU time (s): 1800.16
CPU user time (s): 1799.53
CPU system time (s): 0.638902
CPU usage (%): 99.2993
Max. virtual memory (cumulated for all children) (KiB): 915652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.53
system time used= 0.638902
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 46583
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38610
involuntary context switches= 51038

runsolver used 2.30565 s user time and 5.72213 s system time

The end

Launcher Data (download as text)

Begin job on node26 on Sun Jan  7 05:11:28 UTC 2007


IDJOB= 201278
IDBENCH= 3754
FILE ID= node26/201278-1168146688

PBS_JOBID= 3478132

Free space on /tmp= 66529 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp12/fapp12-1500-5.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201278-1168146688/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node26/watcher-201278-1168146688 -o ROOT/results/node26/solver-201278-1168146688 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201278-1168146688/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  adf10fdc6d350a6af7b358d510ea8438

RANDOM SEED= 744713508

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1520512 kB
Buffers:         56116 kB
Cached:         308160 kB
SwapCached:          0 kB
Active:         259268 kB
Inactive:       214652 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1520512 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            5160 kB
Writeback:           0 kB
Mapped:         132012 kB
Slab:            46136 kB
Committed_AS:  3153104 kB
PageTables:       2388 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66531 MiB



End job on node26 on Sun Jan  7 05:41:41 UTC 2007