Trace number 200854

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.13 1812.6

General information on the benchmark

Namefapp/fapp11-15/fapp14/
fapp14-2500-7.xml
MD5SUMa79c9b99e8808e3f0c1cc2f1e05bf11a
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2500
Number of constraints40767
Maximum constraint arity2
Maximum domain size362
Number of constraints which are defined in extension0
Number of constraints which are defined in intension40767
Global constraints used (with number of constraints)

Solver Data (download as text)

0.47	   
0.47	Abscon 109 (November, 2006)
0.47	   
0.47	   configuration
0.47	     name=esac.xml
0.50	   
0.50	   instance
0.50	     name=/tmp/evaluation/200854-1168143988/unknown.xml
0.53	   
0.53	   domains being loaded...
0.56	   
0.56	   variables being loaded...
0.84	     nbVariables=2500  nbDomainTypes=30  minDomainSize=42  maxDomainSize=362
0.84	       =>  wckTime=0.368  cpuTime=0.27  mem=35M193
0.84	   
0.84	   predicates being loaded...
0.84	   
0.84	   constraints being loaded...
202.06	   
202.06	   INFO : Stopping converting binary constraints (cpu=200.01, mem = 113M947)
206.31	     nbConstraints=21610  nbMergedConstraints=19157  nbConvertedConstraints=4002  nbConvertConstraintsChecks=352818456
206.31	     nbExtensionStructures=3455  nbSharedExtensionStructures=547  nbConflictsStructures=3455
206.31	     nbSharedConflictsStructures=547  nbSharedBinaryRepresentations=1696984  nbEvaluationManagers=13196
206.31	     nbSharedEvaluationManagers=4412  maxDegree=27  maxArity=2
206.31	       =>  wckTime=205.837  cpuTime=203.72  mem=138M460
206.85	   
206.85	   solver IterativeSystematicSolver being built... 
207.51	       =>  wckTime=207.04  cpuTime=204.17  mem=224M529
318.07	   
318.07	   INFO : Stopping ESAC
318.08	   
318.08	   preprocessing
318.08	     nbConstraintChecks=211806879  nbValidityChecks=74288921  nbPropagations=45198  nbRevisions=670456
318.08	     nbUselessRevisions=616625  nbSingletonTests=926  nbEffectiveSingletonTests=10  nbESACBranches=15
318.08	     nbRemovedValues=377415  detectedInconsistency=no
318.08	       =>  wckTime=110.54  cpuTime=109.46  mem=224M529
321.00	   
321.00	   search
321.00	     run=0  nbConstraintChecks=4216289  nbValidityChecks=4633581  nbPropagations=47930  nbRevisions=714746
321.00	     nbUselessRevisions=656734  nbAssignments=71  nbFailedAssignments=18  nbBacktracks=11  nbVisitedNodes=99
321.00	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=53
321.00	       =>  wckTime=113.466  cpuTime=112.35  mem=226M559
323.85	   
323.85	   search
323.85	     run=1  nbConstraintChecks=9864340  nbValidityChecks=11867888  nbPropagations=100323  nbRevisions=1504237
323.85	     nbUselessRevisions=1381344  nbAssignments=171  nbFailedAssignments=35  nbBacktracks=26  nbVisitedNodes=205
323.85	     nbRestartNogoods=4  mapSize=0  nbInferences=0  nbTooLargeKeys=114
323.85	       =>  wckTime=116.315  cpuTime=115.17  mem=226M559
326.70	   
326.70	   search
326.70	     run=2  nbConstraintChecks=15487343  nbValidityChecks=19437029  nbPropagations=157747  nbRevisions=2374387
326.70	     nbUselessRevisions=2178955  nbAssignments=271  nbFailedAssignments=48  nbBacktracks=50  nbVisitedNodes=315
326.70	     nbRestartNogoods=10  mapSize=0  nbInferences=0  nbTooLargeKeys=182
326.70	       =>  wckTime=119.164  cpuTime=117.99  mem=226M559
328.76	   
328.76	   search
328.76	     run=3  nbConstraintChecks=19192365  nbValidityChecks=23837036  nbPropagations=218773  nbRevisions=3301568
328.76	     nbUselessRevisions=3027601  nbAssignments=376  nbFailedAssignments=72  nbBacktracks=83  nbVisitedNodes=457
328.76	     nbRestartNogoods=12  mapSize=0  nbInferences=0  nbTooLargeKeys=263
328.76	       =>  wckTime=121.232  cpuTime=120.04  mem=226M559
348.36	   
348.36	   search
348.36	     run=4  nbConstraintChecks=58029305  nbValidityChecks=65401758  nbPropagations=306956  nbRevisions=4678885
348.36	     nbUselessRevisions=4284727  nbAssignments=983  nbFailedAssignments=201  nbBacktracks=134  nbVisitedNodes=1016
348.36	     nbRestartNogoods=24  mapSize=0  nbInferences=0  nbTooLargeKeys=540
348.36	       =>  wckTime=140.824  cpuTime=139.43  mem=226M559
431.05	   
431.05	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1291, mem=226M559)
434.47	   
434.47	   search
434.47	     run=5  nbConstraintChecks=233697951  nbValidityChecks=277906698  nbPropagations=526952  nbRevisions=8000091
434.47	     nbUselessRevisions=7330809  nbAssignments=4479  nbFailedAssignments=315  nbBacktracks=211  nbVisitedNodes=2448
434.47	     nbRestartNogoods=57
434.47	       =>  wckTime=226.939  cpuTime=224.67  mem=226M559
707.45	   
707.45	   search
707.45	     run=6  nbConstraintChecks=824527408  nbValidityChecks=1087897280  nbPropagations=1386987  nbRevisions=20393725
707.45	     nbUselessRevisions=18755840  nbAssignments=27216  nbFailedAssignments=395  nbBacktracks=324  nbVisitedNodes=4100
707.45	     nbRestartNogoods=104
707.45	       =>  wckTime=499.915  cpuTime=494.83  mem=227M280
1050.30	   
1050.30	   search
1050.30	     run=7  nbConstraintChecks=1606052745  nbValidityChecks=2230489983  nbPropagations=3250346  nbRevisions=46749167
1050.30	     nbUselessRevisions=43070267  nbAssignments=69009  nbFailedAssignments=590  nbBacktracks=495  nbVisitedNodes=5358
1050.30	     nbRestartNogoods=140
1050.30	       =>  wckTime=842.766  cpuTime=834.87  mem=227M280
1086.31	   
1086.31	   search
1086.31	     run=8  nbConstraintChecks=1682104537  nbValidityChecks=2306771732  nbPropagations=5180758  nbRevisions=74184595
1086.31	     nbUselessRevisions=68355398  nbAssignments=70447  nbFailedAssignments=837  nbBacktracks=751  nbVisitedNodes=6814
1086.31	     nbRestartNogoods=143
1086.31	       =>  wckTime=878.781  cpuTime=870.68  mem=227M280
1243.57	   
1243.57	   search
1243.57	     run=9  nbConstraintChecks=2034228174  nbValidityChecks=2711109338  nbPropagations=7477886  nbRevisions=107054243
1243.57	     nbUselessRevisions=98400202  nbAssignments=77739  nbFailedAssignments=2621  nbBacktracks=1136  nbVisitedNodes=11562
1243.57	     nbRestartNogoods=184
1243.57	       =>  wckTime=1036.034  cpuTime=1027.08  mem=227M280
1629.98	   
1629.98	   search
1629.98	     run=10  nbConstraintChecks=2950476551  nbValidityChecks=4034586034  nbPropagations=10722548  nbRevisions=153414419
1629.98	     nbUselessRevisions=140822458  nbAssignments=104421  nbFailedAssignments=3926  nbBacktracks=1717
1629.98	     nbVisitedNodes=15730  nbRestartNogoods=236
1629.98	       =>  wckTime=1422.451  cpuTime=1411.3  mem=202M741

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node19/watcher-200854-1168143988 -o ROOT/results/node19/solver-200854-1168143988 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200854-1168143988/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.16 2.05 2.01 4/86 14521
/proc/meminfo: memFree=1514648/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=172 CPUtime=0
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 217 0 0 0 0 0 0 0 18 0 1 0 162793479 176128 24 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 7484196 0 0 4096 0 0 0 0 17 0 0 0
/proc/14520/statm: 43 24 18 14 0 3 0

[startup+0.108478 s]
/proc/loadavg: 2.16 2.05 2.01 4/86 14521
/proc/meminfo: memFree=1514648/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=47976 CPUtime=0
/proc/14520/stat : 14520 (java) D 14518 14520 13916 0 -1 0 1223 0 1 0 0 0 0 0 18 0 1 0 162793479 49127424 972 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 2147483391 0 7368 18446744072099781622 0 0 17 0 0 0
/proc/14520/statm: 11994 972 769 14 0 1707 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 47976

[startup+0.516557 s]
/proc/loadavg: 2.16 2.05 2.01 4/86 14521
/proc/meminfo: memFree=1514648/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915328 CPUtime=0.32
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 5597 0 1 0 29 3 0 0 23 0 8 0 162793479 937295872 5336 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4152148416 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228832 5336 2076 14 0 215302 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 915328

[startup+1.33871 s]
/proc/loadavg: 2.15 2.05 2.01 3/93 14528
/proc/meminfo: memFree=1434336/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=1.15
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 23966 0 1 0 103 12 0 0 25 0 8 0 162793479 937623552 23703 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228912 23703 2160 14 0 215382 0
[pid=14520/tid=14522] ppid=14518 vsize=915648 CPUtime=0.07
/proc/14520/task/14522/stat : 14522 (java) R 14518 14520 13916 0 -1 64 7422 0 0 0 4 3 0 0 16 0 8 0 162793497 937623552 23704 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4153822953 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 23705 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 23705 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937623552 23707 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915648 CPUtime=0.15
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 410 0 0 0 14 1 0 0 16 0 8 0 162793500 937623552 23708 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937623552 23709 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937623552 23710 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 915648

[startup+2.98302 s]
/proc/loadavg: 2.15 2.05 2.01 3/93 14528
/proc/meminfo: memFree=1419552/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=2.76
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 26190 0 1 0 262 14 0 0 25 0 8 0 162793479 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073830940 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228912 25924 2180 14 0 215382 0
[pid=14520/tid=14522] ppid=14518 vsize=915648 CPUtime=0.19
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 9568 0 0 0 15 4 0 0 16 0 8 0 162793497 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915648 CPUtime=0.17
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 423 0 0 0 16 1 0 0 15 0 8 0 162793500 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937623552 25924 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 915648

[startup+6.27264 s]
/proc/loadavg: 2.15 2.05 2.01 3/93 14528
/proc/meminfo: memFree=1419104/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=6.05
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 26206 0 1 0 590 15 0 0 25 0 8 0 162793479 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073832800 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228912 25939 2181 14 0 215382 0
[pid=14520/tid=14522] ppid=14518 vsize=915648 CPUtime=0.19
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 9568 0 0 0 15 4 0 0 16 0 8 0 162793497 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915648 CPUtime=0.18
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 437 0 0 0 17 1 0 0 15 0 8 0 162793500 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937623552 25939 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 915648

[startup+12.7559 s]
/proc/loadavg: 2.12 2.05 2.01 3/93 14528
/proc/meminfo: memFree=1419232/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=12.54
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 26209 0 1 0 1238 16 0 0 25 0 8 0 162793479 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073830940 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228912 25942 2181 14 0 215382 0
[pid=14520/tid=14522] ppid=14518 vsize=915648 CPUtime=0.19
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 9568 0 0 0 15 4 0 0 16 0 8 0 162793497 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915648 CPUtime=0.19
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 440 0 0 0 18 1 0 0 16 0 8 0 162793500 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937623552 25942 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.54
Current children cumulated vsize (KiB) 915648

[startup+25.5963 s]
/proc/loadavg: 2.10 2.05 2.01 3/93 14528
/proc/meminfo: memFree=1408608/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=25.36
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 28948 0 1 0 2518 18 0 0 25 0 8 0 162793479 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073837031 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228912 28678 2181 14 0 215382 0
[pid=14520/tid=14522] ppid=14518 vsize=915648 CPUtime=0.32
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 12303 0 0 0 27 5 0 0 16 0 8 0 162793497 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915648 CPUtime=0.19
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 441 0 0 0 18 1 0 0 15 0 8 0 162793500 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937623552 28678 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 915648

[startup+51.2051 s]
/proc/loadavg: 2.07 2.04 2.01 3/93 14528
/proc/meminfo: memFree=1408480/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=50.93
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 28955 0 1 0 5073 20 0 0 25 0 8 0 162793479 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073830893 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228912 28684 2181 14 0 215382 0
[pid=14520/tid=14522] ppid=14518 vsize=915648 CPUtime=0.32
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 12303 0 0 0 27 5 0 0 16 0 8 0 162793497 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915648 CPUtime=0.2
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 447 0 0 0 19 1 0 0 16 0 8 0 162793500 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937623552 28684 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 50.93
Current children cumulated vsize (KiB) 915648

[startup+102.508 s]
/proc/loadavg: 2.02 2.03 2.00 3/93 14528
/proc/meminfo: memFree=1378272/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=102.18
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 36530 0 1 0 10191 27 0 0 25 0 8 0 162793479 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073479184 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228912 36255 2182 14 0 215382 0
[pid=14520/tid=14522] ppid=14518 vsize=915648 CPUtime=0.72
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 19867 0 0 0 64 8 0 0 16 0 8 0 162793497 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915648 CPUtime=0.21
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 454 0 0 0 20 1 0 0 16 0 8 0 162793500 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915648 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937623552 36255 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 102.18
Current children cumulated vsize (KiB) 915648

[startup+162.543 s]
/proc/loadavg: 2.01 2.03 2.00 3/93 14528
/proc/meminfo: memFree=1366368/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915648 CPUtime=162.16
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 42922 0 1 0 16181 35 0 0 25 0 8 0 162793479 937623552 42645 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073830902 0 4 0 23759 18446744073709551615 0 0 17 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1413.31
Current children cumulated vsize (KiB) 915932

[startup+1483.7 s]
/proc/loadavg: 2.00 2.00 2.00 3/94 14664
/proc/meminfo: memFree=1116456/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915932 CPUtime=1473.06
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 68212 0 1 0 147242 64 0 0 25 0 8 0 162793479 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074230219 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228983 67858 2547 14 0 215453 0
[pid=14520/tid=14522] ppid=14518 vsize=915932 CPUtime=2.34
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 50897 0 0 0 212 22 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915932 CPUtime=0.43
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 612 0 0 0 40 3 0 0 16 0 8 0 162793500 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1473.06
Current children cumulated vsize (KiB) 915932

[startup+1543.78 s]
/proc/loadavg: 2.00 2.00 2.00 3/94 14664
/proc/meminfo: memFree=1116456/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915932 CPUtime=1532.79
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 68212 0 1 0 153215 64 0 0 25 0 8 0 162793479 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074218021 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228983 67858 2547 14 0 215453 0
[pid=14520/tid=14522] ppid=14518 vsize=915932 CPUtime=2.34
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 50897 0 0 0 212 22 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915932 CPUtime=0.43
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 612 0 0 0 40 3 0 0 16 0 8 0 162793500 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1532.79
Current children cumulated vsize (KiB) 915932

[startup+1603.87 s]
/proc/loadavg: 2.15 2.04 2.01 3/94 14664
/proc/meminfo: memFree=1116392/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915932 CPUtime=1592.55
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 68212 0 1 0 159191 64 0 0 25 0 8 0 162793479 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074213815 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228983 67858 2547 14 0 215453 0
[pid=14520/tid=14522] ppid=14518 vsize=915932 CPUtime=2.34
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 50897 0 0 0 212 22 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915932 CPUtime=0.43
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 612 0 0 0 40 3 0 0 16 0 8 0 162793500 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) R 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937914368 67858 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1592.55
Current children cumulated vsize (KiB) 915932

[startup+1663.96 s]
/proc/loadavg: 2.06 2.03 2.00 3/94 14664
/proc/meminfo: memFree=1116328/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915932 CPUtime=1652.32
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 68215 0 1 0 165167 65 0 0 25 0 8 0 162793479 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073834665 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228983 67861 2547 14 0 215453 0
[pid=14520/tid=14522] ppid=14518 vsize=915932 CPUtime=2.34
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 50897 0 0 0 212 22 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915932 CPUtime=0.43
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 615 0 0 0 40 3 0 0 16 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1652.32
Current children cumulated vsize (KiB) 915932

[startup+1724.03 s]
/proc/loadavg: 2.02 2.02 2.00 3/94 14664
/proc/meminfo: memFree=1116264/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915932 CPUtime=1712.05
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 68215 0 1 0 171140 65 0 0 25 0 8 0 162793479 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073838455 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228983 67861 2547 14 0 215453 0
[pid=14520/tid=14522] ppid=14518 vsize=915932 CPUtime=2.34
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 50897 0 0 0 212 22 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915932 CPUtime=0.43
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 615 0 0 0 40 3 0 0 16 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1712.05
Current children cumulated vsize (KiB) 915932

[startup+1784.11 s]
/proc/loadavg: 2.00 2.02 2.00 3/94 14664
/proc/meminfo: memFree=1116264/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915932 CPUtime=1771.8
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 68215 0 1 0 177115 65 0 0 25 0 8 0 162793479 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074225527 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228983 67861 2547 14 0 215453 0
[pid=14520/tid=14522] ppid=14518 vsize=915932 CPUtime=2.34
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 50897 0 0 0 212 22 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915932 CPUtime=0.43
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 615 0 0 0 40 3 0 0 16 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1771.8
Current children cumulated vsize (KiB) 915932



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1812.51 s]
/proc/loadavg: 2.00 2.02 2.00 3/94 14664
/proc/meminfo: memFree=1116264/2055920 swapFree=4171244/4192956
[pid=14520] ppid=14518 vsize=915932 CPUtime=1800.04
/proc/14520/stat : 14520 (java) R 14518 14520 13916 0 -1 0 68215 0 1 0 179939 65 0 0 25 0 8 0 162793479 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4074213942 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/14520/statm: 228983 67861 2547 14 0 215453 0
[pid=14520/tid=14522] ppid=14518 vsize=915932 CPUtime=2.34
/proc/14520/task/14522/stat : 14522 (java) S 14518 14520 13916 0 -1 64 50897 0 0 0 212 22 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14523] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14523/stat : 14523 (java) S 14518 14520 13916 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14524] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14524/stat : 14524 (java) S 14518 14520 13916 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 162793497 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14525] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14525/stat : 14525 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14526] ppid=14518 vsize=915932 CPUtime=0.43
/proc/14520/task/14526/stat : 14526 (java) S 14518 14520 13916 0 -1 64 615 0 0 0 40 3 0 0 16 0 8 0 162793500 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14527] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14527/stat : 14527 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=14520/tid=14528] ppid=14518 vsize=915932 CPUtime=0
/proc/14520/task/14528/stat : 14528 (java) S 14518 14520 13916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 162793501 937914368 67861 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 915932

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1812.6
CPU time (s): 1800.13
CPU user time (s): 1799.43
CPU system time (s): 0.698893
CPU usage (%): 99.3123
Max. virtual memory (cumulated for all children) (KiB): 915932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.43
system time used= 0.698893
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 68232
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38792
involuntary context switches= 88196

runsolver used 2.26865 s user time and 5.78912 s system time

The end

Launcher Data (download as text)

Begin job on node19 on Sun Jan  7 04:26:28 UTC 2007


IDJOB= 200854
IDBENCH= 3731
FILE ID= node19/200854-1168143988

PBS_JOBID= 3477841

Free space on /tmp= 66309 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp14/fapp14-2500-7.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200854-1168143988/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node19/watcher-200854-1168143988 -o ROOT/results/node19/solver-200854-1168143988 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/200854-1168143988/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  a79c9b99e8808e3f0c1cc2f1e05bf11a

RANDOM SEED= 173551883

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.260
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.260
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1515128 kB
Buffers:         66560 kB
Cached:         369116 kB
SwapCached:      10472 kB
Active:         172176 kB
Inactive:       302004 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1515128 kB
SwapTotal:     4192956 kB
SwapFree:      4171244 kB
Dirty:            7300 kB
Writeback:           0 kB
Mapped:          50836 kB
Slab:            51340 kB
Committed_AS:  3963368 kB
PageTables:       2340 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66304 MiB



End job on node19 on Sun Jan  7 04:56:41 UTC 2007