Trace number 196299

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.07 1816.52

General information on the benchmark

Namerandom/rand-3-24-24/
rand-3-24-24-76-632-8_ext.xml
MD5SUMc527ad7568c6baeb5904a2d1842fb79f
Bench CategoryN-ARY-EXT (n-ary constraints in extension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1500.09
SatisfiableNO
(Un)Satisfiability was proved
Number of variables24
Number of constraints76
Maximum constraint arity3
Maximum domain size24
Number of constraints which are defined in extension76
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.39	   
0.39	Abscon 109 (November, 2006)
0.39	   
0.39	   configuration
0.39	     name=esac.xml
0.43	   
0.43	   instance
0.43	     name=/tmp/evaluation/196299-1168121669/unknown.xml
0.46	   
0.46	   domains being loaded...
0.46	   
0.46	   variables being loaded...
0.50	     nbVariables=24  nbDomainTypes=1  minDomainSize=24  maxDomainSize=24
0.50	       =>  wckTime=0.1  cpuTime=0.08  mem=6M951
0.50	   
0.50	   relations being loaded...
1.17	   
1.17	   constraints being loaded...
1.45	     nbConstraints=76  nbRelationTypes=76  nbExtensionStructures=76  nbSharedExtensionStructures=0
1.45	     nbConflictsStructures=76  nbSharedConflictsStructures=0  nbSharedBinaryRepresentations=0  maxDegree=18  maxArity=3
1.45	       =>  wckTime=1.051  cpuTime=0.91  mem=50M841
1.57	   
1.57	   solver IterativeSystematicSolver being built... 
1.75	       =>  wckTime=1.352  cpuTime=1.04  mem=35M597
1.86	   
1.86	   preprocessing
1.86	     nbConstraintChecks=33294  nbValidityChecks=55991  nbPropagations=233  nbRevisions=2336  nbUselessRevisions=2055
1.86	     nbSingletonTests=35  nbEffectiveSingletonTests=0  nbESACBranches=4  nbRemovedValues=0  detectedInconsistency=no
1.86	       =>  wckTime=0.108  cpuTime=0.08  mem=35M597
1.93	   
1.93	   search
1.93	     run=0  nbConstraintChecks=27707  nbValidityChecks=52150  nbPropagations=495  nbRevisions=5573
1.93	     nbUselessRevisions=4650  nbAssignments=23  nbFailedAssignments=7  nbBacktracks=10  nbVisitedNodes=39
1.93	     nbRestartNogoods=0  mapSize=8  nbInferences=0  nbTooLargeKeys=0
1.93	       =>  wckTime=0.175  cpuTime=0.13  mem=35M597
2.01	   
2.01	   search
2.01	     run=1  nbConstraintChecks=74467  nbValidityChecks=148270  nbPropagations=1544  nbRevisions=17110
2.01	     nbUselessRevisions=14026  nbAssignments=71  nbFailedAssignments=27  nbBacktracks=26  nbVisitedNodes=112
2.01	     nbRestartNogoods=7  mapSize=22  nbInferences=0  nbTooLargeKeys=0
2.01	       =>  wckTime=0.26  cpuTime=0.22  mem=35M597
2.15	   
2.15	   search
2.15	     run=2  nbConstraintChecks=147059  nbValidityChecks=305123  nbPropagations=3325  nbRevisions=37891
2.15	     nbUselessRevisions=30844  nbAssignments=148  nbFailedAssignments=52  nbBacktracks=49  nbVisitedNodes=205
2.15	     nbRestartNogoods=12  mapSize=41  nbInferences=0  nbTooLargeKeys=0
2.15	       =>  wckTime=0.399  cpuTime=0.35  mem=35M597
2.28	   
2.28	   search
2.28	     run=3  nbConstraintChecks=224293  nbValidityChecks=468243  nbPropagations=5983  nbRevisions=69416
2.28	     nbUselessRevisions=56055  nbAssignments=235  nbFailedAssignments=93  nbBacktracks=82  nbVisitedNodes=341
2.28	     nbRestartNogoods=18  mapSize=62  nbInferences=0  nbTooLargeKeys=0
2.28	       =>  wckTime=0.531  cpuTime=0.47  mem=35M597
2.43	   
2.43	   search
2.43	     run=4  nbConstraintChecks=322858  nbValidityChecks=660308  nbPropagations=9692  nbRevisions=114273
2.43	     nbUselessRevisions=91965  nbAssignments=350  nbFailedAssignments=154  nbBacktracks=132  nbVisitedNodes=543
2.43	     nbRestartNogoods=20  mapSize=100  nbInferences=0  nbTooLargeKeys=0
2.43	       =>  wckTime=0.675  cpuTime=0.61  mem=35M597
2.73	   
2.73	   search
2.73	     run=5  nbConstraintChecks=516579  nbValidityChecks=1057319  nbPropagations=15815  nbRevisions=188266
2.73	     nbUselessRevisions=151424  nbAssignments=536  nbFailedAssignments=260  nbBacktracks=208  nbVisitedNodes=886
2.73	     nbRestartNogoods=21  mapSize=167  nbInferences=0  nbTooLargeKeys=0
2.73	       =>  wckTime=0.976  cpuTime=0.91  mem=35M597
3.12	   
3.12	   search
3.12	     run=6  nbConstraintChecks=765762  nbValidityChecks=1586868  nbPropagations=24916  nbRevisions=298609
3.12	     nbUselessRevisions=239506  nbAssignments=816  nbFailedAssignments=421  nbBacktracks=323  nbVisitedNodes=1395
3.12	     nbRestartNogoods=27  mapSize=259  nbInferences=0  nbTooLargeKeys=0
3.12	       =>  wckTime=1.369  cpuTime=1.29  mem=35M597
3.73	   
3.73	   search
3.73	     run=7  nbConstraintChecks=1150673  nbValidityChecks=2370264  nbPropagations=38620  nbRevisions=462184
3.73	     nbUselessRevisions=368799  nbAssignments=1190  nbFailedAssignments=616  nbBacktracks=494  nbVisitedNodes=2069
3.73	     nbRestartNogoods=31  mapSize=402  nbInferences=0  nbTooLargeKeys=0
3.73	       =>  wckTime=1.976  cpuTime=1.89  mem=35M597
4.65	   
4.65	   search
4.65	     run=8  nbConstraintChecks=1735611  nbValidityChecks=3567937  nbPropagations=59877  nbRevisions=711745
4.65	     nbUselessRevisions=564839  nbAssignments=1810  nbFailedAssignments=975  nbBacktracks=751  nbVisitedNodes=3205
4.65	     nbRestartNogoods=34  mapSize=619  nbInferences=0  nbTooLargeKeys=0
4.65	       =>  wckTime=2.896  cpuTime=2.78  mem=35M597
6.34	   
6.34	   search
6.34	     run=9  nbConstraintChecks=2895340  nbValidityChecks=5882149  nbPropagations=93251  nbRevisions=1110305
6.34	     nbUselessRevisions=877758  nbAssignments=2794  nbFailedAssignments=1572  nbBacktracks=1135  nbVisitedNodes=5053
6.34	     nbRestartNogoods=37  mapSize=960  nbInferences=0  nbTooLargeKeys=0
6.34	       =>  wckTime=4.592  cpuTime=4.46  mem=35M597
6.58	   
6.58	   INFO : Stopping hyperNogood (mapSize=1009, nbTooLargekeys=0, mem=35M597)
8.06	   
8.06	   search
8.06	     run=10  nbConstraintChecks=4061286  nbValidityChecks=8323302  nbPropagations=141478  nbRevisions=1686371
8.06	     nbUselessRevisions=1330299  nbAssignments=4103  nbFailedAssignments=2299  nbBacktracks=1711  nbVisitedNodes=7433
8.06	     nbRestartNogoods=39
8.06	       =>  wckTime=6.306  cpuTime=6.14  mem=35M597
11.06	   
11.06	   search
11.06	     run=11  nbConstraintChecks=6101561  nbValidityChecks=12528184  nbPropagations=213942  nbRevisions=2553877
11.06	     nbUselessRevisions=2014206  nbAssignments=6289  nbFailedAssignments=3606  nbBacktracks=2575  nbVisitedNodes=11448
11.06	     nbRestartNogoods=51
11.06	       =>  wckTime=9.312  cpuTime=9.12  mem=35M597
18.31	   
18.31	   search
18.31	     run=12  nbConstraintChecks=11089804  nbValidityChecks=22190442  nbPropagations=332182  nbRevisions=4024810
18.31	     nbUselessRevisions=3177626  nbAssignments=9962  nbFailedAssignments=5976  nbBacktracks=3874  nbVisitedNodes=18437
18.31	     nbRestartNogoods=64
18.31	       =>  wckTime=16.559  cpuTime=16.3  mem=35M597
25.02	   
25.02	   search
25.02	     run=13  nbConstraintChecks=15540896  nbValidityChecks=31341636  nbPropagations=503740  nbRevisions=6119614
25.02	     nbUselessRevisions=4823739  nbAssignments=14400  nbFailedAssignments=8463  nbBacktracks=5822  nbVisitedNodes=26546
25.02	     nbRestartNogoods=75
25.02	       =>  wckTime=23.269  cpuTime=22.95  mem=35M597
35.74	   
35.74	   search
35.74	     run=14  nbConstraintChecks=22734030  nbValidityChecks=46148079  nbPropagations=758207  nbRevisions=9217051
35.74	     nbUselessRevisions=7256526  nbAssignments=21305  nbFailedAssignments=12441  nbBacktracks=8741  nbVisitedNodes=39271
35.74	     nbRestartNogoods=83
35.74	       =>  wckTime=33.99  cpuTime=33.57  mem=35M597
51.26	   
51.26	   search
51.26	     run=15  nbConstraintChecks=33171913  nbValidityChecks=67475200  nbPropagations=1138592  nbRevisions=13800588
51.26	     nbUselessRevisions=10853454  nbAssignments=31218  nbFailedAssignments=17966  nbBacktracks=13120
51.26	     nbVisitedNodes=57408  nbRestartNogoods=93
51.26	       =>  wckTime=49.505  cpuTime=48.92  mem=35M597
75.60	   
75.60	   search
75.60	     run=16  nbConstraintChecks=49844394  nbValidityChecks=101214111  nbPropagations=1710793  nbRevisions=20691386
75.60	     nbUselessRevisions=16257721  nbAssignments=46700  nbFailedAssignments=26873  nbBacktracks=19689
75.60	     nbVisitedNodes=85974  nbRestartNogoods=101
75.60	       =>  wckTime=73.846  cpuTime=73.01  mem=35M597
105.93	   
105.93	   search
105.93	     run=17  nbConstraintChecks=69954668  nbValidityChecks=143118263  nbPropagations=2538924  nbRevisions=30542040
105.93	     nbUselessRevisions=23969668  nbAssignments=68086  nbFailedAssignments=38402  nbBacktracks=29543
105.93	     nbVisitedNodes=124612  nbRestartNogoods=108
105.93	       =>  wckTime=104.18  cpuTime=103.07  mem=35M597
160.79	   
160.79	   search
160.79	     run=18  nbConstraintChecks=106811975  nbValidityChecks=217878789  nbPropagations=3777203  nbRevisions=45390615
160.79	     nbUselessRevisions=35638036  nbAssignments=102125  nbFailedAssignments=57657  nbBacktracks=44321
160.79	     nbVisitedNodes=187101  nbRestartNogoods=117
160.79	       =>  wckTime=159.034  cpuTime=157.4  mem=35M597
234.85	   
234.85	   search
234.85	     run=19  nbConstraintChecks=156434173  nbValidityChecks=321186142  nbPropagations=5623565  nbRevisions=67406608
234.85	     nbUselessRevisions=52901205  nbAssignments=153289  nbFailedAssignments=86636  nbBacktracks=66489
234.85	     nbVisitedNodes=280812  nbRestartNogoods=133
234.85	       =>  wckTime=233.103  cpuTime=230.79  mem=35M597
363.40	   
363.40	   search
363.40	     run=20  nbConstraintChecks=242998329  nbValidityChecks=495686127  nbPropagations=8422353  nbRevisions=101049503
363.40	     nbUselessRevisions=79357021  nbAssignments=230807  nbFailedAssignments=130896  nbBacktracks=99741
363.40	     nbVisitedNodes=423577  nbRestartNogoods=157
363.40	       =>  wckTime=361.644  cpuTime=358.11  mem=35M597
555.53	   
555.53	   search
555.53	     run=21  nbConstraintChecks=373442552  nbValidityChecks=760814940  nbPropagations=12667878  nbRevisions=152583533
555.53	     nbUselessRevisions=120002437  nbAssignments=352917  nbFailedAssignments=203123  nbBacktracks=149619
555.53	     nbVisitedNodes=649519  nbRestartNogoods=178
555.53	       =>  wckTime=553.774  cpuTime=548.24  mem=35M597
831.12	   
831.12	   search
831.12	     run=22  nbConstraintChecks=559958162  nbValidityChecks=1138549996  nbPropagations=19082529  nbRevisions=229766473
831.12	     nbUselessRevisions=180716988  nbAssignments=523647  nbFailedAssignments=299021  nbBacktracks=224437
831.12	     nbVisitedNodes=963635  nbRestartNogoods=201
831.12	       =>  wckTime=829.37  cpuTime=820.51  mem=35M597
1254.81	   
1254.81	   search
1254.81	     run=23  nbConstraintChecks=845971802  nbValidityChecks=1721328703  nbPropagations=28700874  nbRevisions=345886402
1254.81	     nbUselessRevisions=272108747  nbAssignments=784896  nbFailedAssignments=448018  nbBacktracks=336665
1254.81	     nbVisitedNodes=1445831  nbRestartNogoods=223
1254.81	       =>  wckTime=1253.062  cpuTime=1239.89  mem=35M597

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node24/watcher-196299-1168121669 -o ROOT/results/node24/solver-196299-1168121669 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/196299-1168121669/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.26 2.08 1.97 4/95 755
/proc/meminfo: memFree=1460368/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=18540 CPUtime=0
/proc/754/stat : 754 (runsolver) R 752 754 32081 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 160562322 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 237788261671 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/754/statm: 4635 279 244 17 0 2626 0

[startup+0.103919 s]
/proc/loadavg: 2.26 2.08 1.97 4/95 755
/proc/meminfo: memFree=1460368/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=905804 CPUtime=0.01
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 1646 0 1 0 1 0 0 0 17 0 1 0 160562322 927543296 1395 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153443603 0 4 0 7368 0 0 0 17 1 0 0
/proc/754/statm: 226451 1395 831 14 0 214034 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 905804

[startup+0.511959 s]
/proc/loadavg: 2.26 2.08 1.97 4/95 755
/proc/meminfo: memFree=1460368/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915328 CPUtime=0.41
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 6215 0 1 0 37 4 0 0 18 0 8 0 160562322 937295872 5954 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228832 5954 2137 14 0 215302 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 915328

[startup+1.33505 s]
/proc/loadavg: 2.26 2.08 1.97 4/102 762
/proc/meminfo: memFree=1394200/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915328 CPUtime=1.22
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 19112 0 1 0 112 10 0 0 24 0 8 0 160562322 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153379787 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228832 18850 2160 14 0 215302 0
[pid=754/tid=756] ppid=752 vsize=915328 CPUtime=0.05
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 2650 0 0 0 4 1 0 0 17 0 8 0 160562334 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915328 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915328 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 160562335 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915328 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915328 CPUtime=0.1
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 321 0 0 0 10 0 0 0 16 0 8 0 160562338 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915328 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915328 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937295872 18850 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 915328

[startup+2.98821 s]
/proc/loadavg: 2.26 2.08 1.97 3/102 762
/proc/meminfo: memFree=1376728/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=2.86
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23568 0 1 0 273 13 0 0 25 0 8 0 160562322 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073754373 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23304 2531 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 17 0 8 0 160562334 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.2
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 373 0 0 0 19 1 0 0 15 0 8 0 160562338 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23304 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 915420

[startup+6.27954 s]
/proc/loadavg: 2.24 2.07 1.97 3/102 762
/proc/meminfo: memFree=1376736/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=6.12
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23585 0 1 0 599 13 0 0 25 0 8 0 160562322 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073754306 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23318 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 17 0 8 0 160562334 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.23
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 387 0 0 0 22 1 0 0 17 0 8 0 160562338 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23318 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.12
Current children cumulated vsize (KiB) 915420

[startup+12.7772 s]
/proc/loadavg: 2.30 2.09 1.97 3/102 762
/proc/meminfo: memFree=1376672/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=12.55
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23589 0 1 0 1242 13 0 0 25 0 8 0 160562322 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073756011 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23321 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 391 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 915420

[startup+25.6255 s]
/proc/loadavg: 2.33 2.10 1.98 3/102 762
/proc/meminfo: memFree=1376864/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=25.3
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23589 0 1 0 2516 14 0 0 25 0 8 0 160562322 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073780742 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23321 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 391 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23321 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.3
Current children cumulated vsize (KiB) 915420

[startup+51.2761 s]
/proc/loadavg: 2.20 2.09 1.98 3/102 762
/proc/meminfo: memFree=1376928/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=50.68
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 5054 14 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073754259 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 915420

[startup+102.543 s]
/proc/loadavg: 2.09 2.07 1.98 3/102 762
/proc/meminfo: memFree=1376864/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=101.46
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 10132 14 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073632892 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.46
Current children cumulated vsize (KiB) 915420

[startup+162.568 s]
/proc/loadavg: 2.03 2.06 1.98 3/102 762
/proc/meminfo: memFree=1376928/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=160.9
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 16076 14 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073757925 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1409.2
Current children cumulated vsize (KiB) 915420

[startup+1483.52 s]
/proc/loadavg: 2.00 2.01 2.00 3/105 818
/proc/meminfo: memFree=1429008/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=1468.88
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 146864 24 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073754292 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1468.88
Current children cumulated vsize (KiB) 915420

[startup+1543.54 s]
/proc/loadavg: 2.06 2.02 2.00 3/105 818
/proc/meminfo: memFree=1429008/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=1528.57
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 152833 24 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073757849 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1528.57
Current children cumulated vsize (KiB) 915420

[startup+1603.57 s]
/proc/loadavg: 2.02 2.02 2.00 3/105 818
/proc/meminfo: memFree=1401168/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=1588.21
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 158797 24 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073756093 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1588.21
Current children cumulated vsize (KiB) 915420

[startup+1663.59 s]
/proc/loadavg: 2.01 2.01 2.00 3/105 818
/proc/meminfo: memFree=1401168/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=1647.89
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 164764 25 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073754259 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1647.89
Current children cumulated vsize (KiB) 915420

[startup+1723.62 s]
/proc/loadavg: 2.00 2.00 2.00 3/105 818
/proc/meminfo: memFree=1373328/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=1707.6
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 170735 25 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073761104 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1707.6
Current children cumulated vsize (KiB) 915420

[startup+1783.63 s]
/proc/loadavg: 2.00 2.00 2.00 3/105 818
/proc/meminfo: memFree=1373264/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=1767.33
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 176708 25 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073755975 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1767.33
Current children cumulated vsize (KiB) 915420



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1816.47 s]
/proc/loadavg: 2.00 2.00 2.00 3/105 818
/proc/meminfo: memFree=1373264/2055920 swapFree=4192812/4192956
[pid=754] ppid=752 vsize=915420 CPUtime=1800.01
/proc/754/stat : 754 (java) R 752 754 32081 0 -1 0 23591 0 1 0 179976 25 0 0 25 0 8 0 160562322 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073632892 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/754/statm: 228855 23322 2532 14 0 215325 0
[pid=754/tid=756] ppid=752 vsize=915420 CPUtime=0.17
/proc/754/task/756/stat : 756 (java) S 752 754 32081 0 -1 64 6584 0 0 0 15 2 0 0 16 0 8 0 160562334 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=757] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/757/stat : 757 (java) S 752 754 32081 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=758] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/758/stat : 758 (java) S 752 754 32081 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 160562335 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=759] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/759/stat : 759 (java) S 752 754 32081 0 -1 64 0 0 0 0 0 0 0 0 18 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=760] ppid=752 vsize=915420 CPUtime=0.24
/proc/754/task/760/stat : 760 (java) S 752 754 32081 0 -1 64 392 0 0 0 23 1 0 0 16 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=761] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/761/stat : 761 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=754/tid=762] ppid=752 vsize=915420 CPUtime=0
/proc/754/task/762/stat : 762 (java) S 752 754 32081 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 160562338 937390080 23322 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 915420

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1816.52
CPU time (s): 1800.07
CPU user time (s): 1799.8
CPU system time (s): 0.273958
CPU usage (%): 99.0944
Max. virtual memory (cumulated for all children) (KiB): 915420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.8
system time used= 0.273958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23609
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37830
involuntary context switches= 86748

runsolver used 2.50162 s user time and 7.2049 s system time

The end

Launcher Data (download as text)

Begin job on node24 on Sat Jan  6 22:14:31 UTC 2007


IDJOB= 196299
IDBENCH= 3341
FILE ID= node24/196299-1168121669

PBS_JOBID= 3477451

Free space on /tmp= 66457 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-3-24-24/rand-3-24-24-76-632-8_ext.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/196299-1168121669/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node24/watcher-196299-1168121669 -o ROOT/results/node24/solver-196299-1168121669 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/196299-1168121669/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  c527ad7568c6baeb5904a2d1842fb79f

RANDOM SEED= 387569855

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1460784 kB
Buffers:         35408 kB
Cached:         142548 kB
SwapCached:          0 kB
Active:         455084 kB
Inactive:        81664 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1460784 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            4680 kB
Writeback:           0 kB
Mapped:         386688 kB
Slab:            42324 kB
Committed_AS:  3900952 kB
PageTables:       3052 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66458 MiB



End job on node24 on Sat Jan  6 22:44:47 UTC 2007