Trace number 206735

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.07 1807.55

General information on the benchmark

Namerandom/rand-3-28-28/
rand-3-28-28-93-632-44_ext.xml
MD5SUMf66defe44a9042bd3059afa3d35d7949
Bench CategoryN-ARY-EXT (n-ary constraints in extension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables28
Number of constraints93
Maximum constraint arity3
Maximum domain size28
Number of constraints which are defined in extension93
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.33	   
0.33	Abscon 109 (November, 2006)
0.33	   
0.33	   configuration
0.33	     name=esac.xml
0.36	   
0.36	   instance
0.36	     name=/tmp/evaluation/206735-1168177455/unknown.xml
0.39	   
0.39	   domains being loaded...
0.40	   
0.40	   variables being loaded...
0.43	     nbVariables=28  nbDomainTypes=1  minDomainSize=28  maxDomainSize=28
0.43	       =>  wckTime=0.1  cpuTime=0.09  mem=6M951
0.43	   
0.43	   relations being loaded...
1.57	   
1.57	   constraints being loaded...
2.33	     nbConstraints=92  nbRelationTypes=93  nbMergedConstraints=1  nbExtensionStructures=92
2.33	     nbSharedExtensionStructures=0  nbConflictsStructures=92  nbSharedConflictsStructures=0
2.33	     nbSharedBinaryRepresentations=0  maxDegree=16  maxArity=3
2.33	       =>  wckTime=1.997  cpuTime=1.59  mem=58M37
2.48	   
2.48	   solver IterativeSystematicSolver being built... 
2.66	       =>  wckTime=2.333  cpuTime=1.75  mem=65M618
2.81	   
2.81	   preprocessing
2.81	     nbConstraintChecks=50670  nbValidityChecks=81933  nbPropagations=267  nbRevisions=2856  nbUselessRevisions=2521
2.81	     nbSingletonTests=40  nbEffectiveSingletonTests=0  nbESACBranches=4  nbRemovedValues=0  detectedInconsistency=no
2.81	       =>  wckTime=0.145  cpuTime=0.11  mem=65M618
2.90	   
2.90	   search
2.90	     run=0  nbConstraintChecks=40278  nbValidityChecks=78335  nbPropagations=649  nbRevisions=7565
2.90	     nbUselessRevisions=6324  nbAssignments=29  nbFailedAssignments=10  nbBacktracks=12  nbVisitedNodes=47
2.90	     nbRestartNogoods=0  mapSize=10  nbInferences=0  nbTooLargeKeys=0
2.90	       =>  wckTime=0.235  cpuTime=0.19  mem=66M626
3.02	   
3.02	   search
3.02	     run=1  nbConstraintChecks=105749  nbValidityChecks=199456  nbPropagations=1841  nbRevisions=22242
3.02	     nbUselessRevisions=18423  nbAssignments=70  nbFailedAssignments=28  nbBacktracks=28  nbVisitedNodes=115
3.02	     nbRestartNogoods=3  mapSize=22  nbInferences=0  nbTooLargeKeys=0
3.02	       =>  wckTime=0.354  cpuTime=0.31  mem=66M626
3.25	   
3.26	   search
3.26	     run=2  nbConstraintChecks=230509  nbValidityChecks=457538  nbPropagations=3969  nbRevisions=49666
3.26	     nbUselessRevisions=40640  nbAssignments=153  nbFailedAssignments=58  nbBacktracks=51  nbVisitedNodes=222
3.26	     nbRestartNogoods=9  mapSize=45  nbInferences=0  nbTooLargeKeys=0
3.26	       =>  wckTime=0.588  cpuTime=0.53  mem=66M626
3.47	   
3.47	   search
3.47	     run=3  nbConstraintChecks=352726  nbValidityChecks=698248  nbPropagations=7244  nbRevisions=91629
3.47	     nbUselessRevisions=74552  nbAssignments=233  nbFailedAssignments=98  nbBacktracks=84  nbVisitedNodes=364
3.47	     nbRestartNogoods=10  mapSize=74  nbInferences=0  nbTooLargeKeys=0
3.47	       =>  wckTime=0.802  cpuTime=0.74  mem=66M626
3.86	   
3.86	   search
3.86	     run=4  nbConstraintChecks=576760  nbValidityChecks=1157398  nbPropagations=12729  nbRevisions=160201
3.86	     nbUselessRevisions=129302  nbAssignments=387  nbFailedAssignments=181  nbBacktracks=135  nbVisitedNodes=629
3.86	     nbRestartNogoods=14  mapSize=123  nbInferences=0  nbTooLargeKeys=0
3.86	       =>  wckTime=1.189  cpuTime=1.12  mem=66M626
4.26	   
4.26	   search
4.26	     run=5  nbConstraintChecks=812633  nbValidityChecks=1631526  nbPropagations=20450  nbRevisions=256402
4.26	     nbUselessRevisions=205850  nbAssignments=561  nbFailedAssignments=273  nbBacktracks=211  nbVisitedNodes=940
4.26	     nbRestartNogoods=22  mapSize=188  nbInferences=0  nbTooLargeKeys=0
4.26	       =>  wckTime=1.592  cpuTime=1.51  mem=66M626
5.34	   
5.35	   search
5.35	     run=6  nbConstraintChecks=1445479  nbValidityChecks=2901126  nbPropagations=33902  nbRevisions=427287
5.35	     nbUselessRevisions=340960  nbAssignments=1021  nbFailedAssignments=596  nbBacktracks=325  nbVisitedNodes=1793
5.35	     nbRestartNogoods=27  mapSize=298  nbInferences=0  nbTooLargeKeys=0
5.35	       =>  wckTime=2.678  cpuTime=2.59  mem=66M626
6.18	   
6.18	   search
6.18	     run=7  nbConstraintChecks=1934255  nbValidityChecks=3885872  nbPropagations=52876  nbRevisions=670646
6.18	     nbUselessRevisions=534159  nbAssignments=1401  nbFailedAssignments=798  nbBacktracks=497  nbVisitedNodes=2486
6.18	     nbRestartNogoods=41  mapSize=459  nbInferences=0  nbTooLargeKeys=0
6.18	       =>  wckTime=3.517  cpuTime=3.41  mem=66M626
7.53	   
7.53	   search
7.53	     run=8  nbConstraintChecks=2709632  nbValidityChecks=5466209  nbPropagations=80226  nbRevisions=1019589
7.53	     nbUselessRevisions=811104  nbAssignments=1977  nbFailedAssignments=1110  nbBacktracks=753  nbVisitedNodes=3540
7.53	     nbRestartNogoods=44  mapSize=694  nbInferences=0  nbTooLargeKeys=0
7.53	       =>  wckTime=4.862  cpuTime=4.72  mem=66M626
9.35	   
9.35	   INFO : Stopping hyperNogood (mapSize=1006, nbTooLargekeys=0, mem=66M626)
9.66	   
9.66	   search
9.66	     run=9  nbConstraintChecks=4022720  nbValidityChecks=8162085  nbPropagations=121562  nbRevisions=1541064
9.66	     nbUselessRevisions=1224849  nbAssignments=3065  nbFailedAssignments=1792  nbBacktracks=1137  nbVisitedNodes=5567
9.66	     nbRestartNogoods=54
9.66	       =>  wckTime=6.987  cpuTime=6.82  mem=66M626
13.21	   
13.21	   search
13.21	     run=10  nbConstraintChecks=6212612  nbValidityChecks=12593333  nbPropagations=184115  nbRevisions=2340922
13.21	     nbUselessRevisions=1861334  nbAssignments=4664  nbFailedAssignments=2807  nbBacktracks=1713  nbVisitedNodes=8567
13.21	     nbRestartNogoods=63
13.21	       =>  wckTime=10.542  cpuTime=10.34  mem=66M626
17.70	   
17.70	   search
17.70	     run=11  nbConstraintChecks=8981974  nbValidityChecks=18085176  nbPropagations=275656  nbRevisions=3516893
17.70	     nbUselessRevisions=2797442  nbAssignments=6748  nbFailedAssignments=4020  nbBacktracks=2577  nbVisitedNodes=12417
17.70	     nbRestartNogoods=78
17.70	       =>  wckTime=15.029  cpuTime=14.78  mem=66M626
23.93	   
23.93	   search
23.93	     run=12  nbConstraintChecks=12869300  nbValidityChecks=25711892  nbPropagations=399545  nbRevisions=5117119
23.93	     nbUselessRevisions=4072017  nbAssignments=9357  nbFailedAssignments=5324  nbBacktracks=3875  nbVisitedNodes=17079
23.93	     nbRestartNogoods=87
23.93	       =>  wckTime=21.262  cpuTime=20.96  mem=66M626
34.90	   
34.90	   search
34.90	     run=13  nbConstraintChecks=19780007  nbValidityChecks=39858279  nbPropagations=594364  nbRevisions=7640019
34.90	     nbUselessRevisions=6080543  nbAssignments=14612  nbFailedAssignments=8626  nbBacktracks=5822  nbVisitedNodes=26934
34.90	     nbRestartNogoods=106
34.90	       =>  wckTime=32.236  cpuTime=31.86  mem=66M626
55.17	   
55.17	   search
55.17	     run=14  nbConstraintChecks=31800533  nbValidityChecks=63701211  nbPropagations=897596  nbRevisions=11639952
55.17	     nbUselessRevisions=9263104  nbAssignments=22805  nbFailedAssignments=13875  nbBacktracks=8741  nbVisitedNodes=42439
55.17	     nbRestartNogoods=123
55.17	       =>  wckTime=52.499  cpuTime=51.78  mem=66M626
76.65	   
76.65	   search
76.65	     run=15  nbConstraintChecks=44782220  nbValidityChecks=89441104  nbPropagations=1338217  nbRevisions=17386679
76.65	     nbUselessRevisions=13834613  nbAssignments=32988  nbFailedAssignments=19671  nbBacktracks=13119
76.65	     nbVisitedNodes=61274  nbRestartNogoods=131
76.65	       =>  wckTime=73.983  cpuTime=73.01  mem=66M626
112.27	   
112.27	   search
112.27	     run=16  nbConstraintChecks=65721035  nbValidityChecks=130823322  nbPropagations=1990060  nbRevisions=26048598
112.27	     nbUselessRevisions=20772013  nbAssignments=49267  nbFailedAssignments=29325  nbBacktracks=19688
112.27	     nbVisitedNodes=91443  nbRestartNogoods=143
112.27	       =>  wckTime=109.602  cpuTime=108.3  mem=66M626
167.63	   
167.63	   search
167.63	     run=17  nbConstraintChecks=99301888  nbValidityChecks=198026572  nbPropagations=2983338  nbRevisions=39093261
167.63	     nbUselessRevisions=31172606  nbAssignments=73920  nbFailedAssignments=44106  nbBacktracks=29540
167.63	     nbVisitedNodes=137702  nbRestartNogoods=163
167.63	       =>  wckTime=164.964  cpuTime=163.15  mem=66M626
252.79	   
252.79	   search
252.79	     run=18  nbConstraintChecks=151837837  nbValidityChecks=303550557  nbPropagations=4518514  nbRevisions=59153730
252.79	     nbUselessRevisions=47108251  nbAssignments=113890  nbFailedAssignments=69277  nbBacktracks=44318
252.79	     nbVisitedNodes=212727  nbRestartNogoods=183
252.79	       =>  wckTime=250.121  cpuTime=247.62  mem=66M626
371.59	   
371.59	   search
371.59	     run=19  nbConstraintChecks=226790618  nbValidityChecks=451472478  nbPropagations=6803080  nbRevisions=88785993
371.59	     nbUselessRevisions=70653101  nbAssignments=166355  nbFailedAssignments=99546  nbBacktracks=66486
371.59	     nbVisitedNodes=309980  nbRestartNogoods=198
371.59	       =>  wckTime=368.922  cpuTime=365.69  mem=66M626
545.32	   
545.32	   search
545.32	     run=20  nbConstraintChecks=335703198  nbValidityChecks=674404559  nbPropagations=10271214  nbRevisions=133375696
545.32	     nbUselessRevisions=105979533  nbAssignments=250092  nbFailedAssignments=150022  nbBacktracks=99739
545.32	     nbVisitedNodes=467139  nbRestartNogoods=221
545.32	       =>  wckTime=542.655  cpuTime=538.15  mem=66M626
814.35	   
814.35	   search
814.35	     run=21  nbConstraintChecks=506977440  nbValidityChecks=1014645567  nbPropagations=15316419  nbRevisions=198479562
814.35	     nbUselessRevisions=157545471  nbAssignments=369916  nbFailedAssignments=219910  nbBacktracks=149617
814.35	     nbVisitedNodes=689547  nbRestartNogoods=243
814.35	       =>  wckTime=811.679  cpuTime=804.92  mem=66M626
1192.80	   
1192.80	   search
1192.80	     run=22  nbConstraintChecks=734215461  nbValidityChecks=1479246997  nbPropagations=22870406  nbRevisions=296206473
1192.80	     nbUselessRevisions=235129974  nbAssignments=551962  nbFailedAssignments=327130  nbBacktracks=224435
1192.80	     nbVisitedNodes=1028422  nbRestartNogoods=263
1192.80	       =>  wckTime=1190.132  cpuTime=1182.96  mem=66M626

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node30/watcher-206735-1168177455 -o ROOT/results/node30/solver-206735-1168177455 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/206735-1168177455/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.10 2.04 1.95 2/94 438
/proc/meminfo: memFree=1637656/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=18540 CPUtime=0
/proc/437/stat : 437 (runsolver) R 435 437 32352 0 -1 4194368 17 0 0 0 0 0 0 0 19 0 1 0 166139434 18984960 279 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 264907582759 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/437/statm: 4635 279 244 17 0 2626 0

[startup+0.103077 s]
/proc/loadavg: 2.10 2.04 1.95 2/94 438
/proc/meminfo: memFree=1637656/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=912760 CPUtime=0.07
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 2756 0 1 0 6 1 0 0 18 0 8 0 166139434 934666240 2502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153804966 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228190 2502 1386 14 0 215091 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 912760

[startup+0.511103 s]
/proc/loadavg: 2.10 2.04 1.95 2/94 438
/proc/meminfo: memFree=1637656/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915328 CPUtime=0.47
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 7250 0 1 0 43 4 0 0 18 0 8 0 166139434 937295872 6989 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073563246 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228832 6989 2137 14 0 215302 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 915328

[startup+1.33416 s]
/proc/loadavg: 2.10 2.04 1.95 3/101 445
/proc/meminfo: memFree=1570528/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915328 CPUtime=1.28
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 19098 0 1 0 119 9 0 0 25 0 8 0 166139434 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073445369 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228832 18836 2149 14 0 215302 0
[pid=437/tid=439] ppid=435 vsize=915328 CPUtime=0.05
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 2681 0 0 0 4 1 0 0 17 0 8 0 166139438 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=440] ppid=435 vsize=915328 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915328 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915328 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915328 CPUtime=0.08
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 307 0 0 0 8 0 0 0 16 0 8 0 166139442 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=444] ppid=435 vsize=915328 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915328 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937295872 18836 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 915328

[startup+2.98626 s]
/proc/loadavg: 2.09 2.03 1.95 3/101 445
/proc/meminfo: memFree=1529760/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=2.93
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32571 0 1 0 277 16 0 0 25 0 8 0 166139434 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073629919 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32306 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 17 0 8 0 166139438 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.2
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 372 0 0 0 20 0 0 0 15 0 8 0 166139442 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32306 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 915440

[startup+6.26647 s]
/proc/loadavg: 2.09 2.03 1.95 3/101 445
/proc/meminfo: memFree=1517792/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=6.17
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32586 0 1 0 601 16 0 0 25 0 8 0 166139434 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073800239 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32319 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 17 0 8 0 166139438 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.23
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 386 0 0 0 23 0 0 0 15 0 8 0 166139442 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32319 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 915440

[startup+12.7649 s]
/proc/loadavg: 2.08 2.03 1.95 3/101 445
/proc/meminfo: memFree=1517984/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=12.61
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32603 0 1 0 1245 16 0 0 25 0 8 0 166139434 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073659977 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32333 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.27
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 401 0 0 0 26 1 0 0 16 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 915440

[startup+25.6217 s]
/proc/loadavg: 2.06 2.03 1.95 3/101 445
/proc/meminfo: memFree=1518112/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=25.36
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32603 0 1 0 2519 17 0 0 25 0 8 0 166139434 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073660020 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32333 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.27
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 401 0 0 0 26 1 0 0 16 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 915440

[startup+51.2523 s]
/proc/loadavg: 2.18 2.06 1.96 3/105 500
/proc/meminfo: memFree=1386496/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=50.61
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32603 0 1 0 5044 17 0 0 25 0 8 0 166139434 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073659977 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32333 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.27
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 401 0 0 0 26 1 0 0 16 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.61
Current children cumulated vsize (KiB) 915440

[startup+102.519 s]
/proc/loadavg: 2.11 2.06 1.97 3/105 500
/proc/meminfo: memFree=1366912/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=101.36
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32603 0 1 0 10118 18 0 0 25 0 8 0 166139434 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073634812 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32333 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.27
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 401 0 0 0 26 1 0 0 16 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.36
Current children cumulated vsize (KiB) 915440

[startup+162.55 s]
/proc/loadavg: 2.04 2.05 1.97 3/105 500
/proc/meminfo: memFree=1342912/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=160.83
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32603 0 1 0 16065 18 0 0 25 0 8 0 166139434 937410560 32333 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073805398 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1416.26
Current children cumulated vsize (KiB) 915440

[startup+1483.55 s]
/proc/loadavg: 2.06 2.02 2.00 3/105 698
/proc/meminfo: memFree=967296/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=1476.32
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32606 0 1 0 147606 26 0 0 25 0 8 0 166139434 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073805296 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32335 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.28
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 403 0 0 0 27 1 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1476.32
Current children cumulated vsize (KiB) 915440

[startup+1543.61 s]
/proc/loadavg: 2.02 2.01 2.00 3/105 698
/proc/meminfo: memFree=967296/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=1536.33
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32606 0 1 0 153606 27 0 0 25 0 8 0 166139434 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073803887 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32335 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.28
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 403 0 0 0 27 1 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1536.33
Current children cumulated vsize (KiB) 915440

[startup+1603.71 s]
/proc/loadavg: 2.01 2.00 2.00 3/105 698
/proc/meminfo: memFree=937600/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=1596.34
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32606 0 1 0 159607 27 0 0 25 0 8 0 166139434 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073660020 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32335 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.28
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 403 0 0 0 27 1 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1596.34
Current children cumulated vsize (KiB) 915440

[startup+1663.71 s]
/proc/loadavg: 2.08 2.03 2.01 3/105 698
/proc/meminfo: memFree=937600/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=1656.34
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32606 0 1 0 165606 28 0 0 25 0 8 0 166139434 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073634812 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32335 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.28
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 403 0 0 0 27 1 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1656.34
Current children cumulated vsize (KiB) 915440

[startup+1723.72 s]
/proc/loadavg: 2.03 2.02 2.00 3/105 698
/proc/meminfo: memFree=907712/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=1716.25
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32606 0 1 0 171597 28 0 0 25 0 8 0 166139434 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073660023 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32335 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.28
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 403 0 0 0 27 1 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1716.25
Current children cumulated vsize (KiB) 915440

[startup+1783.73 s]
/proc/loadavg: 2.01 2.02 2.00 3/105 698
/proc/meminfo: memFree=907712/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=1776.25
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32606 0 1 0 177596 29 0 0 25 0 8 0 166139434 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073660020 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32335 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.28
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 403 0 0 0 27 1 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1776.25
Current children cumulated vsize (KiB) 915440



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1807.49 s]
/proc/loadavg: 2.00 2.01 2.00 3/105 698
/proc/meminfo: memFree=907712/2055920 swapFree=4191880/4192956
[pid=437] ppid=435 vsize=915440 CPUtime=1800.02
/proc/437/stat : 437 (java) R 435 437 32352 0 -1 0 32606 0 1 0 179973 29 0 0 25 0 8 0 166139434 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073844451 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/437/statm: 228860 32335 2531 14 0 215330 0
[pid=437/tid=439] ppid=435 vsize=915440 CPUtime=0.44
/proc/437/task/439/stat : 439 (java) S 435 437 32352 0 -1 64 15582 0 0 0 37 7 0 0 16 0 8 0 166139438 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=440] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/440/stat : 440 (java) S 435 437 32352 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=441] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/441/stat : 441 (java) S 435 437 32352 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 166139439 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=442] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/442/stat : 442 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=443] ppid=435 vsize=915440 CPUtime=0.28
/proc/437/task/443/stat : 443 (java) S 435 437 32352 0 -1 64 403 0 0 0 27 1 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=437/tid=444] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/444/stat : 444 (java) S 435 437 32352 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=437/tid=445] ppid=435 vsize=915440 CPUtime=0
/proc/437/task/445/stat : 445 (java) S 435 437 32352 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 166139442 937410560 32335 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 915440

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1807.55
CPU time (s): 1800.07
CPU user time (s): 1799.76
CPU system time (s): 0.316951
CPU usage (%): 99.5867
Max. virtual memory (cumulated for all children) (KiB): 915440

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.76
system time used= 0.316951
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32623
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37780
involuntary context switches= 73786

runsolver used 3.10553 s user time and 6.89095 s system time

The end

Launcher Data (download as text)

Begin job on node30 on Sun Jan  7 13:44:15 UTC 2007


IDJOB= 206735
IDBENCH= 4231
FILE ID= node30/206735-1168177455

PBS_JOBID= 3479033

Free space on /tmp= 66477 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-3-28-28/rand-3-28-28-93-632-44_ext.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/206735-1168177455/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node30/watcher-206735-1168177455 -o ROOT/results/node30/solver-206735-1168177455 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/206735-1168177455/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  f66defe44a9042bd3059afa3d35d7949

RANDOM SEED= 430450569

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1638136 kB
Buffers:         33704 kB
Cached:         196820 kB
SwapCached:        268 kB
Active:         198348 kB
Inactive:       149980 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1638136 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:            7488 kB
Writeback:           0 kB
Mapped:         143056 kB
Slab:            54092 kB
Committed_AS:  3615560 kB
PageTables:       2424 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66475 MiB



End job on node30 on Sun Jan  7 14:14:23 UTC 2007