Trace number 201247

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 AC? (TO) 1800.15 1811.51

General information on the benchmark

Namefapp/fapp11-15/fapp12/
fapp12-1500-2.xml
MD5SUMa9559a77dc2a348044495e00f4dfba11
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of constraints25409
Maximum constraint arity2
Maximum domain size310
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25409
Global constraints used (with number of constraints)

Solver Data (download as text)

0.37	   
0.37	Abscon 109 (November, 2006)
0.37	   
0.37	   configuration
0.37	     name=mac.xml
0.40	   
0.40	   instance
0.40	     name=/tmp/evaluation/201247-1168072277/unknown.xml
0.43	   
0.43	   domains being loaded...
0.46	   
0.46	   variables being loaded...
0.69	     nbVariables=1500  nbDomainTypes=13  minDomainSize=42  maxDomainSize=310
0.69	       =>  wckTime=0.315  cpuTime=0.22  mem=22M513
0.69	   
0.69	   predicates being loaded...
0.69	   
0.69	   constraints being loaded...
4.63	   
4.63	   INFO : Stopping converting binary constraints (cpu=4.01, mem = 44M490)
7.90	     nbConstraints=13439  nbMergedConstraints=11970  nbConvertedConstraints=65  nbConvertConstraintsChecks=5245200
7.90	     nbExtensionStructures=58  nbSharedExtensionStructures=7  nbConflictsStructures=58  nbSharedConflictsStructures=7
7.90	     nbSharedBinaryRepresentations=19285  nbEvaluationManagers=9682  nbSharedEvaluationManagers=3692  maxDegree=22
7.90	     maxArity=2
7.90	       =>  wckTime=7.529  cpuTime=6.83  mem=66M537
8.10	   
8.10	   solver IterativeSystematicSolver being built... 
8.61	       =>  wckTime=8.239  cpuTime=7.18  mem=84M937
45.92	   
45.92	   preprocessing
45.92	     nbConstraintChecks=63165359  nbValidityChecks=2664735  nbPropagations=2251  nbRevisions=47292
45.92	     nbUselessRevisions=41766  nbRemovedValues=272354  detectedInconsistency=no
45.92	       =>  wckTime=37.289  cpuTime=36.92  mem=84M937
48.93	   
48.93	   search
48.93	     run=0  nbConstraintChecks=4151896  nbValidityChecks=4136661  nbPropagations=4729  nbRevisions=89433
48.93	     nbUselessRevisions=80335  nbAssignments=56  nbFailedAssignments=24  nbBacktracks=12  nbVisitedNodes=89
48.93	     nbRestartNogoods=0  mapSize=0  nbInferences=0  nbTooLargeKeys=32
48.93	       =>  wckTime=40.305  cpuTime=39.88  mem=85M943
59.25	   
59.25	   search
59.25	     run=1  nbConstraintChecks=18537566  nbValidityChecks=18378474  nbPropagations=23050  nbRevisions=426027
59.25	     nbUselessRevisions=383765  nbAssignments=206  nbFailedAssignments=42  nbBacktracks=31  nbVisitedNodes=264
59.25	     nbRestartNogoods=1  mapSize=0  nbInferences=0  nbTooLargeKeys=164
59.25	       =>  wckTime=50.624  cpuTime=50.1  mem=85M943
64.07	   
64.07	   search
64.07	     run=2  nbConstraintChecks=23991313  nbValidityChecks=32948357  nbPropagations=55754  nbRevisions=1025060
64.07	     nbUselessRevisions=924633  nbAssignments=368  nbFailedAssignments=60  nbBacktracks=60  nbVisitedNodes=463
64.07	     nbRestartNogoods=10  mapSize=0  nbInferences=0  nbTooLargeKeys=308
64.07	       =>  wckTime=55.439  cpuTime=54.87  mem=85M943
69.33	   
69.33	   search
69.33	     run=3  nbConstraintChecks=29871384  nbValidityChecks=49094628  nbPropagations=104402  nbRevisions=1922553
69.33	     nbUselessRevisions=1734119  nbAssignments=544  nbFailedAssignments=83  nbBacktracks=93  nbVisitedNodes=678
69.33	     nbRestartNogoods=15  mapSize=0  nbInferences=0  nbTooLargeKeys=461
69.33	       =>  wckTime=60.707  cpuTime=60.09  mem=85M943
74.74	   
74.74	   search
74.74	     run=4  nbConstraintChecks=35889692  nbValidityChecks=65715782  nbPropagations=170091  nbRevisions=3137354
74.74	     nbUselessRevisions=2828072  nbAssignments=731  nbFailedAssignments=109  nbBacktracks=143  nbVisitedNodes=915
74.74	     nbRestartNogoods=25  mapSize=0  nbInferences=0  nbTooLargeKeys=622
74.74	       =>  wckTime=66.113  cpuTime=65.43  mem=85M943
82.19	   
82.19	   search
82.19	     run=5  nbConstraintChecks=43900215  nbValidityChecks=87664394  nbPropagations=260107  nbRevisions=4818647
82.19	     nbUselessRevisions=4337303  nbAssignments=975  nbFailedAssignments=159  nbBacktracks=222  nbVisitedNodes=1253
82.19	     nbRestartNogoods=31  mapSize=0  nbInferences=0  nbTooLargeKeys=816
82.19	       =>  wckTime=73.561  cpuTime=72.82  mem=85M943
89.67	   
89.67	   search
89.67	     run=6  nbConstraintChecks=53892260  nbValidityChecks=102593284  nbPropagations=362111  nbRevisions=6700725
89.67	     nbUselessRevisions=6031447  nbAssignments=1219  nbFailedAssignments=211  nbBacktracks=337  nbVisitedNodes=1592
89.67	     nbRestartNogoods=41  mapSize=0  nbInferences=0  nbTooLargeKeys=1008
89.67	       =>  wckTime=81.044  cpuTime=80.22  mem=85M943
96.95	   
96.95	   INFO : Stopping hyperNogood (mapSize=0, nbTooLargekeys=1150, mem=85M943)
107.28	   
107.28	   search
107.28	     run=7  nbConstraintChecks=76492757  nbValidityChecks=141925303  nbPropagations=499016  nbRevisions=9208582
107.28	     nbUselessRevisions=8288256  nbAssignments=1792  nbFailedAssignments=462  nbBacktracks=515  nbVisitedNodes=2499
107.28	     nbRestartNogoods=53
107.28	       =>  wckTime=98.65  cpuTime=97.66  mem=85M943
121.42	   
121.42	   search
121.42	     run=8  nbConstraintChecks=92228573  nbValidityChecks=174915970  nbPropagations=681462  nbRevisions=12585917
121.42	     nbUselessRevisions=11293382  nbAssignments=2337  nbFailedAssignments=637  nbBacktracks=772  nbVisitedNodes=3286
121.42	     nbRestartNogoods=79
121.42	       =>  wckTime=112.79  cpuTime=111.66  mem=85M943
141.93	   
141.93	   search
141.93	     run=9  nbConstraintChecks=112780629  nbValidityChecks=228872346  nbPropagations=940814  nbRevisions=17465630
141.93	     nbUselessRevisions=15572079  nbAssignments=3269  nbFailedAssignments=1078  nbBacktracks=1157  nbVisitedNodes=4784
141.93	     nbRestartNogoods=97
141.93	       =>  wckTime=133.303  cpuTime=131.98  mem=85M943
162.75	   
162.75	   search
162.75	     run=10  nbConstraintChecks=136798051  nbValidityChecks=287258701  nbPropagations=1262326  nbRevisions=23491573
162.75	     nbUselessRevisions=20871927  nbAssignments=4380  nbFailedAssignments=1553  nbBacktracks=1737  nbVisitedNodes=6562
162.75	     nbRestartNogoods=99
162.75	       =>  wckTime=154.121  cpuTime=152.61  mem=85M943
226.29	   
226.29	   search
226.29	     run=11  nbConstraintChecks=210095810  nbValidityChecks=489363008  nbPropagations=1795795  nbRevisions=33470082
226.29	     nbUselessRevisions=29706965  nbAssignments=6784  nbFailedAssignments=3040  nbBacktracks=2601  nbVisitedNodes=10885
226.29	     nbRestartNogoods=135
226.29	       =>  wckTime=217.662  cpuTime=215.58  mem=85M943
354.27	   
354.27	   search
354.27	     run=12  nbConstraintChecks=351781519  nbValidityChecks=834543863  nbPropagations=2719905  nbRevisions=50897271
354.27	     nbUselessRevisions=44939769  nbAssignments=10480  nbFailedAssignments=5327  nbBacktracks=3898  nbVisitedNodes=17431
354.27	     nbRestartNogoods=157
354.27	       =>  wckTime=345.639  cpuTime=342.39  mem=85M943
484.46	   
484.46	   search
484.46	     run=13  nbConstraintChecks=491684224  nbValidityChecks=1179620316  nbPropagations=4036564  nbRevisions=75950652
484.46	     nbUselessRevisions=66723826  nbAssignments=15737  nbFailedAssignments=8499  nbBacktracks=5845  nbVisitedNodes=26736
484.46	     nbRestartNogoods=206
484.46	       =>  wckTime=475.829  cpuTime=471.4  mem=85M943
715.89	   
715.89	   search
715.89	     run=14  nbConstraintChecks=742840462  nbValidityChecks=1852431838  nbPropagations=6148392  nbRevisions=116055425
715.89	     nbUselessRevisions=101704980  nbAssignments=23418  nbFailedAssignments=13157  nbBacktracks=8765
715.89	     nbVisitedNodes=40401  nbRestartNogoods=253
715.89	       =>  wckTime=707.267  cpuTime=701.18  mem=85M943
1284.68	   
1284.68	   search
1284.68	     run=15  nbConstraintChecks=1394707197  nbValidityChecks=3340442797  nbPropagations=9860093  nbRevisions=187418945
1284.68	     nbUselessRevisions=163679270  nbAssignments=38768  nbFailedAssignments=24048  nbBacktracks=13143
1284.68	     nbVisitedNodes=68989  nbRestartNogoods=274
1284.68	       =>  wckTime=1276.051  cpuTime=1267.32  mem=85M943

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node30/watcher-201247-1168072277 -o ROOT/results/node30/solver-201247-1168072277 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201247-1168072277/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.87 1.94 1.83 3/93 2402
/proc/meminfo: memFree=1058336/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=18540 CPUtime=0
/proc/2401/stat : 2401 (runsolver) R 2399 2401 1950 0 -1 4194368 17 0 0 0 0 0 0 0 21 0 1 0 155621768 18984960 280 18446744073709551615 4194304 4267372 548682068960 18446744073709551615 264907582759 0 2147483391 4096 24578 0 0 0 17 0 0 0
/proc/2401/statm: 4635 280 244 17 0 2626 0

[startup+0.107505 s]
/proc/loadavg: 1.87 1.94 1.83 3/93 2402
/proc/meminfo: memFree=1058336/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=907808 CPUtime=0.04
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 2429 0 1 0 3 1 0 0 20 0 4 0 155621768 929595392 2176 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155340661 0 4 0 7368 18446744073709551615 0 0 17 0 0 0
/proc/2401/statm: 226952 2176 1203 14 0 214535 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 907808

[startup+0.51553 s]
/proc/loadavg: 1.87 1.94 1.83 3/93 2402
/proc/meminfo: memFree=1058336/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915328 CPUtime=0.41
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 6435 0 1 0 38 3 0 0 22 0 8 0 155621768 937295872 6174 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2401/statm: 228832 6174 2138 14 0 215302 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 915328

[startup+1.33659 s]
/proc/loadavg: 1.87 1.94 1.83 3/100 2409
/proc/meminfo: memFree=987176/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915616 CPUtime=1.22
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 22178 0 1 0 112 10 0 0 25 0 8 0 155621768 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4153380189 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2401/statm: 228904 21915 2160 14 0 215374 0
[pid=2401/tid=2403] ppid=2399 vsize=915616 CPUtime=0.07
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 5635 0 0 0 6 1 0 0 16 0 8 0 155621776 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915616 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915616 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155621777 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915616 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915616 CPUtime=0.16
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 408 0 0 0 16 0 0 0 16 0 8 0 155621780 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915616 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915616 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937590784 21915 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 915616

[startup+2.97668 s]
/proc/loadavg: 1.87 1.94 1.83 3/100 2409
/proc/meminfo: memFree=978728/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=2.85
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 22255 0 1 0 274 11 0 0 25 0 8 0 155621768 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073837671 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/2401/statm: 228936 21990 2180 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.1
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 5635 0 0 0 9 1 0 0 17 0 8 0 155621776 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.18
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 422 0 0 0 18 0 0 0 15 0 8 0 155621780 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 21990 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.85
Current children cumulated vsize (KiB) 915744

[startup+6.27109 s]
/proc/loadavg: 1.88 1.94 1.83 2/90 2455
/proc/meminfo: memFree=1102264/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=6.14
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 26169 0 1 0 598 16 0 0 18 0 8 0 155621768 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4154171057 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 25901 2182 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.28
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 9519 0 0 0 24 4 0 0 16 0 8 0 155621776 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.22
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 448 0 0 0 21 1 0 0 16 0 8 0 155621780 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 25901 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.14
Current children cumulated vsize (KiB) 915744

[startup+12.7605 s]
/proc/loadavg: 1.97 1.96 1.83 3/100 2465
/proc/meminfo: memFree=956016/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=12.56
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37614 0 1 0 1235 21 0 0 25 0 8 0 155621768 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073836912 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37338 2533 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20486 0 0 0 65 8 0 0 17 0 8 0 155621776 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.33
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 507 0 0 0 32 1 0 0 16 0 8 0 155621780 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37338 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 915744

[startup+25.6023 s]
/proc/loadavg: 1.98 1.96 1.84 3/100 2465
/proc/meminfo: memFree=914736/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=25.29
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37616 0 1 0 2508 21 0 0 25 0 8 0 155621768 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073831542 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37339 2533 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20486 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.33
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 508 0 0 0 32 1 0 0 16 0 8 0 155621780 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37339 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.29
Current children cumulated vsize (KiB) 915744

[startup+51.2189 s]
/proc/loadavg: 1.98 1.96 1.84 3/100 2465
/proc/meminfo: memFree=914928/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=50.66
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37641 0 1 0 5045 21 0 0 25 0 8 0 155621768 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073836003 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37359 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.35
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 522 0 0 0 34 1 0 0 15 0 8 0 155621780 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37359 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 915744

[startup+102.475 s]
/proc/loadavg: 1.99 1.97 1.84 3/100 2465
/proc/meminfo: memFree=914864/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=101.45
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37660 0 1 0 10123 22 0 0 25 0 8 0 155621768 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073336160 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37370 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.39
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 537 0 0 0 37 2 0 0 15 0 8 0 155621780 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37370 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.45
Current children cumulated vsize (KiB) 915744

[startup+162.489 s]
/proc/loadavg: 1.99 1.97 1.85 3/100 2465
/proc/meminfo: memFree=914800/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=160.92
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37675 0 1 0 16070 22 0 0 25 0 8 0 155621768 937721856 37377 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074143765 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1413.23
Current children cumulated vsize (KiB) 915744

[startup+1482.67 s]
/proc/loadavg: 2.08 2.04 1.95 3/100 2465
/proc/meminfo: memFree=914672/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=1472.95
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37677 0 1 0 147263 32 0 0 25 0 8 0 155621768 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073832830 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37379 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.41
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 552 0 0 0 39 2 0 0 16 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1472.95
Current children cumulated vsize (KiB) 915744

[startup+1542.68 s]
/proc/loadavg: 2.03 2.03 1.95 3/100 2465
/proc/meminfo: memFree=914672/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=1532.68
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37677 0 1 0 153236 32 0 0 25 0 8 0 155621768 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073837083 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37379 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.41
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 552 0 0 0 39 2 0 0 16 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1532.68
Current children cumulated vsize (KiB) 915744

[startup+1602.68 s]
/proc/loadavg: 2.01 2.02 1.95 3/100 2465
/proc/meminfo: memFree=914608/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=1592.41
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37677 0 1 0 159208 33 0 0 25 0 8 0 155621768 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073336169 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37379 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.41
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 552 0 0 0 39 2 0 0 16 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1592.41
Current children cumulated vsize (KiB) 915744

[startup+1662.69 s]
/proc/loadavg: 2.00 2.02 1.95 3/100 2465
/proc/meminfo: memFree=914672/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=1652.13
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37677 0 1 0 165180 33 0 0 25 0 8 0 155621768 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074153274 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37379 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.41
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 552 0 0 0 39 2 0 0 16 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1652.13
Current children cumulated vsize (KiB) 915744

[startup+1722.69 s]
/proc/loadavg: 2.00 2.01 1.95 3/100 2465
/proc/meminfo: memFree=914672/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=1711.86
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37677 0 1 0 171152 34 0 0 25 0 8 0 155621768 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074153274 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37379 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.41
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 552 0 0 0 39 2 0 0 16 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1711.86
Current children cumulated vsize (KiB) 915744

[startup+1782.7 s]
/proc/loadavg: 2.03 2.02 1.96 3/100 2465
/proc/meminfo: memFree=914608/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=1771.55
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37677 0 1 0 177121 34 0 0 25 0 8 0 155621768 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074150820 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37379 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.41
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 552 0 0 0 39 2 0 0 16 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1771.55
Current children cumulated vsize (KiB) 915744



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1811.42 s]
/proc/loadavg: 2.02 2.02 1.96 3/106 2581
/proc/meminfo: memFree=913248/2055920 swapFree=4191880/4192956
[pid=2401] ppid=2399 vsize=915744 CPUtime=1800.06
/proc/2401/stat : 2401 (java) R 2399 2401 1950 0 -1 0 37677 0 1 0 179972 34 0 0 25 0 8 0 155621768 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074223240 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/2401/statm: 228936 37379 2537 14 0 215406 0
[pid=2401/tid=2403] ppid=2399 vsize=915744 CPUtime=0.73
/proc/2401/task/2403/stat : 2403 (java) S 2399 2401 1950 0 -1 64 20487 0 0 0 65 8 0 0 16 0 8 0 155621776 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2404] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2404/stat : 2404 (java) S 2399 2401 1950 0 -1 64 10 0 0 0 0 0 0 0 16 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2405] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2405/stat : 2405 (java) S 2399 2401 1950 0 -1 64 6 0 0 0 0 0 0 0 15 0 8 0 155621777 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2406] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2406/stat : 2406 (java) S 2399 2401 1950 0 -1 64 0 0 0 0 0 0 0 0 22 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2407] ppid=2399 vsize=915744 CPUtime=0.41
/proc/2401/task/2407/stat : 2407 (java) S 2399 2401 1950 0 -1 64 552 0 0 0 39 2 0 0 16 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=2401/tid=2408] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2408/stat : 2408 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 23 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=2401/tid=2409] ppid=2399 vsize=915744 CPUtime=0
/proc/2401/task/2409/stat : 2409 (java) S 2399 2401 1950 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 155621780 937721856 37379 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 915744

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1811.51
CPU time (s): 1800.15
CPU user time (s): 1799.78
CPU system time (s): 0.370943
CPU usage (%): 99.3729
Max. virtual memory (cumulated for all children) (KiB): 915744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.78
system time used= 0.370943
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 37693
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38431
involuntary context switches= 70228

runsolver used 2.36364 s user time and 5.66214 s system time

The end

Launcher Data (download as text)

Begin job on node30 on Sat Jan  6 08:31:17 UTC 2007


IDJOB= 201247
IDBENCH= 3752
FILE ID= node30/201247-1168072277

PBS_JOBID= 3475943

Free space on /tmp= 66474 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp12/fapp12-1500-2.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201247-1168072277/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node30/watcher-201247-1168072277 -o ROOT/results/node30/solver-201247-1168072277 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar mac.xml 1 XSax /tmp/evaluation/201247-1168072277/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  a9559a77dc2a348044495e00f4dfba11

RANDOM SEED= 905961090

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1058944 kB
Buffers:         50264 kB
Cached:         663672 kB
SwapCached:        268 kB
Active:         324884 kB
Inactive:       584584 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1058944 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:           11408 kB
Writeback:           0 kB
Mapped:         223272 kB
Slab:            71960 kB
Committed_AS:  3853336 kB
PageTables:       2548 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66475 MiB



End job on node30 on Sat Jan  6 09:01:30 UTC 2007