Trace number 201699

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 109 ESAC? (TO) 1800.13 1807.39

General information on the benchmark

Namefapp/fapp11-15/fapp13/
fapp13-2000-4.xml
MD5SUM3f4c3da4d1086c239753fd2edce97a45
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of constraints25652
Maximum constraint arity2
Maximum domain size190
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25652
Global constraints used (with number of constraints)

Solver Data (download as text)

0.29	   
0.29	Abscon 109 (November, 2006)
0.29	   
0.29	   configuration
0.29	     name=esac.xml
0.32	   
0.32	   instance
0.32	     name=/tmp/evaluation/201699-1168149264/unknown.xml
0.35	   
0.35	   domains being loaded...
0.39	   
0.39	   variables being loaded...
0.60	     nbVariables=2000  nbDomainTypes=49  minDomainSize=42  maxDomainSize=190
0.60	       =>  wckTime=0.303  cpuTime=0.21  mem=20M547
0.60	   
0.60	   predicates being loaded...
0.60	   
0.60	   constraints being loaded...
138.50	     nbConstraints=13669  nbMergedConstraints=11983  nbConvertedConstraints=13669  nbConvertConstraintsChecks=239431336
138.50	     nbExtensionStructures=9933  nbSharedExtensionStructures=3736  nbConflictsStructures=9933
138.50	     nbSharedConflictsStructures=3736  nbSharedBinaryRepresentations=2761536  maxDegree=17  maxArity=2
138.50	       =>  wckTime=138.207  cpuTime=136.46  mem=109M802
138.87	   
138.87	   solver IterativeSystematicSolver being built... 
139.13	       =>  wckTime=138.837  cpuTime=136.67  mem=107M987
179.94	   
179.94	   INFO : Stopping ESAC
179.94	   
179.94	   preprocessing
179.94	     nbConstraintChecks=215270300  nbPropagations=377219  nbRevisions=2379595  nbUselessRevisions=1960274
179.94	     nbSingletonTests=5286  nbEffectiveSingletonTests=32  nbESACBranches=129  nbRemovedValues=156017
179.94	     detectedInconsistency=no
179.94	       =>  wckTime=40.794  cpuTime=40.6  mem=107M987
181.55	   
181.55	   search
181.55	     run=0  nbConstraintChecks=6654198  nbPropagations=390011  nbRevisions=2473100  nbUselessRevisions=2038525
181.55	     nbAssignments=215  nbFailedAssignments=16  nbBacktracks=15  nbVisitedNodes=237  nbRestartNogoods=0  mapSize=9
181.55	     nbInferences=0  nbTooLargeKeys=0
181.55	       =>  wckTime=42.409  cpuTime=42.2  mem=117M609
186.07	   
186.07	   search
186.07	     run=1  nbConstraintChecks=40646088  nbPropagations=844497  nbRevisions=5389008  nbUselessRevisions=4449785
186.07	     nbAssignments=1218  nbFailedAssignments=30  nbBacktracks=34  nbVisitedNodes=410  nbRestartNogoods=4  mapSize=18
186.07	     nbInferences=0  nbTooLargeKeys=0
186.07	       =>  wckTime=46.921  cpuTime=46.69  mem=123M301
187.00	   
187.00	   search
187.00	     run=2  nbConstraintChecks=45703963  nbPropagations=1307909  nbRevisions=8367988  nbUselessRevisions=6909871
187.00	     nbAssignments=1387  nbFailedAssignments=57  nbBacktracks=59  nbVisitedNodes=618  nbRestartNogoods=5  mapSize=38
187.00	     nbInferences=0  nbTooLargeKeys=0
187.00	       =>  wckTime=47.851  cpuTime=47.59  mem=98M185
188.90	   
188.90	   search
188.90	     run=3  nbConstraintChecks=56996615  nbPropagations=1790983  nbRevisions=11508254  nbUselessRevisions=9500709
188.90	     nbAssignments=1714  nbFailedAssignments=116  nbBacktracks=95  nbVisitedNodes=1026  nbRestartNogoods=7  mapSize=68
188.90	     nbInferences=0  nbTooLargeKeys=0
188.90	       =>  wckTime=49.755  cpuTime=49.48  mem=109M447
201.01	   
201.01	   search
201.01	     run=4  nbConstraintChecks=150962233  nbPropagations=2453956  nbRevisions=15862837  nbUselessRevisions=13105048
201.01	     nbAssignments=4960  nbFailedAssignments=159  nbBacktracks=147  nbVisitedNodes=1397  nbRestartNogoods=22
201.01	     mapSize=115  nbInferences=0  nbTooLargeKeys=0
201.01	       =>  wckTime=61.859  cpuTime=61.53  mem=120M506
206.05	   
206.05	   search
206.05	     run=5  nbConstraintChecks=184019143  nbPropagations=3181276  nbRevisions=20719683  nbUselessRevisions=17124428
206.05	     nbAssignments=5923  nbFailedAssignments=198  nbBacktracks=224  nbVisitedNodes=1779  nbRestartNogoods=27
206.05	     mapSize=158  nbInferences=0  nbTooLargeKeys=0
206.05	       =>  wckTime=66.906  cpuTime=66.55  mem=132M357
212.23	   
212.23	   search
212.23	     run=6  nbConstraintChecks=225629814  nbPropagations=3990120  nbRevisions=26208928  nbUselessRevisions=21666278
212.23	     nbAssignments=7160  nbFailedAssignments=265  nbBacktracks=338  nbVisitedNodes=2282  nbRestartNogoods=33
212.23	     mapSize=242  nbInferences=0  nbTooLargeKeys=0
212.23	       =>  wckTime=73.083  cpuTime=72.67  mem=114M486
220.08	   
220.08	   search
220.08	     run=7  nbConstraintChecks=281287293  nbPropagations=4905998  nbRevisions=32537539  nbUselessRevisions=26900255
220.08	     nbAssignments=8594  nbFailedAssignments=362  nbBacktracks=508  nbVisitedNodes=2909  nbRestartNogoods=40
220.08	     mapSize=335  nbInferences=0  nbTooLargeKeys=0
220.08	       =>  wckTime=80.933  cpuTime=80.49  mem=129M598
235.36	   
235.36	   search
235.36	     run=8  nbConstraintChecks=393755969  nbPropagations=6025417  nbRevisions=40443045  nbUselessRevisions=33398309
235.36	     nbAssignments=11229  nbFailedAssignments=689  nbBacktracks=764  nbVisitedNodes=4139  nbRestartNogoods=64
235.36	     mapSize=498  nbInferences=0  nbTooLargeKeys=0
235.36	       =>  wckTime=96.215  cpuTime=95.71  mem=149M672
249.51	   
249.51	   search
249.51	     run=9  nbConstraintChecks=488585770  nbPropagations=7330838  nbRevisions=49906096  nbUselessRevisions=41171336
249.51	     nbAssignments=13889  nbFailedAssignments=860  nbBacktracks=1154  nbVisitedNodes=5248  nbRestartNogoods=81
249.51	     mapSize=670  nbInferences=0  nbTooLargeKeys=0
249.51	       =>  wckTime=110.361  cpuTime=109.77  mem=143M127
257.64	   
257.65	   search
257.65	     run=10  nbConstraintChecks=535613206  nbPropagations=8733231  nbRevisions=60260832  nbUselessRevisions=49654518
257.65	     nbAssignments=15402  nbFailedAssignments=1060  nbBacktracks=1731  nbVisitedNodes=6677  nbRestartNogoods=92
257.65	     mapSize=969  nbInferences=0  nbTooLargeKeys=0
257.65	       =>  wckTime=118.5  cpuTime=117.87  mem=176M895
278.25	   
278.25	   INFO : Stopping hyperNogood (mapSize=1031, nbTooLargekeys=0, mem=163M49)
296.16	   
296.16	   search
296.16	     run=11  nbConstraintChecks=793609325  nbPropagations=10664881  nbRevisions=75171524  nbUselessRevisions=61857538
296.16	     nbAssignments=22904  nbFailedAssignments=1640  nbBacktracks=2596  nbVisitedNodes=9243  nbRestartNogoods=109
296.16	       =>  wckTime=157.011  cpuTime=156.19  mem=163M49
331.52	   
331.52	   search
331.52	     run=12  nbConstraintChecks=1053076960  nbPropagations=13066511  nbRevisions=93992276  nbUselessRevisions=77163369
331.52	     nbAssignments=29227  nbFailedAssignments=3111  nbBacktracks=3897  nbVisitedNodes=14159  nbRestartNogoods=140
331.52	       =>  wckTime=192.379  cpuTime=191.41  mem=163M416
418.25	   
418.25	   search
418.25	     run=13  nbConstraintChecks=1544078017  nbPropagations=16439309  nbRevisions=124034491  nbUselessRevisions=101352223
418.25	     nbAssignments=33508  nbFailedAssignments=4967  nbBacktracks=5843  nbVisitedNodes=20729  nbRestartNogoods=147
418.25	       =>  wckTime=279.109  cpuTime=277.74  mem=163M416
513.45	   
513.45	   search
513.45	     run=14  nbConstraintChecks=2150099622  nbPropagations=20970867  nbRevisions=165733207  nbUselessRevisions=134900883
513.45	     nbAssignments=43054  nbFailedAssignments=7956  nbBacktracks=8762  nbVisitedNodes=30785  nbRestartNogoods=171
513.45	       =>  wckTime=374.304  cpuTime=372.41  mem=163M416
645.83	   
645.83	   search
645.83	     run=15  nbConstraintChecks=3010285337  nbPropagations=27068209  nbRevisions=224569507  nbUselessRevisions=181831990
645.83	     nbAssignments=54958  nbFailedAssignments=14053  nbBacktracks=13140  nbVisitedNodes=49614  nbRestartNogoods=181
645.83	       =>  wckTime=506.688  cpuTime=504.28  mem=163M416
860.43	   
860.43	   search
860.43	     run=16  nbConstraintChecks=4438441050  nbPropagations=35584747  nbRevisions=309786538  nbUselessRevisions=249195201
860.43	     nbAssignments=76856  nbFailedAssignments=26256  nbBacktracks=19708  nbVisitedNodes=84166  nbRestartNogoods=221
860.43	       =>  wckTime=721.283  cpuTime=718.04  mem=163M416
1173.22	   
1173.22	   search
1173.22	     run=17  nbConstraintChecks=6336184060  nbPropagations=47665977  nbRevisions=436269065  nbUselessRevisions=348848597
1173.22	     nbAssignments=103128  nbFailedAssignments=39811  nbBacktracks=29560  nbVisitedNodes=126686  nbRestartNogoods=253
1173.22	       =>  wckTime=1034.074  cpuTime=1029.61  mem=163M416

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node76/watcher-201699-1168149264 -o ROOT/results/node76/solver-201699-1168149264 -C 1800 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201699-1168149264/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.01 1.54 1.82 4/74 21879
/proc/meminfo: memFree=1413024/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=1788 CPUtime=0
/proc/21878/stat : 21878 (java) D 21874 21878 21734 0 -1 0 374 0 0 0 0 0 0 0 18 0 1 0 163323499 1830912 161 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4817844 0 2147483391 4096 0 18446744072100015398 0 0 17 0 0 0
/proc/21878/statm: 447 161 126 14 0 91 0

[startup+0.102 s]
/proc/loadavg: 1.01 1.54 1.82 4/74 21879
/proc/meminfo: memFree=1413024/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=914992 CPUtime=0.07
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 2993 0 1 0 6 1 0 0 17 0 8 0 163323499 936951808 2741 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155765900 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228748 2741 1428 14 0 215242 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 914992

[startup+0.510084 s]
/proc/loadavg: 1.01 1.54 1.82 4/74 21879
/proc/meminfo: memFree=1413024/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915332 CPUtime=0.49
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 7318 0 1 0 44 5 0 0 18 0 8 0 163323499 937299968 7059 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4152815842 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228833 7059 2139 14 0 215302 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 915332

[startup+1.33225 s]
/proc/loadavg: 1.01 1.54 1.82 4/93 21899
/proc/meminfo: memFree=1323208/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1.3
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 21466 0 1 0 118 12 0 0 24 0 8 0 163323499 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073436052 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 21205 2161 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=0.08
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 4923 0 0 0 6 2 0 0 16 0 8 0 163323503 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.16
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 410 0 0 0 15 1 0 0 16 0 8 0 163323506 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 163323506 937598976 21205 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.3
Current children cumulated vsize (KiB) 915624

[startup+2.98457 s]
/proc/loadavg: 1.09 1.55 1.82 3/93 21899
/proc/meminfo: memFree=1304456/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=2.95
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 21558 0 1 0 282 13 0 0 25 0 8 0 163323499 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073820456 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 21295 2183 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=0.11
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 4923 0 0 0 9 2 0 0 17 0 8 0 163323503 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.19
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 437 0 0 0 18 1 0 0 16 0 8 0 163323506 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 163323506 937598976 21295 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 915624

[startup+6.2682 s]
/proc/loadavg: 1.09 1.55 1.82 3/93 21899
/proc/meminfo: memFree=1273992/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=6.22
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 21561 0 1 0 607 15 0 0 25 0 8 0 163323499 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073819347 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 21297 2183 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=0.11
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 4923 0 0 0 9 2 0 0 16 0 8 0 163323503 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.2
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 439 0 0 0 19 1 0 0 16 0 8 0 163323506 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 163323506 937598976 21297 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 915624

[startup+12.7485 s]
/proc/loadavg: 1.31 1.58 1.82 3/93 21899
/proc/meminfo: memFree=1221384/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=12.67
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 24181 0 1 0 1250 17 0 0 25 0 8 0 163323499 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073822024 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 23914 2183 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=0.21
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 7534 0 0 0 19 2 0 0 16 0 8 0 163323503 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.21
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 445 0 0 0 20 1 0 0 16 0 8 0 163323506 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 163323506 937598976 23914 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 915624

[startup+25.594 s]
/proc/loadavg: 1.42 1.60 1.83 3/93 21899
/proc/meminfo: memFree=1169352/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=25.47
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 24191 0 1 0 2525 22 0 0 25 0 8 0 163323499 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073820455 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 23923 2183 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=0.21
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 7534 0 0 0 19 2 0 0 16 0 8 0 163323503 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.22
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 454 0 0 0 21 1 0 0 16 0 8 0 163323506 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 163323506 937598976 23923 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 915624

[startup+51.292 s]
/proc/loadavg: 1.68 1.64 1.83 3/93 21899
/proc/meminfo: memFree=1078728/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=51.04
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 28221 0 1 0 5074 30 0 0 25 0 8 0 163323499 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073820508 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 27950 2183 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=0.47
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 11561 0 0 0 43 4 0 0 16 0 8 0 163323503 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.22
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 454 0 0 0 21 1 0 0 16 0 8 0 163323506 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 163323506 937598976 27950 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 51.04
Current children cumulated vsize (KiB) 915624

[startup+102.581 s]
/proc/loadavg: 1.90 1.71 1.84 3/93 21899
/proc/meminfo: memFree=952584/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=102.13
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 34662 0 1 0 10160 53 0 0 25 0 8 0 163323499 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073827511 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 34387 2183 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=0.82
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 17998 0 0 0 75 7 0 0 16 0 8 0 163323503 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.22
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 454 0 0 0 21 1 0 0 16 0 8 0 163323506 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 163323506 937598976 34387 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 102.13
Current children cumulated vsize (KiB) 915624

[startup+162.633 s]
/proc/loadavg: 2.05 1.79 1.86 3/93 21899
/proc/meminfo: memFree=894408/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=161.94
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 39689 0 1 0 16123 71 0 0 25 0 8 0 163323499 937598976 39406 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074149899 0 4 0 23759 18446744073709551615 0 0 17 1 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 1418.05
Current children cumulated vsize (KiB) 915624

[startup+1483.9 s]
/proc/loadavg: 2.00 2.00 1.93 3/93 22099
/proc/meminfo: memFree=687560/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1477.89
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 55806 0 1 0 147707 82 0 0 25 0 8 0 163323499 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074126787 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 55502 2548 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=1.44
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 38589 0 0 0 129 15 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.39
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 543 0 0 0 36 3 0 0 16 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0.03
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 1 2 0 0 15 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1477.89
Current children cumulated vsize (KiB) 915624

[startup+1543.96 s]
/proc/loadavg: 2.05 2.01 1.94 3/93 22099
/proc/meminfo: memFree=687624/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1537.71
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 55806 0 1 0 153689 82 0 0 25 0 8 0 163323499 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074129534 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 55502 2548 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=1.44
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 38589 0 0 0 129 15 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.39
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 543 0 0 0 36 3 0 0 16 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0.03
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 1 2 0 0 15 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1537.71
Current children cumulated vsize (KiB) 915624

[startup+1604.01 s]
/proc/loadavg: 2.02 2.01 1.94 3/93 22099
/proc/meminfo: memFree=687560/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1597.54
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 55806 0 1 0 159672 82 0 0 25 0 8 0 163323499 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074128712 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 55502 2548 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=1.44
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 38589 0 0 0 129 15 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.39
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 543 0 0 0 36 3 0 0 16 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0.03
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 1 2 0 0 15 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1597.54
Current children cumulated vsize (KiB) 915624

[startup+1664.07 s]
/proc/loadavg: 2.00 2.00 1.94 3/93 22099
/proc/meminfo: memFree=687560/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1657.36
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 55806 0 1 0 165654 82 0 0 25 0 8 0 163323499 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073323881 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 55502 2548 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=1.44
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 38589 0 0 0 129 15 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.39
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 543 0 0 0 36 3 0 0 16 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0.04
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 2 2 0 0 15 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1657.36
Current children cumulated vsize (KiB) 915624

[startup+1724.12 s]
/proc/loadavg: 2.00 2.00 1.94 3/93 22099
/proc/meminfo: memFree=687560/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1717.18
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 55806 0 1 0 171636 82 0 0 25 0 8 0 163323499 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074126102 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 55502 2548 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=1.44
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 38589 0 0 0 129 15 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.39
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 543 0 0 0 36 3 0 0 16 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0.04
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 2 2 0 0 15 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1717.18
Current children cumulated vsize (KiB) 915624

[startup+1784.18 s]
/proc/loadavg: 2.00 2.00 1.94 3/93 22099
/proc/meminfo: memFree=687496/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1777
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 55806 0 1 0 177618 82 0 0 25 0 8 0 163323499 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073323881 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 55502 2548 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=1.44
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 38589 0 0 0 129 15 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.39
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 543 0 0 0 36 3 0 0 16 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0.04
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 2 2 0 0 15 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1777
Current children cumulated vsize (KiB) 915624



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1807.32 s]
/proc/loadavg: 2.00 2.00 1.94 3/93 22099
/proc/meminfo: memFree=687496/2055888 swapFree=4095388/4096564
[pid=21878] ppid=21874 vsize=915624 CPUtime=1800.06
/proc/21878/stat : 21878 (java) R 21874 21878 21734 0 -1 0 55806 0 1 0 179924 82 0 0 25 0 8 0 163323499 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4074126095 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/21878/statm: 228906 55502 2548 14 0 215375 0
[pid=21878/tid=21886] ppid=21874 vsize=915624 CPUtime=1.44
/proc/21878/task/21886/stat : 21886 (java) S 21874 21878 21734 0 -1 64 38589 0 0 0 129 15 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21888] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21888/stat : 21888 (java) S 21874 21878 21734 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21889] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21889/stat : 21889 (java) S 21874 21878 21734 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 163323503 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21892] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21892/stat : 21892 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21893] ppid=21874 vsize=915624 CPUtime=0.39
/proc/21878/task/21893/stat : 21893 (java) S 21874 21878 21734 0 -1 64 543 0 0 0 36 3 0 0 16 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21894] ppid=21874 vsize=915624 CPUtime=0
/proc/21878/task/21894/stat : 21894 (java) S 21874 21878 21734 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=21878/tid=21895] ppid=21874 vsize=915624 CPUtime=0.04
/proc/21878/task/21895/stat : 21895 (java) S 21874 21878 21734 0 -1 64 0 0 0 0 2 2 0 0 15 0 8 0 163323506 937598976 55502 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 915624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 143
Real time (s): 1807.39
CPU time (s): 1800.13
CPU user time (s): 1799.27
CPU system time (s): 0.858869
CPU usage (%): 99.5982
Max. virtual memory (cumulated for all children) (KiB): 915628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.27
system time used= 0.858869
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 55823
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38486
involuntary context switches= 59392

runsolver used 2.16867 s user time and 4.33234 s system time

The end

Launcher Data (download as text)

Begin job on node76 on Sun Jan  7 05:54:24 UTC 2007


IDJOB= 201699
IDBENCH= 3779
FILE ID= node76/201699-1168149264

PBS_JOBID= 3478414

Free space on /tmp= 66640 MiB

BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp13/fapp13-2000-4.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201699-1168149264/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node76/watcher-201699-1168149264 -o ROOT/results/node76/solver-201699-1168149264 -C 1800 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -jar abscon109.jar esac.xml 1 XSax /tmp/evaluation/201699-1168149264/unknown.xml

META MD5SUM SOLVER= 9b91398c18c9fe54a6c4cfb50dadce08
MD5SUM BENCH=  3f4c3da4d1086c239753fd2edce97a45

RANDOM SEED= 22599874

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.254
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6006.17
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.254
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5999.42
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055888 kB
MemFree:       1413304 kB
Buffers:         55668 kB
Cached:         510248 kB
SwapCached:        456 kB
Active:         310968 kB
Inactive:       277104 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055888 kB
LowFree:       1413304 kB
SwapTotal:     4096564 kB
SwapFree:      4095388 kB
Dirty:            9196 kB
Writeback:           0 kB
Mapped:          29140 kB
Slab:            40428 kB
Committed_AS:  6045156 kB
PageTables:       1720 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264388 kB
VmallocChunk: 536606243 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66640 MiB



End job on node76 on Sun Jan  7 06:24:32 UTC 2007