Trace number 2099213

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 112v4 AC? (TO) 1800.08 1808.35

General information on the benchmark

Namecsp/rand-2-50-23/
normalized-rand-2-50-23-587-230-38_ext.xml
MD5SUMa13aa7ad6dbdebcdf12e97feed8819d9
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1443.02
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of constraints462
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension462
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data 

0.00/0.10	
0.00/0.10	Abscon 112 (May, 2008)
0.18/0.25	
0.18/0.25	   configuration
0.18/0.25	     name=mac.xml
0.28/0.33	   
0.28/0.33	   instance
0.28/0.33	     name=HOME/instance-2099213-1247417683.xml
0.28/0.37	   
0.28/0.37	   domains being loaded...
0.28/0.38	   
0.28/0.38	   variables being loaded...
0.37/0.40	     nbVariables=50  nbDomainTypes=1  minDomainSize=23  maxDomainSize=23  nbTotalValues=1150
0.37/0.40	       =>  wckTime=0.153  cpuTime=0.1  mem=7M892
0.37/0.40	   
0.37/0.40	   relations being loaded...
0.57/0.65	   
0.57/0.65	   constraints being loaded...
0.78/0.89	     nbConstraints=462  nbRelationTypes=462  nbExtensionStructures=462  nbSharedExtensionStructures=0
0.78/0.89	     nbConflictsStructures=462  nbSharedConflictsStructures=0  nbSharedBinaryRepresentations=2255  minDegree=9
0.78/0.89	     maxDegree=25  minArity=2  maxArity=2  nbGenerators=0  nbFusions=0  symmetryWckTime=0.071  symmetryCpuTime=0.05
0.78/0.89	       =>  wckTime=0.643  cpuTime=0.47  mem=23M606
0.86/0.97	   
0.86/0.97	   solver IterativeSystematicSolver being built... 
1.06/1.12	       =>  wckTime=0.87  cpuTime=0.58  mem=22M636
1.06/1.13	   
1.06/1.13	   preprocessing
1.06/1.13	     nbConstraintChecks=0  nbPropagations=50  nbRevisions=0  nbUselessRevisions=0  nbRemovedValues=0
1.06/1.13	     detectedInconsistency=no
1.06/1.13	       =>  wckTime=0.0090  cpuTime=0.0  mem=22M636
1.16/1.29	   
1.16/1.29	   INFO : Stopping use of transposition table (mapSize=101, nbTooLargekeys=0, mem=23M628)

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2099213-1247417683/watcher-2099213-1247417683 -o /tmp/evaluation-result-2099213-1247417683/solver-2099213-1247417683 -C 1800 -W 2000 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-2099213-1247417683.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.99 2.00 2.00 3/80 28621
/proc/meminfo: memFree=1709632/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=18576 CPUtime=0
/proc/28621/stat : 28621 (runsolver) R 28619 28621 28309 0 -1 4194368 16 0 0 0 0 0 0 0 19 0 1 0 28836022 19021824 284 996147200 4194304 4302564 548682068384 18446744073709551615 206381313319 0 2147483391 4096 24578 0 0 0 17 1 0 0
/proc/28621/statm: 4644 284 249 26 0 2626 0

[startup+0.108494 s]
/proc/loadavg: 1.99 2.00 2.00 3/80 28621
/proc/meminfo: memFree=1709632/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=865984 CPUtime=0.08
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 3731 0 1 0 7 1 0 0 18 0 9 0 28836022 886767616 3197 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216496 3197 1690 9 0 210981 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 865984

[startup+0.201514 s]
/proc/loadavg: 1.99 2.00 2.00 3/80 28621
/proc/meminfo: memFree=1709632/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=866144 CPUtime=0.18
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 4596 0 1 0 16 2 0 0 18 0 9 0 28836022 886931456 4013 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216536 4013 1875 9 0 211014 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 866144

[startup+0.301531 s]
/proc/loadavg: 1.99 2.00 2.00 3/80 28621
/proc/meminfo: memFree=1709632/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=866144 CPUtime=0.28
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 5658 0 1 0 25 3 0 0 18 0 9 0 28836022 886931456 5061 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216536 5061 1927 9 0 211014 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 866144

[startup+0.701603 s]
/proc/loadavg: 1.99 2.00 2.00 3/80 28621
/proc/meminfo: memFree=1709632/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867112 CPUtime=0.68
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 8595 0 1 0 63 5 0 0 18 0 9 0 28836022 887922688 7948 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216778 7948 2007 9 0 211236 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 867112

[startup+1.50175 s]
/proc/loadavg: 2.07 2.02 2.01 4/89 28634
/proc/meminfo: memFree=1673784/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=1.45
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18817 295 1 0 137 8 0 0 18 0 9 0 28836022 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11591 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=1.12
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12587 295 1 0 107 5 0 0 25 0 9 0 28836024 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4125952315 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 17 0 9 0 28836026 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.23
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 719 295 0 0 23 0 0 0 15 0 9 0 28836028 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 4 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11591 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.45
Current children cumulated vsize (KiB) 867980

[startup+3.10204 s]
/proc/loadavg: 2.07 2.02 2.01 3/89 28634
/proc/meminfo: memFree=1673336/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=3.04
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18840 295 1 0 296 8 0 0 18 0 9 0 28836022 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11612 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=2.67
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12588 295 1 0 262 5 0 0 25 0 9 0 28836024 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4126912612 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 17 0 9 0 28836026 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.26
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 741 295 0 0 26 0 0 0 15 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 4 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.04
Current children cumulated vsize (KiB) 867980

[startup+6.30162 s]
/proc/loadavg: 2.07 2.02 2.00 3/89 28634
/proc/meminfo: memFree=1673080/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=6.2
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18855 295 1 0 612 8 0 0 18 0 9 0 28836022 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11612 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=5.84
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12589 295 1 0 579 5 0 0 25 0 9 0 28836024 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4126381357 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.26
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 741 295 0 0 26 0 0 0 15 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11612 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 867980

[startup+12.7028 s]
/proc/loadavg: 2.06 2.02 2.00 3/89 28634
/proc/meminfo: memFree=1672888/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=12.54
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18857 295 1 0 1246 8 0 0 18 0 9 0 28836022 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11613 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=12.18
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12589 295 1 0 1213 5 0 0 25 0 9 0 28836024 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4126913072 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.26
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 743 295 0 0 26 0 0 0 17 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.54
Current children cumulated vsize (KiB) 867980

[startup+25.5011 s]
/proc/loadavg: 2.05 2.01 2.00 3/89 28634
/proc/meminfo: memFree=1672952/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=25.23
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18857 295 1 0 2514 9 0 0 18 0 9 0 28836022 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11613 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=24.86
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12589 295 1 0 2480 6 0 0 25 0 9 0 28836024 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4126912964 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.26
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 743 295 0 0 26 0 0 0 17 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 867980

[startup+51.1018 s]
/proc/loadavg: 2.03 2.01 2.00 3/89 28634
/proc/meminfo: memFree=1672952/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=50.58
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18857 295 1 0 5049 9 0 0 18 0 9 0 28836022 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11613 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=50.22
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12589 295 1 0 5016 6 0 0 25 0 9 0 28836024 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4126959891 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.26
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 743 295 0 0 26 0 0 0 16 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11613 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0

################
# More data... #
################

/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.27
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 748 295 0 0 27 0 0 0 16 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1474.16
Current children cumulated vsize (KiB) 867980

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.04 3/89 28681
/proc/meminfo: memFree=1732032/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=1534.14
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18864 295 1 0 153400 14 0 0 18 0 9 0 28836022 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11614 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=1533.78
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12591 295 1 0 153366 12 0 0 25 0 9 0 28836024 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4126900886 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.27
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 748 295 0 0 27 0 0 0 16 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1534.14
Current children cumulated vsize (KiB) 867980

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.03 3/89 28681
/proc/meminfo: memFree=1732032/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=1594.11
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18864 295 1 0 159396 15 0 0 18 0 9 0 28836022 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11614 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=1593.74
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12591 295 1 0 159362 12 0 0 25 0 9 0 28836024 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4126913027 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.27
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 748 295 0 0 27 0 0 0 16 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1594.11
Current children cumulated vsize (KiB) 867980

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.02 3/89 28681
/proc/meminfo: memFree=1732032/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=1654.08
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18864 295 1 0 165393 15 0 0 18 0 9 0 28836022 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11614 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=1653.71
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12591 295 1 0 165359 12 0 0 25 0 9 0 28836024 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4126941051 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.27
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 748 295 0 0 27 0 0 0 16 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1654.08
Current children cumulated vsize (KiB) 867980

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.02 3/89 28681
/proc/meminfo: memFree=1732032/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=1714.05
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18864 295 1 0 171390 15 0 0 18 0 9 0 28836022 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11614 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=1713.68
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12591 295 1 0 171356 12 0 0 25 0 9 0 28836024 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4126381335 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.27
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 748 295 0 0 27 0 0 0 16 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1714.05
Current children cumulated vsize (KiB) 867980

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.01 3/89 28681
/proc/meminfo: memFree=1732032/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=1774.02
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18864 295 1 0 177387 15 0 0 18 0 9 0 28836022 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11614 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=1773.65
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12591 295 1 0 177353 12 0 0 25 0 9 0 28836024 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4126922955 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.27
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 748 295 0 0 27 0 0 0 16 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1774.02
Current children cumulated vsize (KiB) 867980



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.3 s]
/proc/loadavg: 2.00 2.00 2.01 3/89 28681
/proc/meminfo: memFree=1732032/2055920 swapFree=4192812/4192956
[pid=28621] ppid=28619 vsize=867980 CPUtime=1800.02
/proc/28621/stat : 28621 (java) S 28619 28621 28309 0 -1 0 18864 295 1 0 179987 15 0 0 18 0 9 0 28836022 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/28621/statm: 216995 11614 2657 9 0 211431 0
[pid=28621/tid=28623] ppid=28619 vsize=867980 CPUtime=1799.65
/proc/28621/task/28623/stat : 28623 (java) R 28619 28621 28309 0 -1 64 12591 295 1 0 179953 12 0 0 25 0 9 0 28836024 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4126095963 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=28621/tid=28624] ppid=28619 vsize=867980 CPUtime=0.06
/proc/28621/task/28624/stat : 28624 (java) S 28619 28621 28309 0 -1 64 4668 295 0 0 6 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28625] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28625/stat : 28625 (java) S 28619 28621 28309 0 -1 64 19 295 0 0 0 0 0 0 17 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28626] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28626/stat : 28626 (java) S 28619 28621 28309 0 -1 64 9 295 0 0 0 0 0 0 16 0 9 0 28836026 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28627] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28627/stat : 28627 (java) S 28619 28621 28309 0 -1 64 2 295 0 0 0 0 0 0 18 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28628] ppid=28619 vsize=867980 CPUtime=0.27
/proc/28621/task/28628/stat : 28628 (java) S 28619 28621 28309 0 -1 64 748 295 0 0 27 0 0 0 16 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28629] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28629/stat : 28629 (java) S 28619 28621 28309 0 -1 64 0 295 0 0 0 0 0 0 19 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=28621/tid=28630] ppid=28619 vsize=867980 CPUtime=0
/proc/28621/task/28630/stat : 28630 (java) S 28619 28621 28309 0 -1 64 18 295 0 0 0 0 0 0 15 0 9 0 28836028 888811520 11614 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 867980

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 143
Real time (s): 1808.35
CPU time (s): 1800.08
CPU user time (s): 1799.91
CPU system time (s): 0.170974
CPU usage (%): 99.5428
Max. virtual memory (cumulated for all children) (KiB): 867980

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.91
system time used= 0.170974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19190
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37712
involuntary context switches= 74472

runsolver used 2.14567 second user time and 6.08907 second system time

The end

Launcher Data 

Begin job on node2 at 2009-07-12 18:54:43
IDJOB=2099213
IDBENCH=59997
IDSOLVER=773
FILE ID=node2/2099213-1247417683
PBS_JOBID= 9510816
Free space on /tmp= 66332 MiB

SOLVER NAME= Abscon 112v4 AC
BENCH NAME= CPAI08/csp/rand-2-50-23/normalized-rand-2-50-23-587-230-38_ext.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2099213-1247417683/watcher-2099213-1247417683 -o /tmp/evaluation-result-2099213-1247417683/solver-2099213-1247417683 -C 1800 -W 2000 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-2099213-1247417683.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= a13aa7ad6dbdebcdf12e97feed8819d9
RANDOM SEED=1768449526

node2.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1710112 kB
Buffers:         36140 kB
Cached:         126176 kB
SwapCached:          0 kB
Active:         224616 kB
Inactive:        69384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1710112 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            2416 kB
Writeback:           0 kB
Mapped:         152124 kB
Slab:            36756 kB
Committed_AS:   992812 kB
PageTables:       2120 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66332 MiB
End job on node2 at 2009-07-12 19:24:54