Trace number 2093573

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 112v4 AC? (TO) 1800.08 1816.95

General information on the benchmark

Namecsp/magicSquare/
normalized-magicSquare-12_glb.xml
MD5SUMcd5b883393acd0fa1b14ec778755c15e
Bench CategoryAlldiff+Elt+WSum (alldiff,element,weightedsum)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.97755
Satisfiable
(Un)Satisfiability was proved
Number of variables144
Number of constraints27
Maximum constraint arity144
Maximum domain size144
Number of constraints which are defined in extension0
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)alldifferent(1),weightedsum(26)

Solver Data 

0.03/0.09	
0.03/0.09	Abscon 112 (May, 2008)
0.18/0.24	
0.18/0.24	   configuration
0.18/0.24	     name=mac.xml
0.28/0.32	   
0.28/0.32	   instance
0.28/0.32	     name=HOME/instance-2093573-1247401509.xml
0.28/0.36	   
0.28/0.36	   domains being loaded...
0.28/0.37	   
0.28/0.37	   variables being loaded...
0.38/0.42	     nbVariables=144  nbDomainTypes=1  minDomainSize=144  maxDomainSize=144  nbTotalValues=20736
0.38/0.42	       =>  wckTime=0.178  cpuTime=0.13  mem=8M868
0.38/0.42	   
0.38/0.42	   constraints being loaded...
0.57/0.63	     nbConstraints=61  nbGlobalConstraints=61  nbSharedBinaryRepresentations=0  minDegree=9  maxDegree=11  minArity=12
0.57/0.63	     avgArity=23.87  maxArity=144  nbGenerators=8  nbFusions=0  symmetryWckTime=0.167  symmetryCpuTime=0.08
0.57/0.63	       =>  wckTime=0.389  cpuTime=0.26  mem=13M753
0.57/0.69	   
0.57/0.69	   solver IterativeSystematicSolver being built... 
0.67/0.76	   
0.67/0.76	   INFO : Forward propagation technique limited 
0.77/0.84	       =>  wckTime=0.598  cpuTime=0.39  mem=21M42
0.77/0.85	   
0.77/0.85	   preprocessing
0.77/0.85	     nbConstraintChecks=0  nbPropagations=144  nbRevisions=0  nbUselessRevisions=0  nbRemovedValues=0
0.77/0.85	     detectedInconsistency=no
0.77/0.85	       =>  wckTime=0.01  cpuTime=0.01  mem=21M42
1.56/1.63	   
1.56/1.63	   INFO : Stopping use of transposition table (mapSize=101, nbTooLargekeys=0, mem=22M83)

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2093573-1247401509/watcher-2093573-1247401509 -o /tmp/evaluation-result-2093573-1247401509/solver-2093573-1247401509 -C 1800 -W 2000 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-2093573-1247401509.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 1.48 0.71 4/80 27640
/proc/meminfo: memFree=1778560/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=10764 CPUtime=0
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 740 0 0 0 0 0 0 0 18 0 2 0 27214864 11022336 520 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16784584 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 2691 520 240 9 0 1196 0
[pid=27640/tid=27641] ppid=27638 vsize=10764 CPUtime=0
/proc/27640/task/27641/stat : 27641 (java) D 27638 27640 27396 0 -1 64 62 0 0 0 0 0 0 0 18 0 2 0 27214865 11022336 520 996147200 134512640 134550932 4294955968 18446744073709551615 8106788 0 2147483391 0 16784584 18446744072099937270 0 0 -1 1 0 0

[startup+0.053576 s]
/proc/loadavg: 2.01 1.48 0.71 4/80 27640
/proc/meminfo: memFree=1778560/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=861936 CPUtime=0.03
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 2383 0 1 0 2 1 0 0 18 0 5 0 27214864 882622464 1963 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800971 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 215484 1964 902 9 0 210399 0
[pid=27640/tid=27641] ppid=27638 vsize=861936 CPUtime=0.03
/proc/27640/task/27641/stat : 27641 (java) D 27638 27640 27396 0 -1 64 1691 0 1 0 2 1 0 0 17 0 5 0 27214865 882622464 1964 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 2147483391 0 16800971 18446744072099937270 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 861936

[startup+0.106329 s]
/proc/loadavg: 2.01 1.48 0.71 4/80 27640
/proc/meminfo: memFree=1778560/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=865984 CPUtime=0.09
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 3770 0 1 0 7 2 0 0 18 0 9 0 27214864 886767616 3225 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216496 3225 1701 9 0 210981 0
[pid=27640/tid=27641] ppid=27638 vsize=865984 CPUtime=0.07
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 2862 0 1 0 6 1 0 0 18 0 9 0 27214865 886767616 3225 996147200 134512640 134550932 4294955968 18446744073709551615 4125975838 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 865984

[startup+0.301351 s]
/proc/loadavg: 2.01 1.48 0.71 4/80 27640
/proc/meminfo: memFree=1778560/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=866144 CPUtime=0.28
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 5660 0 1 0 25 3 0 0 18 0 9 0 27214864 886931456 5063 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216536 5063 1927 9 0 211014 0
[pid=27640/tid=27641] ppid=27638 vsize=866144 CPUtime=0.25
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 4727 0 1 0 22 3 0 0 19 0 9 0 27214865 886931456 5063 996147200 134512640 134550932 4294955968 18446744073709551615 8106788 0 2147483391 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 866144

[startup+0.701397 s]
/proc/loadavg: 2.01 1.48 0.71 4/80 27640
/proc/meminfo: memFree=1778560/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867368 CPUtime=0.67
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 11304 308 1 0 62 5 0 0 18 0 9 0 27214864 888184832 8157 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216842 8157 2651 9 0 211278 0
[pid=27640/tid=27641] ppid=27638 vsize=867368 CPUtime=0.49
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 7525 308 1 0 46 3 0 0 20 0 9 0 27214865 888184832 8157 996147200 134512640 134550932 4294955968 18446744073709551615 104199263 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 867368

[startup+1.50148 s]
/proc/loadavg: 2.17 1.53 0.73 3/89 27653
/proc/meminfo: memFree=1746424/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867368 CPUtime=1.46
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15570 308 1 0 139 7 0 0 18 0 9 0 27214864 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216842 10648 2656 9 0 211278 0
[pid=27640/tid=27641] ppid=27638 vsize=867368 CPUtime=1.2
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11685 308 1 0 115 5 0 0 25 0 9 0 27214865 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4126779567 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867368 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867368 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867368 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867368 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867368 CPUtime=0.18
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 688 308 0 0 18 0 0 0 15 0 9 0 27214869 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867368 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867368 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888184832 10648 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 867368

[startup+3.10166 s]
/proc/loadavg: 2.17 1.53 0.73 3/89 27653
/proc/meminfo: memFree=1746104/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=3.04
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15605 308 1 0 297 7 0 0 18 0 9 0 27214864 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10681 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=2.77
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11699 308 1 0 272 5 0 0 25 0 9 0 27214865 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4126780596 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 17 0 9 0 27214866 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.21
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 709 308 0 0 21 0 0 0 15 0 9 0 27214869 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10681 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.04
Current children cumulated vsize (KiB) 867500

[startup+6.30302 s]
/proc/loadavg: 2.15 1.53 0.74 3/89 27653
/proc/meminfo: memFree=1745720/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=6.21
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15620 308 1 0 614 7 0 0 18 0 9 0 27214864 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10693 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=5.93
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11710 308 1 0 588 5 0 0 25 0 9 0 27214865 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4126781816 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 713 308 0 0 22 0 0 0 15 0 9 0 27214869 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10693 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 867500

[startup+12.7027 s]
/proc/loadavg: 2.14 1.54 0.74 3/89 27653
/proc/meminfo: memFree=1745528/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=12.55
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15628 308 1 0 1248 7 0 0 18 0 9 0 27214864 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10701 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=12.26
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11718 308 1 0 1221 5 0 0 25 0 9 0 27214865 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4126781863 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 713 308 0 0 22 0 0 0 15 0 9 0 27214869 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) R 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10701 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 867500

[startup+25.5012 s]
/proc/loadavg: 2.11 1.56 0.76 3/89 27653
/proc/meminfo: memFree=1745464/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=25.23
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15644 308 1 0 2516 7 0 0 18 0 9 0 27214864 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10715 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=24.93
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11732 308 1 0 2488 5 0 0 25 0 9 0 27214865 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4126779554 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 715 308 0 0 22 0 0 0 17 0 9 0 27214869 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10715 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 867500

[startup+51.1011 s]
/proc/loadavg: 2.07 1.60 0.79 3/89 27653
/proc/meminfo: memFree=1745272/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=50.59
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15694 308 1 0 5052 7 0 0 18 0 9 0 27214864 888320000 10765 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10765 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=50.3
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11782 308 1 0 5025 5 0 0 25 0 9 0 27214865 888320000 10765 996147200 134512640 134550932 4294955968 18446744073709551615 4126781816 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10765 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0

################
# More data... #
################

/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 716 308 0 0 22 0 0 0 16 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1527.99
Current children cumulated vsize (KiB) 867500

[startup+1602.3 s]
/proc/loadavg: 1.98 1.95 1.73 3/89 27735
/proc/meminfo: memFree=1747960/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=1587.42
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15866 308 1 0 158727 15 0 0 18 0 9 0 27214864 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10936 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=1587.13
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11953 308 1 0 158700 13 0 0 25 0 9 0 27214865 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4126847388 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 716 308 0 0 22 0 0 0 16 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1587.42
Current children cumulated vsize (KiB) 867500

[startup+1662.3 s]
/proc/loadavg: 1.99 1.96 1.74 3/89 27735
/proc/meminfo: memFree=1747896/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=1646.86
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15866 308 1 0 164671 15 0 0 18 0 9 0 27214864 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10936 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=1646.57
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11953 308 1 0 164644 13 0 0 25 0 9 0 27214865 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4126095957 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 716 308 0 0 22 0 0 0 16 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1646.86
Current children cumulated vsize (KiB) 867500

[startup+1722.3 s]
/proc/loadavg: 1.99 1.97 1.75 3/89 27735
/proc/meminfo: memFree=1747896/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=1706.3
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15866 308 1 0 170615 15 0 0 18 0 9 0 27214864 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10936 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=1706.01
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11953 308 1 0 170588 13 0 0 25 0 9 0 27214865 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4126095957 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 716 308 0 0 22 0 0 0 16 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1706.3
Current children cumulated vsize (KiB) 867500

[startup+1782.3 s]
/proc/loadavg: 1.99 1.97 1.76 3/89 27735
/proc/meminfo: memFree=1747832/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=1765.74
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15866 308 1 0 176559 15 0 0 18 0 9 0 27214864 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10936 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=1765.45
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11953 308 1 0 176532 13 0 0 25 0 9 0 27214865 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4126857665 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 716 308 0 0 22 0 0 0 16 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1765.74
Current children cumulated vsize (KiB) 867500



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1816.9 s]
/proc/loadavg: 1.99 1.97 1.77 3/89 27735
/proc/meminfo: memFree=1747832/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=1800.02
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15866 308 1 0 179987 15 0 0 18 0 9 0 27214864 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10936 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=1799.72
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11953 308 1 0 179959 13 0 0 25 0 9 0 27214865 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4126850631 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 716 308 0 0 22 0 0 0 16 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 867500

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1816.9 s]
/proc/loadavg: 1.99 1.97 1.77 3/89 27735
/proc/meminfo: memFree=1747832/2055920 swapFree=4192812/4192956
[pid=27640] ppid=27638 vsize=867500 CPUtime=1800.02
/proc/27640/stat : 27640 (java) S 27638 27640 27396 0 -1 0 15866 308 1 0 179987 15 0 0 18 0 9 0 27214864 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/27640/statm: 216875 10936 2656 9 0 211311 0
[pid=27640/tid=27641] ppid=27638 vsize=867500 CPUtime=1799.72
/proc/27640/task/27641/stat : 27641 (java) R 27638 27640 27396 0 -1 64 11953 308 1 0 179959 13 0 0 25 0 9 0 27214865 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4126850631 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27643] ppid=27638 vsize=867500 CPUtime=0.04
/proc/27640/task/27643/stat : 27643 (java) S 27638 27640 27396 0 -1 64 2351 308 0 0 4 0 0 0 16 0 9 0 27214866 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27644] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27644/stat : 27644 (java) S 27638 27640 27396 0 -1 64 17 308 0 0 0 0 0 0 16 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27645] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27645/stat : 27645 (java) S 27638 27640 27396 0 -1 64 8 308 0 0 0 0 0 0 15 0 9 0 27214867 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27646] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27646/stat : 27646 (java) S 27638 27640 27396 0 -1 64 2 308 0 0 0 0 0 0 18 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27647] ppid=27638 vsize=867500 CPUtime=0.22
/proc/27640/task/27647/stat : 27647 (java) S 27638 27640 27396 0 -1 64 716 308 0 0 22 0 0 0 16 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27648] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27648/stat : 27648 (java) S 27638 27640 27396 0 -1 64 1 308 0 0 0 0 0 0 19 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=27640/tid=27649] ppid=27638 vsize=867500 CPUtime=0
/proc/27640/task/27649/stat : 27649 (java) S 27638 27640 27396 0 -1 64 11 308 0 0 0 0 0 0 15 0 9 0 27214869 888320000 10936 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 867500

Child status: 143
Real time (s): 1816.95
CPU time (s): 1800.08
CPU user time (s): 1799.91
CPU system time (s): 0.169974
CPU usage (%): 99.0718
Max. virtual memory (cumulated for all children) (KiB): 867500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.91
system time used= 0.169974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16205
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37688
involuntary context switches= 70454

runsolver used 2.20366 second user time and 6.07408 second system time

The end

Launcher Data 

Begin job on node62 at 2009-07-12 14:25:09
IDJOB=2093573
IDBENCH=53645
IDSOLVER=773
FILE ID=node62/2093573-1247401509
PBS_JOBID= 9510521
Free space on /tmp= 66348 MiB

SOLVER NAME= Abscon 112v4 AC
BENCH NAME= CPAI08/csp/magicSquare/normalized-magicSquare-12_glb.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2093573-1247401509/watcher-2093573-1247401509 -o /tmp/evaluation-result-2093573-1247401509/solver-2093573-1247401509 -C 1800 -W 2000 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-2093573-1247401509.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= cd5b883393acd0fa1b14ec778755c15e
RANDOM SEED=1675277135

node62.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1779040 kB
Buffers:         30304 kB
Cached:         132964 kB
SwapCached:          0 kB
Active:         148592 kB
Inactive:        70680 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1779040 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            2028 kB
Writeback:           0 kB
Mapped:          76420 kB
Slab:            42480 kB
Committed_AS:   999016 kB
PageTables:       1984 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66344 MiB
End job on node62 at 2009-07-12 14:55:28