Trace number 2098707

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Abscon 112v4 AC? (TO) 1800.15 1810.15

General information on the benchmark

Namecsp/rand-3-28-28-fcd/
normalized-rand-3-28-28-93-632-fcd-31_ext.xml
MD5SUM1cff44f109a6e1b18897598e92bd0d84
Bench CategoryN-ARY-EXT (n-ary constraints in extension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables28
Number of constraints93
Maximum constraint arity3
Maximum domain size28
Number of constraints which are defined in extension93
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data

0.03/0.09	
0.03/0.09	Abscon 112 (May, 2008)
0.18/0.24	
0.18/0.24	   configuration
0.18/0.24	     name=mac.xml
0.28/0.32	   
0.28/0.32	   instance
0.28/0.32	     name=HOME/instance-2098707-1247416441.xml
0.28/0.36	   
0.28/0.36	   domains being loaded...
0.28/0.37	   
0.28/0.37	   variables being loaded...
0.28/0.39	     nbVariables=28  nbDomainTypes=1  minDomainSize=28  maxDomainSize=28  nbTotalValues=784
0.28/0.39	       =>  wckTime=0.148  cpuTime=0.1  mem=7M892
0.28/0.39	   
0.28/0.39	   relations being loaded...
1.37/1.48	   
1.37/1.48	   constraints being loaded...
2.26/2.34	     nbConstraints=91  nbRelationTypes=93  nbGlobalConstraints=91  nbMergedConstraints=2  nbExtensionStructures=91
2.26/2.34	     nbSharedExtensionStructures=0  nbConflictsStructures=91  nbSharedConflictsStructures=0
2.26/2.34	     nbSharedBinaryRepresentations=0  minDegree=3  maxDegree=16  minArity=3  maxArity=3  nbGenerators=0  nbFusions=0
2.26/2.34	     symmetryWckTime=0.058  symmetryCpuTime=0.02
2.26/2.34	       =>  wckTime=2.097  cpuTime=1.64  mem=61M252
2.44/2.57	   
2.44/2.57	   solver IterativeSystematicSolver being built... 
2.55/2.65	   
2.55/2.65	   INFO : Forward propagation technique limited 
2.65/2.73	       =>  wckTime=2.482  cpuTime=1.76  mem=63M721
2.74/2.81	   
2.74/2.81	   preprocessing
2.74/2.81	     nbConstraintChecks=0  nbValidityChecks=724956  nbPropagations=28  nbRevisions=0  nbUselessRevisions=0
2.74/2.81	     nbRemovedValues=0  detectedInconsistency=no
2.74/2.81	       =>  wckTime=0.085  cpuTime=0.08  mem=64M755
4.63/4.71	   
4.63/4.71	   INFO : Stopping use of transposition table (mapSize=101, nbTooLargekeys=0, mem=65M758)

Verifier Data

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2098707-1247416441/watcher-2098707-1247416441 -o /tmp/evaluation-result-2098707-1247416441/solver-2098707-1247416441 -C 1800 -W 2000 -M 900 java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-2098707-1247416441.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/80 2637
/proc/meminfo: memFree=1510112/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=1616 CPUtime=0
/proc/2637/stat : 2637 (java) D 2635 2637 2561 0 -1 0 347 0 0 0 0 0 0 0 18 0 1 0 28707675 1654784 151 996147200 134512640 134550932 4294955968 18446744073709551615 4309796 0 2147483391 4096 0 18446744072099781622 0 0 17 1 0 0
/proc/2637/statm: 2669 474 207 9 0 1184 0
[pid=2637/tid=2638] ppid=2635 vsize=10676 CPUtime=0
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 0 0 0 0 0 0 0 0 19 0 2 0 28707676 10932224 474 996147200 134512640 134550932 4294955968 18446744073709551615 5156824 0 0 4096 0 0 0 0 -1 1 0 0

[startup+0.0437351 s]
/proc/loadavg: 2.00 2.00 2.00 3/80 2637
/proc/meminfo: memFree=1510112/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=861936 CPUtime=0.03
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 2276 0 1 0 2 1 0 0 18 0 5 0 28707675 882622464 1879 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800971 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 215484 1879 861 9 0 210399 0
[pid=2637/tid=2638] ppid=2635 vsize=861936 CPUtime=0.01
/proc/2637/task/2638/stat : 2638 (java) D 2635 2637 2561 0 -1 64 1581 0 1 0 1 0 0 0 17 0 5 0 28707676 882622464 1879 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 2147483391 0 16800971 18446744072099781622 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 861936

[startup+0.102561 s]
/proc/loadavg: 2.00 2.00 2.00 3/80 2637
/proc/meminfo: memFree=1510112/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=865984 CPUtime=0.07
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 3759 0 1 0 6 1 0 0 18 0 9 0 28707675 886767616 3217 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216496 3217 1697 9 0 210981 0
[pid=2637/tid=2638] ppid=2635 vsize=865984 CPUtime=0.07
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 2850 0 1 0 6 1 0 0 18 0 9 0 28707676 886767616 3217 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 865984

[startup+0.301575 s]
/proc/loadavg: 2.00 2.00 2.00 3/80 2637
/proc/meminfo: memFree=1510112/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=866296 CPUtime=0.28
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 5684 0 1 0 25 3 0 0 18 0 9 0 28707675 887087104 5087 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216574 5087 1927 9 0 211052 0
[pid=2637/tid=2638] ppid=2635 vsize=866296 CPUtime=0.24
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 4727 0 1 0 22 2 0 0 19 0 9 0 28707676 887087104 5087 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 2147483391 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 866296

[startup+0.701604 s]
/proc/loadavg: 2.00 2.00 2.00 3/80 2637
/proc/meminfo: memFree=1510112/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=866500 CPUtime=0.67
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 10627 0 1 0 61 6 0 0 18 0 9 0 28707675 887296000 9989 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216625 9989 1999 9 0 211083 0
[pid=2637/tid=2638] ppid=2635 vsize=866500 CPUtime=0.59
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 9600 0 1 0 54 5 0 0 20 0 9 0 28707676 887296000 9989 996147200 134512640 134550932 4294955968 18446744073709551615 4126588044 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 866500

[startup+1.50265 s]
/proc/loadavg: 2.00 2.00 2.00 4/89 2646
/proc/meminfo: memFree=1446808/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=866632 CPUtime=1.47
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 19438 0 1 0 135 12 0 0 18 0 9 0 28707675 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216658 18792 2019 9 0 211116 0
[pid=2637/tid=2638] ppid=2635 vsize=866632 CPUtime=1.31
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 15732 0 1 0 121 10 0 0 25 0 9 0 28707676 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4125979047 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2640] ppid=2635 vsize=866632 CPUtime=0.05
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 2667 0 0 0 4 1 0 0 17 0 9 0 28707678 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=866632 CPUtime=0
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 16 0 0 0 0 0 0 0 16 0 9 0 28707678 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=866632 CPUtime=0
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 5 0 0 0 0 0 0 0 16 0 9 0 28707678 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=866632 CPUtime=0
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 0 0 0 0 0 0 0 18 0 9 0 28707680 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=866632 CPUtime=0.08
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 337 0 0 0 8 0 0 0 16 0 9 0 28707680 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=866632 CPUtime=0
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 28707680 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=866632 CPUtime=0
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 28707680 887431168 18792 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 866632

[startup+3.10277 s]
/proc/loadavg: 2.00 2.00 2.00 4/89 2646
/proc/meminfo: memFree=1413784/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867368 CPUtime=3.05
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 46589 273 1 0 282 22 0 1 18 0 9 0 28707675 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216842 31306 2659 9 0 211278 0
[pid=2637/tid=2638] ppid=2635 vsize=867368 CPUtime=2.32
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 19901 273 1 0 220 11 0 1 25 0 9 0 28707676 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4126840862 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867368 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 18 0 9 0 28707678 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867368 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867368 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867368 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867368 CPUtime=0.21
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 559 273 0 0 20 0 0 1 15 0 9 0 28707680 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867368 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867368 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 4 273 0 0 0 0 0 1 15 0 9 0 28707680 888184832 31306 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 867368

[startup+6.30198 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 2650
/proc/meminfo: memFree=1394584/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=6.21
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 46613 273 1 0 598 22 0 1 18 0 9 0 28707675 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31326 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=5.45
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 19904 273 1 0 533 11 0 1 25 0 9 0 28707676 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4126852564 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 17 0 9 0 28707678 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.24
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 579 273 0 0 23 0 0 1 16 0 9 0 28707680 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31326 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 867500

[startup+12.7014 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 2650
/proc/meminfo: memFree=1394520/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=12.55
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 46628 273 1 0 1232 22 0 1 18 0 9 0 28707675 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31335 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=11.76
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 19907 273 1 0 1164 11 0 1 25 0 9 0 28707676 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4126852498 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 17 0 9 0 28707678 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.26
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 591 273 0 0 25 0 0 1 15 0 9 0 28707680 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31335 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 867500

[startup+25.5023 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 2650
/proc/meminfo: memFree=1394648/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=25.23
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 46636 273 1 0 2500 22 0 1 18 0 9 0 28707675 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31341 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=24.43
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 19909 273 1 0 2431 11 0 1 25 0 9 0 28707676 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4126852531 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.27
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 597 273 0 0 26 0 0 1 16 0 9 0 28707680 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 867500

[startup+51.103 s]
/proc/loadavg: 2.00 2.00 2.00 4/89 2650
/proc/meminfo: memFree=1394712/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=50.59
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 46639 273 1 0 5036 22 0 1 18 0 9 0 28707675 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31341 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=49.81
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 19911 273 1 0 4968 12 0 1 25 0 9 0 28707676 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4126852315 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31341 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0

################
# More data... #
################

/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.28
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 601 273 0 0 27 0 0 1 16 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1532.38
Current children cumulated vsize (KiB) 867500

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 2732
/proc/meminfo: memFree=1617376/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=1592.36
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 48288 273 1 0 159208 27 0 1 18 0 9 0 28707675 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31344 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=1591.56
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 21557 273 1 0 159139 16 0 1 25 0 9 0 28707676 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4126852498 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.28
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 601 273 0 0 27 0 0 1 16 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1592.36
Current children cumulated vsize (KiB) 867500

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/89 2738
/proc/meminfo: memFree=1617184/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=1652.33
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 48371 273 1 0 165205 27 0 1 18 0 9 0 28707675 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31344 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=1651.53
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 21640 273 1 0 165136 16 0 1 25 0 9 0 28707676 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4126852739 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.28
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 601 273 0 0 27 0 0 1 16 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1652.33
Current children cumulated vsize (KiB) 867500

[startup+1722.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/89 2738
/proc/meminfo: memFree=1617184/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=1712.31
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 48429 273 1 0 171203 27 0 1 18 0 9 0 28707675 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31344 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=1711.51
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 21698 273 1 0 171134 16 0 1 25 0 9 0 28707676 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4126840807 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.28
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 601 273 0 0 27 0 0 1 16 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1712.31
Current children cumulated vsize (KiB) 867500

[startup+1782.3 s]
/proc/loadavg: 2.11 2.04 2.01 3/89 2738
/proc/meminfo: memFree=1617184/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=1772.29
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 48496 273 1 0 177201 27 0 1 18 0 9 0 28707675 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31344 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=1771.5
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 21765 273 1 0 177132 17 0 1 25 0 9 0 28707676 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4126852325 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.28
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 601 273 0 0 27 0 0 1 16 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1772.29
Current children cumulated vsize (KiB) 867500



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1810.1 s]
/proc/loadavg: 2.06 2.03 2.00 3/89 2738
/proc/meminfo: memFree=1617184/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=1800.08
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 48529 273 1 0 179980 27 0 1 18 0 9 0 28707675 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31344 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=1799.29
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 21798 273 1 0 179911 17 0 1 25 0 9 0 28707676 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4126852531 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.28
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 601 273 0 0 27 0 0 1 16 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 867500

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1810.1 s]
/proc/loadavg: 2.06 2.03 2.00 3/89 2738
/proc/meminfo: memFree=1617184/2055920 swapFree=4192812/4192956
[pid=2637] ppid=2635 vsize=867500 CPUtime=1800.08
/proc/2637/stat : 2637 (java) S 2635 2637 2561 0 -1 0 48529 273 1 0 179980 27 0 1 18 0 9 0 28707675 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/2637/statm: 216875 31344 2659 9 0 211311 0
[pid=2637/tid=2638] ppid=2635 vsize=867500 CPUtime=1799.29
/proc/2637/task/2638/stat : 2638 (java) R 2635 2637 2561 0 -1 64 21798 273 1 0 179911 17 0 1 25 0 9 0 28707676 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4126852531 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=2637/tid=2640] ppid=2635 vsize=867500 CPUtime=0.5
/proc/2637/task/2640/stat : 2640 (java) S 2635 2637 2561 0 -1 64 25285 273 0 0 41 8 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2641] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2641/stat : 2641 (java) S 2635 2637 2561 0 -1 64 21 273 0 0 0 0 0 1 17 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2642] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2642/stat : 2642 (java) S 2635 2637 2561 0 -1 64 10 273 0 0 0 0 0 1 16 0 9 0 28707678 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2643] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2643/stat : 2643 (java) S 2635 2637 2561 0 -1 64 2 273 0 0 0 0 0 1 18 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2644] ppid=2635 vsize=867500 CPUtime=0.28
/proc/2637/task/2644/stat : 2644 (java) S 2635 2637 2561 0 -1 64 601 273 0 0 27 0 0 1 16 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2645] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2645/stat : 2645 (java) S 2635 2637 2561 0 -1 64 0 273 0 0 0 0 0 1 19 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=2637/tid=2646] ppid=2635 vsize=867500 CPUtime=0.01
/proc/2637/task/2646/stat : 2646 (java) S 2635 2637 2561 0 -1 64 5 273 0 0 0 0 0 1 15 0 9 0 28707680 888320000 31344 996147200 134512640 134550932 4294955968 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 867500

Child status: 143
Real time (s): 1810.15
CPU time (s): 1800.15
CPU user time (s): 1799.84
CPU system time (s): 0.312952
CPU usage (%): 99.4473
Max. virtual memory (cumulated for all children) (KiB): 867500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.84
system time used= 0.312952
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 48833
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37762
involuntary context switches= 57675

runsolver used 2.38764 second user time and 5.85611 second system time

The end

Launcher Data

Begin job on node52 at 2009-07-12 18:34:02
IDJOB=2098707
IDBENCH=58909
IDSOLVER=773
FILE ID=node52/2098707-1247416441
PBS_JOBID= 9510761
Free space on /tmp= 66108 MiB

SOLVER NAME= Abscon 112v4 AC
BENCH NAME= CPAI08/csp/rand-3-28-28-fcd/normalized-rand-3-28-28-93-632-fcd-31_ext.xml
COMMAND LINE= java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2098707-1247416441/watcher-2098707-1247416441 -o /tmp/evaluation-result-2098707-1247416441/solver-2098707-1247416441 -C 1800 -W 2000 -M 900  java -Xms756M -Xmx756M -XX:PermSize=10m -XX:MaxPermSize=10m -cp abscon112V4.jar abscon.Resolution mac.xml 1 XSax HOME/instance-2098707-1247416441.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 1cff44f109a6e1b18897598e92bd0d84
RANDOM SEED=459309216

node52.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1510592 kB
Buffers:         47800 kB
Cached:         192988 kB
SwapCached:          0 kB
Active:         386652 kB
Inactive:       100256 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1510592 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            7880 kB
Writeback:           0 kB
Mapped:         266580 kB
Slab:            43100 kB
Committed_AS:  1022296 kB
PageTables:       2360 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66136 MiB
End job on node52 at 2009-07-12 19:04:14