Trace number 2083244

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Concrete 2009-07-14? (exit code) 341.661 342.561

General information on the benchmark

Namecsp/fapp/fapp26/
normalized-fapp26-2300-10.xml
MD5SUMfed84ca019c3c42e3620b2e79df41b5a
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark29.3985
Satisfiable
(Un)Satisfiability was proved
Number of variables2300
Number of constraints24253
Maximum constraint arity2
Maximum domain size302
Number of constraints which are defined in extension0
Number of constraints which are defined in intension24253
Global constraints used (with number of constraints)

Solver Data 

161.25/161.42	c CPU-LOAD 135.03
161.25/161.42	c LOADED 2300 V (302 E), 2021 PredicateConstraint, 12244 ExtensionConstraint2D, arity 2, 135.03 cpu
334.93/335.81	Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
334.93/335.82		at java.util.jar.Manifest$FastInputStream.<init>(Unknown Source)
336.83/337.75		at java.util.jar.Manifest$FastInputStream.<init>(Unknown Source)
336.83/337.75		at java.util.jar.Manifest.read(Unknown Source)
336.83/337.75		at java.util.jar.Manifest.<init>(Unknown Source)
336.83/337.75		at java.util.jar.JarFile.getManifestFromReference(Unknown Source)
338.72/339.67		at java.util.jar.JarFile.getManifest(Unknown Source)
338.72/339.67		at sun.misc.URLClassPath$JarLoader$2.getManifest(Unknown Source)
338.72/339.67		at java.net.URLClassLoader.defineClass(Unknown Source)
338.72/339.67		at java.net.URLClassLoader.access$000(Unknown Source)
341.50/342.42		at java.net.URLClassLoader$1.run(Unknown Source)
341.50/342.42		at java.security.AccessController.doPrivileged(Native Method)
341.50/342.42		at java.net.URLClassLoader.findClass(Unknown Source)
341.50/342.42		at java.lang.ClassLoader.loadClass(Unknown Source)
341.50/342.42		at sun.misc.Launcher$AppClassLoader.loadClass(Unknown Source)
341.50/342.42		at java.lang.ClassLoader.loadClass(Unknown Source)
341.50/342.42		at java.lang.ClassLoader.loadClassInternal(Unknown Source)
341.50/342.42		at concrete.AbstractLauncher.solve(AbstractLauncher.java:403)
341.50/342.42		at concrete.Concrete.solve(Concrete.java:187)
341.50/342.42		at concrete.Concrete.run(Concrete.java:112)
341.50/342.42		at concrete.Concrete.main(Concrete.java:105)

Verifier Data 

ERROR: Unexpected answer ! ('s SATISFIABLE'/'s UNSATISFIABLE' expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2083244-1247722776/watcher-2083244-1247722776 -o /tmp/evaluation-result-2083244-1247722776/solver-2083244-1247722776 -C 1800 -W 2000 -M 900 HOME/concrete.sh -c HOME/instance-2083244-1247722776.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.25 2.14 2.06 3/72 20109
/proc/meminfo: memFree=949068/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=880 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) R 20107 20109 17142 0 -1 4194304 40 0 0 0 0 0 0 0 18 0 1 0 59342285 901120 25 996147200 4194304 4889804 548682068816 18446744073709551615 256362214793 0 0 4096 0 0 0 0 17 1 0 0
/proc/20109/statm: 220 25 18 169 0 8 0

[startup+0.0977561 s]
/proc/loadavg: 2.25 2.14 2.06 3/72 20109
/proc/meminfo: memFree=949068/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.102752 s]
/proc/loadavg: 2.25 2.14 2.06 3/72 20109
/proc/meminfo: memFree=949068/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.302774 s]
/proc/loadavg: 2.25 2.14 2.06 3/72 20109
/proc/meminfo: memFree=949068/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.707376 s]
/proc/loadavg: 2.25 2.14 2.06 3/72 20109
/proc/meminfo: memFree=949068/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.5029 s]
/proc/loadavg: 2.25 2.14 2.06 4/82 20122
/proc/meminfo: memFree=935804/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=847756 CPUtime=2.05
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 6573 0 1 0 198 7 0 0 18 0 9 0 59342286 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 211939 5646 2000 9 0 206417 0
[pid=20114/tid=20115] ppid=20109 vsize=847756 CPUtime=1.25
/proc/20114/task/20115/stat : 20115 (java) R 20109 20109 17142 0 -1 64 3995 0 1 0 123 2 0 0 20 0 9 0 59342287 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 102851408 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=847756 CPUtime=0.04
/proc/20114/task/20116/stat : 20116 (java) S 20109 20109 17142 0 -1 64 589 0 0 0 4 0 0 0 16 0 9 0 59342288 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=847756 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=847756 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 4 0 0 0 0 0 0 0 16 0 9 0 59342288 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=847756 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=847756 CPUtime=0.72
/proc/20114/task/20120/stat : 20120 (java) R 20109 20109 17142 0 -1 64 1291 0 0 0 70 2 0 0 23 0 9 0 59342294 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 101875449 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=847756 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=847756 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 59342294 868102144 5646 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.05
Current children cumulated vsize (KiB) 853112

[startup+3.10107 s]
/proc/loadavg: 2.25 2.14 2.06 4/82 20122
/proc/meminfo: memFree=928828/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=847888 CPUtime=3.64
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 9348 0 1 0 356 8 0 0 18 0 9 0 59342286 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 211972 8191 2624 9 0 206450 0
[pid=20114/tid=20115] ppid=20109 vsize=847888 CPUtime=2.56
/proc/20114/task/20115/stat : 20115 (java) R 20109 20109 17142 0 -1 64 4031 0 1 0 254 2 0 0 25 0 9 0 59342287 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4126519589 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=847888 CPUtime=0.25
/proc/20114/task/20116/stat : 20116 (java) S 20109 20109 17142 0 -1 64 3254 0 0 0 23 2 0 0 16 0 9 0 59342288 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=847888 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=847888 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 4 0 0 0 0 0 0 0 15 0 9 0 59342288 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=847888 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=847888 CPUtime=0.8
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 1365 0 0 0 78 2 0 0 16 0 9 0 59342294 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=847888 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=847888 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 59342294 868237312 8191 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.64
Current children cumulated vsize (KiB) 853244

[startup+6.3024 s]
/proc/loadavg: 2.31 2.15 2.06 3/82 20122
/proc/meminfo: memFree=919292/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=847924 CPUtime=6.78
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 10813 0 1 0 667 11 0 0 18 0 9 0 59342286 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 211981 9620 2624 9 0 206459 0
[pid=20114/tid=20115] ppid=20109 vsize=847924 CPUtime=5.52
/proc/20114/task/20115/stat : 20115 (java) R 20109 20109 17142 0 -1 64 4101 0 1 0 549 3 0 0 25 0 9 0 59342287 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4126028712 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=847924 CPUtime=0.4
/proc/20114/task/20116/stat : 20116 (java) S 20109 20109 17142 0 -1 64 4649 0 0 0 38 2 0 0 16 0 9 0 59342288 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 4 0 0 0 0 0 0 0 15 0 9 0 59342288 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=847924 CPUtime=0.8
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 1365 0 0 0 78 2 0 0 16 0 9 0 59342294 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 59342294 868274176 9620 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.78
Current children cumulated vsize (KiB) 853280

[startup+12.7011 s]
/proc/loadavg: 2.29 2.15 2.06 4/82 20122
/proc/meminfo: memFree=908796/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=847924 CPUtime=13.15
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 13039 0 1 0 1303 12 0 0 18 0 9 0 59342286 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 211981 11186 2625 9 0 206459 0
[pid=20114/tid=20115] ppid=20109 vsize=847924 CPUtime=11.65
/proc/20114/task/20115/stat : 20115 (java) R 20109 20109 17142 0 -1 64 4247 0 1 0 1162 3 0 0 25 0 9 0 59342287 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4126516425 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=847924 CPUtime=0.63
/proc/20114/task/20116/stat : 20116 (java) S 20109 20109 17142 0 -1 64 6729 0 0 0 60 3 0 0 16 0 9 0 59342288 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 4 0 0 0 0 0 0 0 15 0 9 0 59342288 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=847924 CPUtime=0.8
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 1365 0 0 0 78 2 0 0 17 0 9 0 59342294 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=847924 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 59342294 868274176 11186 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 13.15
Current children cumulated vsize (KiB) 853280

[startup+25.5024 s]
/proc/loadavg: 2.22 2.14 2.06 5/83 20123
/proc/meminfo: memFree=891572/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=848952 CPUtime=25.9
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 16485 0 1 0 2576 14 0 0 18 0 10 0 59342286 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 212238 13958 2625 9 0 206716 0
[pid=20114/tid=20115] ppid=20109 vsize=848952 CPUtime=24.06
/proc/20114/task/20115/stat : 20115 (java) R 20109 20109 17142 0 -1 64 4533 0 1 0 2402 4 0 0 25 0 10 0 59342287 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=848952 CPUtime=0.97
/proc/20114/task/20116/stat : 20116 (java) R 20109 20109 17142 0 -1 64 9876 0 0 0 92 5 0 0 16 0 10 0 59342288 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 104187679 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=848952 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 10 0 59342288 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=848952 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 4 0 0 0 0 0 0 0 16 0 10 0 59342288 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=848952 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 10 0 59342291 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=848952 CPUtime=0.81
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 1373 0 0 0 79 2 0 0 16 0 10 0 59342294 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=848952 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 10 0 59342294 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=848952 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 10 0 59342294 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20123] ppid=20109 vsize=848952 CPUtime=0
/proc/20114/task/20123/stat : 20123 (java) S 20109 20109 17142 0 -1 64 5 0 0 0 0 0 0 0 24 0 10 0 59344792 869326848 13958 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.9
Current children cumulated vsize (KiB) 854308

[startup+51.1021 s]
/proc/loadavg: 2.15 2.13 2.06 4/83 20123
/proc/meminfo: memFree=841588/2055920 swapFree=4192812/4192956

################
# More data... #
################

[pid=20114/tid=20117] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 17 0 10 0 59342288 872493056 73389 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 8 0 0 0 0 0 0 0 16 0 10 0 59342288 872493056 73389 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 10 0 59342291 872493056 73389 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=852044 CPUtime=6.03
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 4111 0 0 0 588 15 0 0 15 0 10 0 59342294 872493056 73389 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 10 0 59342294 872493056 73389 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) R 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 10 0 59342294 872493056 73389 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=20114/tid=20123] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20123/stat : 20123 (java) S 20109 20109 17142 0 -1 64 5 0 0 0 0 0 0 0 24 0 10 0 59344792 872493056 73389 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 102.39
Current children cumulated vsize (KiB) 857400

[startup+162.303 s]
/proc/loadavg: 2.08 2.12 2.06 5/82 20123
/proc/meminfo: memFree=134452/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=852044 CPUtime=162.15
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 186499 0 1 0 16064 151 0 0 18 0 9 0 59342286 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 213011 183074 2634 9 0 207489 0
[pid=20114/tid=20115] ppid=20109 vsize=852044 CPUtime=135.33
/proc/20114/task/20115/stat : 20115 (java) R 20109 20109 17142 0 -1 64 12369 0 1 0 13475 58 0 0 25 0 9 0 59342287 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=852044 CPUtime=19.55
/proc/20114/task/20116/stat : 20116 (java) R 20109 20109 17142 0 -1 64 168729 0 0 0 1882 73 0 0 16 0 9 0 59342288 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 104190060 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 9 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=852044 CPUtime=7.22
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 4692 0 0 0 705 17 0 0 16 0 9 0 59342294 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 59342294 872493056 183074 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 162.15
Current children cumulated vsize (KiB) 857400

[startup+222.308 s]
/proc/loadavg: 2.34 2.18 2.08 4/82 20124
/proc/meminfo: memFree=58156/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=852044 CPUtime=221.91
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 197825 0 1 0 22035 156 0 0 18 0 9 0 59342286 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 213011 194377 2636 9 0 207489 0
[pid=20114/tid=20115] ppid=20109 vsize=852044 CPUtime=176.36
/proc/20114/task/20115/stat : 20115 (java) S 20109 20109 17142 0 -1 64 12389 0 1 0 17578 58 0 0 25 0 9 0 59342287 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=852044 CPUtime=38.15
/proc/20114/task/20116/stat : 20116 (java) R 20109 20109 17142 0 -1 64 180030 0 0 0 3737 78 0 0 18 0 9 0 59342288 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 102331104 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 11 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=852044 CPUtime=7.35
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 4694 0 0 0 717 18 0 0 16 0 9 0 59342294 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 0 0 0 0 15 0 9 0 59342294 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 221.91
Current children cumulated vsize (KiB) 857400

[startup+282.302 s]
/proc/loadavg: 2.19 2.17 2.09 4/82 20124
/proc/meminfo: memFree=25004/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=852044 CPUtime=281.66
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 197852 0 1 0 28009 157 0 0 18 0 9 0 59342286 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 213011 194377 2636 9 0 207489 0
[pid=20114/tid=20115] ppid=20109 vsize=852044 CPUtime=177.95
/proc/20114/task/20115/stat : 20115 (java) S 20109 20109 17142 0 -1 64 12416 0 1 0 17737 58 0 0 17 0 9 0 59342287 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=852044 CPUtime=96.3
/proc/20114/task/20116/stat : 20116 (java) R 20109 20109 17142 0 -1 64 180030 0 0 0 9552 78 0 0 25 0 9 0 59342288 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 104188842 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 11 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=852044 CPUtime=7.35
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 4694 0 0 0 717 18 0 0 16 0 9 0 59342294 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=852044 CPUtime=0.02
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 1 1 0 0 15 0 9 0 59342294 872493056 194377 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 281.66
Current children cumulated vsize (KiB) 857400

[startup+342.302 s]
/proc/loadavg: 2.07 2.14 2.08 4/82 20124
/proc/meminfo: memFree=16236/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=852044 CPUtime=341.4
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 197879 0 1 0 33982 158 0 0 18 0 9 0 59342286 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 213011 194378 2636 9 0 207489 0
[pid=20114/tid=20115] ppid=20109 vsize=852044 CPUtime=177.97
/proc/20114/task/20115/stat : 20115 (java) S 20109 20109 17142 0 -1 64 12442 0 1 0 17738 59 0 0 17 0 9 0 59342287 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=852044 CPUtime=156.04
/proc/20114/task/20116/stat : 20116 (java) R 20109 20109 17142 0 -1 64 180031 0 0 0 15525 79 0 0 25 0 9 0 59342288 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 104191077 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 11 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=852044 CPUtime=7.35
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 4694 0 0 0 717 18 0 0 16 0 9 0 59342294 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=852044 CPUtime=0.02
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 1 1 0 0 15 0 9 0 59342294 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 341.4
Current children cumulated vsize (KiB) 857400

Solver just ended. Dumping a history of the last processes samples

[startup+342.402 s]
/proc/loadavg: 2.07 2.14 2.08 4/82 20124
/proc/meminfo: memFree=16236/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=852044 CPUtime=341.5
/proc/20114/stat : 20114 (java) S 20109 20109 17142 0 -1 0 197879 0 1 0 33992 158 0 0 18 0 9 0 59342286 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 213011 194378 2636 9 0 207489 0
[pid=20114/tid=20115] ppid=20109 vsize=852044 CPUtime=177.97
/proc/20114/task/20115/stat : 20115 (java) S 20109 20109 17142 0 -1 64 12442 0 1 0 17738 59 0 0 17 0 9 0 59342287 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20116] ppid=20109 vsize=852044 CPUtime=156.14
/proc/20114/task/20116/stat : 20116 (java) R 20109 20109 17142 0 -1 64 180031 0 0 0 15535 79 0 0 25 0 9 0 59342288 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 104191080 0 0 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20117] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20117/stat : 20117 (java) S 20109 20109 17142 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20118] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20118/stat : 20118 (java) S 20109 20109 17142 0 -1 64 11 0 0 0 0 0 0 0 16 0 9 0 59342288 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20119] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20119/stat : 20119 (java) S 20109 20109 17142 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 59342291 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20120] ppid=20109 vsize=852044 CPUtime=7.35
/proc/20114/task/20120/stat : 20120 (java) S 20109 20109 17142 0 -1 64 4694 0 0 0 717 18 0 0 16 0 9 0 59342294 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20121] ppid=20109 vsize=852044 CPUtime=0
/proc/20114/task/20121/stat : 20121 (java) S 20109 20109 17142 0 -1 64 2 0 0 0 0 0 0 0 20 0 9 0 59342294 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 1 0 0
[pid=20114/tid=20122] ppid=20109 vsize=852044 CPUtime=0.02
/proc/20114/task/20122/stat : 20122 (java) S 20109 20109 17142 0 -1 64 1 0 0 0 1 1 0 0 15 0 9 0 59342294 872493056 194378 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 341.5
Current children cumulated vsize (KiB) 857400

[startup+342.502 s]
/proc/loadavg: 2.07 2.14 2.08 4/82 20124
/proc/meminfo: memFree=16236/2055920 swapFree=4192812/4192956
[pid=20109] ppid=20107 vsize=5356 CPUtime=0
/proc/20109/stat : 20109 (concrete.sh) S 20107 20109 17142 0 -1 4194304 341 291 0 0 0 0 0 0 18 0 1 0 59342285 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 256364831556 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/20109/statm: 1339 244 201 169 0 50 0
[pid=20114] ppid=20109 vsize=0 CPUtime=341.59
/proc/20114/stat : 20114 (java) Z 20109 20109 17142 0 -1 12 197889 0 1 0 33995 164 0 0 16 0 2 0 59342286 0 0 996147200 0 0 0 0 0 0 0 0 25189583 18446744073709551615 0 0 17 1 0 0
/proc/20114/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 341.59
Current children cumulated vsize (KiB) 5356

Child status: 1
Real time (s): 342.561
CPU time (s): 341.661
CPU user time (s): 339.955
CPU system time (s): 1.70574
CPU usage (%): 99.7372
Max. virtual memory (cumulated for all children) (KiB): 858552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 339.955
system time used= 1.70574
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 198531
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37570
involuntary context switches= 35688

runsolver used 0.484926 second user time and 1.24181 second system time

The end

Launcher Data 

Begin job on node90 at 2009-07-16 07:39:36
IDJOB=2083244
IDBENCH=57755
IDSOLVER=735
FILE ID=node90/2083244-1247722776
PBS_JOBID= 9521331
Free space on /tmp= 66092 MiB

SOLVER NAME= Concrete 2009-06-10
BENCH NAME= CPAI08/csp/fapp/fapp26/normalized-fapp26-2300-10.xml
COMMAND LINE= HOME/concrete.sh -c BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2083244-1247722776/watcher-2083244-1247722776 -o /tmp/evaluation-result-2083244-1247722776/solver-2083244-1247722776 -C 1800 -W 2000 -M 900  HOME/concrete.sh -c HOME/instance-2083244-1247722776.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= fed84ca019c3c42e3620b2e79df41b5a
RANDOM SEED=852389948

node90.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        949548 kB
Buffers:         95892 kB
Cached:         330332 kB
SwapCached:          0 kB
Active:         613296 kB
Inactive:       386932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        949548 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            4764 kB
Writeback:           0 kB
Mapped:         579328 kB
Slab:            90348 kB
Committed_AS:  1198084 kB
PageTables:       2976 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66092 MiB
End job on node90 at 2009-07-16 07:45:19