Trace number 1114911

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerNumber of falsified constraintsCPU timeWall clock time
Concrete + CSP4J - MCRW Engine 2008-05-30MSAT (TO)2 3600.07 3622.02

General information on the benchmark

Namecsp/tightness0.9/
normalized-rand-2-40-180-84-900-40_ext.xml
MD5SUMa91b122166d09430f4c9a44f5a97b7f6
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkMSAT TO
Best Number of falsified constraints1
Best CPU time to get the best result obtained on this benchmark3600.06
Satisfiable
(Un)Satisfiability was proved
Number of variables40
Number of constraints84
Maximum constraint arity2
Maximum domain size180
Number of constraints which are defined in extension84
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

2.07/2.11	c CPU-LOAD 1.27
2.07/2.11	c LOADED 40 V (180 E), 84 ExtensionConstraint2D, arity 2, 1.27 cpu
2.16/2.24	s SATISFIABLE
2.16/2.24	o 14
2.16/2.24	v 103 74 137 129 160 118 54 31 83 17 141 144 74 113 49 78 93 28 130 16 32 47 171 37 93 131 141 62 163 101 96 146 176 75 127 130 106 34 87 21 
2.16/2.24	o 16
2.16/2.24	v 103 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 130 16 32 47 171 151 93 131 141 62 163 101 96 146 176 75 127 130 106 34 87 21 
2.16/2.24	o 17
2.16/2.24	v 103 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 130 16 0 47 171 151 93 131 141 62 163 101 96 146 176 75 127 130 106 34 87 21 
2.16/2.24	o 18
2.16/2.24	v 103 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 130 16 0 47 171 151 93 131 141 62 163 101 34 146 176 75 127 130 106 34 87 21 
2.16/2.24	o 20
2.16/2.24	v 103 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 42 16 0 47 171 151 93 131 141 62 163 101 34 146 176 75 127 130 106 34 87 21 
2.16/2.24	o 23
2.16/2.24	v 103 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 42 16 0 47 171 151 19 131 141 62 163 101 34 146 176 75 127 130 106 34 87 21 
2.16/2.24	o 25
2.16/2.24	v 103 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 42 16 0 47 171 151 19 131 141 62 163 101 34 146 176 100 127 130 106 34 87 21 
2.16/2.24	o 27
2.16/2.24	v 2 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 42 16 0 47 171 151 19 131 141 62 163 101 34 146 176 100 127 130 106 34 87 21 
2.16/2.24	o 30
2.16/2.24	v 2 74 137 129 160 118 54 31 83 17 141 144 74 113 28 78 93 28 42 16 0 47 171 151 19 131 141 62 163 101 34 146 176 100 0 130 106 34 87 21 
2.16/2.24	o 32
2.16/2.24	v 2 74 137 129 160 118 54 31 83 17 141 144 74 113 28 100 93 28 42 16 0 47 171 151 19 131 141 62 163 101 34 146 176 100 0 130 106 34 87 21 
2.16/2.25	o 33
2.16/2.25	v 2 74 137 129 160 118 54 31 83 17 141 144 74 113 28 100 93 28 42 16 0 47 171 151 19 49 141 62 163 101 34 146 176 100 0 130 106 34 87 21 
2.16/2.25	o 36
2.16/2.25	v 2 74 137 129 160 118 54 31 83 17 141 144 74 113 28 100 93 28 42 16 0 47 171 151 19 49 141 62 163 101 34 146 176 100 0 130 106 114 87 21 
2.16/2.25	o 38
2.16/2.25	v 2 74 71 129 160 118 54 31 83 17 141 144 74 113 28 100 93 28 42 16 0 47 171 151 19 49 141 62 163 101 34 146 176 100 0 130 106 114 87 21 
2.16/2.25	o 39
2.16/2.25	v 2 74 71 129 160 118 54 31 83 17 141 144 74 113 28 100 93 28 42 16 0 47 171 151 19 49 141 62 163 101 34 146 176 100 0 130 106 114 87 0 
2.16/2.25	o 40
2.16/2.25	v 2 74 71 129 160 118 54 31 83 17 141 61 74 113 28 100 93 28 42 16 0 47 171 151 19 49 141 62 163 101 34 146 176 115 0 130 106 114 87 0 
2.16/2.25	o 42
2.16/2.25	v 2 74 71 129 160 107 54 31 83 17 141 61 74 113 28 100 93 28 42 16 0 47 171 151 19 49 141 62 163 101 34 146 176 115 0 130 106 114 87 0 
2.16/2.25	o 44
2.16/2.25	v 2 74 71 129 160 107 54 31 83 17 141 61 74 113 28 100 93 28 42 16 0 47 171 151 19 49 141 62 163 101 34 146 176 115 0 95 106 114 87 0 
2.16/2.25	o 45
2.16/2.25	v 2 74 71 129 160 107 54 31 83 17 46 61 74 113 28 62 93 28 42 16 0 47 171 151 19 49 141 62 163 89 34 146 176 115 0 95 106 114 87 0 
2.16/2.26	o 46
2.16/2.26	v 129 74 71 129 160 107 54 31 83 17 46 61 2 134 28 62 93 28 42 16 0 47 171 151 19 115 141 62 163 89 34 146 176 115 0 95 0 114 87 0 
2.16/2.26	o 47
2.16/2.26	v 129 74 71 129 160 107 54 31 83 17 46 61 2 134 80 62 93 28 42 16 0 47 171 151 19 115 141 62 163 89 34 146 176 5 0 95 0 114 87 90 
2.16/2.26	o 48
2.16/2.26	v 129 74 71 129 160 107 54 31 83 17 46 61 2 134 80 62 93 28 42 141 0 47 171 151 128 115 141 62 163 89 34 146 176 5 0 95 0 114 87 90 
2.16/2.26	o 50
2.16/2.26	v 150 74 71 129 160 107 54 31 83 17 46 61 2 134 80 62 93 28 42 141 0 47 171 151 128 115 141 62 163 89 34 146 176 5 0 95 0 114 87 90 
2.16/2.26	o 51
2.16/2.26	v 150 74 71 129 160 107 54 31 83 17 46 61 2 134 80 62 93 28 42 141 0 13 171 151 128 115 141 62 163 89 34 146 176 5 0 95 0 114 87 90 
2.16/2.26	o 52
2.16/2.26	v 150 74 71 129 160 107 54 31 83 17 46 61 2 134 80 62 93 28 42 141 0 13 171 151 128 115 141 62 163 89 34 146 176 5 0 95 0 114 131 90 
2.16/2.26	o 53
2.16/2.26	v 150 74 71 129 160 107 54 16 83 17 46 56 2 134 80 62 93 28 42 141 0 13 171 151 128 115 141 62 66 89 34 146 176 5 0 95 0 114 131 90 
2.16/2.26	o 54
2.16/2.26	v 150 74 71 93 86 107 54 16 83 17 46 56 2 134 80 51 93 28 42 141 0 13 171 151 128 49 141 62 66 89 34 146 176 5 0 113 0 114 131 90 
2.16/2.26	o 57
2.16/2.26	v 150 74 71 93 86 107 54 16 83 17 46 56 2 134 80 51 93 28 42 141 0 13 171 151 128 49 141 62 66 89 34 146 176 5 0 71 0 114 131 90 
2.16/2.26	o 60
2.16/2.26	v 150 74 71 93 86 107 54 0 83 17 46 56 2 134 80 51 93 28 42 141 0 13 171 151 128 49 141 62 134 89 34 146 81 5 0 71 0 114 131 90 
2.16/2.26	o 61
2.16/2.26	v 150 74 71 93 86 107 54 0 83 17 120 56 2 134 80 51 93 28 42 141 0 13 171 151 172 49 141 62 134 89 34 146 81 5 48 75 0 114 131 90 
2.16/2.26	o 62
2.16/2.26	v 150 74 71 93 86 107 54 31 83 17 120 56 2 134 80 51 34 28 42 141 0 13 171 151 172 49 122 62 134 89 34 146 81 5 111 75 0 114 131 90 
2.16/2.26	o 63
2.16/2.26	v 161 74 23 93 86 107 54 31 83 17 120 56 2 134 80 23 34 119 42 141 0 13 171 151 172 49 122 62 134 89 34 146 81 5 111 75 0 114 47 90 
2.16/2.27	o 64
2.16/2.27	v 34 74 23 93 86 78 54 94 83 17 120 56 2 134 80 177 34 119 42 141 168 13 171 151 172 49 126 130 134 89 34 179 81 5 111 75 108 101 47 90 
2.16/2.27	o 65
2.16/2.27	v 34 74 23 93 86 78 54 94 124 17 120 56 2 134 80 23 34 119 42 141 168 13 171 151 172 49 126 130 134 89 34 179 81 5 111 75 108 101 47 90 
2.16/2.27	o 66
2.16/2.27	v 34 74 23 93 86 78 54 94 124 17 120 56 2 110 80 23 34 152 42 141 168 13 171 151 172 49 126 130 134 89 34 179 81 5 111 75 108 101 47 90 
2.16/2.27	o 67
2.16/2.27	v 34 74 23 93 86 78 54 99 124 17 120 56 2 110 80 177 34 52 42 141 39 13 171 151 172 49 126 130 134 89 34 72 81 5 111 75 108 101 47 90 
2.16/2.27	o 69
2.16/2.27	v 34 74 23 93 86 66 54 99 124 17 120 56 2 112 80 177 34 52 42 141 39 13 162 102 172 49 126 130 134 89 34 72 81 5 111 75 108 101 47 90 
2.16/2.27	o 70
2.16/2.27	v 34 74 23 93 86 66 54 99 124 17 114 56 2 112 80 177 34 52 42 141 39 13 162 102 172 49 126 130 134 89 34 72 81 5 111 148 108 101 47 90 
2.16/2.28	o 71
2.16/2.28	v 12 74 23 93 86 66 54 99 124 17 114 56 2 110 80 177 34 52 42 141 39 13 162 102 172 49 175 130 134 89 34 72 81 5 111 148 108 101 47 90 
2.16/2.29	o 72
2.16/2.29	v 12 74 23 93 86 30 176 21 124 82 114 59 121 110 80 117 134 52 42 141 39 13 34 140 172 49 175 130 2 89 34 13 102 102 145 148 108 167 47 90 
2.25/2.31	o 73
2.25/2.31	v 110 74 23 93 86 28 117 21 90 82 114 158 66 113 80 117 63 52 16 141 39 13 34 140 5 49 2 79 2 89 34 13 169 102 145 148 157 167 13 90 
2.25/2.35	o 74
2.25/2.35	v 40 74 38 95 128 36 138 88 61 125 51 161 66 41 142 117 164 25 16 141 16 13 98 173 93 147 81 164 124 89 92 136 169 151 145 153 67 143 143 90 
2.25/2.35	o 75
2.25/2.35	v 40 74 38 95 128 36 138 88 61 125 51 161 66 41 142 117 164 25 16 141 16 13 98 173 49 147 81 164 124 89 92 136 169 151 145 153 67 143 176 90 
2.25/2.38	o 76
2.25/2.38	v 40 74 80 95 128 36 138 32 29 125 65 124 66 63 26 117 63 25 16 141 16 0 93 173 66 147 81 164 128 117 92 136 29 151 145 93 67 143 148 90 
2.95/3.05	o 77
2.95/3.05	v 68 85 133 84 143 92 22 34 118 128 147 148 146 49 33 36 125 88 160 36 177 54 90 151 35 77 179 94 118 132 31 22 71 111 132 119 126 140 98 155 
2.95/3.05	o 78
2.95/3.05	v 79 85 133 84 143 92 22 17 118 128 147 148 146 49 33 36 125 88 160 36 177 54 90 151 35 77 177 113 118 132 31 22 71 111 132 119 126 140 98 155 
4.73/4.84	o 79
4.73/4.84	v 111 138 178 70 71 15 12 105 166 50 12 118 29 165 4 11 131 75 138 103 55 35 113 109 14 5 152 90 104 146 88 17 99 0 106 150 175 13 145 156 
44.84/45.35	o 80
44.84/45.35	v 117 59 34 178 152 75 71 90 93 55 61 171 11 127 115 161 97 24 48 137 11 162 18 150 151 135 36 26 163 15 130 142 159 124 74 96 177 107 126 52 
235.11/237.48	o 81
235.11/237.48	v 48 7 122 27 39 85 122 169 106 155 106 7 7 82 140 90 22 124 134 139 0 5 176 137 41 115 157 158 102 9 25 137 17 46 92 56 21 18 6 41 
3255.13/3276.94	o 82
3255.13/3276.94	v 12 46 176 45 12 51 78 59 71 163 162 137 178 84 172 64 61 53 43 15 33 95 143 132 49 71 20 117 96 45 13 37 50 42 142 20 90 174 152 28

Verifier Data (download as text)

OK	2	82
2 unsatisfied constraints, 82 satisfied constraints

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1114911-1215910796/watcher-1114911-1215910796 -o /tmp/evaluation-result-1114911-1215910796/solver-1114911-1215910796 -C 3600 -W 4000 -M 900 --output-limit 1,15 HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1114911-1215910796.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 4000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 2.03 4/81 21696
/proc/meminfo: memFree=1872848/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 271 0 0 0 0 0 0 0 20 0 1 0 47781712 5484544 230 996147200 4194304 4889804 548682068752 18446744073709551615 221236658258 0 0 4100 65536 18446744071563648864 0 0 17 1 0 0
/proc/21696/statm: 1339 230 191 169 0 50 0
[pid=21697] ppid=21696 vsize=124 CPUtime=0
/proc/21697/stat : 21697 (dirname) R 21696 21696 21131 0 -1 4194304 47 0 0 0 0 0 0 0 22 0 1 0 47781712 126976 22 996147200 4194304 4208292 548682069008 18446744073709551615 221233870217 0 0 4096 0 0 0 0 17 1 0 0
/proc/21697/statm: 31 22 16 3 0 3 0

[startup+0.0249619 s]
/proc/loadavg: 1.92 1.98 2.03 4/81 21696
/proc/meminfo: memFree=1872848/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.102751 s]
/proc/loadavg: 1.92 1.98 2.03 4/81 21696
/proc/meminfo: memFree=1872848/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.301784 s]
/proc/loadavg: 1.92 1.98 2.03 4/81 21696
/proc/meminfo: memFree=1872848/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.701859 s]
/proc/loadavg: 1.92 1.98 2.03 4/81 21696
/proc/meminfo: memFree=1872848/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.50301 s]
/proc/loadavg: 1.92 1.98 2.03 3/91 21707
/proc/meminfo: memFree=1858304/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=843624 CPUtime=1.47
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 7998 0 1 0 142 5 0 0 18 0 9 0 47781713 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 210906 7032 2562 9 0 205474 0
[pid=21699/tid=21700] ppid=21696 vsize=843624 CPUtime=0.94
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3189 0 1 0 93 1 0 0 25 0 9 0 47781714 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4125768880 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21701] ppid=21696 vsize=843624 CPUtime=0.43
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 3743 0 0 0 41 2 0 0 16 0 9 0 47781715 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21702] ppid=21696 vsize=843624 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=843624 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 47781715 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=843624 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=843624 CPUtime=0.07
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 333 0 0 0 7 0 0 0 16 0 9 0 47781717 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=843624 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=843624 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 863870976 7032 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 848980

[startup+3.10231 s]
/proc/loadavg: 1.92 1.98 2.03 4/91 21708
/proc/meminfo: memFree=1848448/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=3.05
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9554 0 1 0 298 7 0 0 18 0 9 0 47781713 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8501 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=2.23
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3369 0 1 0 220 3 0 0 25 0 9 0 47781714 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4125969046 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.67
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5071 0 0 0 64 3 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.13
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 376 0 0 0 13 0 0 0 16 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 850012

[startup+6.30291 s]
/proc/loadavg: 1.93 1.98 2.03 3/91 21708
/proc/meminfo: memFree=1848064/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=6.22
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9555 0 1 0 615 7 0 0 18 0 9 0 47781713 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8501 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=5.4
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3370 0 1 0 537 3 0 0 25 0 9 0 47781714 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4125969003 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.67
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5071 0 0 0 64 3 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.13
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 376 0 0 0 13 0 0 0 16 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 850012

[startup+12.7021 s]
/proc/loadavg: 1.93 1.98 2.03 3/91 21708
/proc/meminfo: memFree=1848000/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=12.55
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9555 0 1 0 1248 7 0 0 18 0 9 0 47781713 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8501 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=11.74
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3370 0 1 0 1171 3 0 0 25 0 9 0 47781714 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4125956002 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.67
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5071 0 0 0 64 3 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.13
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 376 0 0 0 13 0 0 0 16 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8501 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 850012

[startup+25.5015 s]
/proc/loadavg: 1.95 1.98 2.03 4/91 21708
/proc/meminfo: memFree=1848128/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=25.23
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9558 0 1 0 2516 7 0 0 18 0 9 0 47781713 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8504 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=24.41
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3370 0 1 0 2438 3 0 0 25 0 9 0 47781714 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4125952707 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.67
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5071 0 0 0 64 3 0 0 16 0 9 0 47781715 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.13
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 379 0 0 0 13 0 0 0 16 0 9 0 47781717 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8504 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 850012

[startup+51.1014 s]

################
# More data... #
################

/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 393 0 0 0 16 0 0 0 16 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3320.49
Current children cumulated vsize (KiB) 850012

[startup+3402.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/83 21818
/proc/meminfo: memFree=1745416/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=3380.47
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9651 0 1 0 338026 21 0 0 18 0 9 0 47781713 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8571 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=3379.61
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3444 0 1 0 337944 17 0 0 25 0 9 0 47781714 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4125956015 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.68
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5076 0 0 0 65 3 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.16
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 393 0 0 0 16 0 0 0 16 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3380.47
Current children cumulated vsize (KiB) 850012

[startup+3462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/83 21818
/proc/meminfo: memFree=1745032/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=3440.45
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9651 0 1 0 344023 22 0 0 18 0 9 0 47781713 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8571 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=3439.58
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3444 0 1 0 343941 17 0 0 25 0 9 0 47781714 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4125969032 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.68
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5076 0 0 0 65 3 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.16
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 393 0 0 0 16 0 0 0 16 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3440.45
Current children cumulated vsize (KiB) 850012

[startup+3522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/83 21818
/proc/meminfo: memFree=1744968/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=3500.41
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9652 0 1 0 350019 22 0 0 18 0 9 0 47781713 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8571 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=3499.55
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3445 0 1 0 349938 17 0 0 25 0 9 0 47781714 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4125968944 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.68
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5076 0 0 0 65 3 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.16
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 393 0 0 0 16 0 0 0 16 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3500.41
Current children cumulated vsize (KiB) 850012

[startup+3582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/83 21818
/proc/meminfo: memFree=1744904/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=3560.39
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9652 0 1 0 356017 22 0 0 18 0 9 0 47781713 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8571 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=3559.52
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3445 0 1 0 355935 17 0 0 25 0 9 0 47781714 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4125956059 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.68
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5076 0 0 0 65 3 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.16
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 393 0 0 0 16 0 0 0 16 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3560.39
Current children cumulated vsize (KiB) 850012



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3622 s]
/proc/loadavg: 2.00 2.00 2.00 3/83 21818
/proc/meminfo: memFree=1744904/2055920 swapFree=4180308/4192956
[pid=21696] ppid=21694 vsize=5356 CPUtime=0
/proc/21696/stat : 21696 (concrete.sh) S 21694 21696 21131 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 47781712 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 221236486980 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/21696/statm: 1339 242 201 169 0 50 0
[pid=21699] ppid=21696 vsize=844656 CPUtime=3600.07
/proc/21699/stat : 21699 (java) S 21696 21696 21131 0 -1 0 9652 0 1 0 359985 22 0 0 18 0 9 0 47781713 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/21699/statm: 211164 8571 2571 9 0 205731 0
[pid=21699/tid=21700] ppid=21696 vsize=844656 CPUtime=3599.21
/proc/21699/task/21700/stat : 21700 (java) R 21696 21696 21131 0 -1 64 3445 0 1 0 359903 18 0 0 25 0 9 0 47781714 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4125952777 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21701] ppid=21696 vsize=844656 CPUtime=0.68
/proc/21699/task/21701/stat : 21701 (java) S 21696 21696 21131 0 -1 64 5076 0 0 0 65 3 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=21699/tid=21702] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21702/stat : 21702 (java) S 21696 21696 21131 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21703] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21703/stat : 21703 (java) S 21696 21696 21131 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 47781715 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21704] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21704/stat : 21704 (java) S 21696 21696 21131 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21705] ppid=21696 vsize=844656 CPUtime=0.16
/proc/21699/task/21705/stat : 21705 (java) S 21696 21696 21131 0 -1 64 393 0 0 0 16 0 0 0 16 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21706] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21706/stat : 21706 (java) S 21696 21696 21131 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=21699/tid=21707] ppid=21696 vsize=844656 CPUtime=0
/proc/21699/task/21707/stat : 21707 (java) S 21696 21696 21131 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 47781717 864927744 8571 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.07
Current children cumulated vsize (KiB) 850012

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21696 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 3600.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3622.02
CPU time (s): 3600.07
CPU user time (s): 3599.85
CPU system time (s): 0.22
CPU usage (%): 99.394
Max. virtual memory (cumulated for all children) (KiB): 850012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 5

runsolver used 4.72528 second user time and 11.7632 second system time

The end

Launcher Data (download as text)

Begin job on node21 at 2008-07-13 02:59:56
IDJOB=1114911
IDBENCH=61793
IDSOLVER=335
FILE ID=node21/1114911-1215910796
PBS_JOBID= 7903714
Free space on /tmp= 66480 MiB

SOLVER NAME= Concrete + CSP4J - MCRW Engine 2008-05-30
BENCH NAME= CPAI08/csp/tightness0.9/normalized-rand-2-40-180-84-900-40_ext.xml
COMMAND LINE= HOME/concrete.sh -c -ext 0 -s MCRW -max BENCHNAME 
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1114911-1215910796/watcher-1114911-1215910796 -o /tmp/evaluation-result-1114911-1215910796/solver-1114911-1215910796 -C 3600 -W 4000 -M 900 --output-limit 1,15  HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1114911-1215910796.xml 

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= a91b122166d09430f4c9a44f5a97b7f6
RANDOM SEED=1383690943

node21.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.257
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.257
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1873328 kB
Buffers:         38496 kB
Cached:          78044 kB
SwapCached:       6744 kB
Active:          65080 kB
Inactive:        73756 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1873328 kB
SwapTotal:     4192956 kB
SwapFree:      4180308 kB
Dirty:            2620 kB
Writeback:           0 kB
Mapped:          38032 kB
Slab:            28924 kB
Committed_AS:   258140 kB
PageTables:       1916 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66468 MiB
End job on node21 at 2008-07-13 04:00:20