Trace number 1112419

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerNumber of falsified constraintsCPU timeWall clock time
Concrete + CSP4J - MCRW Engine 2008-05-30MSAT (TO)3 3600.02 3625.92

General information on the benchmark

Namecsp/super-os/super-os-taillard-5/
normalized-super-os-taillard-5-7.xml
MD5SUM891dc58259d78fa5815dec2b7fea9f74
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkMOPT
Best Number of falsified constraints3
Best CPU time to get the best result obtained on this benchmark645.598
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of constraints325
Maximum constraint arity2
Maximum domain size302
Number of constraints which are defined in extension0
Number of constraints which are defined in intension325
Global constraints used (with number of constraints)

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

1.21/1.83	c CPU-LOAD 0.74
1.21/1.83	c LOADED 50 V (302 E), 300 DTPConstraint, 25 ExtensionConstraint2D, arity 2, 0.74 cpu
1.32/1.99	s SATISFIABLE
1.32/1.99	o 289
1.32/1.99	v 123 11 200 205 224 239 95 34 42 7 49 172 234 98 117 144 13 9 246 203 3 202 4 125 116 130 233 201 102 287 106 131 187 88 0 1 284 286 30 58 108 105 204 209 108 3 294 69 98 30 
1.32/1.99	o 290
1.32/1.99	v 123 11 200 205 224 239 95 34 42 7 49 172 234 98 117 104 13 9 246 203 3 202 4 125 116 130 233 201 102 287 106 131 187 88 0 132 284 286 30 58 108 105 204 209 108 3 294 69 98 30 
1.32/1.99	o 291
1.32/1.99	v 123 11 200 205 224 239 96 197 42 7 49 172 234 230 117 104 13 9 246 2 9 202 4 125 116 108 235 201 102 287 186 200 81 88 0 132 284 286 9 58 116 117 204 209 108 3 294 69 98 30 
1.42/2.01	o 292
1.42/2.01	v 112 71 259 205 240 194 98 0 42 7 63 139 236 186 100 113 0 18 257 203 0 129 5 125 107 108 225 201 294 287 186 119 90 88 0 122 289 286 25 48 210 117 201 209 107 6 294 69 98 30 
1.42/2.01	o 293
1.42/2.01	v 112 122 259 205 237 195 98 0 42 7 63 139 236 186 100 113 0 18 267 203 0 129 5 125 107 108 225 201 294 287 186 119 90 88 0 135 289 286 13 48 210 117 201 209 107 6 294 69 98 30 
1.42/2.02	o 294
1.42/2.02	v 98 122 259 205 237 189 98 0 42 7 63 159 235 186 7 112 0 210 116 203 0 115 1 11 107 108 225 201 294 287 186 189 91 88 0 135 289 286 13 48 210 117 201 209 107 6 294 69 98 30 
1.42/2.03	o 295
1.42/2.03	v 106 122 189 205 229 208 111 8 45 7 66 48 235 186 100 195 99 2 7 8 3 122 1 3 107 106 225 201 294 287 186 189 91 88 0 127 289 286 9 49 210 117 201 13 109 6 294 69 98 30 
1.42/2.03	o 296
1.42/2.03	v 106 122 189 205 229 221 111 8 45 7 50 48 235 186 100 195 99 214 7 8 3 122 1 3 107 106 225 201 294 287 186 189 91 88 0 127 289 286 9 49 210 117 201 13 109 6 294 69 98 30 
1.42/2.03	o 297
1.42/2.03	v 106 122 189 205 229 221 111 8 45 7 50 48 235 230 100 195 99 214 7 8 3 122 1 3 107 106 225 201 294 287 186 189 91 88 0 127 289 286 9 49 210 117 204 13 109 6 294 69 98 30 
1.42/2.03	o 298
1.42/2.03	v 106 122 189 205 229 221 111 8 45 7 50 48 235 230 100 195 99 214 7 8 132 122 1 3 107 106 225 201 294 287 186 189 91 88 0 127 289 286 9 49 210 117 204 13 109 6 294 69 98 30 
1.42/2.03	o 300
1.42/2.03	v 106 122 189 205 222 221 111 25 47 42 50 48 235 230 103 113 99 214 6 8 106 122 1 3 107 105 225 201 294 191 186 189 91 88 0 1 289 286 9 49 210 128 204 10 109 6 294 69 98 30 
1.42/2.04	o 301
1.42/2.04	v 106 29 189 205 222 221 111 25 47 42 50 48 235 230 103 113 99 8 6 8 106 122 1 3 107 105 225 201 294 191 186 189 91 88 0 1 289 286 216 49 210 128 205 10 109 6 294 69 98 30 
1.42/2.04	o 302
1.42/2.04	v 106 29 189 205 222 221 111 25 47 42 50 48 235 230 103 106 99 29 6 8 106 122 1 3 107 105 225 201 294 191 186 189 91 88 0 1 289 286 216 49 210 128 205 10 109 6 294 69 98 286 
1.42/2.07	o 303
1.42/2.07	v 118 45 189 205 121 219 221 215 41 44 57 51 235 207 200 199 127 128 1 8 127 116 20 3 195 203 66 19 294 191 98 77 93 87 0 8 289 286 208 50 210 208 110 10 113 7 294 9 287 286 
1.42/2.07	o 304
1.42/2.07	v 108 15 189 205 126 110 221 215 40 44 57 51 235 231 200 1 127 116 1 8 127 126 20 3 195 203 65 19 294 191 96 95 92 89 0 8 289 286 208 50 210 208 97 10 113 5 294 9 287 286 
1.51/2.14	o 305
1.51/2.14	v 115 1 199 76 100 52 216 0 230 44 187 51 236 44 193 4 113 116 8 65 116 112 1 3 203 205 65 63 294 191 99 68 103 93 2 8 289 286 238 50 200 7 104 10 193 11 294 90 287 286 
1.51/2.15	o 306
1.51/2.15	v 118 1 199 76 240 52 216 0 130 44 187 51 236 44 193 4 113 116 8 65 114 112 0 3 203 205 65 63 294 191 99 68 103 93 2 8 289 286 238 50 184 7 104 10 193 11 294 90 287 286 
1.81/2.47	o 307
1.81/2.47	v 103 1 198 20 236 12 110 3 218 2 130 9 214 36 94 15 184 1 272 1 234 1 224 3 113 14 123 16 299 191 111 3 100 6 185 8 283 286 238 50 109 16 206 4 186 10 292 4 100 16 
3.69/4.40	o 308
3.69/4.40	v 205 7 287 284 75 40 214 7 141 137 142 4 224 15 212 1 133 0 102 3 209 10 84 15 203 6 154 23 298 2 195 4 189 24 138 5 119 8 138 1 217 17 122 28 204 27 1 61 293 91 
4.58/5.24	o 309
4.58/5.24	v 88 1 282 11 87 13 216 2 161 7 186 3 98 6 165 3 93 6 265 2 90 11 176 3 159 2 245 6 298 297 60 8 159 2 255 12 191 8 254 7 176 0 173 3 83 3 264 39 296 23 
4.79/5.41	o 310
4.79/5.41	v 94 1 163 11 241 10 168 2 105 7 189 3 206 1 79 1 97 7 264 2 99 32 99 33 166 165 248 251 298 297 60 7 208 4 255 1 233 8 166 7 109 0 209 215 79 8 194 39 296 23 
11.23/11.92	o 311
11.23/11.92	v 178 10 82 79 184 14 105 0 248 9 248 251 11 20 89 10 95 16 215 192 95 16 232 231 103 1 184 2 294 5 79 0 98 99 194 0 288 289 246 244 101 5 97 3 195 0 294 1 185 8 
41.76/42.74	o 313
41.76/42.74	v 32 42 15 11 182 185 113 108 252 245 3 8 64 60 143 123 231 230 87 86 109 113 229 238 7 1 179 182 301 5 142 152 130 134 61 59 0 1 255 259 227 224 135 146 15 18 0 2 121 118 
42.26/43.23	o 314
42.26/43.23	v 182 180 17 11 50 49 115 116 249 250 0 1 147 164 50 51 231 232 89 90 112 113 236 238 11 6 181 182 1 5 146 139 39 43 176 192 7 1 258 255 223 225 143 138 21 22 0 4 128 129 
42.26/43.23	o 315
42.26/43.23	v 182 180 17 11 50 49 115 116 249 250 0 1 147 164 50 51 231 232 89 90 112 113 236 238 11 6 181 182 1 5 146 139 39 43 176 175 7 1 258 255 223 225 143 138 21 22 0 4 128 129 
42.26/43.23	o 316
42.26/43.23	v 182 180 17 11 50 49 115 116 249 250 0 1 147 164 50 3 231 232 89 90 112 113 236 238 11 6 181 182 1 5 149 139 39 43 177 175 7 1 258 255 227 225 143 138 21 22 0 4 128 129 
55.54/56.63	o 317
55.54/56.63	v 83 87 287 286 18 3 220 222 153 156 253 254 88 82 159 156 1 7 2 17 86 90 5 11 215 218 171 152 301 297 50 49 148 150 1 2 289 288 246 247 171 177 0 2 82 80 272 275 296 293 
55.84/56.91	o 318
55.84/56.91	v 81 82 287 286 1 3 219 222 163 154 251 248 85 88 156 150 5 2 2 11 91 100 1 5 217 218 170 168 301 297 53 48 151 150 0 4 289 288 246 247 172 174 0 1 81 80 272 275 296 295 
113.24/114.83	o 319
113.24/114.83	v 143 152 286 287 71 80 217 214 17 16 4 0 213 214 56 57 142 141 272 271 226 222 150 148 70 72 3 0 219 51 174 175 52 46 68 227 283 284 0 9 146 140 222 223 51 53 9 8 1 2 
113.54/115.19	o 320
113.54/115.19	v 146 143 286 287 63 66 215 216 8 7 2 1 213 214 52 53 142 141 272 271 232 229 147 145 60 59 0 5 214 144 155 139 44 50 236 167 288 284 2 1 142 145 221 223 52 49 9 8 0 1 
113.74/115.33	o 321
113.74/115.33	v 146 143 286 287 75 64 215 221 8 7 4 1 213 214 54 53 142 141 272 271 233 219 150 147 59 62 1 5 214 144 140 139 44 42 237 240 288 284 0 2 143 141 221 219 52 49 9 8 0 1 
113.74/115.33	o 322
113.74/115.33	v 146 143 286 287 75 64 215 221 8 7 4 1 213 214 54 53 142 141 272 271 233 219 150 147 59 62 1 5 214 144 140 139 44 42 237 240 288 289 0 2 143 141 221 219 52 49 9 8 0 1

Verifier Data (download as text)

OK	3	322
3 unsatisfied constraints, 322 satisfied constraints

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112419-1215867762/watcher-1112419-1215867762 -o /tmp/evaluation-result-1112419-1215867762/solver-1112419-1215867762 -C 3600 -W 4000 -M 900 --output-limit 1,15 HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112419-1215867762.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 4000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.09 2.81 2.55 4/80 19272
/proc/meminfo: memFree=1614568/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=880 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) R 19270 19272 17954 0 -1 4194304 40 0 0 0 0 0 0 0 20 0 1 0 43478255 901120 25 996147200 4194304 4889804 548682068752 18446744073709551615 225609577749 0 0 4096 0 0 0 0 17 0 0 0
/proc/19272/statm: 220 25 18 169 0 8 0

[startup+0.081979 s]
/proc/loadavg: 3.09 2.81 2.55 4/80 19272
/proc/meminfo: memFree=1614568/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.10298 s]
/proc/loadavg: 3.09 2.81 2.55 4/80 19272
/proc/meminfo: memFree=1614568/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.302997 s]
/proc/loadavg: 3.09 2.81 2.55 4/80 19272
/proc/meminfo: memFree=1614568/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.701038 s]
/proc/loadavg: 3.09 2.81 2.55 4/80 19272
/proc/meminfo: memFree=1614568/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.5011 s]
/proc/loadavg: 3.09 2.81 2.55 4/91 19284
/proc/meminfo: memFree=1603528/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=0.92
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 5890 0 1 0 87 5 0 0 18 0 10 0 43478259 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 5215 1971 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=0.58
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3611 0 1 0 55 3 0 0 22 0 10 0 43478268 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 102909623 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.03
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 498 0 0 0 3 0 0 0 16 0 10 0 43478286 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 10 0 43478286 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 16 0 10 0 43478286 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 10 0 43478292 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.28
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1045 0 0 0 28 0 0 0 16 0 10 0 43478292 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 10 0 43478292 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 10 0 43478292 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19284] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19284/stat : 19284 (java) S 19272 19272 17954 0 -1 64 4 0 0 0 0 0 0 0 20 0 10 0 43478355 867487744 5215 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 852512

[startup+3.10123 s]
/proc/loadavg: 3.09 2.81 2.55 4/90 19284
/proc/meminfo: memFree=1596040/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=2.5
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7622 0 1 0 244 6 0 0 18 0 9 0 43478259 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6743 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=2.02
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3655 0 1 0 198 4 0 0 25 0 9 0 43478268 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4126590595 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.12
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 12 0 0 0 17 0 9 0 43478286 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.33
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1080 0 0 0 33 0 0 0 15 0 9 0 43478292 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6743 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.5
Current children cumulated vsize (KiB) 852512

[startup+6.30251 s]
/proc/loadavg: 3.00 2.80 2.54 3/90 19284
/proc/meminfo: memFree=1595848/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=5.68
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7625 0 1 0 562 6 0 0 18 0 9 0 43478259 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6744 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=5.19
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3656 0 1 0 515 4 0 0 25 0 9 0 43478268 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4126551917 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.12
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 12 0 0 0 16 0 9 0 43478286 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.33
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1082 0 0 0 33 0 0 0 17 0 9 0 43478292 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6744 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 5.68
Current children cumulated vsize (KiB) 852512

[startup+12.7011 s]
/proc/loadavg: 3.00 2.80 2.54 4/90 19284
/proc/meminfo: memFree=1595848/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=12.02
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7626 0 1 0 1196 6 0 0 18 0 9 0 43478259 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6745 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=11.53
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3656 0 1 0 1149 4 0 0 25 0 9 0 43478268 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4126566701 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.12
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 12 0 0 0 16 0 9 0 43478286 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.33
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1083 0 0 0 33 0 0 0 17 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.02
Current children cumulated vsize (KiB) 852512

[startup+25.5022 s]
/proc/loadavg: 2.85 2.78 2.54 4/90 19284
/proc/meminfo: memFree=1596048/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=24.71
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7626 0 1 0 2465 6 0 0 18 0 9 0 43478259 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6745 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=24.23
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3656 0 1 0 2419 4 0 0 25 0 9 0 43478268 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4126545479 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.12
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 12 0 0 0 16 0 9 0 43478286 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.33
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1083 0 0 0 33 0 0 0 17 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6745 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 24.71
Current children cumulated vsize (KiB) 852512

[startup+51.1024 s]
/proc/loadavg: 2.78 2.77 2.54 4/90 19284

################
# More data... #
################

/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1092 0 0 0 36 0 0 0 17 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3377.34
Current children cumulated vsize (KiB) 852512

[startup+3462.3 s]
/proc/loadavg: 2.00 2.02 2.15 3/91 19327
/proc/meminfo: memFree=1911752/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=3437.09
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7658 0 1 0 343693 16 0 0 18 0 9 0 43478259 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6754 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=3436.55
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3679 0 1 0 343642 13 0 0 25 0 9 0 43478268 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4126566701 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.13
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 13 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.36
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1092 0 0 0 36 0 0 0 17 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3437.09
Current children cumulated vsize (KiB) 852512

[startup+3522.3 s]
/proc/loadavg: 2.00 2.01 2.14 3/91 19333
/proc/meminfo: memFree=1910792/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=3496.84
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7659 0 1 0 349668 16 0 0 18 0 9 0 43478259 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6754 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=3496.3
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3680 0 1 0 349617 13 0 0 25 0 9 0 43478268 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4126551949 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.13
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 13 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.36
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1092 0 0 0 36 0 0 0 17 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3496.84
Current children cumulated vsize (KiB) 852512

[startup+3582.3 s]
/proc/loadavg: 2.00 2.01 2.13 3/91 19333
/proc/meminfo: memFree=1910792/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=3556.6
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7659 0 1 0 355644 16 0 0 18 0 9 0 43478259 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6754 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=3556.07
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3680 0 1 0 355593 14 0 0 25 0 9 0 43478268 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4126566701 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.13
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 13 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.36
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1092 0 0 0 36 0 0 0 17 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) S 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3556.6
Current children cumulated vsize (KiB) 852512



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3625.9 s]
/proc/loadavg: 2.00 2.00 2.12 3/91 19333
/proc/meminfo: memFree=1910728/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=3600.02
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7659 0 1 0 359986 16 0 0 18 0 9 0 43478259 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6754 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=3599.49
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3680 0 1 0 359935 14 0 0 25 0 9 0 43478268 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4126590600 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.13
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 13 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.36
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1092 0 0 0 36 0 0 0 17 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) R 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.02
Current children cumulated vsize (KiB) 852512

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+3625.9 s]
/proc/loadavg: 2.00 2.00 2.12 3/91 19333
/proc/meminfo: memFree=1910728/2055920 swapFree=4178212/4192956
[pid=19272] ppid=19270 vsize=5356 CPUtime=0
/proc/19272/stat : 19272 (concrete.sh) S 19270 19272 17954 0 -1 4194304 315 128 0 0 0 0 0 0 17 0 1 0 43478255 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 225612194628 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/19272/statm: 1339 242 201 169 0 50 0
[pid=19275] ppid=19272 vsize=847156 CPUtime=3600.02
/proc/19275/stat : 19275 (java) S 19272 19272 17954 0 -1 0 7659 0 1 0 359986 16 0 0 18 0 9 0 43478259 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/19275/statm: 211789 6754 2583 9 0 206349 0
[pid=19275/tid=19276] ppid=19272 vsize=847156 CPUtime=3599.49
/proc/19275/task/19276/stat : 19276 (java) R 19272 19272 17954 0 -1 64 3680 0 1 0 359935 14 0 0 25 0 9 0 43478268 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4126590600 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19277] ppid=19272 vsize=847156 CPUtime=0.13
/proc/19275/task/19277/stat : 19277 (java) S 19272 19272 17954 0 -1 64 2150 0 0 0 13 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19278] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19278/stat : 19278 (java) S 19272 19272 17954 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19279] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19279/stat : 19279 (java) S 19272 19272 17954 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 43478286 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19280] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19280/stat : 19280 (java) S 19272 19272 17954 0 -1 64 0 0 0 0 0 0 0 0 18 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19281] ppid=19272 vsize=847156 CPUtime=0.36
/proc/19275/task/19281/stat : 19281 (java) S 19272 19272 17954 0 -1 64 1092 0 0 0 36 0 0 0 17 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19282] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19282/stat : 19282 (java) S 19272 19272 17954 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=19275/tid=19283] ppid=19272 vsize=847156 CPUtime=0
/proc/19275/task/19283/stat : 19283 (java) R 19272 19272 17954 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 43478292 867487744 6754 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.02
Current children cumulated vsize (KiB) 852512

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 19272 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=5999
# CPU time returned by wait4() is 0.005999
# while last known CPU time is 3600.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3625.92
CPU time (s): 3600.02
CPU user time (s): 3599.86
CPU system time (s): 0.16
CPU usage (%): 99.2857
Max. virtual memory (cumulated for all children) (KiB): 852512

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.005999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 32

runsolver used 3.61545 second user time and 9.71552 second system time

The end

Launcher Data (download as text)

Begin job on node31 at 2008-07-12 15:02:42
IDJOB=1112419
IDBENCH=61415
IDSOLVER=335
FILE ID=node31/1112419-1215867762
PBS_JOBID= 7903464
Free space on /tmp= 66488 MiB

SOLVER NAME= Concrete + CSP4J - MCRW Engine 2008-05-30
BENCH NAME= CPAI08/csp/super-os/super-os-taillard-5/normalized-super-os-taillard-5-7.xml
COMMAND LINE= HOME/concrete.sh -c -ext 0 -s MCRW -max BENCHNAME 
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112419-1215867762/watcher-1112419-1215867762 -o /tmp/evaluation-result-1112419-1215867762/solver-1112419-1215867762 -C 3600 -W 4000 -M 900 --output-limit 1,15  HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112419-1215867762.xml 

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= 891dc58259d78fa5815dec2b7fea9f74
RANDOM SEED=1724086281

node31.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1615240 kB
Buffers:          2816 kB
Cached:          32540 kB
SwapCached:       7756 kB
Active:         394296 kB
Inactive:         3612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1615240 kB
SwapTotal:     4192956 kB
SwapFree:      4178212 kB
Dirty:             880 kB
Writeback:           0 kB
Mapped:         378856 kB
Slab:            27156 kB
Committed_AS:  1047824 kB
PageTables:       2576 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66492 MiB
End job on node31 at 2008-07-12 16:03:10