Trace number 1113888

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerNumber of falsified constraintsCPU timeWall clock time
Concrete + CSP4J - Tabu Engine 2008-05-30MSAT (TO)9 3600.03 3617.12

General information on the benchmark

Namecsp/os-taillard-10/
normalized-os-taillard-10-95-3.xml
MD5SUMdfb2240ca0f054206c6638f309ef341d
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkMOPT
Best Number of falsified constraints4
Best CPU time to get the best result obtained on this benchmark2152.9
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints900
Maximum constraint arity2
Maximum domain size548
Number of constraints which are defined in extension0
Number of constraints which are defined in intension900
Global constraints used (with number of constraints)

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

1.87/1.98	c CPU-LOAD 1.11
1.87/1.98	c LOADED 100 V (548 E), 900 DTPConstraint, arity 2, 1.11 cpu
2.26/2.40	s SATISFIABLE
2.26/2.40	o 867
2.26/2.40	v 2 519 150 214 367 264 101 393 142 465 180 404 65 522 90 247 311 2 306 465 267 197 387 22 358 21 484 79 379 515 168 278 467 51 70 317 195 1 221 450 16 152 375 289 434 401 508 446 50 195 533 447 127 219 157 275 495 26 333 318 310 8 197 410 187 272 477 311 511 103 194 474 512 281 12 113 260 290 375 139 87 162 439 109 268 353 507 209 28 362 471 55 185 437 311 157 344 64 0 355 
2.36/2.40	o 868
2.36/2.40	v 2 519 150 214 367 270 101 393 142 465 180 404 65 522 90 247 311 2 306 465 267 197 387 22 358 21 484 79 379 515 168 278 467 51 70 317 195 1 221 450 16 152 375 289 434 401 508 446 50 195 533 447 127 219 157 275 495 26 333 318 310 8 197 410 187 272 477 311 511 103 194 474 512 281 12 113 260 290 375 139 87 162 439 109 268 353 507 209 28 362 471 55 185 437 311 157 344 64 0 355 
2.36/2.41	o 869
2.36/2.41	v 2 519 150 214 367 270 101 393 142 465 180 404 65 522 90 247 311 2 306 465 267 197 387 139 358 21 484 79 379 515 168 278 467 51 70 317 195 1 221 450 16 152 375 289 434 401 508 446 50 195 533 447 127 219 157 275 495 26 333 318 310 8 197 410 187 272 477 311 511 103 194 474 512 281 12 113 260 290 375 139 87 162 439 109 268 353 507 209 28 362 471 55 185 437 311 157 344 64 0 355 
2.36/2.42	o 870
2.36/2.42	v 2 519 275 214 367 270 101 393 142 465 180 404 65 522 87 247 311 2 306 465 267 197 387 139 358 21 484 85 379 515 168 278 109 220 70 317 195 1 221 450 16 152 375 289 434 401 508 446 50 195 533 447 127 219 157 275 495 26 333 315 310 8 197 410 186 272 477 311 511 103 194 474 512 281 12 113 260 290 375 177 87 162 439 109 258 20 507 209 456 362 471 55 185 437 311 157 344 64 0 355 
2.36/2.43	o 871
2.36/2.43	v 2 519 275 214 367 270 101 393 142 465 180 404 65 522 87 247 311 2 306 465 267 197 387 139 358 21 484 85 379 515 168 278 109 220 70 317 195 1 221 450 16 152 375 289 434 401 508 444 50 195 533 447 127 219 157 275 495 26 333 315 310 8 197 410 186 272 477 311 511 103 199 474 512 281 1 95 260 290 375 177 87 162 439 109 258 20 507 209 456 362 471 55 185 437 311 157 344 64 0 355 
2.36/2.45	o 872
2.36/2.45	v 2 519 2 214 128 270 101 393 142 465 180 404 65 522 86 247 311 2 306 465 267 197 387 139 358 21 484 80 379 515 168 278 105 220 343 317 195 1 221 450 72 152 375 289 434 401 508 444 9 195 533 447 127 189 157 275 495 26 333 87 302 8 213 410 186 272 477 14 511 103 199 474 512 281 1 95 260 290 362 184 87 162 439 109 256 20 507 209 456 362 471 69 185 437 311 157 344 53 0 355 
2.36/2.47	o 873
2.36/2.47	v 2 519 2 214 200 293 101 393 142 465 180 404 65 522 86 247 311 2 303 465 267 197 387 139 358 21 484 98 378 515 168 278 105 11 343 317 195 36 221 450 80 152 375 289 434 401 508 444 9 195 533 447 127 189 157 275 495 26 333 87 302 8 354 410 186 272 477 21 511 103 199 474 512 281 1 95 260 290 362 184 87 162 439 109 256 20 507 256 219 362 471 69 185 437 311 157 328 81 0 355 
2.36/2.48	o 874
2.36/2.48	v 2 519 2 214 200 293 101 393 142 465 180 404 65 522 86 247 311 2 303 465 267 197 387 139 358 21 484 98 378 515 168 278 105 11 343 317 195 36 221 450 80 152 375 289 434 401 508 444 9 195 533 447 127 189 157 275 495 26 333 87 302 442 354 410 186 272 543 21 511 103 199 474 512 281 1 95 260 290 362 184 87 162 439 109 256 17 507 262 199 362 471 69 185 437 311 157 328 235 0 355 
2.46/2.50	o 875
2.46/2.50	v 2 519 2 214 200 293 101 393 142 465 180 404 65 522 72 247 312 2 303 465 267 197 385 133 358 21 484 36 378 515 168 278 105 86 343 309 195 36 221 450 121 152 375 289 434 401 508 444 15 195 533 447 127 189 157 275 495 26 333 87 302 442 354 410 186 272 543 21 511 103 199 474 512 281 1 95 260 290 362 184 87 162 439 407 256 17 507 297 200 362 471 69 185 437 311 157 328 239 0 355 
2.46/2.51	o 876
2.46/2.51	v 2 519 2 214 200 293 101 393 142 465 180 404 65 522 72 247 312 2 303 465 267 197 385 133 358 21 484 36 378 515 168 278 105 86 343 309 195 36 221 450 121 152 375 289 434 401 508 444 15 195 533 447 127 189 157 275 495 26 333 87 302 442 364 410 186 272 543 24 511 103 199 474 512 281 1 95 260 290 362 184 4 162 439 407 256 19 507 49 200 362 471 69 185 437 311 157 334 239 0 355 
2.46/2.53	o 877
2.46/2.53	v 2 519 2 216 200 293 101 393 142 465 273 404 68 522 107 247 312 2 303 465 267 197 267 112 358 21 484 14 378 515 168 278 105 100 332 309 195 23 221 450 121 152 375 289 434 401 508 444 18 195 533 447 127 189 157 275 495 26 333 87 302 442 362 410 186 272 543 24 511 103 199 474 512 281 1 109 260 290 362 184 4 162 439 407 256 15 507 49 457 362 471 65 185 437 311 157 342 239 0 355 
2.46/2.55	o 878
2.46/2.55	v 2 519 2 216 209 293 101 393 142 465 273 404 68 522 107 247 312 2 303 465 267 197 267 112 358 412 484 14 378 515 168 278 105 432 3 309 195 6 213 450 121 152 375 289 434 401 508 307 18 195 533 447 127 189 157 275 495 26 326 87 302 442 362 410 186 272 543 24 511 103 199 474 512 281 1 109 260 290 362 184 4 162 439 407 256 15 507 49 224 362 470 65 185 437 311 157 342 239 0 355 
2.46/2.57	o 879
2.46/2.57	v 9 500 2 237 206 293 101 393 142 465 273 404 68 522 109 247 312 2 303 465 267 197 267 112 358 417 484 14 373 515 168 278 105 9 3 309 195 482 213 450 121 152 375 456 434 401 272 307 8 195 533 447 127 189 157 275 495 26 329 87 302 442 362 410 186 272 543 8 511 103 199 474 512 281 1 109 260 290 362 184 4 162 439 407 256 35 507 58 224 362 470 66 470 437 311 157 342 239 0 350 
2.46/2.58	o 880
2.46/2.58	v 9 500 2 225 206 293 101 393 142 465 273 404 68 522 109 247 310 2 303 465 174 197 271 112 358 417 484 14 373 515 168 278 105 9 3 309 195 482 213 450 121 152 375 448 434 401 272 307 8 195 533 447 127 189 144 275 495 26 329 87 302 442 362 410 186 272 543 8 511 103 199 474 512 281 1 109 260 290 362 184 4 162 439 407 256 35 507 58 224 362 470 66 470 437 311 157 342 239 0 350 
2.56/2.60	o 881
2.56/2.60	v 6 500 2 235 222 293 101 393 142 465 273 404 68 522 109 247 310 2 303 465 174 197 271 112 358 417 484 14 376 515 168 278 105 470 3 309 195 419 213 318 121 152 375 458 434 401 272 307 19 195 533 447 127 189 144 275 495 26 329 87 302 442 362 410 186 272 543 8 511 103 199 474 512 281 1 109 260 290 362 184 4 162 439 407 257 25 507 50 224 362 472 63 470 437 311 157 342 239 0 350 
2.56/2.61	o 882
2.56/2.61	v 6 529 2 235 222 293 101 393 142 465 273 404 68 522 109 247 310 2 303 465 174 197 271 112 358 417 484 14 376 515 168 278 105 470 3 309 195 419 213 318 121 152 375 458 434 401 272 307 19 195 533 447 127 189 144 275 495 26 329 87 302 442 362 410 186 272 543 8 511 103 199 474 512 281 1 109 260 290 362 184 4 162 439 407 257 25 507 50 224 362 472 63 470 437 311 157 342 239 0 350 
2.56/2.63	o 883
2.56/2.63	v 5 529 2 227 222 293 101 393 142 465 273 404 68 522 109 247 309 2 305 465 177 197 271 112 358 418 484 12 374 515 168 278 105 470 3 309 195 419 213 318 121 152 375 458 434 401 272 307 12 195 533 447 127 189 144 275 495 26 329 87 302 442 362 410 186 272 543 8 511 103 189 474 512 281 1 109 260 290 362 184 4 128 439 407 275 25 507 30 224 362 163 63 475 437 311 157 345 239 0 332 
2.56/2.69	o 884
2.56/2.69	v 9 529 6 223 460 293 101 393 142 118 273 404 68 522 107 247 310 2 295 465 176 183 270 112 358 411 484 12 373 515 168 278 105 470 3 309 195 418 213 315 121 152 375 458 434 401 272 307 11 195 533 447 127 189 144 275 495 26 330 87 302 442 362 410 186 272 543 1 511 103 189 474 512 281 4 109 260 290 362 184 4 128 439 407 256 24 507 20 224 362 163 69 475 437 311 157 335 239 0 339 
2.66/2.71	o 885
2.66/2.71	v 6 529 4 223 460 293 101 393 142 118 273 404 68 522 107 247 305 2 306 465 177 183 258 112 358 411 484 12 3 515 168 278 105 470 3 309 195 418 213 315 121 152 375 458 434 401 272 307 11 195 533 447 127 189 144 275 495 26 330 87 302 442 362 410 186 272 543 6 511 103 189 474 512 281 4 109 260 290 362 184 4 128 439 407 275 167 507 21 236 362 163 67 475 437 311 157 345 239 0 332 
7.14/7.21	o 886
7.14/7.21	v 1 529 2 223 460 293 96 393 142 118 273 404 68 522 109 247 310 2 302 465 191 202 275 105 358 411 484 7 5 515 168 278 105 470 3 309 195 418 213 315 121 152 375 458 434 401 272 307 15 194 533 447 127 189 144 275 495 26 332 87 302 442 362 410 186 272 543 5 511 103 412 474 512 281 11 109 260 290 367 184 4 128 439 407 268 168 507 16 236 362 163 76 475 437 311 157 337 239 0 158 
11.02/11.17	o 887
11.02/11.17	v 0 529 2 223 460 293 96 393 142 118 273 404 67 522 103 247 306 2 295 465 158 202 273 105 358 411 484 3 4 515 168 278 105 470 3 308 195 418 213 311 121 152 375 458 434 401 272 307 16 195 533 255 127 439 211 275 495 26 329 87 302 442 362 410 186 272 543 23 511 103 402 474 512 281 6 109 260 290 367 184 4 128 439 407 276 165 507 21 238 362 166 78 472 437 311 157 329 239 0 158 
229.06/230.30	o 888
229.06/230.30	v 457 366 283 402 178 104 351 29 239 8 401 28 65 1 168 362 432 252 442 316 106 3 461 152 75 237 409 300 301 207 390 148 179 223 296 47 278 497 10 405 507 406 11 38 3 181 447 124 212 324 470 357 433 127 0 390 368 497 178 84 493 106 28 183 403 12 277 324 300 223 302 185 48 499 316 415 4 512 81 224 1 435 361 284 182 15 474 82 514 313 383 464 244 106 441 7 14 325 145 221 
230.65/231.85	o 889
230.65/231.85	v 457 366 283 402 178 104 351 41 239 8 401 28 68 1 165 362 153 250 445 316 106 3 461 152 439 237 409 308 303 207 390 148 239 177 296 47 278 497 10 405 507 406 11 37 3 183 472 124 213 316 470 357 433 279 0 390 368 497 166 84 493 106 28 183 403 12 277 283 80 223 300 185 27 499 362 417 4 512 66 224 1 435 377 284 182 15 474 83 514 313 383 469 26 106 303 7 17 327 145 209 
232.24/233.44	o 890
232.24/233.44	v 457 89 283 402 178 106 351 27 239 8 401 28 66 1 166 362 152 250 445 316 106 7 454 152 439 237 409 308 301 207 390 148 239 181 296 47 278 497 10 405 507 406 11 30 3 360 472 124 183 282 470 357 433 280 0 390 368 497 172 84 493 106 28 189 403 12 277 287 80 223 300 185 32 499 369 419 4 512 63 224 1 435 377 284 182 15 474 83 514 313 382 462 33 106 303 7 12 323 145 209 
234.33/235.50	o 891
234.33/235.50	v 457 89 283 402 178 106 351 28 239 8 401 28 66 1 167 362 151 250 445 316 106 7 454 152 439 237 409 297 286 207 390 148 239 181 296 47 278 497 10 405 507 406 11 30 3 360 472 124 180 281 470 357 433 280 0 390 368 497 174 84 493 106 381 28 426 12 277 290 80 223 303 185 58 499 300 416 4 512 88 224 1 435 377 284 182 13 474 82 514 313 27 474 400 106 303 7 15 324 145 209

Verifier Data (download as text)

OK	9	891
9 unsatisfied constraints, 891 satisfied constraints

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1113888-1215893128/watcher-1113888-1215893128 -o /tmp/evaluation-result-1113888-1215893128/solver-1113888-1215893128 -C 3600 -W 4000 -M 900 --output-limit 1,15 HOME/concrete.sh -c -ext 0 -max -s Tabu HOME/instance-1113888-1215893128.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 4000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.10 3.10 3.09 7/81 18621
/proc/meminfo: memFree=1854288/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 271 0 0 0 0 0 0 0 19 0 1 0 45720882 5484544 230 996147200 4194304 4889804 548682068752 18446744073709551615 223188058194 0 0 4100 65536 18446744071563648864 0 0 17 1 0 0
/proc/18620/statm: 1339 230 191 169 0 50 0
[pid=18621] ppid=18620 vsize=5356 CPUtime=0
/proc/18621/stat : 18621 (concrete.sh) R 18620 18620 17987 0 -1 4194368 25 0 0 0 0 0 0 0 21 0 1 0 45720882 5484544 235 996147200 4194304 4889804 548682068752 18446744073709551615 223187889447 0 0 4096 0 0 0 0 17 1 0 0
/proc/18621/statm: 1339 235 195 169 0 50 0

[startup+0.0508989 s]
/proc/loadavg: 3.10 3.10 3.09 7/81 18621
/proc/meminfo: memFree=1854288/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.102714 s]
/proc/loadavg: 3.10 3.10 3.09 7/81 18621
/proc/meminfo: memFree=1854288/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.302722 s]
/proc/loadavg: 3.10 3.10 3.09 7/81 18621
/proc/meminfo: memFree=1854288/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.702768 s]
/proc/loadavg: 3.10 3.10 3.09 7/81 18621
/proc/meminfo: memFree=1854288/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.50183 s]
/proc/loadavg: 3.10 3.10 3.09 5/91 18632
/proc/meminfo: memFree=1838528/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=846780 CPUtime=1.47
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 8011 0 1 0 142 5 0 0 18 0 10 0 45720883 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211695 7165 2574 9 0 206256 0
[pid=18623/tid=18624] ppid=18620 vsize=846780 CPUtime=0.96
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3415 0 1 0 94 2 0 0 24 0 10 0 45720884 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18625] ppid=18620 vsize=846780 CPUtime=0.15
/proc/18623/task/18625/stat : 18625 (java) R 18620 18620 17987 0 -1 64 2849 0 0 0 14 1 0 0 16 0 10 0 45720885 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 103737215 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=846780 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 10 0 45720885 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=846780 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 15 0 10 0 45720885 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=846780 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 10 0 45720887 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=846780 CPUtime=0.33
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1012 0 0 0 33 0 0 0 16 0 10 0 45720887 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=846780 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 10 0 45720887 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=846780 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 10 0 45720887 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18632] ppid=18620 vsize=846780 CPUtime=0
/proc/18623/task/18632/stat : 18632 (java) S 18620 18620 17987 0 -1 64 3 0 0 0 0 0 0 0 22 0 10 0 45720978 867102720 7165 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 852136

[startup+3.10197 s]
/proc/loadavg: 3.10 3.10 3.09 3/90 18632
/proc/meminfo: memFree=1825344/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=3.06
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10530 0 1 0 299 7 0 0 18 0 9 0 45720883 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9644 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=2.21
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3606 0 1 0 219 2 0 0 25 0 9 0 45720884 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4126905416 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5058 0 0 0 33 3 0 0 17 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.46
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1129 0 0 0 46 0 0 0 16 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 852420

[startup+6.30226 s]
/proc/loadavg: 3.10 3.10 3.09 3/90 18632
/proc/meminfo: memFree=1825152/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=6.24
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10531 0 1 0 617 7 0 0 18 0 9 0 45720883 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9644 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=5.39
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3606 0 1 0 537 2 0 0 25 0 9 0 45720884 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4126870118 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5058 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.46
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1130 0 0 0 46 0 0 0 16 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 852420

[startup+12.7018 s]
/proc/loadavg: 3.01 3.08 3.08 3/90 18632
/proc/meminfo: memFree=1825152/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=12.61
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10532 0 1 0 1254 7 0 0 18 0 9 0 45720883 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9644 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=11.76
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3607 0 1 0 1174 2 0 0 25 0 9 0 45720884 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4126852519 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5058 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.46
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1130 0 0 0 46 0 0 0 16 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9644 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 852420

[startup+25.503 s]
/proc/loadavg: 2.78 3.03 3.06 3/90 18632
/proc/meminfo: memFree=1825216/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=25.35
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10533 0 1 0 2528 7 0 0 18 0 9 0 45720883 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9645 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=24.49
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3607 0 1 0 2447 2 0 0 25 0 9 0 45720884 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4126852456 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5058 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.47
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1131 0 0 0 47 0 0 0 16 0 9 0 45720887 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9645 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.35
Current children cumulated vsize (KiB) 852420

################
# More data... #
################

/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1137 0 0 0 48 0 0 0 16 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3385.87
Current children cumulated vsize (KiB) 852420

[startup+3462.3 s]
/proc/loadavg: 2.42 2.60 2.61 3/92 18691
/proc/meminfo: memFree=1422960/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=3445.55
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10565 0 1 0 344534 21 0 0 18 0 9 0 45720883 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9665 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=3444.68
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3619 0 1 0 344452 16 0 0 25 0 9 0 45720884 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4126905315 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5072 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.48
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1137 0 0 0 48 0 0 0 16 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3445.55
Current children cumulated vsize (KiB) 852420

[startup+3522.3 s]
/proc/loadavg: 2.43 2.58 2.60 3/92 18742
/proc/meminfo: memFree=1778160/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=3505.32
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10565 0 1 0 350503 29 0 0 18 0 9 0 45720883 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9665 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=3504.46
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3619 0 1 0 350421 25 0 0 25 0 9 0 45720884 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4126870118 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5072 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.48
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1137 0 0 0 48 0 0 0 16 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3505.32
Current children cumulated vsize (KiB) 852420

[startup+3582.3 s]
/proc/loadavg: 2.23 2.49 2.57 3/92 18742
/proc/meminfo: memFree=1190000/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=3565.25
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10565 0 1 0 356488 37 0 0 18 0 9 0 45720883 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9665 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=3564.37
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3619 0 1 0 356405 32 0 0 25 0 9 0 45720884 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4126905315 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5072 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.48
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1137 0 0 0 48 0 0 0 16 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3565.25
Current children cumulated vsize (KiB) 852420



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3617.1 s]
/proc/loadavg: 2.06 2.42 2.54 3/92 18793
/proc/meminfo: memFree=1798000/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=3600.03
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10565 0 1 0 359962 41 0 0 18 0 9 0 45720883 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9665 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=3599.15
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3619 0 1 0 359879 36 0 0 25 0 9 0 45720884 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4126852534 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5072 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.48
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1137 0 0 0 48 0 0 0 16 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3600.03
Current children cumulated vsize (KiB) 852420

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+3617.1 s]
/proc/loadavg: 2.06 2.42 2.54 3/92 18793
/proc/meminfo: memFree=1798000/2055920 swapFree=4181044/4192956
[pid=18620] ppid=18618 vsize=5356 CPUtime=0
/proc/18620/stat : 18620 (concrete.sh) S 18618 18620 17987 0 -1 4194304 315 128 0 0 0 0 0 0 18 0 1 0 45720882 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 223187886916 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18620/statm: 1339 242 201 169 0 50 0
[pid=18623] ppid=18620 vsize=847064 CPUtime=3600.03
/proc/18623/stat : 18623 (java) S 18620 18620 17987 0 -1 0 10565 0 1 0 359962 41 0 0 18 0 9 0 45720883 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18623/statm: 211766 9665 2578 9 0 206326 0
[pid=18623/tid=18624] ppid=18620 vsize=847064 CPUtime=3599.15
/proc/18623/task/18624/stat : 18624 (java) R 18620 18620 17987 0 -1 64 3619 0 1 0 359879 36 0 0 25 0 9 0 45720884 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4126852534 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18623/tid=18625] ppid=18620 vsize=847064 CPUtime=0.36
/proc/18623/task/18625/stat : 18625 (java) S 18620 18620 17987 0 -1 64 5072 0 0 0 33 3 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18626] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18626/stat : 18626 (java) S 18620 18620 17987 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18627] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18627/stat : 18627 (java) S 18620 18620 17987 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 45720885 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18628] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18628/stat : 18628 (java) S 18620 18620 17987 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18629] ppid=18620 vsize=847064 CPUtime=0.48
/proc/18623/task/18629/stat : 18629 (java) S 18620 18620 17987 0 -1 64 1137 0 0 0 48 0 0 0 16 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18630] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18630/stat : 18630 (java) S 18620 18620 17987 0 -1 64 0 0 0 0 0 0 0 0 19 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18623/tid=18631] ppid=18620 vsize=847064 CPUtime=0
/proc/18623/task/18631/stat : 18631 (java) S 18620 18620 17987 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 45720887 867393536 9665 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3600.03
Current children cumulated vsize (KiB) 852420

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18620 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.004998
# while last known CPU time is 3600.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3617.12
CPU time (s): 3600.03
CPU user time (s): 3599.62
CPU system time (s): 0.41
CPU usage (%): 99.5275
Max. virtual memory (cumulated for all children) (KiB): 852420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 4

runsolver used 4.43633 second user time and 12.0372 second system time

The end

Launcher Data (download as text)

Begin job on node68 at 2008-07-12 22:05:28
IDJOB=1113888
IDBENCH=61658
IDSOLVER=336
FILE ID=node68/1113888-1215893128
PBS_JOBID= 7903590
Free space on /tmp= 66560 MiB

SOLVER NAME= Concrete + CSP4J - Tabu Engine 2008-05-30
BENCH NAME= CPAI08/csp/os-taillard-10/normalized-os-taillard-10-95-3.xml
COMMAND LINE= HOME/concrete.sh -c -ext 0 -max -s Tabu BENCHNAME 
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1113888-1215893128/watcher-1113888-1215893128 -o /tmp/evaluation-result-1113888-1215893128/solver-1113888-1215893128 -C 3600 -W 4000 -M 900 --output-limit 1,15  HOME/concrete.sh -c -ext 0 -max -s Tabu HOME/instance-1113888-1215893128.xml 

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= dfb2240ca0f054206c6638f309ef341d
RANDOM SEED=1645797185

node68.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1854904 kB
Buffers:         19848 kB
Cached:          54704 kB
SwapCached:       5892 kB
Active:         122680 kB
Inactive:        36412 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1854904 kB
SwapTotal:     4192956 kB
SwapFree:      4181044 kB
Dirty:            1004 kB
Writeback:           0 kB
Mapped:         101520 kB
Slab:            27268 kB
Committed_AS:   927556 kB
PageTables:       1952 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66516 MiB
End job on node68 at 2008-07-12 23:05:47