Trace number 1112747

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerNumber of falsified constraintsCPU timeWall clock time
Concrete + CSP4J - MCRW Engine 2008-05-30MSAT (TO)7 3600.02 3633.33

General information on the benchmark

Namecsp/os-gp/
normalized-gp10-08-1092.xml
MD5SUMf41ed40355d7ef2ae84bd4ab3983b449
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkMOPT
Best Number of falsified constraints1
Best CPU time to get the best result obtained on this benchmark17.3564
Satisfiable
(Un)Satisfiability was proved
Number of variables101
Number of constraints1000
Maximum constraint arity2
Maximum domain size1093
Number of constraints which are defined in extension0
Number of constraints which are defined in intension1000
Global constraints used (with number of constraints)

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

2.06/2.12	c CPU-LOAD 1.13
2.06/2.12	c LOADED 101 V (1093 E), 100 DiffConstraint, 900 DTPConstraint, arity 2, 1.13 cpu
3.55/3.66	s SATISFIABLE
3.55/3.66	o 979
3.55/3.66	v 1092 551 561 826 170 940 5 3 815 837 124 291 528 865 612 131 421 56 1092 896 81 738 875 1090 274 674 111 893 188 592 880 967 1087 622 888 721 458 357 219 772 452 31 936 652 602 1076 898 531 237 67 1089 659 1043 13 1062 709 923 61 1056 79 479 112 1068 45 838 213 1087 145 399 76 69 1006 30 398 908 390 154 327 7 441 782 114 910 54 947 1092 1033 547 959 8 141 932 709 72 849 952 532 1083 851 38 1058 
3.55/3.67	o 980
3.55/3.67	v 1092 551 561 826 170 940 5 3 815 837 124 291 528 865 612 131 421 56 1092 891 81 738 875 1090 274 674 111 893 188 592 880 967 1069 622 888 721 458 357 219 772 452 31 936 652 602 1076 898 531 237 67 1084 659 1043 13 1062 709 923 61 1056 79 479 112 1068 45 838 213 1087 145 399 76 69 1006 30 398 908 390 154 327 7 441 782 114 910 54 947 1092 1033 547 959 8 141 932 479 72 849 952 532 1083 851 38 1058 
3.55/3.69	o 981
3.55/3.69	v 1092 551 561 826 1010 940 5 3 815 837 124 291 528 855 612 131 421 56 1090 889 81 738 875 1090 274 674 111 893 188 66 880 969 1080 622 888 188 458 357 219 772 452 31 936 652 602 1076 898 531 237 67 1084 659 1043 13 74 709 923 61 1056 79 479 112 1068 45 838 213 1087 145 399 76 69 1053 30 398 908 390 154 327 7 446 782 114 910 54 947 1086 1033 547 959 8 232 932 479 72 849 952 532 1085 851 38 1058 
3.75/3.83	o 982
3.75/3.83	v 1092 104 548 354 1082 940 5 3 937 274 581 291 528 638 612 131 421 56 1069 871 81 513 875 1087 225 674 111 893 188 66 54 993 1086 622 888 188 458 357 219 772 452 31 277 652 602 1076 898 531 237 67 1074 659 1043 13 143 709 765 61 1056 1082 858 112 1068 45 838 213 1086 145 399 76 69 801 30 398 22 284 154 327 7 446 354 114 910 54 947 338 1033 554 959 8 145 719 479 72 849 952 532 1089 851 38 1058 
3.85/3.98	o 983
3.85/3.98	v 1092 104 572 354 1088 123 5 3 91 274 763 291 528 630 612 131 421 56 1063 850 81 513 875 1086 226 674 111 893 188 66 54 1077 1071 622 888 188 458 357 219 772 452 31 277 1025 602 1090 898 151 237 67 1074 28 1043 13 125 82 765 61 1056 1075 564 112 1068 45 838 213 1087 145 399 76 69 1049 30 398 22 284 154 825 7 430 354 114 910 54 947 319 1033 476 959 8 137 719 479 72 849 952 532 1087 851 38 1058 
3.95/4.04	o 984
3.95/4.04	v 1092 104 538 354 1086 123 5 3 91 274 572 291 528 630 612 131 421 56 1064 850 81 513 875 1083 226 674 111 893 188 66 54 657 1073 622 70 188 458 357 219 85 452 31 917 1025 602 1090 898 151 237 67 255 28 1043 13 87 82 765 61 1056 1073 579 112 1068 45 838 213 1086 145 399 76 69 1049 30 398 22 284 154 825 7 430 887 114 910 54 947 307 1033 418 959 8 1087 719 479 72 849 952 532 1089 851 38 1058 
3.95/4.04	o 985
3.95/4.04	v 1092 104 538 354 1086 123 5 3 91 274 572 291 528 630 612 131 421 56 1064 850 81 513 875 1083 226 674 111 893 188 66 54 646 1073 622 70 188 458 357 219 85 452 31 917 1025 602 1090 898 151 237 67 255 28 1043 13 87 82 765 61 1056 1073 579 112 1068 45 838 213 1086 145 399 76 69 1049 30 398 22 284 154 825 7 430 887 114 910 54 947 307 1033 418 959 8 1091 0 479 72 849 952 532 1089 851 38 1058 
3.95/4.05	o 986
3.95/4.05	v 1092 104 538 354 1086 123 5 3 91 274 572 291 528 630 612 131 421 56 1064 850 81 513 875 1083 226 674 111 893 188 66 54 646 1073 622 70 188 458 357 219 85 152 31 917 1025 602 1090 898 151 237 67 255 28 1043 13 87 82 765 61 1056 1090 579 112 1068 45 838 213 1086 145 399 76 69 1049 30 398 22 284 154 825 7 430 887 114 910 54 947 317 1033 418 959 8 1091 0 479 72 849 952 532 1089 851 38 1058 
3.95/4.09	o 987
3.95/4.09	v 1092 104 535 354 1086 123 5 3 91 274 567 291 528 630 612 131 421 56 1069 850 81 513 875 1085 226 674 111 893 188 66 54 646 1079 622 70 188 458 357 219 85 152 31 917 1025 602 1083 898 151 237 67 255 28 1043 13 98 82 765 61 1056 1090 859 112 1068 45 838 213 1087 145 399 76 69 1056 30 398 22 284 154 825 7 430 9 114 910 54 947 338 1033 376 959 8 1086 0 479 72 849 952 532 1089 851 38 1058 
4.05/4.19	o 988
4.05/4.19	v 1092 104 179 997 1019 123 5 3 91 778 479 291 528 630 175 131 421 56 1075 850 81 513 875 1087 200 674 111 893 753 66 54 646 1089 622 70 188 458 357 219 85 152 31 917 1025 15 1073 898 151 237 67 414 28 1043 13 334 82 765 61 1056 1084 859 112 1068 45 838 213 1091 145 399 76 69 1056 30 888 22 284 154 825 7 430 9 114 910 54 947 340 1033 440 959 8 164 0 479 72 849 952 532 1087 851 38 1058 
4.15/4.25	o 989
4.15/4.25	v 1092 104 179 997 1040 123 5 3 91 778 500 291 528 630 3 131 421 56 1082 850 81 513 875 1087 93 674 705 893 753 66 793 646 1080 622 376 188 458 357 219 85 152 31 917 1025 15 1068 898 151 237 67 349 28 1043 13 399 82 765 61 1056 1058 859 112 1068 45 838 213 1091 145 399 76 69 1060 30 888 22 284 154 825 7 430 9 114 910 54 947 338 1033 427 959 8 164 0 479 72 849 952 532 1084 851 38 1058 
13.56/13.77	o 990
13.56/13.77	v 1092 51 106 69 1064 0 669 3 68 998 370 246 923 689 3 663 359 986 1092 363 281 295 13 1058 679 64 28 76 0 10 6 419 1054 4 16 2 59 28 961 107 1026 60 807 938 15 83 12 754 752 993 1087 0 4 13 285 61 76 814 161 1066 831 1 21 67 58 1003 1068 960 256 34 10 1040 366 143 109 991 495 2 219 598 12 266 9 219 20 1057 936 320 686 8 39 146 85 267 44 691 767 1084 1001 977 37 
25.94/26.23	o 991
25.94/26.23	v 1092 21 551 26 204 0 101 3 45 48 812 22 12 822 3 109 191 11 1085 261 749 143 13 1092 672 45 17 415 0 10 6 637 1090 4 16 2 45 87 46 165 371 9 967 91 2 1084 3 16 35 145 403 0 4 13 1083 1 396 35 97 633 192 1 21 19 22 47 1054 95 129 13 10 1087 149 510 37 625 302 2 26 649 389 616 2 725 601 265 206 751 651 595 19 66 143 220 15 148 645 1089 557 0 7 
167.39/169.04	o 992
167.39/169.04	v 1092 16 99 1088 725 2 645 11 8 38 353 620 6 342 15 56 0 46 971 724 86 495 27 676 79 9 10 1092 0 7 53 96 882 637 27 0 26 512 42 526 5 7 762 69 6 212 1 25 18 10 999 12 40 6 356 31 879 47 867 1024 170 14 32 1 3 924 1000 21 248 22 11 639 505 131 1 8 35 0 6 176 12 26 5 44 67 1081 561 158 75 12 718 71 0 1090 9 91 404 646 164 27 2 
1160.18/1171.25	o 993
1160.18/1171.25	v 1092 5 282 6 1048 1 19 3 0 549 770 63 2 305 93 152 106 11 1054 857 21 1076 6 543 266 0 1 49 25 18 19 176 573 56 7 4 5 24 10 87 1086 1 161 99 0 1078 154 12 4 32 458 21 5 1047 555 15 437 39 48 1088 257 24 1 242 17 57 931 33 304 6 4 609 40 9 2 3 526 8 7 180 1051 36 0 250 25 344 277 748 678 15 65 95 28 1083 46 981 801 279 155 9 0

Verifier Data (download as text)

OK	7	993
7 unsatisfied constraints, 993 satisfied constraints

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112747-1215873527/watcher-1112747-1215873527 -o /tmp/evaluation-result-1112747-1215873527/solver-1112747-1215873527 -C 3600 -W 4000 -M 900 --output-limit 1,15 HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112747-1215873527.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 4000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.17 2.03 2.01 4/81 16383
/proc/meminfo: memFree=1862316/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) R 16381 16383 15478 0 -1 4194304 295 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582840991 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=5356 CPUtime=0
/proc/16385/stat : 16385 (concrete.sh) R 16383 16383 15478 0 -1 4194368 0 0 0 0 0 0 0 0 21 0 1 0 44055977 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582840991 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/16385/statm: 1339 242 201 169 0 50 0

[startup+0.060135 s]
/proc/loadavg: 2.17 2.03 2.01 4/81 16383
/proc/meminfo: memFree=1862316/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=840680 CPUtime=0.04
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 2309 0 1 0 3 1 0 0 22 0 9 0 44055977 860856320 1841 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 210170 1841 1071 9 0 205147 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 846036

[startup+0.101176 s]
/proc/loadavg: 2.17 2.03 2.01 4/81 16383
/proc/meminfo: memFree=1862316/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=842904 CPUtime=0.08
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 3342 0 1 0 6 2 0 0 22 0 9 0 44055977 863133696 2798 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 210726 2798 1649 9 0 205303 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 848260

[startup+0.301163 s]
/proc/loadavg: 2.17 2.03 2.01 4/81 16383
/proc/meminfo: memFree=1862316/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=843364 CPUtime=0.28
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 4388 0 1 0 25 3 0 0 22 0 9 0 44055977 863604736 3775 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 210841 3775 1879 9 0 205402 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 848720

[startup+0.701211 s]
/proc/loadavg: 2.17 2.03 2.01 4/81 16383
/proc/meminfo: memFree=1862316/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=844276 CPUtime=0.67
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 4849 0 1 0 64 3 0 0 22 0 9 0 44055977 864538624 4230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211069 4230 1898 9 0 205630 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 849632

[startup+1.50231 s]
/proc/loadavg: 2.17 2.03 2.01 4/92 16395
/proc/meminfo: memFree=1847252/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=846852 CPUtime=1.47
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 7777 0 1 0 142 5 0 0 22 0 10 0 44055977 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211713 6926 2576 9 0 206274 0
[pid=16385/tid=16387] ppid=16383 vsize=846852 CPUtime=1
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3436 0 1 0 97 3 0 0 25 0 10 0 44055978 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16388] ppid=16383 vsize=846852 CPUtime=0.09
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 2598 0 0 0 9 0 0 0 16 0 10 0 44055979 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=846852 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 10 0 44055979 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=846852 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 15 0 10 0 44055979 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=846852 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 10 0 44055981 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=846852 CPUtime=0.34
/proc/16385/task/16392/stat : 16392 (java) R 16383 16383 15478 0 -1 64 1006 0 0 0 34 0 0 0 16 0 10 0 44055981 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 102129254 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=846852 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 10 0 44055981 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=846852 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 10 0 44055981 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16395] ppid=16383 vsize=846852 CPUtime=0
/proc/16385/task/16395/stat : 16395 (java) S 16383 16383 15478 0 -1 64 4 0 0 0 0 0 0 0 21 0 10 0 44056061 867176448 6926 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 852208

[startup+3.10249 s]
/proc/loadavg: 2.17 2.03 2.01 3/91 16395
/proc/meminfo: memFree=1820500/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=3.06
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15048 0 1 0 296 10 0 0 22 0 9 0 44055977 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14155 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=2.11
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3846 0 1 0 207 4 0 0 25 0 9 0 44055978 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4126852040 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9366 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.45
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1098 0 0 0 44 1 0 0 15 0 9 0 44055981 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14155 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 852372

[startup+6.30287 s]
/proc/loadavg: 2.16 2.03 2.01 3/91 16395
/proc/meminfo: memFree=1815060/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=6.23
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15057 0 1 0 613 10 0 0 22 0 9 0 44055977 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14162 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=5.26
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3848 0 1 0 522 4 0 0 25 0 9 0 44055978 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4126841508 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9366 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.46
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1105 0 0 0 45 1 0 0 15 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 852372

[startup+12.7026 s]
/proc/loadavg: 2.14 2.03 2.01 3/91 16395
/proc/meminfo: memFree=1815060/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=12.56
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15057 0 1 0 1246 10 0 0 22 0 9 0 44055977 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14162 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=11.6
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3848 0 1 0 1156 4 0 0 25 0 9 0 44055978 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4126857901 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9366 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.46
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1105 0 0 0 45 1 0 0 15 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14162 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 852372

[startup+25.5011 s]
/proc/loadavg: 2.18 2.04 2.01 3/91 16395
/proc/meminfo: memFree=1814932/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=25.24
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15059 0 1 0 2514 10 0 0 22 0 9 0 44055977 867344384 14164 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14164 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=24.28
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3848 0 1 0 2424 4 0 0 25 0 9 0 44055978 867344384 14164 996147200 134512640 134550740 4294956000 18446744073709551615 4126857901 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9366 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14164 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14164 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0

################
# More data... #
################

/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1116 0 0 0 48 1 0 0 16 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3370.31
Current children cumulated vsize (KiB) 852372

[startup+3462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/91 16403
/proc/meminfo: memFree=1811348/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=3429.74
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15127 0 1 0 342962 12 0 0 22 0 9 0 44055977 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14222 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=3428.75
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3906 0 1 0 342869 6 0 0 25 0 9 0 44055978 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4126896103 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9367 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.49
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1116 0 0 0 48 1 0 0 16 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3429.74
Current children cumulated vsize (KiB) 852372

[startup+3522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/91 16403
/proc/meminfo: memFree=1811284/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=3489.18
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15127 0 1 0 348906 12 0 0 22 0 9 0 44055977 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14222 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=3488.19
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3906 0 1 0 348813 6 0 0 25 0 9 0 44055978 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4126895994 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9367 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.49
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1116 0 0 0 48 1 0 0 16 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3489.18
Current children cumulated vsize (KiB) 852372

[startup+3582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 16441
/proc/meminfo: memFree=1647388/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=3549.03
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15127 0 1 0 354889 14 0 0 22 0 9 0 44055977 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14222 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=3548.04
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3906 0 1 0 354796 8 0 0 25 0 9 0 44055978 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4126896005 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9367 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.49
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1116 0 0 0 48 1 0 0 16 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3549.03
Current children cumulated vsize (KiB) 852372



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3633.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 16441
/proc/meminfo: memFree=1647260/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=3600.02
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15127 0 1 0 359988 14 0 0 22 0 9 0 44055977 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14222 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=3599.03
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3906 0 1 0 359895 8 0 0 25 0 9 0 44055978 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4126857901 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9367 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.49
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1116 0 0 0 48 1 0 0 16 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.02
Current children cumulated vsize (KiB) 852372

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+3633.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/90 16441
/proc/meminfo: memFree=1647260/2055924 swapFree=4181092/4192956
[pid=16383] ppid=16381 vsize=5356 CPUtime=0
/proc/16383/stat : 16383 (concrete.sh) S 16381 16383 15478 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44055976 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16383/statm: 1339 242 201 169 0 50 0
[pid=16385] ppid=16383 vsize=847016 CPUtime=3600.02
/proc/16385/stat : 16385 (java) S 16383 16383 15478 0 -1 0 15127 0 1 0 359988 14 0 0 22 0 9 0 44055977 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16385/statm: 211754 14222 2578 9 0 206314 0
[pid=16385/tid=16387] ppid=16383 vsize=847016 CPUtime=3599.03
/proc/16385/task/16387/stat : 16387 (java) R 16383 16383 15478 0 -1 64 3906 0 1 0 359895 8 0 0 25 0 9 0 44055978 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4126857901 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16385/tid=16388] ppid=16383 vsize=847016 CPUtime=0.47
/proc/16385/task/16388/stat : 16388 (java) S 16383 16383 15478 0 -1 64 9367 0 0 0 44 3 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16389] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16389/stat : 16389 (java) S 16383 16383 15478 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16390] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16390/stat : 16390 (java) S 16383 16383 15478 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44055979 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16391] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16391/stat : 16391 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16392] ppid=16383 vsize=847016 CPUtime=0.49
/proc/16385/task/16392/stat : 16392 (java) S 16383 16383 15478 0 -1 64 1116 0 0 0 48 1 0 0 16 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16393] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16393/stat : 16393 (java) S 16383 16383 15478 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16385/tid=16394] ppid=16383 vsize=847016 CPUtime=0
/proc/16385/task/16394/stat : 16394 (java) S 16383 16383 15478 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44055981 867344384 14222 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.02
Current children cumulated vsize (KiB) 852372

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16383 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.003999
# while last known CPU time is 3600.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3633.33
CPU time (s): 3600.02
CPU user time (s): 3599.88
CPU system time (s): 0.14
CPU usage (%): 99.0833
Max. virtual memory (cumulated for all children) (KiB): 852372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 4

runsolver used 5.86911 second user time and 10.6664 second system time

The end

Launcher Data (download as text)

Begin job on node6 at 2008-07-12 16:38:48
IDJOB=1112747
IDBENCH=61468
IDSOLVER=335
FILE ID=node6/1112747-1215873527
PBS_JOBID= 7903519
Free space on /tmp= 66492 MiB

SOLVER NAME= Concrete + CSP4J - MCRW Engine 2008-05-30
BENCH NAME= CPAI08/csp/os-gp/normalized-gp10-08-1092.xml
COMMAND LINE= HOME/concrete.sh -c -ext 0 -s MCRW -max BENCHNAME 
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112747-1215873527/watcher-1112747-1215873527 -o /tmp/evaluation-result-1112747-1215873527/solver-1112747-1215873527 -C 3600 -W 4000 -M 900 --output-limit 1,15  HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112747-1215873527.xml 

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= f41ed40355d7ef2ae84bd4ab3983b449
RANDOM SEED=1214988128

node6.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:       1862796 kB
Buffers:         33180 kB
Cached:          60376 kB
SwapCached:       5928 kB
Active:         106244 kB
Inactive:        43988 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:       1862796 kB
SwapTotal:     4192956 kB
SwapFree:      4181092 kB
Dirty:            1084 kB
Writeback:           0 kB
Mapped:          72448 kB
Slab:            27792 kB
Committed_AS:   303212 kB
PageTables:       2140 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66480 MiB
End job on node6 at 2008-07-12 17:39:23