Trace number 1112735

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerNumber of falsified constraintsCPU timeWall clock time
Concrete + CSP4J - MCRW Engine 2008-05-30MSAT (TO)7 3600.04 3602.72

General information on the benchmark

Namecsp/os-gp/
normalized-gp10-06-1070.xml
MD5SUM995f63597ce032c59d2195b980a2a425
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkMOPT
Best Number of falsified constraints1
Best CPU time to get the best result obtained on this benchmark16.7185
Satisfiable
(Un)Satisfiability was proved
Number of variables101
Number of constraints1000
Maximum constraint arity2
Maximum domain size1071
Number of constraints which are defined in extension0
Number of constraints which are defined in intension1000
Global constraints used (with number of constraints)

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

1.70/2.62	c CPU-LOAD 0.85
1.70/2.62	c LOADED 101 V (1071 E), 100 DiffConstraint, 900 DTPConstraint, arity 2, 0.85 cpu
3.10/4.08	s SATISFIABLE
3.10/4.08	o 977
3.10/4.08	v 1070 4 687 1061 761 72 1029 108 137 557 1037 568 455 735 803 1067 534 650 1035 507 113 836 361 813 924 533 209 1069 453 900 527 1038 26 369 869 265 52 712 120 953 98 40 1057 791 522 754 505 160 936 624 148 224 863 186 296 866 542 1059 119 1068 11 926 716 968 951 492 1058 960 870 296 855 589 966 858 1064 309 529 975 610 992 879 1056 458 282 984 121 691 318 3 428 88 953 1022 322 932 795 911 871 913 4 108 
3.20/4.10	o 978
3.20/4.10	v 1070 4 687 1067 761 72 1029 108 137 557 1057 568 455 735 803 1051 534 650 1038 507 154 836 361 813 924 533 209 1069 453 900 527 1038 26 369 869 265 52 712 120 953 98 40 1057 791 522 754 505 160 936 624 148 224 863 186 296 866 542 1059 119 1068 11 926 716 968 951 492 1038 960 870 296 855 589 966 858 1064 309 529 975 610 992 879 1050 458 282 984 121 691 318 22 428 684 953 1022 322 932 795 911 871 913 3 108 
3.20/4.10	o 979
3.20/4.10	v 1070 4 687 1067 761 72 1029 108 137 557 1057 568 455 735 803 1051 534 650 1038 507 154 836 361 813 924 533 209 1069 453 900 527 1038 26 369 869 265 52 712 120 953 98 40 1057 791 522 754 505 160 936 624 148 224 863 186 296 866 542 1059 119 1068 11 926 716 968 951 492 1038 960 870 296 855 589 966 858 1064 309 529 975 610 992 879 1050 458 282 984 121 691 318 22 428 684 953 1022 322 932 795 911 871 913 3 708 
3.20/4.11	o 980
3.20/4.11	v 1070 4 687 1067 761 72 1029 108 137 557 1057 568 455 735 0 1051 534 650 1052 507 154 836 361 813 924 533 209 1065 453 900 527 1038 26 369 869 265 52 712 120 953 98 40 1057 791 522 754 505 160 936 624 144 224 863 186 296 866 542 1059 119 1068 11 926 716 968 951 465 1069 960 870 296 855 589 966 858 1067 309 529 975 610 992 879 1053 458 282 984 121 691 318 22 428 684 953 998 322 932 795 911 871 913 3 708 
3.20/4.13	o 981
3.20/4.13	v 1070 4 687 1067 761 72 1029 108 137 557 1042 568 455 735 0 810 534 650 1052 507 120 836 361 813 924 555 209 1060 453 900 527 1054 26 376 869 265 52 712 120 953 98 40 1057 791 522 754 505 160 936 624 144 224 863 186 296 866 542 1059 119 1062 11 926 716 968 951 465 1069 960 870 296 855 589 966 858 1070 309 529 975 610 992 879 1053 458 282 984 121 691 318 22 428 684 953 998 322 932 795 911 871 913 3 708 
3.20/4.17	o 982
3.20/4.17	v 1070 4 687 1048 761 72 1029 108 137 557 1067 568 455 735 0 809 534 650 1052 507 163 836 361 813 924 593 209 1063 453 900 527 1052 26 376 869 265 52 712 120 953 98 40 43 791 522 754 505 161 936 624 980 224 863 186 296 874 542 1059 119 1068 11 17 716 968 951 463 1052 960 870 296 855 589 966 858 1067 309 529 975 610 992 879 1057 458 282 984 121 691 318 22 428 684 953 998 289 932 795 911 871 913 3 708 
3.20/4.20	o 983
3.20/4.20	v 1070 4 687 1037 761 72 1029 673 137 557 160 568 455 735 0 809 534 650 1068 507 163 836 361 813 924 566 209 1065 453 900 527 1027 26 376 869 265 52 712 120 953 98 368 42 791 522 754 505 3 936 624 980 224 863 186 296 873 542 1059 119 1068 11 17 716 968 951 463 1062 960 870 296 855 589 966 858 1067 309 529 975 610 992 879 1054 458 282 984 121 691 318 22 428 684 953 1070 302 932 795 911 871 913 3 708 
3.90/4.81	o 984
3.90/4.81	v 1070 4 980 1046 655 72 499 13 719 528 135 875 941 735 0 274 923 650 946 594 122 836 361 813 776 856 209 1060 661 7 527 968 26 355 186 265 52 712 120 64 98 30 45 791 815 754 933 384 570 624 1026 74 3 866 252 883 537 1059 14 1070 11 17 368 968 918 557 1039 960 537 296 855 50 966 239 1048 282 85 975 705 11 529 284 679 282 973 160 718 1039 22 1066 889 89 1041 395 166 64 295 312 2 748 40 
3.90/4.83	o 985
3.90/4.83	v 1070 4 980 1013 655 72 499 13 719 528 135 875 941 735 0 274 923 650 950 594 122 836 361 813 776 884 209 1067 661 7 527 968 26 355 186 265 52 712 120 64 98 30 45 791 815 754 933 384 570 624 962 74 3 866 252 872 537 1059 14 1068 11 17 368 968 918 557 1062 960 537 296 855 50 966 239 1057 89 85 975 254 11 529 284 691 282 973 160 718 1039 22 1066 889 89 1041 345 166 64 295 312 2 748 40 
4.00/4.95	o 986
4.00/4.95	v 1070 4 1050 1067 655 72 1056 13 719 528 159 875 941 735 6 315 923 650 951 594 295 20 361 813 776 94 830 1062 661 7 61 1046 26 287 186 63 52 712 120 64 98 30 45 909 815 754 8 384 570 618 998 74 3 866 252 877 583 1059 14 1068 11 17 368 968 193 557 1059 211 537 296 855 50 966 239 1055 87 85 975 254 11 643 285 670 282 973 795 123 1039 22 1066 889 89 1067 314 166 64 295 312 2 748 40 
4.40/5.34	o 987
4.40/5.34	v 1070 4 1050 1058 655 72 1056 13 719 528 117 210 941 735 6 237 570 153 1058 192 749 20 361 813 168 516 425 868 192 7 61 967 26 333 186 63 52 659 120 64 56 30 45 909 815 754 8 384 944 618 1064 5 3 866 252 877 583 152 14 1070 11 17 368 968 193 557 1065 211 129 296 508 50 966 239 1068 86 85 335 381 11 643 288 531 282 999 759 125 836 22 1066 743 686 1060 349 166 64 295 312 2 772 21 
4.40/5.35	o 988
4.40/5.35	v 1070 4 1050 1058 655 72 1056 13 719 528 117 210 743 735 6 237 570 153 1058 192 745 20 361 813 168 516 425 868 192 7 61 994 26 333 186 63 52 659 120 64 56 30 45 909 815 754 8 384 944 618 1032 5 3 866 252 877 583 152 14 1068 11 17 368 968 193 557 1065 211 129 296 508 50 966 239 1068 86 85 335 381 11 643 284 531 282 999 759 125 836 22 1066 743 686 1060 348 166 64 295 312 2 772 21 
5.20/6.13	o 989
5.20/6.13	v 1070 4 1050 1066 655 72 1056 13 712 131 196 211 1013 901 6 324 240 153 1025 601 619 20 795 893 168 585 955 1055 260 7 61 282 26 71 5 4 1049 869 1002 1068 30 30 65 909 811 53 8 465 944 622 1036 5 3 845 327 893 582 241 14 1070 11 17 807 968 630 318 1062 211 129 34 37 50 41 752 1055 154 48 775 350 101 942 1041 542 1012 190 749 354 312 22 18 17 123 1066 403 737 64 760 762 2 779 21 
14.29/15.23	o 990
14.29/15.23	v 1070 4 33 157 101 925 39 13 615 478 973 928 0 37 171 291 127 35 1059 1 636 944 1028 69 43 565 781 1044 211 7 61 274 25 1056 5 36 2 931 145 22 70 3 1046 36 602 958 8 744 974 42 281 5 3 8 302 1070 137 98 14 552 11 17 550 475 900 67 983 693 871 34 45 6 31 15 1036 760 47 10 369 186 76 1069 693 11 908 990 395 656 30 18 17 79 206 570 59 27 5 69 2 1064 21 
24.49/25.48	o 991
24.49/25.48	v 1070 4 994 1035 1001 8 39 13 720 426 48 637 0 7 263 22 13 399 1054 1 751 44 598 2 60 284 115 859 500 13 660 1048 604 644 5 17 2 262 66 26 38 3 613 36 67 1 8 401 965 267 1070 5 3 992 401 813 219 98 14 1039 11 17 232 39 2 450 1067 7 18 34 1053 6 9 21 1068 647 33 10 260 151 502 231 25 11 919 992 762 738 619 18 17 649 1070 232 37 18 5 701 2 703 1040 
1301.36/1302.99	o 992
1301.36/1302.99	v 1070 0 18 58 601 1 29 30 375 950 1042 1 30 2 463 1058 4 356 598 11 31 5 24 22 15 617 138 806 32 427 10 74 57 758 2 9 3 650 14 27 754 14 1060 4 753 7 8 148 85 593 320 1037 10 51 233 833 593 14 0 1039 1 2 576 712 76 113 1028 1 3 0 1011 9 115 13 884 413 0 6 138 382 617 1054 212 0 125 37 412 620 958 838 3 17 718 378 56 3 13 4 2 58 8 
3493.99/3496.68	o 993
3493.99/3496.68	v 1070 0 6 376 87 16 28 40 701 938 1029 8 12 0 672 825 9 1 15 3 390 25 18 2 10 328 223 1068 923 32 55 379 1 53 14 10 2 960 367 15 6 2 1048 1 544 29 4 243 638 76 707 5 4 22 120 490 725 25 2 1024 45 15 530 694 2 33 1014 7 6 1 976 10 2 3 974 673 7 23 401 335 77 1069 680 30 888 252 375 78 974 9 1 49 101 734 22 1 99 5 11 438 3

Verifier Data (download as text)

OK	7	993
7 unsatisfied constraints, 993 satisfied constraints

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112735-1215873409/watcher-1112735-1215873409 -o /tmp/evaluation-result-1112735-1215873409/solver-1112735-1215873409 -C 3600 -W 4000 -M 900 --output-limit 1,15 HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112735-1215873409.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 4000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.76 2.61 2.53 4/80 18086
/proc/meminfo: memFree=1814944/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 271 0 0 0 0 0 0 0 20 0 1 0 44043112 5484544 230 996147200 4194304 4889804 548682068752 18446744073709551615 255236735058 0 0 4100 65536 18446744071563648864 0 0 17 1 0 0
/proc/18086/statm: 1339 230 191 169 0 50 0
[pid=18087] ppid=18086 vsize=5356 CPUtime=0
/proc/18087/stat : 18087 (concrete.sh) R 18086 18086 17357 0 -1 4194368 4 0 0 0 0 0 0 0 21 0 1 0 44043113 5484544 230 996147200 4194304 4889804 548682068752 18446744073709551615 255236565796 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/18087/statm: 1339 230 191 169 0 50 0

[startup+0.024559 s]
/proc/loadavg: 2.76 2.61 2.53 4/80 18086
/proc/meminfo: memFree=1814944/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.103237 s]
/proc/loadavg: 2.76 2.61 2.53 4/80 18086
/proc/meminfo: memFree=1814944/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.30176 s]
/proc/loadavg: 2.76 2.61 2.53 4/80 18086
/proc/meminfo: memFree=1814944/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.701833 s]
/proc/loadavg: 2.76 2.61 2.53 4/80 18086
/proc/meminfo: memFree=1814944/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.50299 s]
/proc/loadavg: 2.76 2.61 2.53 4/90 18097
/proc/meminfo: memFree=1808976/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=845260 CPUtime=0.6
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 5055 0 1 0 57 3 0 0 18 0 10 0 44043113 865546240 4424 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211315 4424 1908 9 0 205876 0
[pid=18089/tid=18090] ppid=18086 vsize=845260 CPUtime=0.41
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3384 0 1 0 40 1 0 0 24 0 10 0 44043115 865546240 4424 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=845260 CPUtime=0.02
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 434 0 0 0 2 0 0 0 16 0 10 0 44043116 865546240 4424 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18092] ppid=18086 vsize=845260 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 10 0 44043116 865546240 4424 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=845260 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 10 0 44043116 865546240 4424 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=845260 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 10 0 44043119 865546240 4424 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=845260 CPUtime=0.13
/proc/18089/task/18095/stat : 18095 (java) R 18086 18086 17357 0 -1 64 500 0 0 0 13 0 0 0 15 0 10 0 44043119 865546240 4424 996147200 134512640 134550740 4294956000 18446744073709551615 102304713 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=845260 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 10 0 44043119 865546240 4426 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=845260 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 10 0 44043119 865546240 4426 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 850616

[startup+3.1013 s]
/proc/loadavg: 2.76 2.61 2.53 4/91 18098
/proc/meminfo: memFree=1796936/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=2.19
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14770 0 1 0 211 8 0 0 18 0 9 0 44043113 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 13877 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=1.32
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3795 0 1 0 130 2 0 0 25 0 9 0 44043115 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4126842191 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9125 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.43
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1112 0 0 0 42 1 0 0 15 0 9 0 44043119 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 13877 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.19
Current children cumulated vsize (KiB) 852352

[startup+6.30289 s]
/proc/loadavg: 2.78 2.61 2.53 3/90 18098
/proc/meminfo: memFree=1768776/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=5.4
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14781 0 1 0 531 9 0 0 18 0 9 0 44043113 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 13886 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=4.51
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3797 0 1 0 448 3 0 0 25 0 9 0 44043115 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4126855213 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9125 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.44
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1121 0 0 0 43 1 0 0 15 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 5.4
Current children cumulated vsize (KiB) 852352

[startup+12.7021 s]
/proc/loadavg: 2.79 2.62 2.53 3/90 18098
/proc/meminfo: memFree=1768584/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=11.79
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14781 0 1 0 1170 9 0 0 18 0 9 0 44043113 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 13886 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=10.91
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3797 0 1 0 1088 3 0 0 25 0 9 0 44043115 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4126838935 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9125 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.44
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1121 0 0 0 43 1 0 0 16 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 13886 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 11.79
Current children cumulated vsize (KiB) 852352

[startup+25.5025 s]
/proc/loadavg: 2.84 2.64 2.54 3/90 18098
/proc/meminfo: memFree=1768520/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=24.59
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14782 0 1 0 2450 9 0 0 18 0 9 0 44043113 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 13887 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=23.7
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3797 0 1 0 2367 3 0 0 25 0 9 0 44043115 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4126894486 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9125 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.44
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1122 0 0 0 43 1 0 0 16 0 9 0 44043119 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 13887 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 24.59
Current children cumulated vsize (KiB) 852352

[startup+51.1023 s]

################
# More data... #
################

/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1131 0 0 0 45 1 0 0 16 0 9 0 44043119 867323904 14075 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 14075 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 14075 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3399.74
Current children cumulated vsize (KiB) 852352

[startup+3462.3 s]
/proc/loadavg: 2.00 2.04 2.26 3/91 18147
/proc/meminfo: memFree=1734528/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=3459.71
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14982 0 1 0 345943 28 0 0 18 0 9 0 44043113 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 14076 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=3458.79
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3968 0 1 0 345858 21 0 0 25 0 9 0 44043115 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4126838809 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9144 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.46
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1132 0 0 0 45 1 0 0 16 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3459.71
Current children cumulated vsize (KiB) 852352

[startup+3522.3 s]
/proc/loadavg: 2.00 2.03 2.24 3/91 18147
/proc/meminfo: memFree=1734464/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=3519.68
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14983 0 1 0 351940 28 0 0 18 0 9 0 44043113 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 14076 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=3518.76
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3969 0 1 0 351855 21 0 0 25 0 9 0 44043115 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4126855198 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9144 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.46
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1132 0 0 0 45 1 0 0 16 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3519.68
Current children cumulated vsize (KiB) 852352

[startup+3582.3 s]
/proc/loadavg: 2.00 2.02 2.23 3/91 18147
/proc/meminfo: memFree=1734464/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=3579.65
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14983 0 1 0 357937 28 0 0 18 0 9 0 44043113 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 14076 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=3578.73
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3969 0 1 0 357852 21 0 0 25 0 9 0 44043115 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4126838809 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9144 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.46
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1132 0 0 0 45 1 0 0 16 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3579.65
Current children cumulated vsize (KiB) 852352



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3602.7 s]
/proc/loadavg: 2.00 2.02 2.22 3/91 18147
/proc/meminfo: memFree=1734464/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=3600.04
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14983 0 1 0 359976 28 0 0 18 0 9 0 44043113 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 14076 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=3599.12
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3969 0 1 0 359891 21 0 0 25 0 9 0 44043115 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4126845165 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9144 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.46
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1132 0 0 0 45 1 0 0 16 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.04
Current children cumulated vsize (KiB) 852352

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+3602.7 s]
/proc/loadavg: 2.00 2.02 2.22 3/91 18147
/proc/meminfo: memFree=1734464/2055920 swapFree=4180996/4192956
[pid=18086] ppid=18084 vsize=5356 CPUtime=0
/proc/18086/stat : 18086 (concrete.sh) S 18084 18086 17357 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44043112 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18086/statm: 1339 242 201 169 0 50 0
[pid=18089] ppid=18086 vsize=846996 CPUtime=3600.04
/proc/18089/stat : 18089 (java) S 18086 18086 17357 0 -1 0 14983 0 1 0 359976 28 0 0 18 0 9 0 44043113 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18089/statm: 211749 14076 2578 9 0 206309 0
[pid=18089/tid=18090] ppid=18086 vsize=846996 CPUtime=3599.12
/proc/18089/task/18090/stat : 18090 (java) R 18086 18086 17357 0 -1 64 3969 0 1 0 359891 21 0 0 25 0 9 0 44043115 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4126845165 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18091] ppid=18086 vsize=846996 CPUtime=0.42
/proc/18089/task/18091/stat : 18091 (java) S 18086 18086 17357 0 -1 64 9144 0 0 0 38 4 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18092] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18092/stat : 18092 (java) S 18086 18086 17357 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18093] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18093/stat : 18093 (java) S 18086 18086 17357 0 -1 64 6 0 0 0 0 0 0 0 15 0 9 0 44043116 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18094] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18094/stat : 18094 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18095] ppid=18086 vsize=846996 CPUtime=0.46
/proc/18089/task/18095/stat : 18095 (java) S 18086 18086 17357 0 -1 64 1132 0 0 0 45 1 0 0 16 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18096] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18096/stat : 18096 (java) S 18086 18086 17357 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18089/tid=18097] ppid=18086 vsize=846996 CPUtime=0
/proc/18089/task/18097/stat : 18097 (java) S 18086 18086 17357 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44043119 867323904 14076 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.04
Current children cumulated vsize (KiB) 852352

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18086 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.003999
# while last known CPU time is 3600.04
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3602.72
CPU time (s): 3600.04
CPU user time (s): 3599.76
CPU system time (s): 0.28
CPU usage (%): 99.9256
Max. virtual memory (cumulated for all children) (KiB): 852352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 5

runsolver used 4.98424 second user time and 11.4243 second system time

The end

Launcher Data (download as text)

Begin job on node19 at 2008-07-12 16:36:49
IDJOB=1112735
IDBENCH=61466
IDSOLVER=335
FILE ID=node19/1112735-1215873409
PBS_JOBID= 7903516
Free space on /tmp= 66556 MiB

SOLVER NAME= Concrete + CSP4J - MCRW Engine 2008-05-30
BENCH NAME= CPAI08/csp/os-gp/normalized-gp10-06-1070.xml
COMMAND LINE= HOME/concrete.sh -c -ext 0 -s MCRW -max BENCHNAME 
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112735-1215873409/watcher-1112735-1215873409 -o /tmp/evaluation-result-1112735-1215873409/solver-1112735-1215873409 -C 3600 -W 4000 -M 900 --output-limit 1,15  HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112735-1215873409.xml 

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= 995f63597ce032c59d2195b980a2a425
RANDOM SEED=1732082687

node19.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.279
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1815424 kB
Buffers:         38536 kB
Cached:          66440 kB
SwapCached:       6136 kB
Active:         137000 kB
Inactive:        53300 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1815424 kB
SwapTotal:     4192956 kB
SwapFree:      4180996 kB
Dirty:             912 kB
Writeback:           0 kB
Mapped:         101280 kB
Slab:            35156 kB
Committed_AS:  1026172 kB
PageTables:       2156 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66560 MiB
End job on node19 at 2008-07-12 17:36:54