Trace number 1112717

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerNumber of falsified constraintsCPU timeWall clock time
Concrete + CSP4J - MCRW Engine 2008-05-30MSAT (TO)8 3600.09 3624.32

General information on the benchmark

Namecsp/os-gp/
normalized-gp10-07-1078.xml
MD5SUM908bfa49dd2e2d5d6248d0009cefd018
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkMOPT
Best Number of falsified constraints1
Best CPU time to get the best result obtained on this benchmark17.8353
Satisfiable
(Un)Satisfiability was proved
Number of variables101
Number of constraints1000
Maximum constraint arity2
Maximum domain size1079
Number of constraints which are defined in extension0
Number of constraints which are defined in intension1000
Global constraints used (with number of constraints)

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

1.86/1.97	c CPU-LOAD 0.95
1.86/1.97	c LOADED 101 V (1079 E), 900 DTPConstraint, 100 DiffConstraint, arity 2, 0.95 cpu
3.34/3.49	s SATISFIABLE
3.34/3.49	o 979
3.34/3.49	v 1078 6 553 507 912 1077 1019 672 201 469 927 986 246 411 423 153 73 740 976 808 51 985 377 781 726 772 368 744 132 22 954 727 1070 754 195 403 724 164 192 968 13 751 309 56 756 785 17 1065 151 734 991 299 988 628 71 746 203 774 1072 369 418 766 166 927 712 730 693 312 858 653 109 943 974 843 176 11 1050 1038 91 1006 624 133 88 254 1002 42 802 426 357 989 36 505 950 277 921 887 547 0 658 1068 882 
3.34/3.49	o 980
3.34/3.49	v 1078 6 553 507 912 1077 1019 672 201 469 927 986 246 411 423 153 73 740 976 808 51 985 377 781 726 772 368 744 132 22 954 727 1070 754 195 403 724 164 192 968 13 751 309 56 756 785 17 1065 151 734 991 299 988 628 71 746 203 774 1072 369 418 766 166 927 712 730 693 312 858 653 109 943 974 843 176 11 1050 1038 91 1006 624 133 88 254 1002 42 802 437 357 989 36 505 233 277 921 887 547 0 658 1068 882 
3.44/3.51	o 981
3.44/3.51	v 1078 6 748 507 912 1077 1019 672 201 469 927 986 246 411 423 153 73 740 976 808 51 388 384 781 726 772 368 744 132 22 954 727 1066 754 195 403 724 164 192 968 13 751 309 56 756 785 17 1065 151 734 1073 8 988 628 71 746 203 774 1072 369 418 766 166 927 712 730 693 312 858 653 109 943 974 843 176 11 1050 1038 91 1006 624 133 88 254 1002 42 802 460 357 989 36 505 233 277 921 887 547 0 658 1068 882 
3.44/3.51	o 982
3.44/3.51	v 1078 6 748 507 912 1077 1019 672 201 469 927 986 246 411 423 153 73 740 976 808 51 973 384 781 726 772 368 744 132 19 954 727 1066 754 195 403 724 164 192 968 13 751 309 56 756 785 17 1065 151 734 1073 375 988 628 71 746 203 774 1072 369 418 766 166 927 712 730 693 312 858 653 109 943 974 843 176 11 1050 1038 91 1006 624 133 88 254 1002 42 802 460 357 989 36 505 233 277 921 887 547 0 658 1068 882 
3.44/3.52	o 983
3.44/3.52	v 1078 6 748 507 912 1077 1019 672 201 469 927 986 246 411 423 153 73 740 976 808 51 1067 384 781 726 772 368 744 132 19 954 727 1066 754 195 403 724 164 192 968 13 751 309 56 756 785 17 406 151 734 1073 375 988 628 71 746 203 774 1072 369 418 766 166 927 712 730 693 254 858 653 109 943 974 843 176 11 1050 1038 91 1006 624 133 88 254 1069 42 802 424 357 989 36 505 233 277 921 887 547 0 658 1068 882 
3.44/3.52	o 984
3.44/3.52	v 1078 6 748 507 912 1077 1019 672 201 469 927 986 246 411 423 153 73 740 976 808 51 1067 384 781 726 772 368 744 1038 19 954 727 1066 754 195 403 724 164 192 968 13 751 309 56 756 785 17 406 151 734 1073 375 988 628 71 746 203 774 1072 369 418 766 166 933 712 730 693 254 858 653 109 943 974 843 176 11 1050 1038 91 1006 624 133 88 254 1069 42 802 424 357 989 36 505 233 277 921 887 547 0 658 1068 882 
3.44/3.58	o 985
3.44/3.58	v 1078 6 748 507 912 1064 1019 672 201 469 927 986 246 411 423 153 73 740 976 806 51 1073 384 781 726 772 368 744 1038 19 954 727 1066 754 179 403 724 164 1050 0 13 751 309 56 756 785 17 406 151 734 960 375 988 628 71 746 203 774 1068 369 418 766 166 971 712 730 693 219 858 653 109 943 974 843 211 11 1042 1038 91 544 624 133 88 254 1069 42 802 374 260 989 36 505 233 277 921 887 547 1 676 1075 377 
3.54/3.66	o 986
3.54/3.66	v 1078 6 748 507 912 1064 1019 672 205 469 927 1076 246 411 432 153 73 740 976 806 51 459 387 781 726 772 368 744 1038 19 954 727 1066 754 176 403 724 1032 1050 0 13 751 309 56 756 785 17 339 151 734 956 375 988 628 71 746 203 774 503 369 418 766 166 1015 712 730 693 483 858 653 109 443 371 843 174 11 1055 1038 91 544 624 133 88 254 467 42 802 268 1065 989 36 425 233 277 921 887 547 23 676 1074 377 
3.54/3.69	o 987
3.54/3.69	v 1078 6 748 507 912 1039 1019 672 205 469 927 1070 246 411 432 153 73 740 976 806 51 460 379 781 726 772 368 744 1038 19 954 727 1066 754 190 403 724 1032 1050 0 13 751 309 56 756 310 17 768 151 734 1038 375 988 628 71 746 203 774 503 369 420 766 166 1015 712 730 693 533 858 653 109 443 371 843 174 11 1055 1038 91 544 624 133 88 254 467 42 802 265 1063 989 36 425 233 277 921 887 547 23 676 1076 377 
3.84/3.92	o 988
3.84/3.92	v 1078 6 748 507 912 1072 1019 672 205 469 152 1078 132 411 428 153 73 740 976 779 51 454 381 781 726 772 368 744 1038 13 954 1008 1073 141 189 415 168 1048 1050 0 13 4 138 56 756 257 17 769 151 435 1065 375 962 628 71 746 203 1075 490 369 417 766 166 991 712 730 693 533 858 653 109 443 30 843 195 11 1060 1038 91 544 626 133 88 254 838 42 484 265 1051 989 36 425 233 277 921 887 400 23 676 1063 377 
3.93/4.06	o 989
3.93/4.06	v 1078 6 748 900 912 1049 1019 672 217 469 152 1025 132 944 428 153 73 740 976 779 51 456 382 972 726 772 368 744 1038 13 954 1008 1076 819 200 415 168 739 1050 0 13 4 138 61 756 257 17 769 121 435 1037 375 962 628 71 746 203 1074 835 369 416 1019 166 1077 1067 934 828 505 1 1045 109 443 30 843 231 11 1078 1038 91 544 626 144 88 254 838 42 466 268 1065 989 36 425 233 865 921 887 400 23 515 1070 377 
5.02/5.18	o 990
5.02/5.18	v 1078 16 770 617 1065 1071 122 628 359 1015 890 948 18 52 349 153 73 30 122 811 51 439 101 972 2 1028 943 767 779 33 853 346 1062 819 130 396 764 709 97 0 13 4 25 61 20 257 17 777 225 753 1077 375 962 433 22 746 203 1058 785 937 539 700 650 1063 906 934 190 505 1 1045 109 315 30 47 617 11 1025 211 91 1018 342 144 716 697 820 42 481 281 911 32 36 373 522 865 921 250 809 35 607 1067 826 
27.31/27.68	o 991
27.31/27.68	v 1078 272 834 10 27 963 105 33 521 104 0 979 104 2 428 116 264 24 5 756 61 523 995 455 2 45 77 21 35 110 26 7 129 4 1056 642 30 1 12 0 13 4 25 82 20 192 71 313 2 28 876 18 692 202 92 58 327 747 943 85 487 72 10 888 46 28 65 577 453 20 104 10 101 30 849 16 1076 4 24 78 224 856 7 13 769 547 576 997 38 3 20 2 45 57 272 13 0 103 762 958 5 
298.52/301.43	o 992
298.52/301.43	v 1078 830 548 32 1 1056 10 37 150 25 0 1076 15 20 391 861 34 22 4 76 3 353 668 130 10 51 120 0 1 1070 17 12 36 1 851 522 31 17 5 0 21 5 1 71 3 388 4 645 0 52 1034 33 1019 304 749 77 136 1078 618 14 413 7 2 798 17 1 0 449 65 4 42 88 13 30 194 16 991 6 28 2 679 95 7 47 665 25 455 221 948 74 1 1 29 2 54 0 24 913 737 210 28

Verifier Data (download as text)

OK	8	992
8 unsatisfied constraints, 992 satisfied constraints

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112717-1215873089/watcher-1112717-1215873089 -o /tmp/evaluation-result-1112717-1215873089/solver-1112717-1215873089 -C 3600 -W 4000 -M 900 --output-limit 1,15 HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112717-1215873089.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 4000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.55 2.17 2.08 4/81 18390
/proc/meminfo: memFree=1768416/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) R 18388 18390 16292 0 -1 4194304 262 0 0 0 0 0 0 0 20 0 1 0 44012128 5484544 230 996147200 4194304 4889804 548682068752 18446744073709551615 244671113887 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/18390/statm: 1339 230 191 169 0 50 0

[startup+0.0913921 s]
/proc/loadavg: 2.55 2.17 2.08 4/81 18390
/proc/meminfo: memFree=1768416/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.102386 s]
/proc/loadavg: 2.55 2.17 2.08 4/81 18390
/proc/meminfo: memFree=1768416/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.301426 s]
/proc/loadavg: 2.55 2.17 2.08 4/81 18390
/proc/meminfo: memFree=1768416/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.7025 s]
/proc/loadavg: 2.55 2.17 2.08 4/81 18390
/proc/meminfo: memFree=1768416/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.50165 s]
/proc/loadavg: 2.55 2.17 2.08 3/92 18402
/proc/meminfo: memFree=1751432/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=846840 CPUtime=1.47
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 7922 0 1 0 140 7 0 0 18 0 10 0 44012129 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211710 7057 2577 9 0 206270 0
[pid=18393/tid=18394] ppid=18390 vsize=846840 CPUtime=0.92
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3452 0 1 0 89 3 0 0 24 0 10 0 44012130 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4125236814 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18395] ppid=18390 vsize=846840 CPUtime=0.1
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 2685 0 0 0 9 1 0 0 16 0 10 0 44012131 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18396] ppid=18390 vsize=846840 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 10 0 44012131 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=846840 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 15 0 10 0 44012131 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=846840 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 10 0 44012133 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=846840 CPUtime=0.41
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1048 0 0 0 40 1 0 0 15 0 10 0 44012133 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18400] ppid=18390 vsize=846840 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 10 0 44012133 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=846840 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 10 0 44012133 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18402] ppid=18390 vsize=846840 CPUtime=0
/proc/18393/task/18402/stat : 18402 (java) S 18390 18390 16292 0 -1 64 4 0 0 0 0 0 0 0 20 0 10 0 44012196 867164160 7057 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 852196

[startup+3.10194 s]
/proc/loadavg: 2.55 2.17 2.08 3/91 18402
/proc/meminfo: memFree=1721864/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=3.05
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 14918 0 1 0 295 10 0 0 18 0 9 0 44012129 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14023 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=2.06
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3801 0 1 0 202 4 0 0 25 0 9 0 44012130 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4126847669 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9269 0 0 0 46 4 0 0 17 0 9 0 44012131 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.46
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1110 0 0 0 45 1 0 0 15 0 9 0 44012133 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14023 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 852360

[startup+6.30254 s]
/proc/loadavg: 2.50 2.17 2.08 3/91 18402
/proc/meminfo: memFree=1721608/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=6.21
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 14927 0 1 0 611 10 0 0 18 0 9 0 44012129 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14030 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=5.21
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3802 0 1 0 517 4 0 0 25 0 9 0 44012130 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4126846067 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9269 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.47
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1118 0 0 0 46 1 0 0 15 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 852360

[startup+12.7017 s]
/proc/loadavg: 2.46 2.17 2.08 3/91 18402
/proc/meminfo: memFree=1721544/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=12.55
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 14927 0 1 0 1245 10 0 0 18 0 9 0 44012129 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14030 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=11.56
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3802 0 1 0 1152 4 0 0 25 0 9 0 44012130 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4126838820 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9269 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.47
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1118 0 0 0 46 1 0 0 15 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14030 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 852360

[startup+25.5021 s]
/proc/loadavg: 2.36 2.16 2.08 3/91 18402
/proc/meminfo: memFree=1721672/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=25.23
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 14928 0 1 0 2513 10 0 0 18 0 9 0 44012129 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14031 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=24.23
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3802 0 1 0 2419 4 0 0 25 0 9 0 44012130 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4126855117 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9269 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.48
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1119 0 0 0 47 1 0 0 16 0 9 0 44012133 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14031 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 852360

[startup+51.1028 s]
/proc/loadavg: 2.24 2.14 2.07 3/91 18402

################
# More data... #
################

/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1128 0 0 0 48 1 0 0 16 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3378.19
Current children cumulated vsize (KiB) 852360

[startup+3462.3 s]
/proc/loadavg: 2.00 2.11 2.16 3/90 18496
/proc/meminfo: memFree=1783192/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=3438.16
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 15046 0 1 0 343760 56 0 0 18 0 9 0 44012129 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14140 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=3437.13
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3907 0 1 0 343664 49 0 0 25 0 9 0 44012130 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4126846067 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9273 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.49
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1128 0 0 0 48 1 0 0 16 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3438.16
Current children cumulated vsize (KiB) 852360

[startup+3522.3 s]
/proc/loadavg: 2.00 2.09 2.15 3/90 18496
/proc/meminfo: memFree=1783128/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=3498.13
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 15046 0 1 0 349757 56 0 0 18 0 9 0 44012129 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14140 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=3497.1
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3907 0 1 0 349661 49 0 0 25 0 9 0 44012130 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4126855213 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9273 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.49
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1128 0 0 0 48 1 0 0 16 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3498.13
Current children cumulated vsize (KiB) 852360

[startup+3582.3 s]
/proc/loadavg: 2.00 2.07 2.13 3/90 18496
/proc/meminfo: memFree=1783000/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=3558.11
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 15046 0 1 0 355755 56 0 0 18 0 9 0 44012129 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14140 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=3557.08
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3907 0 1 0 355659 49 0 0 25 0 9 0 44012130 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4126846048 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9273 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.49
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1128 0 0 0 48 1 0 0 16 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3558.11
Current children cumulated vsize (KiB) 852360



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3624.3 s]
/proc/loadavg: 2.00 2.06 2.13 3/90 18496
/proc/meminfo: memFree=1782872/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=3600.09
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 15046 0 1 0 359953 56 0 0 18 0 9 0 44012129 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14140 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=3599.06
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3907 0 1 0 359857 49 0 0 25 0 9 0 44012130 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4126896467 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9273 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.49
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1128 0 0 0 48 1 0 0 16 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.09
Current children cumulated vsize (KiB) 852360

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+3624.3 s]
/proc/loadavg: 2.00 2.06 2.13 3/90 18496
/proc/meminfo: memFree=1782872/2055920 swapFree=4192812/4192956
[pid=18390] ppid=18388 vsize=5356 CPUtime=0
/proc/18390/stat : 18390 (concrete.sh) S 18388 18390 16292 0 -1 4194304 315 128 0 0 0 0 0 0 20 0 1 0 44012128 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/18390/statm: 1339 242 201 169 0 50 0
[pid=18393] ppid=18390 vsize=847004 CPUtime=3600.09
/proc/18393/stat : 18393 (java) S 18390 18390 16292 0 -1 0 15046 0 1 0 359953 56 0 0 18 0 9 0 44012129 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/18393/statm: 211751 14140 2578 9 0 206311 0
[pid=18393/tid=18394] ppid=18390 vsize=847004 CPUtime=3599.06
/proc/18393/task/18394/stat : 18394 (java) R 18390 18390 16292 0 -1 64 3907 0 1 0 359857 49 0 0 25 0 9 0 44012130 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4126896467 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18395] ppid=18390 vsize=847004 CPUtime=0.5
/proc/18393/task/18395/stat : 18395 (java) S 18390 18390 16292 0 -1 64 9273 0 0 0 46 4 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18396] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18396/stat : 18396 (java) S 18390 18390 16292 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18397] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18397/stat : 18397 (java) S 18390 18390 16292 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44012131 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18398] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18398/stat : 18398 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18399] ppid=18390 vsize=847004 CPUtime=0.49
/proc/18393/task/18399/stat : 18399 (java) S 18390 18390 16292 0 -1 64 1128 0 0 0 48 1 0 0 16 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=18393/tid=18400] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18400/stat : 18400 (java) S 18390 18390 16292 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=18393/tid=18401] ppid=18390 vsize=847004 CPUtime=0
/proc/18393/task/18401/stat : 18401 (java) S 18390 18390 16292 0 -1 64 3 0 0 0 0 0 0 0 15 0 9 0 44012133 867332096 14140 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3600.09
Current children cumulated vsize (KiB) 852360

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18390 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=5999
# CPU time returned by wait4() is 0.005999
# while last known CPU time is 3600.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3624.32
CPU time (s): 3600.09
CPU user time (s): 3599.53
CPU system time (s): 0.56
CPU usage (%): 99.3315
Max. virtual memory (cumulated for all children) (KiB): 852360

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.005999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 5

runsolver used 4.21236 second user time and 12.3211 second system time

The end

Launcher Data (download as text)

Begin job on node7 at 2008-07-12 16:31:29
IDJOB=1112717
IDBENCH=61463
IDSOLVER=335
FILE ID=node7/1112717-1215873089
PBS_JOBID= 7903446
Free space on /tmp= 66520 MiB

SOLVER NAME= Concrete + CSP4J - MCRW Engine 2008-05-30
BENCH NAME= CPAI08/csp/os-gp/normalized-gp10-07-1078.xml
COMMAND LINE= HOME/concrete.sh -c -ext 0 -s MCRW -max BENCHNAME 
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112717-1215873089/watcher-1112717-1215873089 -o /tmp/evaluation-result-1112717-1215873089/solver-1112717-1215873089 -C 3600 -W 4000 -M 900 --output-limit 1,15  HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112717-1215873089.xml 

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= 908bfa49dd2e2d5d6248d0009cefd018
RANDOM SEED=1439680846

node7.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1768896 kB
Buffers:          5084 kB
Cached:          47072 kB
SwapCached:          0 kB
Active:         219364 kB
Inactive:        15840 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1768896 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            1048 kB
Writeback:           0 kB
Mapped:         203260 kB
Slab:            36524 kB
Committed_AS:   539508 kB
PageTables:       2272 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66520 MiB
End job on node7 at 2008-07-12 17:31:55