Trace number 1112741

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerNumber of falsified constraintsCPU timeWall clock time
Concrete + CSP4J - MCRW Engine 2008-05-30MSAT (TO)8 3600.09 3601.92

General information on the benchmark

Namecsp/os-gp/
normalized-gp10-01-1092.xml
MD5SUMa52afc3b931e8ca9ea1365037f813ab5
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkMOPT
Best Number of falsified constraints1
Best CPU time to get the best result obtained on this benchmark17.7983
Satisfiable
(Un)Satisfiability was proved
Number of variables101
Number of constraints1000
Maximum constraint arity2
Maximum domain size1093
Number of constraints which are defined in extension0
Number of constraints which are defined in intension1000
Global constraints used (with number of constraints)

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

1.76/1.88	c CPU-LOAD 0.94
1.76/1.88	c LOADED 101 V (1093 E), 900 DTPConstraint, 100 DiffConstraint, arity 2, 0.94 cpu
3.15/3.29	s SATISFIABLE
3.15/3.29	o 985
3.15/3.29	v 1092 623 793 372 989 983 69 397 1065 1051 1001 985 595 866 515 616 524 801 129 796 154 452 997 60 478 952 32 860 417 517 879 794 300 1091 85 421 1037 1081 184 993 39 593 588 1030 532 747 326 872 88 231 1047 231 194 1068 568 113 268 1014 173 1085 1008 696 347 233 20 1055 166 794 817 1023 814 274 233 391 353 172 550 244 7 205 107 34 238 837 1063 241 215 871 430 825 810 262 625 1004 620 1023 1075 299 188 8 490 
3.25/3.32	o 986
3.25/3.32	v 1092 377 793 372 989 983 69 397 1069 1051 1001 1031 595 866 515 616 524 801 129 796 154 452 1051 60 478 952 32 860 417 517 879 794 300 501 85 318 1037 1072 184 993 39 593 588 1030 532 747 326 872 88 231 1047 231 194 1068 568 113 268 1014 173 1083 1008 696 347 233 20 1082 166 794 817 1023 814 274 233 1085 353 172 575 244 7 205 107 7 238 837 1063 250 215 871 430 825 810 262 625 1004 575 1023 1074 299 188 8 490 
3.34/3.41	o 987
3.34/3.41	v 1092 377 793 372 989 983 69 412 1066 1051 1001 975 17 866 515 616 524 801 129 796 154 452 971 60 478 952 32 860 417 517 879 794 300 391 85 441 1037 1089 184 993 39 593 242 1030 532 747 326 872 88 231 1034 231 194 1068 580 113 268 1014 173 1083 1008 459 557 233 20 1031 166 794 817 1023 814 274 233 1086 353 172 575 244 7 205 107 7 238 837 1054 242 215 871 430 825 810 262 371 1004 620 1023 1052 299 188 8 490 
3.54/3.65	o 988
3.54/3.65	v 1092 282 793 37 989 983 69 422 1076 1051 1001 1006 17 866 515 616 999 36 129 489 154 452 1015 60 478 952 32 860 417 551 879 804 300 435 85 739 1037 1074 184 993 39 593 506 29 532 540 189 872 88 493 1025 563 194 6 600 113 1001 1014 173 1073 1008 459 557 306 20 1036 166 794 817 1023 814 954 233 1081 1023 172 387 812 7 862 107 15 238 199 1081 242 1060 871 430 226 810 262 371 1004 628 1023 1086 299 188 8 490 
4.14/4.26	o 989
4.14/4.26	v 1092 282 806 1067 989 983 69 357 1081 1051 1001 1092 17 841 122 499 999 36 129 489 154 936 1083 376 245 952 32 193 219 543 1010 790 300 500 85 326 1037 1080 184 273 39 478 48 1044 101 139 550 872 88 493 1088 396 194 6 447 58 1013 1014 173 1074 1008 184 553 292 20 1065 978 160 817 1023 814 1018 527 1071 826 909 94 60 685 862 14 15 1040 997 1046 619 1018 199 261 226 810 514 305 1004 553 1023 1080 237 1026 8 490 
5.13/5.27	o 990
5.13/5.27	v 1092 282 811 236 1009 183 69 420 1084 54 1001 1077 17 53 1049 886 14 36 1003 489 162 403 1077 274 104 3 32 193 156 515 1010 900 300 479 85 306 88 1059 184 273 39 1060 48 119 101 17 531 873 69 87 1084 396 281 6 580 58 1013 337 192 1034 1008 184 338 1013 20 1087 8 160 783 301 1082 633 0 1080 995 1012 103 60 581 22 14 15 236 997 1091 625 855 199 247 226 810 816 49 783 300 181 1081 222 1026 822 818 
19.79/20.09	o 991
19.79/20.09	v 1092 962 181 93 21 88 68 1086 371 47 1 1044 158 182 86 271 14 19 61 421 498 148 1052 260 33 22 99 159 86 680 973 158 106 1086 7 855 32 389 30 75 4 52 3 120 732 795 895 250 13 106 1092 49 143 6 191 572 27 893 40 1057 2 358 554 488 0 1056 8 24 104 13 7 89 86 566 78 47 151 4 1012 22 13 547 21 22 740 94 9 1073 1082 5 72 21 426 30 1064 16 565 47 936 162 8 
454.38/455.00	o 992
454.38/455.00	v 1092 40 376 6 1 2 332 557 1090 3 22 604 8 81 11 480 4 3 43 1 149 1 1090 654 574 4 34 5 65 198 84 454 2 147 61 699 11 1006 3 6 32 8 1 48 37 310 94 356 23 69 491 31 1071 53 642 597 26 129 4 1088 0 124 718 437 26 1044 31 2 223 558 13 222 35 843 7 38 382 22 154 119 12 285 13 37 1061 99 1012 52 650 4 23 6 38 11 247 0 1051 184 589 669 34

Verifier Data (download as text)

OK	8	992
8 unsatisfied constraints, 992 satisfied constraints

Watcher Data (download as text)

runsolver version 3.2.5 (c) roussel@cril.univ-artois.fr

command line: /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112741-1215873461/watcher-1112741-1215873461 -o /tmp/evaluation-result-1112741-1215873461/solver-1112741-1215873461 -C 3600 -W 4000 -M 900 --output-limit 1,15 HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112741-1215873461.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 3630 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 4000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.89 1.97 1.99 4/80 16206
/proc/meminfo: memFree=1852220/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 271 0 0 0 0 0 0 0 20 0 1 0 44049321 5484544 230 996147200 4194304 4889804 548682068752 18446744073709551615 268583010386 0 0 4100 65536 18446744071563648864 0 0 17 1 0 0
/proc/16206/statm: 1339 230 191 169 0 50 0
[pid=16207] ppid=16206 vsize=5356 CPUtime=0
/proc/16207/stat : 16207 (concrete.sh) R 16206 16206 15639 0 -1 4194368 2 0 0 0 0 0 0 0 21 0 1 0 44049321 5484544 230 996147200 4194304 4889804 548682068752 18446744073709551615 268582841076 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/16207/statm: 1339 230 191 169 0 50 0

[startup+0.105683 s]
/proc/loadavg: 1.89 1.97 1.99 4/80 16206
/proc/meminfo: memFree=1852220/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.201695 s]
/proc/loadavg: 1.89 1.97 1.99 4/80 16206
/proc/meminfo: memFree=1852220/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.301705 s]
/proc/loadavg: 1.89 1.97 1.99 4/80 16206
/proc/meminfo: memFree=1852220/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+0.701756 s]
/proc/loadavg: 1.89 1.97 1.99 4/80 16206
/proc/meminfo: memFree=1852220/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5356

[startup+1.50385 s]
/proc/loadavg: 1.89 1.97 1.99 3/91 16218
/proc/meminfo: memFree=1834916/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846840 CPUtime=1.47
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 8352 0 1 0 141 6 0 0 18 0 10 0 44049322 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211710 7483 2577 9 0 206270 0
[pid=16209/tid=16210] ppid=16206 vsize=846840 CPUtime=0.92
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3461 0 1 0 90 2 0 0 25 0 10 0 44049322 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846840 CPUtime=0.11
/proc/16209/task/16211/stat : 16211 (java) R 16206 16206 15639 0 -1 64 3104 0 0 0 10 1 0 0 15 0 10 0 44049324 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 103663183 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846840 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 10 0 44049324 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846840 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 15 0 10 0 44049324 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846840 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 10 0 44049326 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846840 CPUtime=0.39
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1051 0 0 0 39 0 0 0 15 0 10 0 44049326 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846840 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 10 0 44049326 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846840 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 10 0 44049326 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16218] ppid=16206 vsize=846840 CPUtime=0
/proc/16209/task/16218/stat : 16218 (java) S 16206 16206 15639 0 -1 64 4 0 0 0 0 0 0 0 20 0 10 0 44049387 867164160 7483 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 852196

[startup+3.10203 s]
/proc/loadavg: 1.98 1.99 1.99 3/90 16218
/proc/meminfo: memFree=1805348/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=3.05
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15013 0 1 0 296 9 0 0 18 0 9 0 44049322 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14118 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=2.14
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3798 0 1 0 211 3 0 0 25 0 9 0 44049322 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4126846194 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9364 0 0 0 40 4 0 0 17 0 9 0 44049324 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1114 0 0 0 44 0 0 0 16 0 9 0 44049326 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14118 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 852348

[startup+6.3014 s]
/proc/loadavg: 1.98 1.99 1.99 3/90 16218
/proc/meminfo: memFree=1805156/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=6.22
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15021 0 1 0 613 9 0 0 18 0 9 0 44049322 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14125 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=5.3
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3799 0 1 0 527 3 0 0 25 0 9 0 44049322 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4126838857 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9364 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.45
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1121 0 0 0 45 0 0 0 15 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 852348

[startup+12.7021 s]
/proc/loadavg: 1.98 1.99 1.99 3/90 16218
/proc/meminfo: memFree=1804964/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=12.56
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15021 0 1 0 1247 9 0 0 18 0 9 0 44049322 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14125 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=11.63
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3799 0 1 0 1160 3 0 0 25 0 9 0 44049322 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4126846125 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9364 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.45
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1121 0 0 0 45 0 0 0 16 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14125 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 852348

[startup+25.5026 s]
/proc/loadavg: 1.98 1.99 1.99 4/90 16218
/proc/meminfo: memFree=1805092/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=25.23
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15022 0 1 0 2514 9 0 0 18 0 9 0 44049322 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14126 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=24.31
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3799 0 1 0 2428 3 0 0 25 0 9 0 44049322 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4126855213 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9364 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.45
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1122 0 0 0 45 0 0 0 16 0 9 0 44049326 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14126 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 852348

################
# More data... #
################

/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1129 0 0 0 47 1 0 0 16 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3340.58
Current children cumulated vsize (KiB) 852348

[startup+3402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/91 16403
/proc/meminfo: memFree=1811604/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=3400.56
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15134 0 1 0 340038 18 0 0 18 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14230 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=3399.61
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3903 0 1 0 339950 11 0 0 25 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4126862535 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9365 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.48
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1129 0 0 0 47 1 0 0 16 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3400.56
Current children cumulated vsize (KiB) 852348

[startup+3462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/91 16403
/proc/meminfo: memFree=1811476/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=3460.52
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15134 0 1 0 346034 18 0 0 18 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14230 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=3459.58
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3903 0 1 0 345946 12 0 0 25 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4126894425 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9365 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.48
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1129 0 0 0 47 1 0 0 16 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3460.52
Current children cumulated vsize (KiB) 852348

[startup+3522.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/91 16403
/proc/meminfo: memFree=1811412/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=3520.51
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15134 0 1 0 352033 18 0 0 18 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14230 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=3519.57
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3903 0 1 0 351945 12 0 0 25 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4126894405 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9365 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.48
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1129 0 0 0 47 1 0 0 16 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3520.51
Current children cumulated vsize (KiB) 852348

[startup+3582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/91 16403
/proc/meminfo: memFree=1811284/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=3580.49
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15134 0 1 0 358030 19 0 0 18 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14230 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=3579.54
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3903 0 1 0 357942 12 0 0 25 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4126862675 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9365 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.48
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1129 0 0 0 47 1 0 0 16 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3580.49
Current children cumulated vsize (KiB) 852348



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+3601.9 s]
/proc/loadavg: 2.00 2.00 2.00 3/91 16403
/proc/meminfo: memFree=1811284/2055924 swapFree=4181092/4192956
[pid=16206] ppid=16204 vsize=5356 CPUtime=0
/proc/16206/stat : 16206 (concrete.sh) S 16204 16206 15639 0 -1 4194304 315 128 0 0 0 0 0 0 21 0 1 0 44049321 5484544 242 996147200 4194304 4889804 548682068752 18446744073709551615 268582839108 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/16206/statm: 1339 242 201 169 0 50 0
[pid=16209] ppid=16206 vsize=846992 CPUtime=3600.09
/proc/16209/stat : 16209 (java) S 16206 16206 15639 0 -1 0 15134 0 1 0 359990 19 0 0 18 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0
/proc/16209/statm: 211748 14230 2578 9 0 206308 0
[pid=16209/tid=16210] ppid=16206 vsize=846992 CPUtime=3599.13
/proc/16209/task/16210/stat : 16210 (java) R 16206 16206 15639 0 -1 64 3903 0 1 0 359901 12 0 0 25 0 9 0 44049322 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4126846055 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16211] ppid=16206 vsize=846992 CPUtime=0.44
/proc/16209/task/16211/stat : 16211 (java) S 16206 16206 15639 0 -1 64 9365 0 0 0 40 4 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 0 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16212] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16212/stat : 16212 (java) S 16206 16206 15639 0 -1 64 12 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16213] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16213/stat : 16213 (java) S 16206 16206 15639 0 -1 64 6 0 0 0 0 0 0 0 16 0 9 0 44049324 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16214] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16214/stat : 16214 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 18 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16215] ppid=16206 vsize=846992 CPUtime=0.48
/proc/16209/task/16215/stat : 16215 (java) S 16206 16206 15639 0 -1 64 1129 0 0 0 47 1 0 0 16 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 0 0 0
[pid=16209/tid=16216] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16216/stat : 16216 (java) S 16206 16206 15639 0 -1 64 1 0 0 0 0 0 0 0 19 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
[pid=16209/tid=16217] ppid=16206 vsize=846992 CPUtime=0
/proc/16209/task/16217/stat : 16217 (java) S 16206 16206 15639 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 44049326 867319808 14230 996147200 134512640 134550740 4294956000 18446744073709551615 4294960144 0 4 0 16800975 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 3600.09
Current children cumulated vsize (KiB) 852348

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16206 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 3600.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3601.92
CPU time (s): 3600.09
CPU user time (s): 3599.9
CPU system time (s): 0.19
CPU usage (%): 99.9492
Max. virtual memory (cumulated for all children) (KiB): 852348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 443
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 5

runsolver used 5.34719 second user time and 11.0393 second system time

The end

Launcher Data (download as text)

Begin job on node6 at 2008-07-12 16:37:41
IDJOB=1112741
IDBENCH=61467
IDSOLVER=335
FILE ID=node6/1112741-1215873461
PBS_JOBID= 7903541
Free space on /tmp= 66488 MiB

SOLVER NAME= Concrete + CSP4J - MCRW Engine 2008-05-30
BENCH NAME= CPAI08/csp/os-gp/normalized-gp10-01-1092.xml
COMMAND LINE= HOME/concrete.sh -c -ext 0 -s MCRW -max BENCHNAME 
RUNSOLVER COMMAND LINE= /home/evaluation/evaluation/pub/bin/runsolver --timestamp -w /tmp/evaluation-result-1112741-1215873461/watcher-1112741-1215873461 -o /tmp/evaluation-result-1112741-1215873461/solver-1112741-1215873461 -C 3600 -W 4000 -M 900 --output-limit 1,15  HOME/concrete.sh -c -ext 0 -s MCRW -max HOME/instance-1112741-1215873461.xml 

TIME LIMIT= 3600 seconds
MEMORY LIMIT= 900 MiB

MD5SUM BENCH= a52afc3b931e8ca9ea1365037f813ab5
RANDOM SEED=1158851382

node6.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:       1852700 kB
Buffers:         32844 kB
Cached:          61528 kB
SwapCached:       5928 kB
Active:         116548 kB
Inactive:        43812 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:       1852700 kB
SwapTotal:     4192956 kB
SwapFree:      4181092 kB
Dirty:            3316 kB
Writeback:           0 kB
Mapped:          81916 kB
Slab:            27848 kB
Committed_AS:  1011660 kB
PageTables:       2104 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66488 MiB
End job on node6 at 2008-07-12 17:37:45