Trace number 2083046

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Concrete 2009-07-14SAT 275.155 278.037

DiagnosticValue
CHECKS10908000
NODES3789

General information on the benchmark

Namecsp/fapp/fapp34/
normalized-fapp34-0750-4.xml
MD5SUM1196fad89b5a5a4f355ab65ef889a576
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark28.3597
Satisfiable
(Un)Satisfiability was proved
Number of variables750
Number of constraints8639
Maximum constraint arity2
Maximum domain size998
Number of constraints which are defined in extension0
Number of constraints which are defined in intension8639
Global constraints used (with number of constraints)

Solver Data 

220.76/223.12	c CPU-LOAD 194.0
220.76/223.12	c LOADED 750 V (998 E), 1892 PredicateConstraint, 4174 ExtensionConstraint2D, arity 2, 194.0 cpu
274.94/277.87	v -2516 -2558 -3088 -3312 -3298 -3128 2556 -2518 -2990 -2758 -2628 -2578 -2588 -2756 -3036 2618 -3044 2568 -3188 2618 2586 -2566 -2566 -2518 -3044 -2566 -3268 -3352 -2618 2616 2828 2752 -2580 -2848 3150 -2514 -3102 3302 -3096 -3312 -2788 -2792 -2994 3074 -2788 -2604 2986 -2732 -2576 -2786 2518 -3190 -2890 -3150 -2606 3006 -2796 -2518 -2588 2520 -2566 -2578 2798 -2782 -2828 -2480 3150 -2828 -2558 -3038 2914 -3254 -2602 2518 -3338 -2590 -3188 -3004 -2626 -3150 2758 2814 -3146 -2438 -2828 2616 -3352 -3042 3198 2850 -2828 -2482 -2688 -2574 -2478 -2788 -3004 -3104 -3052 -2562 -3352 -2930 -3312 -3106 -3004 3044 -3004 -2984 -3150 -2756 2562 2558 -2432 -2630 -3052 -3004 -2826 -2520 -3142 -2478 -2418 3034 3180 -3220 -3038 3312 -2996 2610 -3044 2604 -3102 2558 3190 -3150 -2608 3150 -2770 -3012 -2616 -3076 2604 -3142 2996 3030 -2704 -2518 -2606 -2752 -2540 3170 -2482 2998 -3190 -2756 -2980 -2828 -2578 -2588 -2480 -3008 -2626 3146 -3150 -3148 -3186 -2562 -2520 -2828 -2480 -2620 3190 -3148 -2518 -2620 2542 2904 -3110 -2518 2604 -2634 -2786 -2732 -2728 3150 -2456 -3054 -2518 -2478 -2786 -3142 -2478 2576 -3004 2788 -2374 -3352 -2624 2968 2992 3148 -3150 -2626 3142 -2558 -3044 -2362 -2520 -3352 -2680 -2952 -3190 -3352 2616 -2554 -3312 -2606 -2518 3188 -2796 -2558 -2828 -2944 -2786 -2688 2606 -2580 -2626 -2358 -3150 -2480 -2558 3190 -3312 -2854 -2932 -2798 -2742 -2496 -2976 2818 -2828 2826 2586 -2560 -3256 -3238 -3188 2566 -2616 3088 3142 -2522 -2484 -2480 -2480 -2620 -3148 -2402 -2734 -3004 2936 -2828 -3188 2630 -2590 -3312 -2564 -3312 -2656 -2788 -2604 -3352 -2788 2436 3056 -2520 -2356 -3004 3142 -2788 -2584 -2520 -3044 -3146 -3044 -3230 -2518 -2920 3214 -2858 -2768 -3190 2728 -3352 -3036 -3002 -2398 -2522 -3312 -3014 3102 -2618 -2826 -3312 2692 -2626 -3148 -2996 3036 -3004 3136 -2628 -3190 -2558 -2588 -3190 -3188 -2578 3284 3178 -3004 -2476 -3312 2586 -3190 -2388 2874 -3026 -3286 2788 -2680 -3004 -2516 2588 3082 -2632 3216 3152 -3078 -2758 -2558 -2558 -3188 -3144 3122 2744 -2758 -2758 -2828 3232 -2918 -2758 -2480 -2564 -3146 -2400 -3150 -3190 -2978 -3142 3138 2356 -3104 -2624 -2590 2796 -2616 -3004 -3200 -2518 -2624 -2518 3276 -2614 -2398 -2950 -2956 -3190 -2588 2628 -2628 -2580 -3352 3342 -2826 -3190 -2788 -2620 -2798 2676 -2836 -3312 -2518 -2608 -2576 2356 -3190 -3352 -3150 -2586 -3038 -2656 2586 -2828 2820 -3332 -2728 -2356 -2620 -2708 2792 -3044 2378 -2788 -3044 -2558 -3192 -3150 -3326 -3044 -2504 -2576 -2626 -2574 -3004 -2624 -3004 -2518 2938 -3102 -2562 2994 -2620 -2788 2956 2558 -2558 -2558 -2730 -3044 -2558 2786 -2586 -3150 -2866 -2480 2420 -3004 -2630 3324 -2798 -2960 2784 -3150 2396 -3044 -2828 -3076 -2798 -2578 -3312 -3190 2598 -3312 -2692 -3026 -3148 -2580 -2774 -2582 -2788 2518 -3142 -2482 -2602 -2798 -2592 -2956 -2996 2996 -3190 -2520 -3352 -2442 2920 2576 3020 -2644 -2564 2578 2796 2810 3352 -2586 -3066 -3150 -3150 -3004 -2898 2416 2494 2962 2880 -2720 -2602 -2828 2758 -2520 -2758 2518 3312 -3312 -3312 -2606 -3036 2356 2944 -2518 -2758 3128 -2798 2808 -3148 -2622 -3004 -2798 -3106 -2954 -3036 3102 -3308 2716 -2584 -2412 -3004 -2828 -2520 -3190 -2758 2630 2778 2396 2758 -2522 -3150 3236 -3144 -2606 -2564 3148 -2558 -3190 -2518 -2528 3352 3004 -2788 -2400 2756 -2568 -2824 -3150 -2518 2524 -2472 -2622 -2614 -2796 -2828 -2482 -2558 -3044 -2518 -3142 -2558 2520 -2558 2516 -2396 -2580 -2618 3070 -3044 -3148 -2604 -2518 -2580 -2996 -2558 -3240 -2440 3026 -2454 2396 -2518 -2616 -2518 -2520 -3142 -2564 -3150 3210 2624 3092 -3044 -2994 -2482 -2788 2878 3066 2628 2778 -2788 -2558 -2480 2922 -2756 -2520 -2558 -2480 -2518 -2616 -3004 -2584 -2360 -3102 -2520 -2828 -2580 -2798 -3202 -3102 2556 -2758 2372 -2618 -3242 2786 -2520 -2522 2976 2668 -3102 3150 2626 2570 -2520 2580 -2754 -2828 -2482 -2582 -3044 -2602 3234 -2576 -3144 -2564 -2758 2826 -3190 2966 -2576 -3188 -2628 2584 -3152 -3044 2522 -3078 -3352 2860 -2788 -2428 -2738 -2604 -3044 3192 2798 2616 -2578 -3102 -3352 -2556 -3038 -2954 -2828 2380 2796 2728 -2788 -2768 2604 -3190 -3044 -2620 -2798 -3188 -2456 2798 3034 2502 -2788 3016 -2488 -3142 -3352 -3104 -3102 -2558 -2594 -2480 -2618 -2580 3016 -2480 -3190 -3078 3186 2622 -2414 3044 -2798 -2826 -2520 -3274 -2566 -3352 -3292 2892 -2482 -2720 2584 -2620 -2788 -2906 2564 2794 -3272 2396 -3190 -2522 -2480 -2590 -2464 -3102 -2582 -2518 -2480 -2480 
274.94/277.87	s SATISFIABLE
274.94/277.87	d NODES 3789
274.94/277.87	d CHECKS 10907972
274.94/277.87	c heuristic-cpu: 0.0
274.94/277.87	c prepro-constraint-ccks: 2911013
274.94/277.87	c prepro-constraint-presenceccks: 421498
274.94/277.87	c prepro-cpu: 29.029999
274.94/277.87	c prepro-matrix2d-ccks: 3502281
274.94/277.87	c prepro-matrix2d-presenceccks: 1706545
274.94/277.87	c prepro-removed: 302126
274.94/277.87	c search-cpu: 22.179998
274.94/277.87	c search-nps: 170.82959
274.94/277.87	c total-assgn: 3789
274.94/277.87	c total-constraint-ccks: 4119196
274.94/277.87	c total-constraint-presence-ccks: 4597152
274.94/277.87	c total-cpu: 51.699997
274.94/277.87	c total-matrix2d-ccks: 6788776
274.94/277.87	c total-matrix2d-presence-ccks: 8741172
274.94/277.87	c TOTAL-NODES 3789
274.94/277.87	c TOTAL-CPU 51.699997

Verifier Data 

OK

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2083046-1247722186/watcher-2083046-1247722186 -o /tmp/evaluation-result-2083046-1247722186/solver-2083046-1247722186 -C 1800 -W 2000 -M 900 HOME/concrete.sh -c HOME/instance-2083046-1247722186.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.99 1.98 1.99 3/83 17662
/proc/meminfo: memFree=885888/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) R 17660 17662 15200 0 -1 4194304 321 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807577759 0 65538 4100 65536 0 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=5356 CPUtime=0
/proc/17666/stat : 17666 (concrete.sh) R 17662 17662 15200 0 -1 4194368 14 0 0 0 0 0 0 0 17 0 1 0 59283738 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 4355544 0 0 4096 0 0 0 0 17 1 0 0
/proc/17666/statm: 1339 244 201 169 0 50 0

[startup+0.0465841 s]
/proc/loadavg: 1.99 1.98 1.99 3/83 17662
/proc/meminfo: memFree=885888/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=837368 CPUtime=0.02
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 1941 0 1 0 1 1 0 0 18 0 5 0 59283738 857464832 1541 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 16800971 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 209342 1541 882 9 0 204247 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 842724

[startup+0.101592 s]
/proc/loadavg: 1.99 1.98 1.99 3/83 17662
/proc/meminfo: memFree=885888/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=845000 CPUtime=0.08
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 3541 0 1 0 6 2 0 0 18 0 9 0 59283738 865280000 3014 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 211250 3014 1645 9 0 205742 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 850356

[startup+0.301611 s]
/proc/loadavg: 1.99 1.98 1.99 3/83 17662
/proc/meminfo: memFree=885888/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=848320 CPUtime=0.28
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 4986 0 1 0 25 3 0 0 18 0 9 0 59283738 868679680 4340 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 212080 4340 1779 9 0 206572 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 853676

[startup+0.701656 s]
/proc/loadavg: 1.99 1.98 1.99 3/83 17662
/proc/meminfo: memFree=885888/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=848468 CPUtime=0.67
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 5817 0 1 0 63 4 0 0 18 0 9 0 59283738 868831232 5109 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 212117 5109 1925 9 0 206602 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 853824

[startup+1.50174 s]
/proc/loadavg: 1.99 1.98 1.99 4/93 17675
/proc/meminfo: memFree=870704/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=848620 CPUtime=1.47
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 8088 0 1 0 141 6 0 0 18 0 9 0 59283738 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 212155 7144 2625 9 0 206633 0
[pid=17666/tid=17668] ppid=17662 vsize=848620 CPUtime=0.99
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 3892 0 1 0 96 3 0 0 25 0 9 0 59283739 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4126067578 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=848620 CPUtime=0.13
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 2132 0 0 0 13 0 0 0 16 0 9 0 59283740 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=848620 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59283740 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=848620 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 4 0 0 0 0 0 0 0 15 0 9 0 59283740 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=848620 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 9 0 59283742 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=848620 CPUtime=0.32
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 1366 0 0 0 31 1 0 0 16 0 9 0 59283746 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=848620 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 59283746 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=848620 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 59283746 868986880 7144 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 853976

[startup+3.10291 s]
/proc/loadavg: 1.99 1.98 1.99 3/93 17675
/proc/meminfo: memFree=848880/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=849648 CPUtime=3.05
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 9583 0 1 0 298 7 0 0 18 0 10 0 59283738 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 212412 8612 2625 9 0 206890 0
[pid=17666/tid=17668] ppid=17662 vsize=849648 CPUtime=2.44
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 3949 0 1 0 240 4 0 0 25 0 10 0 59283739 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=849648 CPUtime=0.26
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 3565 0 0 0 25 1 0 0 16 0 10 0 59283740 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=849648 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 10 0 59283740 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=849648 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 4 0 0 0 0 0 0 0 15 0 10 0 59283740 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=849648 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 10 0 59283742 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=849648 CPUtime=0.32
/proc/17666/task/17673/stat : 17673 (java) R 17662 17662 15200 0 -1 64 1369 0 0 0 31 1 0 0 16 0 10 0 59283746 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 102536457 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=849648 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 10 0 59283746 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=849648 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 10 0 59283746 870039552 8612 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 855004

[startup+6.30225 s]
/proc/loadavg: 1.99 1.98 1.99 3/94 17676
/proc/meminfo: memFree=834344/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=6.21
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 12776 0 1 0 610 11 0 0 18 0 10 0 59283738 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 11579 2628 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=4.85
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 4151 0 1 0 480 5 0 0 25 0 10 0 59283739 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4126760039 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=0.68
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 5620 0 0 0 65 3 0 0 16 0 10 0 59283740 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 10 0 59283740 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 4 0 0 0 0 0 0 0 16 0 10 0 59283740 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 10 0 59283742 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=0.66
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 2302 0 0 0 64 2 0 0 16 0 10 0 59283746 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 10 0 59283746 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 10 0 59283746 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17676] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17676/stat : 17676 (java) S 17662 17662 15200 0 -1 64 5 0 0 0 0 0 0 0 24 0 10 0 59284045 872558592 11579 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 857464

[startup+12.7029 s]
/proc/loadavg: 1.99 1.98 1.99 4/94 17676
/proc/meminfo: memFree=789480/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=12.56
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 16662 0 1 0 1241 15 0 0 18 0 10 0 59283738 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 15337 2633 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=10.42
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 4682 0 1 0 1036 6 0 0 25 0 10 0 59283739 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4125190770 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=1.23
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 8828 0 0 0 118 5 0 0 16 0 10 0 59283740 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 17 0 10 0 59283740 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 8 0 0 0 0 0 0 0 17 0 10 0 59283740 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 10 0 59283742 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=0.88
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 2445 0 0 0 85 3 0 0 15 0 10 0 59283746 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 10 0 59283746 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 10 0 59283746 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17676] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17676/stat : 17676 (java) S 17662 17662 15200 0 -1 64 5 0 0 0 0 0 0 0 24 0 10 0 59284045 872558592 15337 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 857464

[startup+25.5013 s]
/proc/loadavg: 1.99 1.98 1.99 3/94 17676
/proc/meminfo: memFree=700904/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=25.22
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 28272 0 1 0 2499 23 0 0 18 0 10 0 59283738 872558592 26930 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 26930 2633 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=22.15
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 5294 0 1 0 2206 9 0 0 25 0 10 0 59283739 872558592 26930 996147200 134512640 134550932 4294955408 18446744073709551615 4129068840 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=1.76
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 19621 0 0 0 167 9 0 0 17 0 10 0 59283740 872558592 26930 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0

################
# More data... #
################

[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=236.54
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 12370 0 1 0 23604 50 0 0 25 0 9 0 59283739 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4125325779 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=22.55
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 170889 0 0 0 2188 67 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 8 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 9 0 59283742 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=6.8
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 4475 0 0 0 663 17 0 0 16 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 265.93
Current children cumulated vsize (KiB) 857464

[startup+271.903 s]
/proc/loadavg: 2.29 2.12 2.04 3/92 17678
/proc/meminfo: memFree=16408/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=269.09
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 188443 0 1 0 26773 136 0 0 18 0 9 0 59283738 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 187022 2636 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=239.69
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 12370 0 1 0 23918 51 0 0 25 0 9 0 59283739 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4128519258 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=22.55
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 170889 0 0 0 2188 67 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 8 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 9 0 59283742 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=6.83
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 4475 0 0 0 666 17 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 269.09
Current children cumulated vsize (KiB) 857464

[startup+275.102 s]
/proc/loadavg: 2.29 2.12 2.04 3/92 17678
/proc/meminfo: memFree=16408/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=272.26
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 188443 0 1 0 27090 136 0 0 18 0 9 0 59283738 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 187022 2636 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=242.84
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 12370 0 1 0 24233 51 0 0 25 0 9 0 59283739 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4128544060 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=22.55
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 170889 0 0 0 2188 67 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 8 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 9 0 59283742 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=6.84
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 4475 0 0 0 667 17 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 272.26
Current children cumulated vsize (KiB) 857464

[startup+276.702 s]
/proc/loadavg: 2.29 2.12 2.04 3/92 17678
/proc/meminfo: memFree=16408/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=273.85
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 188443 0 1 0 27249 136 0 0 18 0 9 0 59283738 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 187022 2636 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=244.42
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 12370 0 1 0 24391 51 0 0 25 0 9 0 59283739 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4129812489 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=22.55
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 170889 0 0 0 2188 67 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 8 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 9 0 59283742 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=6.85
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 4475 0 0 0 668 17 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 273.85
Current children cumulated vsize (KiB) 857464

[startup+277.502 s]
/proc/loadavg: 2.27 2.12 2.04 3/92 17678
/proc/meminfo: memFree=16408/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=274.64
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 188444 0 1 0 27328 136 0 0 18 0 9 0 59283738 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 187022 2636 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=245.16
/proc/17666/task/17668/stat : 17668 (java) R 17662 17662 15200 0 -1 64 12371 0 1 0 24465 51 0 0 25 0 9 0 59283739 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4130529230 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=22.6
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 170889 0 0 0 2193 67 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 8 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 9 0 59283742 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=6.85
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 4475 0 0 0 668 17 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 59283746 872558592 187022 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 274.64
Current children cumulated vsize (KiB) 857464

[startup+277.902 s]
/proc/loadavg: 2.27 2.12 2.04 3/92 17678
/proc/meminfo: memFree=16408/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=852108 CPUtime=275.02
/proc/17666/stat : 17666 (java) S 17662 17662 15200 0 -1 0 188450 0 1 0 27365 137 0 0 18 0 9 0 59283738 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 213027 187024 2636 9 0 207505 0
[pid=17666/tid=17668] ppid=17662 vsize=852108 CPUtime=245.45
/proc/17666/task/17668/stat : 17668 (java) S 17662 17662 15200 0 -1 64 12377 0 1 0 24494 51 0 0 25 0 9 0 59283739 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17669] ppid=17662 vsize=852108 CPUtime=22.69
/proc/17666/task/17669/stat : 17669 (java) S 17662 17662 15200 0 -1 64 170889 0 0 0 2202 67 0 0 16 0 9 0 59283740 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 0 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17670] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17670/stat : 17670 (java) S 17662 17662 15200 0 -1 64 13 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17671] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17671/stat : 17671 (java) S 17662 17662 15200 0 -1 64 8 0 0 0 0 0 0 0 16 0 9 0 59283740 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17672] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17672/stat : 17672 (java) S 17662 17662 15200 0 -1 64 0 0 0 0 0 0 0 0 23 0 9 0 59283742 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17673] ppid=17662 vsize=852108 CPUtime=6.85
/proc/17666/task/17673/stat : 17673 (java) S 17662 17662 15200 0 -1 64 4475 0 0 0 668 17 0 0 15 0 9 0 59283746 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17674] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17674/stat : 17674 (java) S 17662 17662 15200 0 -1 64 1 0 0 0 0 0 0 0 25 0 9 0 59283746 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
[pid=17666/tid=17675] ppid=17662 vsize=852108 CPUtime=0
/proc/17666/task/17675/stat : 17675 (java) S 17662 17662 15200 0 -1 64 2 0 0 0 0 0 0 0 15 0 9 0 59283746 872558592 187024 996147200 134512640 134550932 4294955408 18446744073709551615 4294960144 0 4 0 25189583 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 275.02
Current children cumulated vsize (KiB) 857464

[startup+278.003 s]
/proc/loadavg: 2.27 2.12 2.04 3/92 17678
/proc/meminfo: memFree=16408/2055920 swapFree=4192812/4192956
[pid=17662] ppid=17660 vsize=5356 CPUtime=0
/proc/17662/stat : 17662 (concrete.sh) S 17660 17662 15200 0 -1 4194304 341 291 0 0 0 0 0 0 17 0 1 0 59283737 5484544 244 996147200 4194304 4889804 548682068816 18446744073709551615 269807575876 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/17662/statm: 1339 244 201 169 0 50 0
[pid=17666] ppid=17662 vsize=0 CPUtime=275.11
/proc/17666/stat : 17666 (java) Z 17662 17662 15200 0 -1 12 188454 0 1 0 27366 145 0 0 16 0 2 0 59283738 0 0 996147200 0 0 0 0 0 0 0 0 25189583 18446744073709551615 0 0 17 0 0 0
/proc/17666/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 275.11
Current children cumulated vsize (KiB) 5356

Child status: 0
Real time (s): 278.037
CPU time (s): 275.155
CPU user time (s): 273.662
CPU system time (s): 1.49277
CPU usage (%): 98.9635
Max. virtual memory (cumulated for all children) (KiB): 857464

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 273.662
system time used= 1.49277
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 189096
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 35583
involuntary context switches= 42712

runsolver used 0.376942 second user time and 0.940856 second system time

The end

Launcher Data 

Begin job on node81 at 2009-07-16 07:29:47
IDJOB=2083046
IDBENCH=57690
IDSOLVER=735
FILE ID=node81/2083046-1247722186
PBS_JOBID= 9521337
Free space on /tmp= 126660 MiB

SOLVER NAME= Concrete 2009-06-10
BENCH NAME= CPAI08/csp/fapp/fapp34/normalized-fapp34-0750-4.xml
COMMAND LINE= HOME/concrete.sh -c BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2083046-1247722186/watcher-2083046-1247722186 -o /tmp/evaluation-result-2083046-1247722186/solver-2083046-1247722186 -C 1800 -W 2000 -M 900  HOME/concrete.sh -c HOME/instance-2083046-1247722186.xml

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 900 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 1196fad89b5a5a4f355ab65ef889a576
RANDOM SEED=2019269934

node81.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.233
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.233
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        886384 kB
Buffers:         95100 kB
Cached:         582588 kB
SwapCached:          0 kB
Active:         592992 kB
Inactive:       484836 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        886384 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            2464 kB
Writeback:           0 kB
Mapped:         420540 kB
Slab:            75888 kB
Committed_AS:  1003952 kB
PageTables:       2684 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 126660 MiB
End job on node81 at 2009-07-16 07:34:25