Trace number 201336

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
CSP4J - MAC 2006-12-19? (TO) 0.004998 1810.01

General information on the benchmark

Namefapp/fapp11-15/fapp12/
fapp12-1500-4.xml
MD5SUMb32f7f4672e7944a90a054382f67ae51
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of constraints25409
Maximum constraint arity2
Maximum domain size310
Number of constraints which are defined in extension0
Number of constraints which are defined in intension25409
Global constraints used (with number of constraints)

Solver Data (download as text)



Verifier Data (download as text)




ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 



Watcher Data (download as text)




runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node69/watcher-201336-1168713602 -o ROOT/results/node69/solver-201336-1168713602 -C 1800 -M 900 /tmp/evaluation/201336-1168713602/cspfj.sh -competition /tmp/evaluation/201336-1168713602/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 0.81 1.66 1.81 4/68 5560
/proc/meminfo: memFree=1354576/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 271 0 0 0 0 0 0 0 18 0 1 0 18858001 5480448 229 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 229 192 169 0 49 0
[pid=5561] ppid=5559 vsize=0 CPUtime=0
/proc/5561/stat : 5561 (dirname) D 5559 5559 5085 0 -1 4194308 128 0 0 0 0 0 0 0 18 0 1 0 18858001 0 0 18446744073709551615 0 0 0 0 0 0 0 4096 0 18446744072100051646 0 0 17 1 0 0
/proc/5561/statm: 0 0 0 0 0 0 0

[startup+0.10564 s]
/proc/loadavg: 0.81 1.66 1.81 4/68 5560
/proc/meminfo: memFree=1354576/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+0.514707 s]
/proc/loadavg: 0.81 1.66 1.81 4/68 5560
/proc/meminfo: memFree=1354576/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5352

[startup+1.34374 s]
/proc/loadavg: 0.81 1.66 1.81 2/76 5569
/proc/meminfo: memFree=1325520/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=865012 CPUtime=0.68
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 5871 0 69 0 61 7 0 0 17 0 8 0 18858002 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073482741 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/5562/statm: 216253 5634 1741 14 0 203524 0
[pid=5562/tid=5563] ppid=5559 vsize=865012 CPUtime=0.11
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 2321 0 0 0 10 1 0 0 16 0 8 0 18858042 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=865012 CPUtime=0
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 18858043 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5565] ppid=5559 vsize=865012 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 15 0 8 0 18858043 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5566] ppid=5559 vsize=865012 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=865012 CPUtime=0.07
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 303 0 0 0 7 0 0 0 16 0 8 0 18858051 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=865012 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=865012 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 885772288 5634 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 870364

[startup+2.98488 s]
/proc/loadavg: 0.81 1.66 1.81 2/76 5569
/proc/meminfo: memFree=1304208/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=865660 CPUtime=2.31
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 12896 0 75 0 217 14 0 0 17 0 8 0 18858002 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073735948 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/5562/statm: 216415 12627 1828 14 0 203677 0
[pid=5562/tid=5563] ppid=5559 vsize=865660 CPUtime=0.3
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 8232 0 0 0 27 3 0 0 16 0 8 0 18858042 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=865660 CPUtime=0
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 18858043 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5565] ppid=5559 vsize=865660 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5566] ppid=5559 vsize=865660 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=865660 CPUtime=0.25
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 510 0 0 0 24 1 0 0 16 0 8 0 18858051 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5568] ppid=5559 vsize=865660 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=865660 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 886435840 12627 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.31
Current children cumulated vsize (KiB) 871012

[startup+6.27516 s]
/proc/loadavg: 0.90 1.67 1.81 5/89 5630
/proc/meminfo: memFree=1189224/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=866920 CPUtime=5.59
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 25229 0 75 0 524 35 0 0 19 0 8 0 18858002 887726080 24935 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073330699 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/5562/statm: 216730 24935 1828 14 0 203992 0
[pid=5562/tid=5563] ppid=5559 vsize=866920 CPUtime=1.01
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 19021 0 0 0 87 14 0 0 16 0 8 0 18858042 887726080 24935 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 18858043 887726080 24936 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5565] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 887726080 24936 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5566] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 887726080 24936 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=866920 CPUtime=0.33
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 538 0 0 0 31 2 0 0 15 0 8 0 18858051 887726080 24936 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 887726080 24936 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 887726080 24936 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 5.59
Current children cumulated vsize (KiB) 872272

[startup+12.6855 s]
/proc/loadavg: 1.07 1.69 1.82 5/89 5630
/proc/meminfo: memFree=1082920/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=866920 CPUtime=11.97
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 44753 0 75 0 1137 60 0 0 25 0 8 0 18858002 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073736007 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/5562/statm: 216730 44439 1828 14 0 203992 0
[pid=5562/tid=5563] ppid=5559 vsize=866920 CPUtime=1.85
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 36545 0 0 0 163 22 0 0 16 0 8 0 18858042 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 18858043 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5565] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5566] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=866920 CPUtime=0.33
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 539 0 0 0 31 2 0 0 15 0 8 0 18858051 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 887726080 44439 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 11.97
Current children cumulated vsize (KiB) 872272

[startup+25.5546 s]
/proc/loadavg: 1.34 1.72 1.83 3/89 5630
/proc/meminfo: memFree=969512/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=866920 CPUtime=24.78
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 68471 0 75 0 2387 91 0 0 25 0 8 0 18858002 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073874672 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/5562/statm: 216730 68144 1828 14 0 203992 0
[pid=5562/tid=5563] ppid=5559 vsize=866920 CPUtime=3.57
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 57497 0 0 0 324 33 0 0 16 0 8 0 18858042 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 18858043 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5565] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5566] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=866920 CPUtime=0.33
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 539 0 0 0 31 2 0 0 15 0 8 0 18858051 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=866920 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 887726080 68144 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 24.78
Current children cumulated vsize (KiB) 872272

[startup+51.2148 s]
/proc/loadavg: 1.78 1.79 1.84 3/89 5630
/proc/meminfo: memFree=805736/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=868420 CPUtime=50.28
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 104432 0 75 0 4891 137 0 0 25 0 8 0 18858002 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073827017 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/5562/statm: 217105 101620 1828 14 0 204367 0
[pid=5562/tid=5563] ppid=5559 vsize=868420 CPUtime=6.78
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 88729 0 0 0 627 51 0 0 16 0 8 0 18858042 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=868420 CPUtime=0
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 18858043 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5565] ppid=5559 vsize=868420 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5566] ppid=5559 vsize=868420 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=868420 CPUtime=0.33
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 539 0 0 0 31 2 0 0 15 0 8 0 18858051 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=868420 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=868420 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 889262080 101620 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 50.28
Current children cumulated vsize (KiB) 873772

[startup+102.429 s]
/proc/loadavg: 1.95 1.83 1.85 3/89 5630
/proc/meminfo: memFree=590376/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=869444 CPUtime=101.23

################
# More data... #
################

/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=884352 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1475.37
Current children cumulated vsize (KiB) 889704

[startup+1543.79 s]
/proc/loadavg: 2.00 2.01 1.95 3/89 5828
/proc/meminfo: memFree=68200/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=884352 CPUtime=1535.14
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 236249 0 75 0 153157 357 0 0 25 0 8 0 18858002 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072942922 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/5562/statm: 221088 182893 1834 14 0 208350 0
[pid=5562/tid=5563] ppid=5559 vsize=884352 CPUtime=13.77
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 154695 0 0 0 1294 83 0 0 16 0 8 0 18858042 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=884352 CPUtime=0
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 18858043 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5565] ppid=5559 vsize=884352 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5566] ppid=5559 vsize=884352 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=884352 CPUtime=13.46
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 11509 0 0 0 1281 65 0 0 15 0 8 0 18858051 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=884352 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=884352 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 905576448 182893 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1535.14
Current children cumulated vsize (KiB) 889704

[startup+1603.84 s]
/proc/loadavg: 2.00 2.00 1.95 3/89 5828
/proc/meminfo: memFree=38760/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=885760 CPUtime=1594.87
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 241912 0 75 0 159128 359 0 0 17 0 8 0 18858002 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072941861 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/5562/statm: 221440 188169 1834 14 0 208702 0
[pid=5562/tid=5563] ppid=5559 vsize=885760 CPUtime=16.25
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 160339 0 0 0 1540 85 0 0 18 0 8 0 18858042 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5564] ppid=5559 vsize=885760 CPUtime=0.01
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 1 0 0 0 17 0 8 0 18858043 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5565] ppid=5559 vsize=885760 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5566] ppid=5559 vsize=885760 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=885760 CPUtime=13.46
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 11509 0 0 0 1281 65 0 0 15 0 8 0 18858051 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=885760 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=885760 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 907018240 188169 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1594.87
Current children cumulated vsize (KiB) 891112

[startup+1663.88 s]
/proc/loadavg: 2.11 2.03 1.96 3/89 5828
/proc/meminfo: memFree=15336/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=885824 CPUtime=1654.61
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 248367 0 75 0 165099 362 0 0 25 0 8 0 18858002 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072941849 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/5562/statm: 221456 194204 1834 14 0 208718 0
[pid=5562/tid=5563] ppid=5559 vsize=885824 CPUtime=21.49
/proc/5562/task/5563/stat : 5563 (java) S 5559 5559 5085 0 -1 64 166792 0 0 0 2060 89 0 0 16 0 8 0 18858042 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5564] ppid=5559 vsize=885824 CPUtime=0.01
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 1 0 0 0 16 0 8 0 18858043 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5565] ppid=5559 vsize=885824 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5566] ppid=5559 vsize=885824 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=885824 CPUtime=13.46
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 11509 0 0 0 1281 65 0 0 15 0 8 0 18858051 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=885824 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=885824 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 907083776 194204 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1654.61
Current children cumulated vsize (KiB) 891176

[startup+1723.91 s]
/proc/loadavg: 2.09 2.04 1.96 4/89 5828
/proc/meminfo: memFree=16488/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=885664 CPUtime=1714.36
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 248982 0 75 0 171073 363 0 0 17 0 8 0 18858002 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4072925640 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/5562/statm: 221416 194193 1834 14 0 208678 0
[pid=5562/tid=5563] ppid=5559 vsize=885664 CPUtime=30.54
/proc/5562/task/5563/stat : 5563 (java) R 5559 5559 5085 0 -1 64 167404 0 0 0 2964 90 0 0 19 0 8 0 18858042 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5564] ppid=5559 vsize=885664 CPUtime=0.01
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 1 0 0 0 16 0 8 0 18858043 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5565] ppid=5559 vsize=885664 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5566] ppid=5559 vsize=885664 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=885664 CPUtime=13.46
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 11509 0 0 0 1281 65 0 0 15 0 8 0 18858051 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=885664 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=885664 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 906919936 194193 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1714.36
Current children cumulated vsize (KiB) 891016

[startup+1783.94 s]
/proc/loadavg: 2.39 2.13 2.00 4/89 5828
/proc/meminfo: memFree=15976/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=887668 CPUtime=1774.11
/proc/5562/stat : 5562 (java) R 5559 5559 5085 0 -1 0 250004 0 75 0 177047 364 0 0 25 0 8 0 18858002 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/5562/statm: 221917 194390 1834 14 0 209179 0
[pid=5562/tid=5563] ppid=5559 vsize=887668 CPUtime=42.67
/proc/5562/task/5563/stat : 5563 (java) R 5559 5559 5085 0 -1 64 168421 0 0 0 4176 91 0 0 17 0 8 0 18858042 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155135561 0 0 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5564] ppid=5559 vsize=887668 CPUtime=0.01
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 1 0 0 0 16 0 8 0 18858043 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5565] ppid=5559 vsize=887668 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5566] ppid=5559 vsize=887668 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=887668 CPUtime=13.46
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 11509 0 0 0 1281 65 0 0 15 0 8 0 18858051 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=887668 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=887668 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 908972032 194390 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1774.11
Current children cumulated vsize (KiB) 893020



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1809.99 s]
/proc/loadavg: 2.57 2.20 2.03 3/89 5828
/proc/meminfo: memFree=15272/2055920 swapFree=4192956/4192956
[pid=5559] ppid=5555 vsize=5352 CPUtime=0
/proc/5559/stat : 5559 (cspfj.sh) S 5555 5559 5085 0 -1 4194304 316 128 0 0 0 0 0 0 18 0 1 0 18858001 5480448 241 18446744073709551615 4194304 4889804 548682069280 18446744073709551615 237947642692 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/5559/statm: 1338 241 201 169 0 49 0
[pid=5562] ppid=5559 vsize=887860 CPUtime=1800.05
/proc/5562/stat : 5562 (java) S 5559 5559 5085 0 -1 0 252267 0 75 0 179639 366 0 0 18 0 8 0 18858002 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/5562/statm: 221965 194432 1834 14 0 209227 0
[pid=5562/tid=5563] ppid=5559 vsize=887860 CPUtime=56.21
/proc/5562/task/5563/stat : 5563 (java) R 5559 5559 5085 0 -1 64 170680 0 0 0 5529 92 0 0 25 0 8 0 18858042 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155134173 0 0 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5564] ppid=5559 vsize=887860 CPUtime=0.01
/proc/5562/task/5564/stat : 5564 (java) S 5559 5559 5085 0 -1 64 11 0 0 0 1 0 0 0 16 0 8 0 18858043 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=5562/tid=5565] ppid=5559 vsize=887860 CPUtime=0
/proc/5562/task/5565/stat : 5565 (java) S 5559 5559 5085 0 -1 64 7 0 0 0 0 0 0 0 16 0 8 0 18858043 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5566] ppid=5559 vsize=887860 CPUtime=0
/proc/5562/task/5566/stat : 5566 (java) S 5559 5559 5085 0 -1 64 0 0 0 0 0 0 0 0 19 0 8 0 18858051 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5567] ppid=5559 vsize=887860 CPUtime=13.46
/proc/5562/task/5567/stat : 5567 (java) S 5559 5559 5085 0 -1 64 11509 0 0 0 1281 65 0 0 15 0 8 0 18858051 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5568] ppid=5559 vsize=887860 CPUtime=0
/proc/5562/task/5568/stat : 5568 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 20 0 8 0 18858051 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=5562/tid=5569] ppid=5559 vsize=887860 CPUtime=0
/proc/5562/task/5569/stat : 5569 (java) S 5559 5559 5085 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 18858051 909168640 194432 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 893212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1810.01
CPU time (s): 0.004998
CPU user time (s): 0.001999
CPU system time (s): 0.002999
CPU usage (%): 0.000276132
Max. virtual memory (cumulated for all children) (KiB): 893716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 444
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21
involuntary context switches= 2

runsolver used 2.10568 s user time and 5.54916 s system time

The end



Launcher Data (download as text)




Begin job on node69 on Sat Jan 13 18:40:08 UTC 2007


IDJOB= 201336
IDBENCH= 3757
IDSOLVER= 77
FILE ID= node69/201336-1168713602

PBS_JOBID= 3547307

Free space on /tmp= 66561 MiB

SOLVER NAME= CSP4J - MAC 2006-12-19
BENCH NAME= HOME/pub/bench/CPAI06/fapp/fapp11-15/fapp12/fapp12-1500-4.xml
COMMAND LINE= /tmp/evaluation/201336-1168713602/cspfj.sh -competition /tmp/evaluation/201336-1168713602/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node69/watcher-201336-1168713602 -o ROOT/results/node69/solver-201336-1168713602 -C 1800 -M 900  /tmp/evaluation/201336-1168713602/cspfj.sh -competition /tmp/evaluation/201336-1168713602/unknown.xml

META MD5SUM SOLVER= ae5901f6cce23734dab709fa25e92adb
MD5SUM BENCH=  b32f7f4672e7944a90a054382f67ae51

RANDOM SEED= 508206982

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.218
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.218
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1355056 kB
Buffers:         49808 kB
Cached:         559132 kB
SwapCached:          0 kB
Active:          82784 kB
Inactive:       546724 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1355056 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:            3712 kB
Writeback:           0 kB
Mapped:          30788 kB
Slab:            57076 kB
Committed_AS:   342220 kB
PageTables:       1692 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66555 MiB



End job on node69 on Sat Jan 13 19:10:25 UTC 2007