Trace number 238635

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
sugar 0.40? (TO) 1800.05 1809.65

General information on the benchmark

NameblackHole/BH-4-7/
BlackHole-4-7-e-7_ext.xml
MD5SUM49462887fa16db92b55fcd3ad886dec7
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables112
Number of constraints1262
Maximum constraint arity2
Maximum domain size28
Number of constraints which are defined in extension1262
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.04	c # Sugar v0-40 (/tmp/evaluation/238635-1170108632/sugar-v0-40.jar)
0.04	
0.04	c # MAIN  BEGIN : /tmp/evaluation/238635-1170108632/unknown.xml [Mon Jan 29 23:10:33 2007]
0.04	c # CONVERT_XML  BEGIN : /tmp/evaluation/238635-1170108632/unknown.xml /tmp/evaluation/238635-1170108632/sugar20654.csp [Mon Jan 29 23:10:33 2007]
0.04	c # CMD : java -Xms200M -Xmx600M -jar /tmp/evaluation/238635-1170108632/sugar-v0-40.jar -convert /tmp/evaluation/238635-1170108632/unknown.xml /tmp/evaluation/238635-1170108632/sugar20654.csp
0.15	c BEGIN convert /tmp/evaluation/238635-1170108632/unknown.xml
0.72	c END convert (0.569306 seconds)
0.74	c # CONVERT_XML  END : /tmp/evaluation/238635-1170108632/sugar20654.csp 1866375 bytes (1 seconds) [Mon Jan 29 23:10:34 2007]
0.74	c # CONVERT_XML  CPU : 0 = 0 + 0 + 0 + 0
0.74	
0.74	c # GENERATE_SAT  BEGIN : /tmp/evaluation/238635-1170108632/sugar20654.bcnf [Mon Jan 29 23:10:34 2007]
0.74	c # CMD : java -Xms200M -Xmx600M -jar /tmp/evaluation/238635-1170108632/sugar-v0-40.jar -bcnf -map /tmp/evaluation/238635-1170108632/sugar20654.map /tmp/evaluation/238635-1170108632/sugar20654.csp /tmp/evaluation/238635-1170108632/sugar20654.bcnf
0.86	c BEGIN parse /tmp/evaluation/238635-1170108632/sugar20654.csp
138.87	c END parse (138.018591 seconds)
138.87	c BEGIN simplify
139.29	c END simplify (0.412881 seconds)
139.29	c BEGIN encode /tmp/evaluation/238635-1170108632/sugar20654.bcnf
141.76	c END encode (2.472424 seconds)
142.02	c # GENERATE_SAT  END : 18424 variables 91071 clauses 26422124 bytes (141 seconds) [Mon Jan 29 23:12:55 2007]
142.02	c # GENERATE_SAT  CPU : 140.43 = 0.15 + 0.02 + 139.09 + 1.17
142.02	
142.02	c # SOLVE_SAT  BEGIN : /tmp/evaluation/238635-1170108632/sugar20654.bcnf [Mon Jan 29 23:12:55 2007]
142.02	c # CMD : /tmp/evaluation/238635-1170108632/minisat /tmp/evaluation/238635-1170108632/sugar20654.bcnf /tmp/evaluation/238635-1170108632/sugar20654.out
142.62	c ==================================[MINISAT]===================================
142.62	c | Conflicts |     ORIGINAL     |              LEARNT              | Progress |
142.62	c |           | Clauses Literals |   Limit Clauses Literals  Lit/Cl |          |
142.62	c ==============================================================================
142.62	c |         0 |   88578  6318164 |   29526       0        0     nan |  0.000 % |
142.70	c |       100 |   88585  6318164 |   32478      90      778     8.6 |  0.516 % |
142.77	c |       250 |   88596  6318164 |   35726     229     1871     8.2 |  0.516 % |
142.83	c |       478 |   88612  6318164 |   39299     439     3880     8.8 |  0.749 % |
142.91	c |       815 |   88632  6318164 |   43229     756     6922     9.2 |  0.749 % |
143.00	c |      1321 |   88645  6318164 |   47551    1249    13737    11.0 |  0.749 % |
143.10	c |      2080 |   88656  6318164 |   52307    1996    24872    12.5 |  0.782 % |
143.23	c |      3219 |   88674  6318164 |   57537    3115    40451    13.0 |  0.814 % |
143.46	c |      4927 |   88690  6318164 |   63291    4806    76036    15.8 |  0.852 % |
143.78	c |      7489 |   88697  6318164 |   69620    7360   165144    22.4 |  0.885 % |
144.37	c |     11333 |   88704  6318164 |   76582   11197   381510    34.1 |  0.885 % |
145.43	c |     17100 |   88707  6318164 |   84241   16961   785662    46.3 |  0.885 % |
147.40	c |     25749 |   88712  6318164 |   92665   25605  1408715    55.0 |  0.885 % |
151.22	c |     38725 |   88713  6318164 |  101931   38580  2309281    59.9 |  0.885 % |
158.29	c |     58187 |   88713  6318164 |  112124   58042  3871809    66.7 |  0.885 % |
174.72	c |     87380 |   87718  6305334 |  123337   87204  6650193    76.3 |  0.885 % |
201.55	c |    131170 |   87722  6305334 |  135671   21421  1844209    86.1 |  0.885 % |
231.72	c |    196856 |   87737  6305334 |  149238   87092  7546399    86.6 |  0.885 % |
287.89	c |    295383 |   87741  6305334 |  164162   48467  3573882    73.7 |  0.885 % |
399.08	c |    443172 |   87756  6305334 |  180578   46458  4692284   101.0 |  0.885 % |
567.25	c |    664856 |   87794  6305334 |  198636  109190  5467477    50.1 |  0.885 % |
870.92	c |    997381 |   87089  6303121 |  218499   89891  4034073    44.9 |  0.896 % |
1416.59	c |   1496171 |   86374  6301016 |  240349  195990 10280207    52.5 |  0.896 % |
1808.63	
1808.63	s UNKNOWN
1808.63	c # INTERRUPTED
1808.63	c # MAIN  END :  (1809 seconds) [Mon Jan 29 23:40:42 2007]
1808.63	c # MAIN  CPU : 140.43 = 0.15 + 0.02 + 139.09 + 1.17
1808.63	

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: UNKNOWN

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node38/watcher-238635-1170108632 -o ROOT/results/node38/solver-238635-1170108632 -C 1800 -M 900 /tmp/evaluation/238635-1170108632/solver /tmp/evaluation/238635-1170108632 /tmp/evaluation/238635-1170108632/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 4.10 3.53 2.76 4/73 20655
/proc/meminfo: memFree=1762200/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=12268 CPUtime=0
/proc/20654/stat : 20654 (sugar) R 20652 20654 20334 0 -1 4194304 596 0 0 0 0 0 0 0 18 0 1 0 30819146 12562432 315 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899340286 0 0 4224 0 0 0 0 17 1 0 0
/proc/20654/statm: 3067 315 241 3 0 167 0

[startup+0.103772 s]
/proc/loadavg: 4.10 3.53 2.76 4/73 20655
/proc/meminfo: memFree=1762200/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1112 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 805 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 805 368 3 0 531 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 13724

[startup+0.511816 s]
/proc/loadavg: 4.10 3.53 2.76 4/73 20655
/proc/meminfo: memFree=1762200/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1121 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 805 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 805 368 3 0 531 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 13724

[startup+1.33391 s]
/proc/loadavg: 4.10 3.53 2.76 2/82 20671
/proc/meminfo: memFree=1758096/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1188 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 808 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 808 370 3 0 531 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20664] ppid=20654 vsize=807064 CPUtime=0.58
/proc/20664/stat : 20664 (java) R 20654 20654 20334 0 -1 0 7764 0 1 0 53 5 0 0 17 0 8 0 30819221 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073491262 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20664/statm: 201766 7512 1494 14 0 189044 0
[pid=20664/tid=20665] ppid=20654 vsize=807064 CPUtime=0.07
/proc/20664/task/20665/stat : 20665 (java) S 20654 20654 20334 0 -1 64 1710 0 0 0 7 0 0 0 16 0 8 0 30819224 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20666] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20666/stat : 20666 (java) S 20654 20654 20334 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 30819224 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20667] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20667/stat : 20667 (java) S 20654 20654 20334 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 30819224 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20668] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20668/stat : 20668 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 30819227 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20669] ppid=20654 vsize=807064 CPUtime=0.04
/proc/20664/task/20669/stat : 20669 (java) S 20654 20654 20334 0 -1 64 292 0 0 0 4 0 0 0 16 0 8 0 30819227 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20670] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20670/stat : 20670 (java) S 20654 20654 20334 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 30819227 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20671] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20671/stat : 20671 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 30819227 826433536 7512 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 820788

[startup+2.9871 s]
/proc/loadavg: 4.10 3.53 2.76 2/82 20671
/proc/meminfo: memFree=1755600/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1188 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 808 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 808 370 3 0 531 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20664] ppid=20654 vsize=807064 CPUtime=2.23
/proc/20664/stat : 20664 (java) R 20654 20654 20334 0 -1 0 14712 0 1 0 215 8 0 0 16 0 8 0 30819221 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073487975 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20664/statm: 201766 14444 1494 14 0 189044 0
[pid=20664/tid=20665] ppid=20654 vsize=807064 CPUtime=0.57
/proc/20664/task/20665/stat : 20665 (java) S 20654 20654 20334 0 -1 64 8642 0 0 0 54 3 0 0 16 0 8 0 30819224 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20666] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20666/stat : 20666 (java) S 20654 20654 20334 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 30819224 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20667] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20667/stat : 20667 (java) S 20654 20654 20334 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 30819224 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20668] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20668/stat : 20668 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 30819227 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20669] ppid=20654 vsize=807064 CPUtime=0.04
/proc/20664/task/20669/stat : 20669 (java) S 20654 20654 20334 0 -1 64 292 0 0 0 4 0 0 0 16 0 8 0 30819227 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20670] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20670/stat : 20670 (java) S 20654 20654 20334 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 30819227 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20671] ppid=20654 vsize=807064 CPUtime=0
/proc/20664/task/20671/stat : 20671 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 30819227 826433536 14444 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 820788

[startup+6.28567 s]
/proc/loadavg: 4.09 3.54 2.76 2/82 20671
/proc/meminfo: memFree=1710032/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1188 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 808 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 808 370 3 0 531 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20664] ppid=20654 vsize=807332 CPUtime=5.52
/proc/20664/stat : 20664 (java) S 20654 20654 20334 0 -1 0 42525 0 1 0 531 21 0 0 16 0 8 0 30819221 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20664/statm: 201833 42133 1506 14 0 189111 0
[pid=20664/tid=20665] ppid=20654 vsize=807332 CPUtime=1.71
/proc/20664/task/20665/stat : 20665 (java) R 20654 20654 20334 0 -1 64 36172 0 0 0 157 14 0 0 16 0 8 0 30819224 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4155216465 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20664/tid=20666] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20666/stat : 20666 (java) S 20654 20654 20334 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 30819224 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20667] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20667/stat : 20667 (java) S 20654 20654 20334 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 30819224 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20668] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20668/stat : 20668 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 30819227 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20669] ppid=20654 vsize=807332 CPUtime=0.12
/proc/20664/task/20669/stat : 20669 (java) S 20654 20654 20334 0 -1 64 398 0 0 0 12 0 0 0 16 0 8 0 30819227 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20670] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20670/stat : 20670 (java) S 20654 20654 20334 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 30819227 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20671] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20671/stat : 20671 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 30819227 826707968 42133 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 821056

[startup+12.7442 s]
/proc/loadavg: 4.00 3.53 2.76 2/82 20671
/proc/meminfo: memFree=1696088/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1188 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 808 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 808 370 3 0 531 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20664] ppid=20654 vsize=807332 CPUtime=11.96
/proc/20664/stat : 20664 (java) R 20654 20654 20334 0 -1 0 55103 0 1 0 1166 30 0 0 16 0 8 0 30819221 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073489631 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/20664/statm: 201833 54120 1507 14 0 189111 0
[pid=20664/tid=20665] ppid=20654 vsize=807332 CPUtime=4.37
/proc/20664/task/20665/stat : 20665 (java) S 20654 20654 20334 0 -1 64 48485 0 0 0 415 22 0 0 16 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20664/tid=20666] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20666/stat : 20666 (java) S 20654 20654 20334 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20667] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20667/stat : 20667 (java) S 20654 20654 20334 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20668] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20668/stat : 20668 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20669] ppid=20654 vsize=807332 CPUtime=0.13
/proc/20664/task/20669/stat : 20669 (java) S 20654 20654 20334 0 -1 64 400 0 0 0 13 0 0 0 16 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20670] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20670/stat : 20670 (java) S 20654 20654 20334 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20671] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20671/stat : 20671 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 821056

[startup+25.6469 s]
/proc/loadavg: 3.94 3.53 2.78 3/90 20734
/proc/meminfo: memFree=1495568/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1188 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 808 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 808 370 3 0 531 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20664] ppid=20654 vsize=807332 CPUtime=24.76
/proc/20664/stat : 20664 (java) R 20654 20654 20334 0 -1 0 56193 0 1 0 2440 36 0 0 25 0 8 0 30819221 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073632470 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20664/statm: 201833 54120 1507 14 0 189111 0
[pid=20664/tid=20665] ppid=20654 vsize=807332 CPUtime=9.4
/proc/20664/task/20665/stat : 20665 (java) S 20654 20654 20334 0 -1 64 49136 0 0 0 914 26 0 0 16 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20664/tid=20666] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20666/stat : 20666 (java) S 20654 20654 20334 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20667] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20667/stat : 20667 (java) S 20654 20654 20334 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20668] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20668/stat : 20668 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20669] ppid=20654 vsize=807332 CPUtime=0.13
/proc/20664/task/20669/stat : 20669 (java) S 20654 20654 20334 0 -1 64 400 0 0 0 13 0 0 0 16 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20670] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20670/stat : 20670 (java) S 20654 20654 20334 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20671] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20671/stat : 20671 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 821056

[startup+51.3039 s]
/proc/loadavg: 3.70 3.51 2.79 4/90 20734
/proc/meminfo: memFree=1496016/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=13724 CPUtime=0.03
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 1188 0 0 0 3 0 0 0 16 0 1 0 30819146 14053376 808 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/20654/statm: 3431 808 370 3 0 531 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20664] ppid=20654 vsize=807332 CPUtime=50.26
/proc/20664/stat : 20664 (java) R 20654 20654 20334 0 -1 0 58773 0 1 0 4977 49 0 0 25 0 8 0 30819221 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4073332698 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20664/statm: 201833 54120 1507 14 0 189111 0
[pid=20664/tid=20665] ppid=20654 vsize=807332 CPUtime=19.86
/proc/20664/task/20665/stat : 20665 (java) S 20654 20654 20334 0 -1 64 50951 0 0 0 1952 34 0 0 16 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20664/tid=20666] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20666/stat : 20666 (java) S 20654 20654 20334 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20667] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20667/stat : 20667 (java) S 20654 20654 20334 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 30819224 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20668] ppid=20654 vsize=807332 CPUtime=0
/proc/20664/task/20668/stat : 20668 (java) S 20654 20654 20334 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 30819227 826707968 54120 18446744073709551615 134512640 134570532 4294956480 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=20664/tid=20669] ppid=20654 vsize=807332 CPUtime=0.13

################
# More data... #
################

/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 23851 0 0 0 109554 29 0 0 25 0 1 0 30833348 95535104 22813 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 23324 22813 52 112 0 23208 0
Current children cumulated CPU time (s) 1236.96
Current children cumulated vsize (KiB) 117096

[startup+1302.98 s]
/proc/loadavg: 2.01 2.04 2.21 3/76 20736
/proc/meminfo: memFree=1673616/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=93448 CPUtime=1155.57
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 23875 0 0 0 115527 30 0 0 25 0 1 0 30833348 95690752 22837 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 23362 22837 52 112 0 23246 0
Current children cumulated CPU time (s) 1296.7
Current children cumulated vsize (KiB) 117248

[startup+1363.01 s]
/proc/loadavg: 2.08 2.04 2.20 3/76 20736
/proc/meminfo: memFree=1672976/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=94056 CPUtime=1215.33
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 24029 0 0 0 121503 30 0 0 25 0 1 0 30833348 96313344 22983 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134525947 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 23514 22983 52 112 0 23398 0
Current children cumulated CPU time (s) 1356.46
Current children cumulated vsize (KiB) 117856

[startup+1423.03 s]
/proc/loadavg: 2.08 2.05 2.18 3/76 20736
/proc/meminfo: memFree=1672464/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=94372 CPUtime=1275.07
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 24105 0 0 0 127477 30 0 0 25 0 1 0 30833348 96636928 23059 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 23593 23059 52 112 0 23477 0
Current children cumulated CPU time (s) 1416.2
Current children cumulated vsize (KiB) 118172

[startup+1483.05 s]
/proc/loadavg: 2.03 2.04 2.17 3/76 20736
/proc/meminfo: memFree=1653264/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=96608 CPUtime=1334.81
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 24650 0 0 0 133450 31 0 0 25 0 1 0 30833348 98926592 23604 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 24152 23604 52 112 0 24036 0
Current children cumulated CPU time (s) 1475.94
Current children cumulated vsize (KiB) 120408

[startup+1543.06 s]
/proc/loadavg: 2.07 2.04 2.17 3/76 20738
/proc/meminfo: memFree=1645776/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=99548 CPUtime=1394.56
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 25353 0 0 0 139424 32 0 0 25 0 1 0 30833348 101937152 24307 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 24887 24307 52 112 0 24771 0
Current children cumulated CPU time (s) 1535.69
Current children cumulated vsize (KiB) 123348

[startup+1603.08 s]
/proc/loadavg: 2.02 2.03 2.15 3/76 20738
/proc/meminfo: memFree=1645712/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=99548 CPUtime=1454.3
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 25354 0 0 0 145398 32 0 0 25 0 1 0 30833348 101937152 24308 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 24887 24308 52 112 0 24771 0
Current children cumulated CPU time (s) 1595.43
Current children cumulated vsize (KiB) 123348

[startup+1663.09 s]
/proc/loadavg: 2.01 2.02 2.14 3/76 20738
/proc/meminfo: memFree=1645648/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=99548 CPUtime=1514.02
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 25354 0 0 0 151370 32 0 0 25 0 1 0 30833348 101937152 24308 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 24887 24308 52 112 0 24771 0
Current children cumulated CPU time (s) 1655.15
Current children cumulated vsize (KiB) 123348

[startup+1723.11 s]
/proc/loadavg: 2.00 2.02 2.13 3/76 20738
/proc/meminfo: memFree=1645520/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=99548 CPUtime=1573.78
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 25370 0 0 0 157345 33 0 0 25 0 1 0 30833348 101937152 24324 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 24887 24324 52 112 0 24771 0
Current children cumulated CPU time (s) 1714.91
Current children cumulated vsize (KiB) 123348

[startup+1783.13 s]
/proc/loadavg: 2.00 2.01 2.12 3/76 20738
/proc/meminfo: memFree=1645456/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=99548 CPUtime=1633.52
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 25387 0 0 0 163319 33 0 0 25 0 1 0 30833348 101937152 24341 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 24887 24341 52 112 0 24771 0
Current children cumulated CPU time (s) 1774.65
Current children cumulated vsize (KiB) 123348



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.62 s]
/proc/loadavg: 2.00 2.01 2.11 3/76 20738
/proc/meminfo: memFree=1645328/2055920 swapFree=4192812/4192956
[pid=20654] ppid=20652 vsize=23800 CPUtime=140.46
/proc/20654/stat : 20654 (sugar) S 20652 20654 20334 0 -1 4194304 3690 105264 0 1 18 2 13909 117 16 0 1 0 30819146 24371200 3170 18446744073709551615 4194304 4206940 548682069232 18446744073709551615 266899337314 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/20654/statm: 5950 3170 373 3 0 3050 0
[pid=20656] ppid=20654 vsize=0 CPUtime=0.67
/proc/20656/stat : 20656 (java) Z 20654 20654 20334 0 -1 1036 7337 0 1 0 62 5 0 0 16 0 1 0 30819150 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/20656/statm: 0 0 0 0 0 0 0
[pid=20735] ppid=20654 vsize=99688 CPUtime=1658.9
/proc/20735/stat : 20735 (minisat) R 20654 20654 20334 0 -1 0 25418 0 0 0 165857 33 0 0 25 0 1 0 30833348 102080512 24372 18446744073709551615 134512640 134974460 4294956768 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/20735/statm: 24922 24372 52 112 0 24806 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 123488

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 1

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 20654 and gives childrusage.ru_utime.tv_sec=139 childrusage.ru_utime.tv_usec=275826 childrusage.ru_stime.tv_sec=1 childrusage.ru_stime.tv_usec=219814
CPU time returned by wait4() is 140.496
while last known CPU time is 1800.05

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1809.65
CPU time (s): 1800.05
CPU user time (s): 1798.46
CPU system time (s): 1.59
CPU usage (%): 99.4694
Max. virtual memory (cumulated for all children) (KiB): 822060

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 139.276
system time used= 1.21981
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 109040
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 26040
involuntary context switches= 25816

runsolver used 2.03669 s user time and 6.10507 s system time

The end

Launcher Data (download as text)

Begin job on node38 on Mon Jan 29 22:10:33 UTC 2007


IDJOB= 238635
IDBENCH= 7012
IDSOLVER= 86
FILE ID= node38/238635-1170108632

PBS_JOBID= 3689949

Free space on /tmp= 61993 MiB

SOLVER NAME= sugar 0.40
BENCH NAME= HOME/pub/bench/CPAI06/blackHole/BH-4-7/BlackHole-4-7-e-7_ext.xml
COMMAND LINE= /tmp/evaluation/238635-1170108632/solver /tmp/evaluation/238635-1170108632 /tmp/evaluation/238635-1170108632/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node38/watcher-238635-1170108632 -o ROOT/results/node38/solver-238635-1170108632 -C 1800 -M 900  /tmp/evaluation/238635-1170108632/solver /tmp/evaluation/238635-1170108632 /tmp/evaluation/238635-1170108632/unknown.xml

META MD5SUM SOLVER= 0a27e717dfe98d83d9802fe0eea45073
MD5SUM BENCH=  49462887fa16db92b55fcd3ad886dec7

RANDOM SEED= 60259350

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.233
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.233
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1762432 kB
Buffers:          4556 kB
Cached:         188836 kB
SwapCached:          0 kB
Active:          58852 kB
Inactive:       171832 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1762432 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:          139868 kB
Writeback:           0 kB
Mapped:          45744 kB
Slab:            48012 kB
Committed_AS:   306788 kB
PageTables:       1884 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66536 MiB



End job on node38 on Mon Jan 29 22:40:43 UTC 2007