Trace number 194274

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
sugar 0.40? (TO) 1800.07 1818.55

General information on the benchmark

Namerandom/rand-2-50-23/
rand-2-50-23-587-230-50_ext.xml
MD5SUM2a9a137dbf54b6c95e22add6928077b6
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark184.732
SatisfiableYES
(Un)Satisfiability was proved
Number of variables50
Number of constraints463
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension463
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.04	c # Sugar v0-40 (/tmp/evaluation/194274-1170090241/sugar-v0-40.jar)
0.04	
0.04	c # MAIN  BEGIN : /tmp/evaluation/194274-1170090241/unknown.xml [Mon Jan 29 18:04:04 2007]
0.04	c # CONVERT_XML  BEGIN : /tmp/evaluation/194274-1170090241/unknown.xml /tmp/evaluation/194274-1170090241/sugar23501.csp [Mon Jan 29 18:04:04 2007]
0.04	c # CMD : java -Xms200M -Xmx600M -jar /tmp/evaluation/194274-1170090241/sugar-v0-40.jar -convert /tmp/evaluation/194274-1170090241/unknown.xml /tmp/evaluation/194274-1170090241/sugar23501.csp
0.15	c BEGIN convert /tmp/evaluation/194274-1170090241/unknown.xml
0.81	c END convert (0.657995 seconds)
0.84	c # CONVERT_XML  END : /tmp/evaluation/194274-1170090241/sugar23501.csp 2143312 bytes (1 seconds) [Mon Jan 29 18:04:05 2007]
0.84	c # CONVERT_XML  CPU : 0 = 0 + 0 + 0 + 0
0.84	
0.84	c # GENERATE_SAT  BEGIN : /tmp/evaluation/194274-1170090241/sugar23501.bcnf [Mon Jan 29 18:04:05 2007]
0.84	c # CMD : java -Xms200M -Xmx600M -jar /tmp/evaluation/194274-1170090241/sugar-v0-40.jar -bcnf -map /tmp/evaluation/194274-1170090241/sugar23501.map /tmp/evaluation/194274-1170090241/sugar23501.csp /tmp/evaluation/194274-1170090241/sugar23501.bcnf
0.96	c BEGIN parse /tmp/evaluation/194274-1170090241/sugar23501.csp
45.47	c END parse (44.511907 seconds)
45.47	c BEGIN simplify
45.65	c END simplify (0.180787 seconds)
45.65	c BEGIN encode /tmp/evaluation/194274-1170090241/sugar23501.bcnf
47.57	c END encode (1.918886 seconds)
47.75	c # GENERATE_SAT  END : 10914 variables 85695 clauses 12657120 bytes (47 seconds) [Mon Jan 29 18:04:52 2007]
47.75	c # GENERATE_SAT  CPU : 46.46 = 0.08 + 0 + 45.85 + 0.53
47.75	
47.75	c # SOLVE_SAT  BEGIN : /tmp/evaluation/194274-1170090241/sugar23501.bcnf [Mon Jan 29 18:04:52 2007]
47.75	c # CMD : /tmp/evaluation/194274-1170090241/minisat /tmp/evaluation/194274-1170090241/sugar23501.bcnf /tmp/evaluation/194274-1170090241/sugar23501.out
48.04	c ==================================[MINISAT]===================================
48.04	c | Conflicts |     ORIGINAL     |              LEARNT              | Progress |
48.04	c |           | Clauses Literals |   Limit Clauses Literals  Lit/Cl |          |
48.04	c ==============================================================================
48.04	c |         0 |   85695  3078573 |   28565       0        0     nan |  0.000 % |
48.10	c |       101 |   85695  3078573 |   31421     101     4177    41.4 |  0.000 % |
48.19	c |       251 |   85695  3078573 |   34563     251     7133    28.4 |  0.000 % |
48.31	c |       477 |   85695  3078573 |   38020     477    10657    22.3 |  0.000 % |
48.48	c |       814 |   85695  3078573 |   41822     814    16534    20.3 |  0.000 % |
48.71	c |      1320 |   85695  3078573 |   46004    1320    23796    18.0 |  0.000 % |
49.16	c |      2080 |   85696  3078573 |   50604    2079    35795    17.2 |  0.000 % |
49.79	c |      3220 |   85696  3078573 |   55665    3219    56521    17.6 |  0.000 % |
50.76	c |      4929 |   85697  3078573 |   61231    4927    91062    18.5 |  0.000 % |
52.38	c |      7491 |   85698  3078573 |   67354    7488   146737    19.6 |  0.000 % |
54.70	c |     11336 |   85702  3078573 |   74090   11329   240085    21.2 |  0.000 % |
58.70	c |     17104 |   85705  3078573 |   81499   17094   408982    23.9 |  0.000 % |
65.30	c |     25754 |   85706  3078573 |   89649   25743   679533    26.4 |  0.000 % |
78.39	c |     38728 |   85706  3078573 |   98614   38717  1032862    26.7 |  0.000 % |
99.04	c |     58191 |   85708  3078573 |  108475   58178  1511628    26.0 |  0.000 % |
129.21	c |     87384 |   85713  3078573 |  119323   87366  2199562    25.2 |  0.000 % |
186.11	c |    131173 |   85716  3078573 |  131255   26318   650065    24.7 |  0.000 % |
267.24	c |    196857 |   85723  3078573 |  144380   91995  3096658    33.7 |  0.000 % |
400.15	c |    295383 |   85736  3078573 |  158819   66234  1830963    27.6 |  0.000 % |
611.50	c |    443173 |   85751  3078573 |  174700   70616  1872385    26.5 |  0.000 % |
932.56	c |    664856 |   85763  3078573 |  192171  135647  4103080    30.2 |  0.000 % |
1479.27	c |    997382 |   85771  3078573 |  211388  124068  4514426    36.4 |  0.000 % |
1817.53	
1817.53	s UNKNOWN
1817.53	c # INTERRUPTED
1817.53	c # MAIN  END :  (1818 seconds) [Mon Jan 29 18:34:22 2007]
1817.53	c # MAIN  CPU : 46.48 = 0.09 + 0.01 + 45.85 + 0.53
1817.53	

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: UNKNOWN

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node11/watcher-194274-1170090241 -o ROOT/results/node11/solver-194274-1170090241 -C 1800 -M 900 /tmp/evaluation/194274-1170090241/solver /tmp/evaluation/194274-1170090241 /tmp/evaluation/194274-1170090241/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.01 0.49 0.18 4/81 23502
/proc/meminfo: memFree=1782920/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=12268 CPUtime=0
/proc/23501/stat : 23501 (sugar) R 23499 23501 22698 0 -1 4194304 596 0 0 0 0 0 0 0 18 0 1 0 28978954 12562432 315 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918945790 0 0 4224 0 0 0 0 17 1 0 0
/proc/23501/statm: 3067 315 241 3 0 167 0

[startup+0.102659 s]
/proc/loadavg: 1.01 0.49 0.18 4/81 23502
/proc/meminfo: memFree=1782920/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=13724 CPUtime=0.04
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 1112 0 0 0 3 1 0 0 16 0 1 0 28978954 14053376 805 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 3431 805 368 3 0 531 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 13724

[startup+0.51068 s]
/proc/loadavg: 1.01 0.49 0.18 4/81 23502
/proc/meminfo: memFree=1782920/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=13724 CPUtime=0.04
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 1121 0 0 0 3 1 0 0 16 0 1 0 28978954 14053376 805 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 3431 805 368 3 0 531 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 13724

[startup+1.33278 s]
/proc/loadavg: 1.00 0.49 0.19 2/91 23518
/proc/meminfo: memFree=1763960/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=13724 CPUtime=0.04
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 1188 0 0 0 3 1 0 0 16 0 1 0 28978954 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 3431 808 370 3 0 531 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 2 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23511] ppid=23501 vsize=807064 CPUtime=0.47
/proc/23511/stat : 23511 (java) R 23501 23501 22698 0 -1 0 7323 0 1 0 44 3 0 0 17 0 8 0 28979039 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073495440 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/23511/statm: 201766 7072 1494 14 0 189044 0
[pid=23511/tid=23512] ppid=23501 vsize=807064 CPUtime=0.05
/proc/23511/task/23512/stat : 23512 (java) S 23501 23501 22698 0 -1 64 1271 0 0 0 5 0 0 0 16 0 8 0 28979042 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23513] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23513/stat : 23513 (java) S 23501 23501 22698 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 28979042 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23514] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23514/stat : 23514 (java) S 23501 23501 22698 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 28979042 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23515] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23515/stat : 23515 (java) S 23501 23501 22698 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 28979045 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23516] ppid=23501 vsize=807064 CPUtime=0.04
/proc/23511/task/23516/stat : 23516 (java) S 23501 23501 22698 0 -1 64 292 0 0 0 4 0 0 0 16 0 8 0 28979045 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23517] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23517/stat : 23517 (java) S 23501 23501 22698 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 28979045 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23518] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23518/stat : 23518 (java) S 23501 23501 22698 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 28979045 826433536 7072 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.27
Current children cumulated vsize (KiB) 820788

[startup+3.02417 s]
/proc/loadavg: 1.00 0.49 0.19 2/90 23518
/proc/meminfo: memFree=1734016/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=13724 CPUtime=0.04
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 1188 0 0 0 3 1 0 0 16 0 1 0 28978954 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 3431 808 370 3 0 531 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23511] ppid=23501 vsize=807064 CPUtime=2.15
/proc/23511/stat : 23511 (java) R 23501 23501 22698 0 -1 0 14620 0 1 0 210 5 0 0 17 0 8 0 28979039 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073479595 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/23511/statm: 201766 14352 1494 14 0 189044 0
[pid=23511/tid=23512] ppid=23501 vsize=807064 CPUtime=0.59
/proc/23511/task/23512/stat : 23512 (java) S 23501 23501 22698 0 -1 64 8551 0 0 0 57 2 0 0 17 0 8 0 28979042 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23513] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23513/stat : 23513 (java) S 23501 23501 22698 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 28979042 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23514] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23514/stat : 23514 (java) S 23501 23501 22698 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 28979042 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23515] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23515/stat : 23515 (java) S 23501 23501 22698 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 28979045 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23516] ppid=23501 vsize=807064 CPUtime=0.04
/proc/23511/task/23516/stat : 23516 (java) S 23501 23501 22698 0 -1 64 292 0 0 0 4 0 0 0 16 0 8 0 28979045 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23517] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23517/stat : 23517 (java) S 23501 23501 22698 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 28979045 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23518] ppid=23501 vsize=807064 CPUtime=0
/proc/23511/task/23518/stat : 23518 (java) S 23501 23501 22698 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 28979045 826433536 14352 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 820788

[startup+6.32037 s]
/proc/loadavg: 1.00 0.50 0.19 2/90 23522
/proc/meminfo: memFree=1636800/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=13724 CPUtime=0.04
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 1188 0 0 0 3 1 0 0 16 0 1 0 28978954 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 3431 808 370 3 0 531 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23511] ppid=23501 vsize=807336 CPUtime=5.44
/proc/23511/stat : 23511 (java) R 23501 23501 22698 0 -1 0 40713 0 1 0 529 15 0 0 16 0 8 0 28979039 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073633656 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/23511/statm: 201834 40340 1506 14 0 189112 0
[pid=23511/tid=23512] ppid=23501 vsize=807336 CPUtime=1.7
/proc/23511/task/23512/stat : 23512 (java) S 23501 23501 22698 0 -1 64 34387 0 0 0 159 11 0 0 16 0 8 0 28979042 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23513] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23513/stat : 23513 (java) S 23501 23501 22698 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 28979042 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23514] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23514/stat : 23514 (java) S 23501 23501 22698 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 28979042 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23515] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23515/stat : 23515 (java) S 23501 23501 22698 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 28979045 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23516] ppid=23501 vsize=807336 CPUtime=0.12
/proc/23511/task/23516/stat : 23516 (java) S 23501 23501 22698 0 -1 64 401 0 0 0 12 0 0 0 16 0 8 0 28979045 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23517] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23517/stat : 23517 (java) S 23501 23501 22698 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 28979045 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23518] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23518/stat : 23518 (java) S 23501 23501 22698 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 28979045 826712064 40340 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 821060

[startup+12.7321 s]
/proc/loadavg: 1.08 0.53 0.20 4/103 23573
/proc/meminfo: memFree=1526104/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=13724 CPUtime=0.04
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 1188 0 0 0 3 1 0 0 16 0 1 0 28978954 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 3431 808 370 3 0 531 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23511] ppid=23501 vsize=807336 CPUtime=11.82
/proc/23511/stat : 23511 (java) R 23501 23501 22698 0 -1 0 55158 0 1 0 1159 23 0 0 17 0 8 0 28979039 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073575519 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/23511/statm: 201834 54113 1507 14 0 189112 0
[pid=23511/tid=23512] ppid=23501 vsize=807336 CPUtime=4.23
/proc/23511/task/23512/stat : 23512 (java) S 23501 23501 22698 0 -1 64 48613 0 0 0 405 18 0 0 16 0 8 0 28979042 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23513] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23513/stat : 23513 (java) S 23501 23501 22698 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 28979042 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23514] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23514/stat : 23514 (java) S 23501 23501 22698 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 28979042 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23515] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23515/stat : 23515 (java) S 23501 23501 22698 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23516] ppid=23501 vsize=807336 CPUtime=0.12
/proc/23511/task/23516/stat : 23516 (java) S 23501 23501 22698 0 -1 64 403 0 0 0 12 0 0 0 16 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23517] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23517/stat : 23517 (java) S 23501 23501 22698 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23518] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23518/stat : 23518 (java) S 23501 23501 22698 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 821060

[startup+25.6296 s]
/proc/loadavg: 1.30 0.59 0.22 3/103 23573
/proc/meminfo: memFree=1351448/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=13724 CPUtime=0.04
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 1188 0 0 0 3 1 0 0 16 0 1 0 28978954 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 3431 808 370 3 0 531 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23511] ppid=23501 vsize=807336 CPUtime=24.6
/proc/23511/stat : 23511 (java) R 23501 23501 22698 0 -1 0 56307 0 1 0 2432 28 0 0 25 0 8 0 28979039 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073703570 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/23511/statm: 201834 54113 1507 14 0 189112 0
[pid=23511/tid=23512] ppid=23501 vsize=807336 CPUtime=8.54
/proc/23511/task/23512/stat : 23512 (java) S 23501 23501 22698 0 -1 64 49406 0 0 0 833 21 0 0 16 0 8 0 28979042 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23513] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23513/stat : 23513 (java) S 23501 23501 22698 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 28979042 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23514] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23514/stat : 23514 (java) S 23501 23501 22698 0 -1 64 5 0 0 0 0 0 0 0 16 0 8 0 28979042 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23511/tid=23515] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23515/stat : 23515 (java) S 23501 23501 22698 0 -1 64 1 0 0 0 0 0 0 0 22 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23516] ppid=23501 vsize=807336 CPUtime=0.12
/proc/23511/task/23516/stat : 23516 (java) S 23501 23501 22698 0 -1 64 403 0 0 0 12 0 0 0 16 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23517] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23517/stat : 23517 (java) S 23501 23501 22698 0 -1 64 3 0 0 0 0 0 0 0 23 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23511/tid=23518] ppid=23501 vsize=807336 CPUtime=0
/proc/23511/task/23518/stat : 23518 (java) S 23501 23501 22698 0 -1 64 0 0 0 0 0 0 0 0 15 0 8 0 28979045 826712064 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 821060

[startup+51.2596 s]
/proc/loadavg: 1.79 0.77 0.29 4/96 23574
/proc/meminfo: memFree=1522640/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.51
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 11 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=17400 CPUtime=3.49
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 5023 0 0 0 346 3 0 0 25 0 1 0 28983729 17817600 3986 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23574/statm: 4350 3986 52 112 0 4234 0
Current children cumulated CPU time (s) 50.76
Current children cumulated vsize (KiB) 36748

[startup+102.545 s]
/proc/loadavg: 1.91 0.96 0.38 3/89 23575
/proc/meminfo: memFree=1694728/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.51
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 11 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0

################
# More data... #
################

/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 13561 0 0 0 118357 19 0 0 25 0 1 0 28983729 53321728 12516 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 13018 12516 52 112 0 12902 0
Current children cumulated CPU time (s) 1231.04
Current children cumulated vsize (KiB) 71420

[startup+1303.01 s]
/proc/loadavg: 2.00 1.99 1.54 3/89 23575
/proc/meminfo: memFree=1637640/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=52204 CPUtime=1243.19
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 13609 0 0 0 124299 20 0 0 25 0 1 0 28983729 53456896 12564 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 13051 12564 52 112 0 12935 0
Current children cumulated CPU time (s) 1290.47
Current children cumulated vsize (KiB) 71552

[startup+1363.01 s]
/proc/loadavg: 2.00 1.99 1.56 3/89 23575
/proc/meminfo: memFree=1637576/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=52204 CPUtime=1302.61
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 13614 0 0 0 130241 20 0 0 25 0 1 0 28983729 53456896 12569 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 13051 12569 52 112 0 12935 0
Current children cumulated CPU time (s) 1349.89
Current children cumulated vsize (KiB) 71552

[startup+1423.01 s]
/proc/loadavg: 2.00 1.99 1.58 3/89 23575
/proc/meminfo: memFree=1637384/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=52392 CPUtime=1362.01
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 13645 0 0 0 136181 20 0 0 25 0 1 0 28983729 53649408 12600 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528316 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 13098 12600 52 112 0 12982 0
Current children cumulated CPU time (s) 1409.29
Current children cumulated vsize (KiB) 71740

[startup+1483.11 s]
/proc/loadavg: 2.07 2.01 1.61 3/89 23575
/proc/meminfo: memFree=1637192/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=52552 CPUtime=1421.55
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 13669 0 0 0 142134 21 0 0 25 0 1 0 28983729 53813248 12624 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 13138 12624 52 112 0 13022 0
Current children cumulated CPU time (s) 1468.83
Current children cumulated vsize (KiB) 71900

[startup+1543.11 s]
/proc/loadavg: 2.02 2.00 1.64 3/89 23575
/proc/meminfo: memFree=1637064/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=52688 CPUtime=1480.97
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 13692 0 0 0 148076 21 0 0 25 0 1 0 28983729 53952512 12647 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 13172 12647 52 112 0 13056 0
Current children cumulated CPU time (s) 1528.25
Current children cumulated vsize (KiB) 72036

[startup+1603.11 s]
/proc/loadavg: 2.01 2.00 1.65 3/89 23575
/proc/meminfo: memFree=1635976/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=53496 CPUtime=1540.37
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 13918 0 0 0 154015 22 0 0 25 0 1 0 28983729 54779904 12873 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134527104 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 13374 12873 52 112 0 13258 0
Current children cumulated CPU time (s) 1587.65
Current children cumulated vsize (KiB) 72844

[startup+1663.21 s]
/proc/loadavg: 2.00 2.00 1.67 3/89 23575
/proc/meminfo: memFree=1632136/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=57480 CPUtime=1599.89
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 14824 0 0 0 159966 23 0 0 25 0 1 0 28983729 58859520 13779 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 14370 13779 52 112 0 14254 0
Current children cumulated CPU time (s) 1647.17
Current children cumulated vsize (KiB) 76828

[startup+1723.22 s]
/proc/loadavg: 2.00 2.00 1.69 3/89 23575
/proc/meminfo: memFree=1630856/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=57888 CPUtime=1659.32
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 14897 0 0 0 165909 23 0 0 25 0 1 0 28983729 59277312 13852 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528435 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 14472 13852 52 112 0 14356 0
Current children cumulated CPU time (s) 1706.6
Current children cumulated vsize (KiB) 77236

[startup+1783.32 s]
/proc/loadavg: 2.00 2.00 1.71 3/89 23575
/proc/meminfo: memFree=1629576/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=57888 CPUtime=1718.82
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 14900 0 0 0 171859 23 0 0 25 0 1 0 28983729 59277312 13855 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 0 0 0
/proc/23574/statm: 14472 13855 52 112 0 14356 0
Current children cumulated CPU time (s) 1766.1
Current children cumulated vsize (KiB) 77236



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1817.53 s]
/proc/loadavg: 1.85 1.97 1.71 2/80 23590
/proc/meminfo: memFree=1710848/2055920 swapFree=4192956/4192956
[pid=23501] ppid=23499 vsize=19348 CPUtime=46.52
/proc/23501/stat : 23501 (sugar) S 23499 23501 22698 0 -1 4194304 2659 71525 0 1 12 2 4585 53 16 0 1 0 28978954 19812352 2170 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 262918942818 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23501/statm: 4837 2170 373 3 0 1937 0
[pid=23503] ppid=23501 vsize=0 CPUtime=0.76
/proc/23503/stat : 23503 (java) Z 23501 23501 22698 0 -1 1036 7892 0 1 0 71 5 0 0 16 0 1 0 28978958 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23503/statm: 0 0 0 0 0 0 0
[pid=23574] ppid=23501 vsize=57888 CPUtime=1752.78
/proc/23574/stat : 23574 (minisat) R 23501 23501 22698 0 -1 0 14900 0 0 0 175254 24 0 0 25 0 1 0 28983729 59277312 13855 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134524987 0 0 4096 3 0 0 0 17 1 0 0
/proc/23574/statm: 14472 13855 52 112 0 14356 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 77236

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 1

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 23501 and gives childrusage.ru_utime.tv_sec=45 childrusage.ru_utime.tv_usec=974010 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=561914
CPU time returned by wait4() is 46.5359
while last known CPU time is 1800.07

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1818.55
CPU time (s): 1800.07
CPU user time (s): 1799.22
CPU system time (s): 0.85
CPU usage (%): 98.9839
Max. virtual memory (cumulated for all children) (KiB): 822064

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 45.974
system time used= 0.561914
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74270
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8743
involuntary context switches= 8740

runsolver used 2.43663 s user time and 5.58815 s system time

The end

Launcher Data (download as text)

Begin job on node11 on Mon Jan 29 17:04:02 UTC 2007


IDJOB= 194274
IDBENCH= 3205
IDSOLVER= 86
FILE ID= node11/194274-1170090241

PBS_JOBID= 3689377

Free space on /tmp= 66560 MiB

SOLVER NAME= sugar 0.40
BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-50-23/rand-2-50-23-587-230-50_ext.xml
COMMAND LINE= /tmp/evaluation/194274-1170090241/solver /tmp/evaluation/194274-1170090241 /tmp/evaluation/194274-1170090241/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node11/watcher-194274-1170090241 -o ROOT/results/node11/solver-194274-1170090241 -C 1800 -M 900  /tmp/evaluation/194274-1170090241/solver /tmp/evaluation/194274-1170090241 /tmp/evaluation/194274-1170090241/unknown.xml

META MD5SUM SOLVER= 0a27e717dfe98d83d9802fe0eea45073
MD5SUM BENCH=  2a9a137dbf54b6c95e22add6928077b6

RANDOM SEED= 921951146

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.243
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.243
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1783464 kB
Buffers:         40672 kB
Cached:         138508 kB
SwapCached:          0 kB
Active:         174756 kB
Inactive:        52296 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1783464 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:            2316 kB
Writeback:           0 kB
Mapped:          66784 kB
Slab:            30704 kB
Committed_AS:   185172 kB
PageTables:       1976 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66561 MiB



End job on node11 on Mon Jan 29 17:34:23 UTC 2007