Trace number 195129

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
sugar 0.40? (TO) 1800.02 1801.69

General information on the benchmark

Namerandom/rand-2-50-23/
rand-2-50-23-587-230-21_ext.xml
MD5SUMec3a38c5bcff9670d4ef63107bc6cb5e
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1298.57
SatisfiableYES
(Un)Satisfiability was proved
Number of variables50
Number of constraints477
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension477
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.06	c # Sugar v0-40 (/tmp/evaluation/195129-1170092089/sugar-v0-40.jar)
0.06	
0.06	c # MAIN  BEGIN : /tmp/evaluation/195129-1170092089/unknown.xml [Mon Jan 29 18:34:51 2007]
0.06	c # CONVERT_XML  BEGIN : /tmp/evaluation/195129-1170092089/unknown.xml /tmp/evaluation/195129-1170092089/sugar23818.csp [Mon Jan 29 18:34:51 2007]
0.06	c # CMD : java -Xms200M -Xmx600M -jar /tmp/evaluation/195129-1170092089/sugar-v0-40.jar -convert /tmp/evaluation/195129-1170092089/unknown.xml /tmp/evaluation/195129-1170092089/sugar23818.csp
0.21	c BEGIN convert /tmp/evaluation/195129-1170092089/unknown.xml
0.87	c END convert (0.660128 seconds)
0.92	c # CONVERT_XML  END : /tmp/evaluation/195129-1170092089/sugar23818.csp 2171354 bytes (1 seconds) [Mon Jan 29 18:34:52 2007]
0.92	c # CONVERT_XML  CPU : 0 = 0 + 0 + 0 + 0
0.92	
0.92	c # GENERATE_SAT  BEGIN : /tmp/evaluation/195129-1170092089/sugar23818.bcnf [Mon Jan 29 18:34:52 2007]
0.92	c # CMD : java -Xms200M -Xmx600M -jar /tmp/evaluation/195129-1170092089/sugar-v0-40.jar -bcnf -map /tmp/evaluation/195129-1170092089/sugar23818.map /tmp/evaluation/195129-1170092089/sugar23818.csp /tmp/evaluation/195129-1170092089/sugar23818.bcnf
1.03	c BEGIN parse /tmp/evaluation/195129-1170092089/sugar23818.csp
34.73	c END parse (33.698159 seconds)
34.73	c BEGIN simplify
34.86	c END simplify (0.123454 seconds)
34.86	c BEGIN encode /tmp/evaluation/195129-1170092089/sugar23818.bcnf
35.91	c END encode (1.050684 seconds)
36.13	c # GENERATE_SAT  END : 7936 variables 80706 clauses 9061264 bytes (35 seconds) [Mon Jan 29 18:35:27 2007]
36.13	c # GENERATE_SAT  CPU : 35.03 = 0.06 + 0 + 34.48 + 0.49
36.13	
36.13	c # SOLVE_SAT  BEGIN : /tmp/evaluation/195129-1170092089/sugar23818.bcnf [Mon Jan 29 18:35:27 2007]
36.13	c # CMD : /tmp/evaluation/195129-1170092089/minisat /tmp/evaluation/195129-1170092089/sugar23818.bcnf /tmp/evaluation/195129-1170092089/sugar23818.out
36.34	c ==================================[MINISAT]===================================
36.34	c | Conflicts |     ORIGINAL     |              LEARNT              | Progress |
36.34	c |           | Clauses Literals |   Limit Clauses Literals  Lit/Cl |          |
36.34	c ==============================================================================
36.34	c |         0 |   80706  2184600 |   26902       0        0     nan |  0.000 % |
36.39	c |       109 |   80706  2184600 |   29592     109    12641   116.0 |  0.000 % |
36.45	c |       259 |   80708  2184600 |   32551     257    14975    58.3 |  0.000 % |
36.55	c |       485 |   80708  2184600 |   35806     483    18561    38.4 |  0.000 % |
36.66	c |       823 |   80708  2184600 |   39387     821    23512    28.6 |  0.000 % |
36.87	c |      1330 |   80708  2184600 |   43325    1328    30452    22.9 |  0.000 % |
37.23	c |      2089 |   80708  2184600 |   47658    2087    40785    19.5 |  0.000 % |
37.75	c |      3229 |   80709  2184600 |   52424    3226    57398    17.8 |  0.000 % |
38.65	c |      4937 |   80709  2184600 |   57666    4934    86025    17.4 |  0.000 % |
40.05	c |      7500 |   80709  2184600 |   63433    7497   128177    17.1 |  0.000 % |
42.30	c |     11344 |   80709  2184600 |   69776   11341   199012    17.5 |  0.000 % |
46.22	c |     17110 |   80709  2184600 |   76754   17107   311346    18.2 |  0.000 % |
52.66	c |     25759 |   80710  2184600 |   84430   25755   469233    18.2 |  0.000 % |
61.73	c |     38733 |   80711  2184600 |   92873   38728   742390    19.2 |  0.000 % |
79.05	c |     58195 |   80712  2184600 |  102160   58189  1178560    20.3 |  0.000 % |
108.57	c |     87387 |   80715  2184600 |  112376   87378  1743932    20.0 |  0.000 % |
156.55	c |    131176 |   80723  2184600 |  123613   33139   804498    24.3 |  0.000 % |
238.83	c |    196860 |   80735  2184600 |  135975   98811  2509272    25.4 |  0.000 % |
369.61	c |    295386 |   80742  2184600 |  149572   78389  2296127    29.3 |  0.000 % |
589.49	c |    443175 |   80752  2184600 |  164530   95652  3089672    32.3 |  0.000 % |
956.84	c |    664860 |   80773  2184600 |  180983   24526   577720    23.6 |  0.000 % |
1504.74	c |    997385 |   80794  2184600 |  199081   39559  1018383    25.7 |  0.000 % |
1800.67	
1800.67	s UNKNOWN
1800.67	c # INTERRUPTED
1800.67	c # MAIN  END :  (1801 seconds) [Mon Jan 29 19:04:52 2007]
1800.67	c # MAIN  CPU : 35.03 = 0.06 + 0 + 34.48 + 0.49
1800.67

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: UNKNOWN

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node16/watcher-195129-1170092089 -o ROOT/results/node16/solver-195129-1170092089 -C 1800 -M 900 /tmp/evaluation/195129-1170092089/solver /tmp/evaluation/195129-1170092089 /tmp/evaluation/195129-1170092089/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.85 1.97 1.72 5/82 23819
/proc/meminfo: memFree=1716352/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=5352 CPUtime=0
/proc/23818/stat : 23818 (solver) R 23814 23818 23583 0 -1 4194304 264 0 0 0 0 0 0 0 18 0 1 0 29163438 5480448 231 18446744073709551615 4194304 4889804 548682069296 18446744073709551615 231962373415 0 0 4096 0 0 0 0 17 1 0 0
/proc/23818/statm: 1338 231 193 169 0 49 0

[startup+0.103167 s]
/proc/loadavg: 1.85 1.97 1.72 5/82 23819
/proc/meminfo: memFree=1716352/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=13724 CPUtime=0.04
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 1112 0 0 0 3 1 0 0 18 0 1 0 29163438 14053376 805 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23818/statm: 3431 805 368 3 0 531 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 13724

[startup+0.511121 s]
/proc/loadavg: 1.85 1.97 1.72 5/82 23819
/proc/meminfo: memFree=1716352/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=13724 CPUtime=0.04
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 1121 0 0 0 3 1 0 0 15 0 1 0 29163438 14053376 805 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23818/statm: 3431 805 368 3 0 531 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 13724

[startup+1.33203 s]
/proc/loadavg: 1.85 1.97 1.72 2/90 23857
/proc/meminfo: memFree=1705528/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=13724 CPUtime=0.04
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 1188 0 0 0 3 1 0 0 15 0 1 0 29163438 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23818/statm: 3431 808 370 3 0 531 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23850] ppid=23818 vsize=807064 CPUtime=0.38
/proc/23850/stat : 23850 (java) S 23818 23818 23583 0 -1 0 6764 0 1 0 35 3 0 0 17 0 8 0 29163530 826433536 6514 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 0 0 0
/proc/23850/statm: 201766 6515 1494 14 0 189044 0
[pid=23850/tid=23851] ppid=23818 vsize=807064 CPUtime=0.03
/proc/23850/task/23851/stat : 23851 (java) R 23818 23818 23583 0 -1 64 715 0 0 0 3 0 0 0 16 0 8 0 29163533 826433536 6516 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4153822953 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23852] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23852/stat : 23852 (java) S 23818 23818 23583 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 29163534 826433536 6516 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23853] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23853/stat : 23853 (java) S 23818 23818 23583 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 29163534 826433536 6517 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23854] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23854/stat : 23854 (java) S 23818 23818 23583 0 -1 64 0 0 0 0 0 0 0 0 21 0 8 0 29163537 826433536 6518 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23855] ppid=23818 vsize=807064 CPUtime=0.05
/proc/23850/task/23855/stat : 23855 (java) S 23818 23818 23583 0 -1 64 292 0 0 0 5 0 0 0 16 0 8 0 29163537 826433536 6519 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23856] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23856/stat : 23856 (java) S 23818 23818 23583 0 -1 64 3 0 0 0 0 0 0 0 22 0 8 0 29163537 826433536 6519 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23857] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23857/stat : 23857 (java) S 23818 23818 23583 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 29163537 826433536 6520 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 820788

[startup+2.97986 s]
/proc/loadavg: 1.78 1.96 1.71 2/96 23871
/proc/meminfo: memFree=1670272/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=13724 CPUtime=0.04
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 1188 0 0 0 3 1 0 0 15 0 1 0 29163438 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23818/statm: 3431 808 370 3 0 531 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23850] ppid=23818 vsize=807064 CPUtime=2.03
/proc/23850/stat : 23850 (java) R 23818 23818 23583 0 -1 0 13762 0 1 0 196 7 0 0 20 0 8 0 29163530 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073482727 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/23850/statm: 201766 13496 1494 14 0 189044 0
[pid=23850/tid=23851] ppid=23818 vsize=807064 CPUtime=0.54
/proc/23850/task/23851/stat : 23851 (java) S 23818 23818 23583 0 -1 64 7695 0 0 0 50 4 0 0 16 0 8 0 29163533 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23852] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23852/stat : 23852 (java) S 23818 23818 23583 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 29163534 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23853] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23853/stat : 23853 (java) S 23818 23818 23583 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 29163534 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23854] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23854/stat : 23854 (java) S 23818 23818 23583 0 -1 64 0 0 0 0 0 0 0 0 21 0 8 0 29163537 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23855] ppid=23818 vsize=807064 CPUtime=0.05
/proc/23850/task/23855/stat : 23855 (java) S 23818 23818 23583 0 -1 64 292 0 0 0 5 0 0 0 16 0 8 0 29163537 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23856] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23856/stat : 23856 (java) S 23818 23818 23583 0 -1 64 3 0 0 0 0 0 0 0 22 0 8 0 29163537 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23857] ppid=23818 vsize=807064 CPUtime=0
/proc/23850/task/23857/stat : 23857 (java) S 23818 23818 23583 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 29163537 826433536 13496 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 820788

[startup+6.2765 s]
/proc/loadavg: 1.78 1.96 1.71 4/103 23878
/proc/meminfo: memFree=1523080/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=13724 CPUtime=0.04
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 1188 0 0 0 3 1 0 0 15 0 1 0 29163438 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23818/statm: 3431 808 370 3 0 531 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23850] ppid=23818 vsize=807328 CPUtime=5.32
/proc/23850/stat : 23850 (java) R 23818 23818 23583 0 -1 0 34557 0 1 0 514 18 0 0 25 0 8 0 29163530 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/23850/statm: 201832 34203 1506 14 0 189110 0
[pid=23850/tid=23851] ppid=23818 vsize=807328 CPUtime=1.54
/proc/23850/task/23851/stat : 23851 (java) R 23818 23818 23583 0 -1 64 28250 0 0 0 141 13 0 0 15 0 8 0 29163533 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4153827301 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23852] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23852/stat : 23852 (java) S 23818 23818 23583 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 29163534 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23853] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23853/stat : 23853 (java) S 23818 23818 23583 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 29163534 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23854] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23854/stat : 23854 (java) S 23818 23818 23583 0 -1 64 0 0 0 0 0 0 0 0 21 0 8 0 29163537 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23855] ppid=23818 vsize=807328 CPUtime=0.12
/proc/23850/task/23855/stat : 23855 (java) S 23818 23818 23583 0 -1 64 401 0 0 0 12 0 0 0 16 0 8 0 29163537 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23856] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23856/stat : 23856 (java) S 23818 23818 23583 0 -1 64 3 0 0 0 0 0 0 0 22 0 8 0 29163537 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23857] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23857/stat : 23857 (java) S 23818 23818 23583 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 29163537 826703872 34203 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 6.11
Current children cumulated vsize (KiB) 821052

[startup+12.7318 s]
/proc/loadavg: 1.89 1.97 1.72 3/103 23878
/proc/meminfo: memFree=1284680/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=13724 CPUtime=0.04
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 1188 0 0 0 3 1 0 0 15 0 1 0 29163438 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23818/statm: 3431 808 370 3 0 531 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23850] ppid=23818 vsize=807328 CPUtime=11.78
/proc/23850/stat : 23850 (java) R 23818 23818 23583 0 -1 0 54971 0 1 0 1147 31 0 0 25 0 8 0 29163530 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4073673576 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/23850/statm: 201832 54113 1507 14 0 189110 0
[pid=23850/tid=23851] ppid=23818 vsize=807328 CPUtime=3.65
/proc/23850/task/23851/stat : 23851 (java) S 23818 23818 23583 0 -1 64 48491 0 0 0 340 25 0 0 16 0 8 0 29163533 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23852] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23852/stat : 23852 (java) S 23818 23818 23583 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 29163534 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23853] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23853/stat : 23853 (java) S 23818 23818 23583 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 29163534 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23854] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23854/stat : 23854 (java) S 23818 23818 23583 0 -1 64 0 0 0 0 0 0 0 0 21 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23855] ppid=23818 vsize=807328 CPUtime=0.13
/proc/23850/task/23855/stat : 23855 (java) S 23818 23818 23583 0 -1 64 403 0 0 0 13 0 0 0 16 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23856] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23856/stat : 23856 (java) S 23818 23818 23583 0 -1 64 3 0 0 0 0 0 0 0 22 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23857] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23857/stat : 23857 (java) S 23818 23818 23583 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 821052

[startup+25.6294 s]
/proc/loadavg: 1.91 1.97 1.72 5/103 23880
/proc/meminfo: memFree=1284680/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=13724 CPUtime=0.04
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 1188 0 0 0 3 1 0 0 15 0 1 0 29163438 14053376 808 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 0 0 0
/proc/23818/statm: 3431 808 370 3 0 531 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23850] ppid=23818 vsize=807328 CPUtime=24.68
/proc/23850/stat : 23850 (java) R 23818 23818 23583 0 -1 0 56277 0 1 0 2431 37 0 0 25 0 8 0 29163530 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/23850/statm: 201832 54113 1507 14 0 189110 0
[pid=23850/tid=23851] ppid=23818 vsize=807328 CPUtime=8.48
/proc/23850/task/23851/stat : 23851 (java) R 23818 23818 23583 0 -1 64 49459 0 0 0 819 29 0 0 15 0 8 0 29163533 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4153822964 0 0 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23852] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23852/stat : 23852 (java) S 23818 23818 23583 0 -1 64 11 0 0 0 0 0 0 0 15 0 8 0 29163534 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23853] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23853/stat : 23853 (java) S 23818 23818 23583 0 -1 64 5 0 0 0 0 0 0 0 15 0 8 0 29163534 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23854] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23854/stat : 23854 (java) S 23818 23818 23583 0 -1 64 0 0 0 0 0 0 0 0 21 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23855] ppid=23818 vsize=807328 CPUtime=0.13
/proc/23850/task/23855/stat : 23855 (java) S 23818 23818 23583 0 -1 64 403 0 0 0 13 0 0 0 16 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=23850/tid=23856] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23856/stat : 23856 (java) S 23818 23818 23583 0 -1 64 3 0 0 0 0 0 0 0 22 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
[pid=23850/tid=23857] ppid=23818 vsize=807328 CPUtime=0
/proc/23850/task/23857/stat : 23857 (java) S 23818 23818 23583 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 29163537 826703872 54113 18446744073709551615 134512640 134570532 4294956464 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 821052

[startup+51.3116 s]
/proc/loadavg: 2.12 2.02 1.74 3/89 23882
/proc/meminfo: memFree=1655992/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=15528 CPUtime=15.17
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 4550 0 0 0 1514 3 0 0 25 0 1 0 29167051 15900672 3511 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 3882 3511 52 112 0 3766 0
Current children cumulated CPU time (s) 50.99
Current children cumulated vsize (KiB) 33036

[startup+102.559 s]
/proc/loadavg: 2.05 2.02 1.76 3/89 23882
/proc/meminfo: memFree=1640248/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0

################
# More data... #
################

/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 11811 0 0 0 120771 20 0 0 25 0 1 0 29167051 46223360 10763 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528392 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11285 10763 52 112 0 11169 0
Current children cumulated CPU time (s) 1243.73
Current children cumulated vsize (KiB) 62648

[startup+1304.22 s]
/proc/loadavg: 2.00 2.00 1.91 3/89 23882
/proc/meminfo: memFree=1589432/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=45140 CPUtime=1267.99
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 11834 0 0 0 126779 20 0 0 25 0 1 0 29167051 46223360 10786 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528426 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11285 10786 52 112 0 11169 0
Current children cumulated CPU time (s) 1303.81
Current children cumulated vsize (KiB) 62648

[startup+1364.31 s]
/proc/loadavg: 2.00 2.00 1.91 3/89 23882
/proc/meminfo: memFree=1589304/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=45324 CPUtime=1328.08
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 11849 0 0 0 132787 21 0 0 25 0 1 0 29167051 46411776 10801 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11331 10801 52 112 0 11215 0
Current children cumulated CPU time (s) 1363.9
Current children cumulated vsize (KiB) 62832

[startup+1424.39 s]
/proc/loadavg: 2.00 2.00 1.91 3/89 23882
/proc/meminfo: memFree=1588920/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=45324 CPUtime=1388.16
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 11875 0 0 0 138794 22 0 0 25 0 1 0 29167051 46411776 10827 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11331 10827 52 112 0 11215 0
Current children cumulated CPU time (s) 1423.98
Current children cumulated vsize (KiB) 62832

[startup+1484.48 s]
/proc/loadavg: 2.00 2.00 1.91 3/89 23882
/proc/meminfo: memFree=1588344/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=45720 CPUtime=1448.24
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 11976 0 0 0 144802 22 0 0 25 0 1 0 29167051 46817280 10928 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11430 10928 52 112 0 11314 0
Current children cumulated CPU time (s) 1484.06
Current children cumulated vsize (KiB) 63228

[startup+1544.57 s]
/proc/loadavg: 2.00 2.00 1.91 3/89 23882
/proc/meminfo: memFree=1588280/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=45868 CPUtime=1508.32
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 11996 0 0 0 150810 22 0 0 25 0 1 0 29167051 46968832 10948 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11467 10948 52 112 0 11351 0
Current children cumulated CPU time (s) 1544.14
Current children cumulated vsize (KiB) 63376

[startup+1604.67 s]
/proc/loadavg: 2.00 2.00 1.91 3/95 23986
/proc/meminfo: memFree=1586552/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=46040 CPUtime=1568.31
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 12031 0 0 0 156808 23 0 0 25 0 1 0 29167051 47144960 10983 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11510 10983 52 112 0 11394 0
Current children cumulated CPU time (s) 1604.13
Current children cumulated vsize (KiB) 63548

[startup+1664.68 s]
/proc/loadavg: 2.05 2.01 1.91 3/89 24080
/proc/meminfo: memFree=1587312/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=46040 CPUtime=1628.21
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 12053 0 0 0 162798 23 0 0 25 0 1 0 29167051 47144960 11005 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134527084 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 11510 11005 52 112 0 11394 0
Current children cumulated CPU time (s) 1664.03
Current children cumulated vsize (KiB) 63548

[startup+1724.76 s]
/proc/loadavg: 2.02 2.01 1.91 3/89 24080
/proc/meminfo: memFree=1585144/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=48472 CPUtime=1688.29
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 12636 0 0 0 168805 24 0 0 25 0 1 0 29167051 49635328 11588 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 12118 11588 52 112 0 12002 0
Current children cumulated CPU time (s) 1724.11
Current children cumulated vsize (KiB) 65980

[startup+1784.85 s]
/proc/loadavg: 2.00 2.00 1.91 3/89 24080
/proc/meminfo: memFree=1581176/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=52284 CPUtime=1748.37
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 13602 0 0 0 174811 26 0 0 25 0 1 0 29167051 53538816 12554 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528340 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 13071 12554 52 112 0 12955 0
Current children cumulated CPU time (s) 1784.19
Current children cumulated vsize (KiB) 69792



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.67 s]
/proc/loadavg: 2.00 2.00 1.91 3/89 24080
/proc/meminfo: memFree=1580536/2055920 swapFree=4192956/4192956
[pid=23818] ppid=23814 vsize=17508 CPUtime=35.07
/proc/23818/stat : 23818 (sugar) S 23814 23818 23583 0 -1 4194304 2215 61865 0 1 9 1 3448 49 16 0 1 0 29163438 17928192 1726 18446744073709551615 4194304 4206940 548682069216 18446744073709551615 231971270754 0 0 4224 16386 18446744071563648864 0 0 17 1 0 0
/proc/23818/statm: 4377 1726 373 3 0 1477 0
[pid=23841] ppid=23818 vsize=0 CPUtime=0.75
/proc/23841/stat : 23841 (java) Z 23818 23818 23583 0 -1 1036 7922 0 1 0 70 5 0 0 16 0 1 0 29163444 0 0 18446744073709551615 0 0 0 0 0 0 4 0 23759 18446744071563351923 0 0 17 1 0 0
/proc/23841/statm: 0 0 0 0 0 0 0
[pid=23882] ppid=23818 vsize=52936 CPUtime=1764.19
/proc/23882/stat : 23882 (minisat) R 23818 23818 23583 0 -1 0 13754 0 0 0 176393 26 0 0 25 0 1 0 29167051 54206464 12706 18446744073709551615 134512640 134974460 4294956752 18446744073709551615 134528363 0 0 4096 3 0 0 0 17 1 0 0
/proc/23882/statm: 13234 12706 52 112 0 13118 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 70444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child status: 1

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 23818 and gives childrusage.ru_utime.tv_sec=34 childrusage.ru_utime.tv_usec=581742 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=517921
CPU time returned by wait4() is 35.0997
while last known CPU time is 1800.02

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1801.69
CPU time (s): 1800.02
CPU user time (s): 1799.2
CPU system time (s): 0.82
CPU usage (%): 99.9073
Max. virtual memory (cumulated for all children) (KiB): 822056

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 34.5817
system time used= 0.517921
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 64165
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7353
involuntary context switches= 7184

runsolver used 2.51562 s user time and 5.48217 s system time

The end

Launcher Data (download as text)

Begin job on node16 on Mon Jan 29 17:34:50 UTC 2007


IDJOB= 195129
IDBENCH= 3250
IDSOLVER= 86
FILE ID= node16/195129-1170092089

PBS_JOBID= 3689403

Free space on /tmp= 66552 MiB

SOLVER NAME= sugar 0.40
BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-50-23/rand-2-50-23-587-230-21_ext.xml
COMMAND LINE= /tmp/evaluation/195129-1170092089/solver /tmp/evaluation/195129-1170092089 /tmp/evaluation/195129-1170092089/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node16/watcher-195129-1170092089 -o ROOT/results/node16/solver-195129-1170092089 -C 1800 -M 900  /tmp/evaluation/195129-1170092089/solver /tmp/evaluation/195129-1170092089 /tmp/evaluation/195129-1170092089/unknown.xml

META MD5SUM SOLVER= 0a27e717dfe98d83d9802fe0eea45073
MD5SUM BENCH=  ec3a38c5bcff9670d4ef63107bc6cb5e

RANDOM SEED= 40928090

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1717872 kB
Buffers:         47008 kB
Cached:         166036 kB
SwapCached:          0 kB
Active:         187600 kB
Inactive:        84348 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1717872 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:            1272 kB
Writeback:           0 kB
Mapped:          77736 kB
Slab:            51448 kB
Committed_AS:   217644 kB
PageTables:       1932 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66541 MiB



End job on node16 on Mon Jan 29 18:04:53 UTC 2007