Trace number 306588

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SATzilla FULL? (exit code) 1199.74 1200.2

General information on the benchmark

Namerandom/LargeSize/3SAT/v7000/
unif-k3-r4.2-v7000-c29400-S2118640909-06.cnf
MD5SUMf797b412c0282263cc1dca0746fdda90
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark54.6397
Satisfiable
(Un)Satisfiability was proved
Number of variables7000
Number of clauses29400
Sum of the clauses size88200
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 329400
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

10.73/10.77	c run March_dl for 5 seconds ... 
10.73/10.77	c Bin: Executing march_dl
10.73/10.77	c child exit by a signal
10.73/10.77	c march_dl returned code 137.
10.73/10.77	c run saps for 2 seconds ... 
10.73/10.77	c Bin: Executing ubcsat2006
10.73/10.77	c child exited successfully
10.73/10.77	c ubcsat2006 returned code 0.
10.73/10.77	c satzilla computing base features
10.73/10.77	c satzilla doing unit-prop probe
10.73/10.77	c satzilla doing local search probe
10.73/10.77	c satzilla doing lobjois search-space size estimate
10.73/10.77	c satzilla's ranking:
10.73/10.77	c 1) march_dl: 4.965846
10.73/10.77	c 2) kcnfs: 5.105445
10.73/10.77	c 3) eureka: 5.286876
10.73/10.77	c 4) zchaff_rand: 5.399374
10.73/10.77	c 5) vallst: 5.855718
10.73/10.77	c 6) minisat20: 6.939570
10.73/10.77	c 7) kcnfs+P: 999.000000
10.73/10.77	c 8) march_dl+P: 999.000000
10.73/10.77	c 9) vallst+P: 999.000000
10.73/10.77	c 10) zchaff_rand+P: 999.000000
10.73/10.77	c 11) rsat+P: 999.000000
10.73/10.77	c 12) eureka+P: 999.000000
10.73/10.77	c 13) minisat20+P: 999.000000
10.73/10.77	c 14) rsat: 999.000000
10.73/10.77	c satzilla running march_dl ... 
1199.45/1200.04	c Bin: Executing march_dl
1199.45/1200.04	c child exit by a signal
1199.45/1200.04	c march_dl returned code 137.
1199.45/1200.04	c march_dl returned code 137.
1199.45/1200.04	c satzilla running kcnfs ... 
1199.45/1200.04	c Bin: Executing kcnfs
1199.45/1200.04	c kcnfs returned code 1.
1199.45/1200.04	c kcnfs returned code 1.
1199.45/1200.04	c satzilla running eureka ... 
1199.45/1200.04	c Bin: Executing eureka
1199.45/1200.04	c eureka returned code 1.
1199.45/1200.04	c eureka returned code 1.
1199.45/1200.04	c satzilla running zchaff_rand ... 
1199.45/1200.04	c Bin: Executing zchaff_rand
1199.45/1200.04	c zchaff_rand returned code 1.
1199.45/1200.04	c zchaff_rand returned code 1.
1199.45/1200.04	c satzilla running vallst ... 
1199.45/1200.04	c Bin: Executing vallst
1199.45/1200.04	c vallst returned code 1.
1199.45/1200.04	c vallst returned code 1.
1199.45/1200.04	c satzilla running minisat20 ... 
1199.45/1200.04	c Bin: Executing minisat20
1199.45/1200.04	c minisat20 returned code 1.
1199.45/1200.04	c minisat20 returned code 1.
1199.45/1200.04	c satzilla running kcnfs with preprocessing ... 
1199.67/1200.19	c Preprocessing...
1199.67/1200.19	c Inital problem has 7000 variables, 29400 nary clauses (0 binary clauses).
1199.67/1200.19	c Num non-binary clauses 29400, Average non-binary clause length 3.000
1199.67/1200.19	c Theory has no gaps
1199.67/1200.19	c Preprocessor runtime was 0.110 seconds.
1199.67/1200.19	c 
1199.67/1200.19	c Satisfiability of theory still undetermined.
1199.67/1200.19	c See file /tmp/m3h6yM for simplified theory.
1199.67/1200.19	c Bin: Executing kcnfs
1199.67/1200.19	c kcnfs returned code 1.
1199.67/1200.19	c kcnfs returned code 1.
1199.67/1200.19	c satzilla running march_dl with preprocessing ... 
1199.67/1200.19	c Bin: Executing march_dl
1199.67/1200.19	c march_dl returned code 1.
1199.67/1200.19	c march_dl returned code 1.
1199.67/1200.19	c satzilla running vallst with preprocessing ... 
1199.67/1200.19	c Bin: Executing vallst
1199.67/1200.19	c vallst returned code 1.
1199.67/1200.19	c vallst returned code 1.
1199.67/1200.19	c satzilla running zchaff_rand with preprocessing ... 
1199.67/1200.19	c Bin: Executing zchaff_rand
1199.67/1200.19	c zchaff_rand returned code 1.
1199.67/1200.19	c zchaff_rand returned code 1.
1199.67/1200.19	c satzilla running rsat with preprocessing ... 
1199.67/1200.19	c Bin: Executing rsat
1199.67/1200.19	c rsat returned code 1.
1199.67/1200.19	c rsat returned code 1.
1199.67/1200.19	c satzilla running eureka with preprocessing ... 
1199.67/1200.19	c Bin: Executing eureka
1199.67/1200.19	c eureka returned code 1.
1199.67/1200.19	c eureka returned code 1.
1199.67/1200.19	c satzilla running minisat20 with preprocessing ... 
1199.67/1200.19	c Bin: Executing minisat20
1199.67/1200.19	c minisat20 returned code 1.
1199.67/1200.19	c minisat20 returned code 1.
1199.67/1200.19	c satzilla running rsat ... 
1199.67/1200.19	c Bin: Executing rsat
1199.67/1200.19	c rsat returned code 1.
1199.67/1200.19	c rsat returned code 1.
1199.67/1200.19	c ERROR: All Failed! 
1199.67/1200.19	c SATZILLA_TIME=1199.900000

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.2.0 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node67/watcher-306588-1172102138 -o ROOT/results/node67/solver-306588-1172102138 -C 1200 -M 1800 --output-limit 1,15 /tmp/evaluation/306588-1172102138/SATzilla2007_F /tmp/evaluation/306588-1172102138/instance-306588-1172102138.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 18733
/proc/meminfo: memFree=1565760/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=1512 CPUtime=0
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 143 0 0 0 0 0 0 0 18 0 1 0 230171440 1548288 125 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 378 125 110 260 0 84 0
[pid=18734] ppid=18733 vsize=1212 CPUtime=0
/proc/18734/stat : 18734 (march_dl) R 18733 18733 17972 0 -1 4194304 204 0 0 0 0 0 0 0 19 0 1 0 230171440 1241088 198 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134669245 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18734/statm: 303 198 50 118 0 182 0

[startup+0.106672 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 18733
/proc/meminfo: memFree=1565760/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=1512 CPUtime=0
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 143 0 0 0 0 0 0 0 18 0 1 0 230171440 1548288 125 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 378 125 110 260 0 84 0
[pid=18734] ppid=18733 vsize=2876 CPUtime=0.09
/proc/18734/stat : 18734 (march_dl) R 18733 18733 17972 0 -1 4194304 1217 0 0 0 9 0 0 0 20 0 1 0 230171440 2945024 545 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134652143 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18734/statm: 719 545 55 118 0 598 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4388

[startup+0.514713 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 18733
/proc/meminfo: memFree=1565760/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=1512 CPUtime=0
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 143 0 0 0 0 0 0 0 18 0 1 0 230171440 1548288 125 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 378 125 110 260 0 84 0
[pid=18734] ppid=18733 vsize=8804 CPUtime=0.5
/proc/18734/stat : 18734 (march_dl) R 18733 18733 17972 0 -1 4194304 5016 0 0 0 49 1 0 0 23 0 1 0 230171440 9015296 2010 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134587702 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18734/statm: 2201 2010 74 118 0 2080 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 10316

[startup+1.3348 s]
/proc/loadavg: 0.92 0.98 0.99 2/66 18735
/proc/meminfo: memFree=1557672/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=1512 CPUtime=0
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 143 0 0 0 0 0 0 0 18 0 1 0 230171440 1548288 125 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 378 125 110 260 0 84 0
[pid=18734] ppid=18733 vsize=8816 CPUtime=1.32
/proc/18734/stat : 18734 (march_dl) R 18733 18733 17972 0 -1 4194304 5019 0 0 0 131 1 0 0 25 0 1 0 230171440 9027584 2013 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134551325 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18734/statm: 2205 2014 74 118 0 2084 0
Current children cumulated CPU time (s) 1.32
Current children cumulated vsize (KiB) 10328

[startup+2.97097 s]
/proc/loadavg: 0.92 0.98 0.99 2/66 18735
/proc/meminfo: memFree=1557544/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=1512 CPUtime=0
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 143 0 0 0 0 0 0 0 18 0 1 0 230171440 1548288 125 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 378 125 110 260 0 84 0
[pid=18734] ppid=18733 vsize=9088 CPUtime=2.95
/proc/18734/stat : 18734 (march_dl) R 18733 18733 17972 0 -1 4194304 5090 0 0 0 294 1 0 0 25 0 1 0 230171440 9306112 2084 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134514060 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18734/statm: 2272 2084 74 118 0 2151 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 10600

[startup+6.24831 s]
/proc/loadavg: 0.93 0.98 0.99 2/66 18736
/proc/meminfo: memFree=1563176/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=1512 CPUtime=4.99
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 149 5132 0 0 0 0 498 1 16 0 1 0 230171440 1548288 125 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/18733/statm: 378 125 110 260 0 84 0
[pid=18736] ppid=18733 vsize=6188 CPUtime=1.23
/proc/18736/stat : 18736 (ubcsat2006) R 18733 18733 17972 0 -1 4194304 708 0 0 0 116 7 0 0 25 0 1 0 230171941 6336512 690 18446744073709551615 134512640 134777720 4294956576 18446744073709551615 4294960144 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18736/statm: 1547 690 156 64 0 1128 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 7700

[startup+12.707 s]
/proc/loadavg: 0.93 0.98 0.99 2/66 18737
/proc/meminfo: memFree=1555176/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=8960 CPUtime=1.92
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5053 0 0 0 191 1 0 0 25 0 1 0 230172517 9175040 2047 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526923 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2240 2047 74 118 0 2119 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 12564

[startup+25.5213 s]
/proc/loadavg: 0.95 0.98 0.99 2/66 18737
/proc/meminfo: memFree=1554672/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=9604 CPUtime=14.73
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5217 0 0 0 1472 1 0 0 25 0 1 0 230172517 9834496 2211 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526923 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2401 2211 74 118 0 2280 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 13208

[startup+51.144 s]
/proc/loadavg: 0.96 0.98 0.99 2/66 18737
/proc/meminfo: memFree=1554352/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=9988 CPUtime=40.34
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5301 0 0 0 4033 1 0 0 25 0 1 0 230172517 10227712 2295 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526942 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2497 2295 74 118 0 2376 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 13592

[startup+102.386 s]
/proc/loadavg: 0.98 0.98 0.99 2/66 18737
/proc/meminfo: memFree=1554032/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=10376 CPUtime=91.57
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5387 0 0 0 9155 2 0 0 25 0 1 0 230172517 10625024 2381 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134528326 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2594 2381 74 118 0 2473 0
Current children cumulated CPU time (s) 102.31
Current children cumulated vsize (KiB) 13980

[startup+162.446 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18737
/proc/meminfo: memFree=1553840/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=10500 CPUtime=151.61
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5438 0 0 0 15159 2 0 0 25 0 1 0 230172517 10752000 2432 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134527856 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2625 2432 74 118 0 2504 0
Current children cumulated CPU time (s) 162.35
Current children cumulated vsize (KiB) 14104

[startup+222.502 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18737
/proc/meminfo: memFree=1553648/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=10624 CPUtime=211.65
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5472 0 0 0 21163 2 0 0 25 0 1 0 230172517 10878976 2466 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526954 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2656 2466 74 118 0 2535 0
Current children cumulated CPU time (s) 222.39
Current children cumulated vsize (KiB) 14228

[startup+282.559 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18737
/proc/meminfo: memFree=1553520/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=10752 CPUtime=271.69
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5497 0 0 0 27167 2 0 0 25 0 1 0 230172517 11010048 2491 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134514060 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2688 2491 74 118 0 2567 0
Current children cumulated CPU time (s) 282.43
Current children cumulated vsize (KiB) 14356

[startup+342.624 s]
/proc/loadavg: 0.99 0.98 0.99 2/72 18821
/proc/meminfo: memFree=1552120/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=10880 CPUtime=331.7
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5520 0 0 0 33167 3 0 0 25 0 1 0 230172517 11141120 2514 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526923 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2720 2514 74 118 0 2599 0
Current children cumulated CPU time (s) 342.44
Current children cumulated vsize (KiB) 14484

[startup+402.713 s]
/proc/loadavg: 0.99 0.98 0.99 2/72 18911
/proc/meminfo: memFree=1551920/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11004 CPUtime=391.71
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5542 0 0 0 39168 3 0 0 25 0 1 0 230172517 11268096 2536 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134551294 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2751 2536 74 118 0 2630 0
Current children cumulated CPU time (s) 402.45
Current children cumulated vsize (KiB) 14608

[startup+462.771 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18935
/proc/meminfo: memFree=1553008/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11004 CPUtime=451.75
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5561 0 0 0 45172 3 0 0 25 0 1 0 230172517 11268096 2555 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134514060 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2751 2555 74 118 0 2630 0
Current children cumulated CPU time (s) 462.49

################
# More data... #
################

/proc/18737/statm: 2814 2615 74 118 0 2693 0
Current children cumulated CPU time (s) 702.64
Current children cumulated vsize (KiB) 14860

[startup+763.051 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18935
/proc/meminfo: memFree=1553072/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11256 CPUtime=751.94
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5630 0 0 0 75190 4 0 0 25 0 1 0 230172517 11526144 2624 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134527835 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2814 2624 74 118 0 2693 0
Current children cumulated CPU time (s) 762.68
Current children cumulated vsize (KiB) 14860

[startup+823.115 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18935
/proc/meminfo: memFree=1553136/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11380 CPUtime=811.99
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5640 0 0 0 81194 5 0 0 25 0 1 0 230172517 11653120 2634 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134514212 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2845 2634 74 118 0 2724 0
Current children cumulated CPU time (s) 822.73
Current children cumulated vsize (KiB) 14984

[startup+883.166 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18935
/proc/meminfo: memFree=1553136/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11380 CPUtime=872.02
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5649 0 0 0 87197 5 0 0 25 0 1 0 230172517 11653120 2643 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526923 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2845 2643 74 118 0 2724 0
Current children cumulated CPU time (s) 882.76
Current children cumulated vsize (KiB) 14984

[startup+943.218 s]
/proc/loadavg: 0.99 0.98 0.99 2/66 18935
/proc/meminfo: memFree=1553008/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11380 CPUtime=932.06
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5658 0 0 0 93201 5 0 0 25 0 1 0 230172517 11653120 2652 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134551557 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2845 2652 74 118 0 2724 0
Current children cumulated CPU time (s) 942.8
Current children cumulated vsize (KiB) 14984

[startup+1003.27 s]
/proc/loadavg: 1.06 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552944/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=992.09
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5668 0 0 0 99204 5 0 0 25 0 1 0 230172517 11780096 2662 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134514049 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2662 74 118 0 2755 0
Current children cumulated CPU time (s) 1002.83
Current children cumulated vsize (KiB) 15108

[startup+1063.33 s]
/proc/loadavg: 1.02 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552880/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1052.14
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5676 0 0 0 105208 6 0 0 25 0 1 0 230172517 11780096 2670 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134553320 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2670 74 118 0 2755 0
Current children cumulated CPU time (s) 1062.88
Current children cumulated vsize (KiB) 15108

[startup+1123.39 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552816/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1112.18
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5684 0 0 0 111212 6 0 0 25 0 1 0 230172517 11780096 2678 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526992 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2678 74 118 0 2755 0
Current children cumulated CPU time (s) 1122.92
Current children cumulated vsize (KiB) 15108

[startup+1183.44 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552816/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1172.22
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5690 0 0 0 117216 6 0 0 25 0 1 0 230172517 11780096 2684 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526942 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2684 74 118 0 2755 0
Current children cumulated CPU time (s) 1182.96
Current children cumulated vsize (KiB) 15108

Solver just ended. Dumping a history of the last processes samples

[startup+1193.79 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552752/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1182.56
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5692 0 0 0 118250 6 0 0 25 0 1 0 230172517 11780096 2686 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134536803 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2686 74 118 0 2755 0
Current children cumulated CPU time (s) 1193.3
Current children cumulated vsize (KiB) 15108

[startup+1197.08 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552752/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1185.85
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5692 0 0 0 118579 6 0 0 25 0 1 0 230172517 11780096 2686 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134514206 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2686 74 118 0 2755 0
Current children cumulated CPU time (s) 1196.59
Current children cumulated vsize (KiB) 15108

[startup+1198.72 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552752/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1187.49
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5692 0 0 0 118743 6 0 0 25 0 1 0 230172517 11780096 2686 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526923 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2686 74 118 0 2755 0
Current children cumulated CPU time (s) 1198.23
Current children cumulated vsize (KiB) 15108

[startup+1199.53 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552752/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1188.31
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5692 0 0 0 118825 6 0 0 25 0 1 0 230172517 11780096 2686 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134514060 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2686 74 118 0 2755 0
Current children cumulated CPU time (s) 1199.05
Current children cumulated vsize (KiB) 15108

[startup+1199.94 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552752/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=3604 CPUtime=10.74
/proc/18733/stat : 18733 (SATzilla2007_F) S 18731 18733 17972 0 -1 4194304 2232 5846 0 0 352 5 702 15 25 0 1 0 230171440 3690496 716 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 135217869 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/18733/statm: 901 716 170 260 0 607 0
[pid=18737] ppid=18733 vsize=11504 CPUtime=1188.71
/proc/18737/stat : 18737 (march_dl) R 18733 18733 17972 0 -1 4194304 5692 0 0 0 118865 6 0 0 25 0 1 0 230172517 11780096 2686 18446744073709551615 134512640 134996440 4294956736 18446744073709551615 134526917 0 0 8392704 0 0 0 0 17 1 0 0
/proc/18737/statm: 2876 2686 74 118 0 2755 0
Current children cumulated CPU time (s) 1199.45
Current children cumulated vsize (KiB) 15108

[startup+1200.15 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 18935
/proc/meminfo: memFree=1552752/2055920 swapFree=4176000/4192956
[pid=18733] ppid=18731 vsize=8264 CPUtime=1199.67
/proc/18733/stat : 18733 (SATzilla2007_F) R 18731 18733 17972 0 -1 4194304 3509 11538 0 0 360 7 119578 22 19 0 1 0 230171440 8462336 1805 18446744073709551615 134512640 135581085 4294956704 18446744073709551615 134592206 0 0 4096 0 0 0 0 17 0 0 0
/proc/18733/statm: 2066 1805 177 260 0 1772 0
Current children cumulated CPU time (s) 1199.67
Current children cumulated vsize (KiB) 8264

Child status: 17
Real time (s): 1200.2
CPU time (s): 1199.74
CPU user time (s): 1199.43
CPU system time (s): 0.300954
CPU usage (%): 99.9614
Max. virtual memory (cumulated for all children) (KiB): 15108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1199.43
system time used= 0.300954
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15070
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 26
involuntary context switches= 2949

runsolver used 0.791879 second user time and 2.53261 second system time

The end

Launcher Data (download as text)

Begin job on node67 on Wed Feb 21 23:55:38 UTC 2007

IDJOB= 306588
IDBENCH= 20184
IDSOLVER= 136
FILE ID= node67/306588-1172102138

PBS_JOBID= 3892867

Free space on /tmp= 66550 MiB

SOLVER NAME= SATzilla FULL
BENCH NAME= HOME/pub/bench/SAT07/random/LargeSize/3SAT/v7000/unif-k3-r4.2-v7000-c29400-S2118640909-06.cnf
COMMAND LINE= /tmp/evaluation/306588-1172102138/SATzilla2007_F /tmp/evaluation/306588-1172102138/instance-306588-1172102138.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node67/watcher-306588-1172102138 -o ROOT/results/node67/solver-306588-1172102138 -C 1200 -M 1800 --output-limit 1,15  /tmp/evaluation/306588-1172102138/SATzilla2007_F /tmp/evaluation/306588-1172102138/instance-306588-1172102138.cnf            

META MD5SUM SOLVER= cf97f3a2fd0b75b608f79c1ce3d2be4a
MD5SUM BENCH=  f797b412c0282263cc1dca0746fdda90

RANDOM SEED= 687563560

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node67.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1566232 kB
Buffers:         39988 kB
Cached:         386384 kB
SwapCached:      11616 kB
Active:         323572 kB
Inactive:       121164 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1566232 kB
SwapTotal:     4192956 kB
SwapFree:      4176000 kB
Dirty:           10632 kB
Writeback:           0 kB
Mapped:          15548 kB
Slab:            30940 kB
Committed_AS:   735488 kB
PageTables:       1452 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66550 MiB

End job on node67 on Thu Feb 22 00:15:38 UTC 2007