Trace number 1825796

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SATzilla2009_C 2009-03-22? (exit code) 4998.72 5000.97

General information on the benchmark

NameCRAFTED/sgen/sat/
sgen1-sat-200-100.cnf
MD5SUM3eff3d0cb86e42a8fbb844259e0c7beb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark57.7442
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses480
Sum of the clauses size1200
Maximum clause length5
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2400
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 580
Number of clauses of size over 50

Solver Data

16.37/16.44	c SATzilla is building models for class 2
16.37/16.44	c run presolver march_dl2004 for 5 seconds ... 
16.37/16.44	c Bin: Executing march_dl2004
16.37/16.44	c spawning binary file with 5 seconds ...
16.37/16.44	c child exit by a signal
16.37/16.44	c march_dl2004 returned code 137.
16.37/16.44	c run presolver mxc-sr08 for 5 seconds ... 
16.37/16.44	c Bin: Executing mxc-sr08
16.37/16.44	c spawning binary file with 5 seconds ...
16.37/16.44	c child exit by a signal
16.37/16.44	c mxc-sr08 returned code 137.
16.37/16.44	c Orignal number of varibales is 200, number of clauses is 480 
16.37/16.44	c predicted feature computation time is 6.893587 
16.37/16.44	c Bin: Executing satelite
16.37/16.44	c spawning binary file with 240 seconds ...
16.37/16.44	c child exited successfully
16.37/16.44	c satzilla computing base features
16.37/16.44	c Number of variabe is: 200, Number of clause is : 480 
16.37/16.44	c Initializing...
16.37/16.44	c satzilla compute diameter ...
16.37/16.44	c start diameter features ...
16.37/16.44	c satzilla doing clause learning
16.37/16.44	c start clause learning features ...
16.37/16.44	c Bin: Executing zchaff07
16.37/16.44	c spawning binary file with 2 seconds ...
16.37/16.44	c child exit by a signal
16.37/16.44	c satzilla doing survey propogation probe
16.37/16.44	c do survay propogation for 2 second ...
16.37/16.44	c satzilla doing local search probe
16.37/16.44	c satzilla doing lobjois search-space size estimate
16.37/16.44	c features are:200 480 200 480 0 0 0.416667 1 0 -0 0.0125 0.447214 0.01 0.025 0.450561 0.833333 0.833333 0.0125 0 0.0125 0.0125 -0 0.333333 0 0.333333 0.333333 -0 0.00833333 0 0.00833333 0.00833333 -0 0.833333 0.0249167 0.0163845 0.0229167 0.025 4.54271 0.109664 4 5 0.689494 4574.5 0.00645805 4534 4610 4610 4534 4610 4560 4594 36.4045 0.0591726 34.088 39.415 39.415 34.088 39.415 34.6626 37.4524 0.583177 9.13326e-05 0.583012 0.583359 0.583242 0.583114 0.583208 0.583149 0.583175 0.229501 9.76326e-05 0.229463 0.229565 0.229534 0.229475 0.229518 0.229483 0.229495 7.03737 0.267461 51.7419 0.123012 52 44 60 1.08091 0.223137 0.930901 0.031355 0.669582 0.8249 
16.37/16.44	c satzilla's ranking:
16.37/16.44	c 1) tts-4-0: 2.679850
16.37/16.44	c 2) march_dl2004: 1.012754
16.37/16.44	c 3) zchaff_rand: 0.573444
16.37/16.44	c 4) vallst: 0.385747
16.37/16.44	c 5) minisat20: -0.214734
16.37/16.44	c 6) minisat20SAT07: -0.598425
16.37/16.44	c 7) mxc-sr08: -1.285740
16.37/16.44	c 8) SATenstein: -10000.000000
16.37/16.44	c 9) gnovelty+: -10000.000000
16.37/16.44	c 10) adaptg2wsat+: -10000.000000
16.37/16.44	c 11) adaptg2wsat0: -10000.000000
16.37/16.44	c 12) picosat846: -10000.000000
16.37/16.44	c 13) kcnfs04SAT07: -10000.000000
16.37/16.44	c satzilla running tts-4-0 ... 
4998.62/5000.97	c Bin: Executing tts-4-0
4998.62/5000.97	c spawning binary file with 4983 seconds ...
4998.62/5000.97	c child exit by a signal
4998.62/5000.97	c tts-4-0 returned code 137.
4998.62/5000.97	c satzilla running march_dl2004 ... 
4998.62/5000.97	c Bin: Executing march_dl2004
4998.62/5000.97	c march_dl2004 returned code 1.
4998.62/5000.97	c satzilla running zchaff_rand ... 
4998.62/5000.97	c Bin: Executing zchaff_rand
4998.62/5000.97	c zchaff_rand returned code 1.
4998.62/5000.97	c satzilla running vallst ... 
4998.62/5000.97	c Bin: Executing vallst
4998.62/5000.97	c vallst returned code 1.
4998.62/5000.97	c satzilla running minisat20 ... 
4998.62/5000.97	c Bin: Executing minisat20
4998.62/5000.97	c minisat20 returned code 1.
4998.62/5000.97	c satzilla running minisat20SAT07 ... 
4998.62/5000.97	c Bin: Executing minisat20SAT07
4998.62/5000.97	c minisat20SAT07 returned code 1.
4998.62/5000.97	c satzilla running mxc-sr08 ... 
4998.62/5000.97	c Bin: Executing mxc-sr08
4998.62/5000.97	c mxc-sr08 returned code 1.
4998.62/5000.97	c satzilla running SATenstein ... 
4998.62/5000.97	c Bin: Executing SATenstein
4998.62/5000.97	c SATenstein returned code 1.
4998.62/5000.97	c satzilla running gnovelty+ ... 
4998.62/5000.97	c Bin: Executing gnovelty+
4998.62/5000.97	c gnovelty+ returned code 1.
4998.62/5000.97	c satzilla running adaptg2wsat+ ... 
4998.62/5000.97	c Bin: Executing adaptg2wsat+
4998.62/5000.97	c adaptg2wsat+ returned code 1.
4998.62/5000.97	c satzilla running adaptg2wsat0 ... 
4998.62/5000.97	c Bin: Executing adaptg2wsat0
4998.62/5000.97	c adaptg2wsat0 returned code 1.
4998.62/5000.97	c satzilla running picosat846 ... 
4998.62/5000.97	c Bin: Executing picosat846
4998.62/5000.97	c picosat846 returned code 1.
4998.62/5000.97	c satzilla running kcnfs04SAT07 ... 
4998.62/5000.97	c Bin: Executing kcnfs04SAT07
4998.62/5000.97	c kcnfs04SAT07 returned code 1.
4998.62/5000.97	c ERROR: All Failed! 
4998.62/5000.97	c SATZILLA_TIME=4999.460000

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1825796-1242512097/watcher-1825796-1242512097 -o /tmp/evaluation-result-1825796-1242512097/solver-1825796-1242512097 -C 5000 -W 6000 -M 1800 HOME/SATzilla2009_C HOME/instance-1825796-1242512097.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 6000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 5375
/proc/meminfo: memFree=1167704/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=0
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 279243750 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 112 96 399 0 111 0
[pid=5376] ppid=5375 vsize=904 CPUtime=0
/proc/5376/stat : 5376 (march_dl2004) R 5375 5375 5284 0 -1 4194304 166 0 0 0 0 0 0 0 19 0 1 0 279243750 925696 158 1992294400 134512640 134996440 4294956192 18446744073709551615 134559596 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5376/statm: 226 158 72 118 0 105 0

[startup+0.085354 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 5375
/proc/meminfo: memFree=1167704/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=0
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 279243750 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 112 96 399 0 111 0
[pid=5376] ppid=5375 vsize=896 CPUtime=0.08
/proc/5376/stat : 5376 (march_dl2004) R 5375 5375 5284 0 -1 4194304 184 0 0 0 8 0 0 0 19 0 1 0 279243750 917504 176 1992294400 134512640 134996440 4294956192 18446744073709551615 134663585 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5376/statm: 224 176 74 118 0 103 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 2952

[startup+0.101355 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 5375
/proc/meminfo: memFree=1167704/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=0
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 279243750 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 112 96 399 0 111 0
[pid=5376] ppid=5375 vsize=896 CPUtime=0.09
/proc/5376/stat : 5376 (march_dl2004) R 5375 5375 5284 0 -1 4194304 185 0 0 0 9 0 0 0 19 0 1 0 279243750 917504 177 1992294400 134512640 134996440 4294956192 18446744073709551615 134565990 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5376/statm: 224 177 74 118 0 103 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 2952

[startup+0.30137 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 5375
/proc/meminfo: memFree=1167704/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=0
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 279243750 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 112 96 399 0 111 0
[pid=5376] ppid=5375 vsize=1040 CPUtime=0.29
/proc/5376/stat : 5376 (march_dl2004) R 5375 5375 5284 0 -1 4194304 189 0 0 0 29 0 0 0 21 0 1 0 279243750 1064960 181 1992294400 134512640 134996440 4294956192 18446744073709551615 134526992 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5376/statm: 260 181 74 118 0 139 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 3096

[startup+0.701402 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 5375
/proc/meminfo: memFree=1167704/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=0
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 279243750 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 112 96 399 0 111 0
[pid=5376] ppid=5375 vsize=1040 CPUtime=0.69
/proc/5376/stat : 5376 (march_dl2004) R 5375 5375 5284 0 -1 4194304 189 0 0 0 69 0 0 0 25 0 1 0 279243750 1064960 181 1992294400 134512640 134996440 4294956192 18446744073709551615 134587997 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5376/statm: 260 181 74 118 0 139 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 3096

[startup+1.50147 s]
/proc/loadavg: 0.92 0.98 0.99 2/66 5377
/proc/meminfo: memFree=1167112/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=0
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 279243750 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 112 96 399 0 111 0
[pid=5376] ppid=5375 vsize=1040 CPUtime=1.49
/proc/5376/stat : 5376 (march_dl2004) R 5375 5375 5284 0 -1 4194304 191 0 0 0 149 0 0 0 25 0 1 0 279243750 1064960 183 1992294400 134512640 134996440 4294956192 18446744073709551615 134551294 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5376/statm: 260 183 74 118 0 139 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 3096

[startup+3.1016 s]
/proc/loadavg: 0.92 0.98 0.99 2/66 5377
/proc/meminfo: memFree=1166216/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=0
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 279243750 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 112 96 399 0 111 0
[pid=5376] ppid=5375 vsize=1040 CPUtime=3.09
/proc/5376/stat : 5376 (march_dl2004) R 5375 5375 5284 0 -1 4194304 194 0 0 0 308 1 0 0 25 0 1 0 279243750 1064960 186 1992294400 134512640 134996440 4294956192 18446744073709551615 134532761 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5376/statm: 260 186 74 118 0 139 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 3096

[startup+6.30186 s]
/proc/loadavg: 0.93 0.98 0.99 2/66 5378
/proc/meminfo: memFree=1166856/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=2056 CPUtime=4.99
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 156 196 0 0 0 0 498 1 19 0 1 0 279243750 2105344 125 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 514 125 107 399 0 111 0
[pid=5378] ppid=5375 vsize=1656 CPUtime=1.29
/proc/5378/stat : 5378 (mxc-sr08) R 5375 5375 5284 0 -1 4194304 318 0 0 0 129 0 0 0 25 0 1 0 279244250 1695744 314 1992294400 134512640 135078026 4294956192 18446744073709551615 134522284 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5378/statm: 414 314 71 138 0 273 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 3712

[startup+12.7024 s]
/proc/loadavg: 0.93 0.98 0.99 2/66 5380
/proc/meminfo: memFree=1163528/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=7312 CPUtime=12.67
/proc/5375/stat : 5375 (SATzilla2009_C) R 5373 5375 5284 0 -1 4194304 393 2095 0 0 58 10 1196 3 24 0 1 0 279243750 7487488 320 1992294400 134512640 136149437 4294956224 18446744073709551615 135542670 0 0 4096 3 0 0 0 17 0 0 0
/proc/5375/statm: 1828 320 207 399 0 1425 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 7312

[startup+25.5014 s]
/proc/loadavg: 0.95 0.98 0.99 2/66 5381
/proc/meminfo: memFree=1159688/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=8532 CPUtime=9.05
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 2044 0 0 0 904 1 0 0 25 0 1 0 279245394 8736768 2039 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 2133 2039 68 110 0 2020 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 11700

[startup+51.1015 s]
/proc/loadavg: 1.02 1.00 1.00 2/66 5381
/proc/meminfo: memFree=1151048/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=17444 CPUtime=34.61
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 4288 0 0 0 3459 2 0 0 25 0 1 0 279245394 17862656 4283 1992294400 134512640 134965848 4294956208 18446744073709551615 134534139 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 4361 4283 68 110 0 4248 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 20612

[startup+102.306 s]
/proc/loadavg: 1.15 1.03 1.01 2/66 5381
/proc/meminfo: memFree=1137224/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=30816 CPUtime=85.79
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 7635 0 0 0 8574 5 0 0 25 0 1 0 279245394 31555584 7630 1992294400 134512640 134965848 4294956208 18446744073709551615 134534126 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 7704 7630 68 110 0 7591 0
Current children cumulated CPU time (s) 102.2
Current children cumulated vsize (KiB) 33984

[startup+162.302 s]
/proc/loadavg: 1.05 1.02 1.00 2/66 5381
/proc/meminfo: memFree=1122568/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=45584 CPUtime=145.77
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 11299 0 0 0 14570 7 0 0 25 0 1 0 279245394 46678016 11294 1992294400 134512640 134965848 4294956208 18446744073709551615 134534060 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 11396 11294 68 110 0 11283 0
Current children cumulated CPU time (s) 162.18
Current children cumulated vsize (KiB) 48752

[startup+222.301 s]
/proc/loadavg: 1.02 1.02 1.00 2/66 5381
/proc/meminfo: memFree=1100360/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=67852 CPUtime=205.74
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 16857 0 0 0 20563 11 0 0 25 0 1 0 279245394 69480448 16852 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 16963 16852 68 110 0 16850 0
Current children cumulated CPU time (s) 222.15
Current children cumulated vsize (KiB) 71020

[startup+282.301 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 5381
/proc/meminfo: memFree=1094856/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=73244 CPUtime=265.72
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 18236 0 0 0 26560 12 0 0 25 0 1 0 279245394 75001856 18231 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 18311 18231 68 110 0 18198 0
Current children cumulated CPU time (s) 282.13
Current children cumulated vsize (KiB) 76412

[startup+342.301 s]
/proc/loadavg: 1.00 1.01 1.00 2/66 5381
/proc/meminfo: memFree=1090056/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=77932 CPUtime=325.7
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 19417 0 0 0 32557 13 0 0 25 0 1 0 279245394 79802368 19412 1992294400 134512640 134965848 4294956208 18446744073709551615 134534137 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 19483 19412 68 110 0 19370 0
Current children cumulated CPU time (s) 342.11
Current children cumulated vsize (KiB) 81100

[startup+402.301 s]

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=886920/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=280456 CPUtime=4643.79
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 70057 0 0 0 464318 61 0 0 25 0 1 0 279245394 287186944 70052 1992294400 134512640 134965848 4294956208 18446744073709551615 134534033 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 70114 70052 68 110 0 70001 0
Current children cumulated CPU time (s) 4660.2
Current children cumulated vsize (KiB) 283624

[startup+4722.31 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=883272/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=284208 CPUtime=4703.74
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 70951 0 0 0 470312 62 0 0 25 0 1 0 279245394 291028992 70946 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 71052 70946 68 110 0 70939 0
Current children cumulated CPU time (s) 4720.15
Current children cumulated vsize (KiB) 287376

[startup+4782.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=878792/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=288660 CPUtime=4763.72
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 72063 0 0 0 476309 63 0 0 25 0 1 0 279245394 295587840 72058 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 72165 72058 68 110 0 72052 0
Current children cumulated CPU time (s) 4780.13
Current children cumulated vsize (KiB) 291828

[startup+4842.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=877576/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=289832 CPUtime=4823.69
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 72365 0 0 0 482306 63 0 0 25 0 1 0 279245394 296787968 72360 1992294400 134512640 134965848 4294956208 18446744073709551615 134534348 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 72458 72360 68 110 0 72345 0
Current children cumulated CPU time (s) 4840.1
Current children cumulated vsize (KiB) 293000

[startup+4902.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=875912/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=291472 CPUtime=4883.66
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 72801 0 0 0 488303 63 0 0 25 0 1 0 279245394 298467328 72796 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 72868 72796 68 110 0 72755 0
Current children cumulated CPU time (s) 4900.07
Current children cumulated vsize (KiB) 294640

[startup+4962.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=874440/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=292880 CPUtime=4943.62
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73141 0 0 0 494299 63 0 0 25 0 1 0 279245394 299909120 73136 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73220 73136 68 110 0 73107 0
Current children cumulated CPU time (s) 4960.03
Current children cumulated vsize (KiB) 296048

Solver just ended. Dumping a history of the last processes samples

[startup+4966.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=874376/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=292880 CPUtime=4947.62
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73163 0 0 0 494699 63 0 0 25 0 1 0 279245394 299909120 73158 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73220 73158 68 110 0 73107 0
Current children cumulated CPU time (s) 4964.03
Current children cumulated vsize (KiB) 296048

[startup+4979.1 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=873928/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=293348 CPUtime=4960.42
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73280 0 0 0 495979 63 0 0 25 0 1 0 279245394 300388352 73275 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73337 73275 68 110 0 73224 0
Current children cumulated CPU time (s) 4976.83
Current children cumulated vsize (KiB) 296516

[startup+4991.9 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=873672/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=293816 CPUtime=4973.22
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73348 0 0 0 497258 64 0 0 25 0 1 0 279245394 300867584 73343 1992294400 134512640 134965848 4294956208 18446744073709551615 134534114 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73454 73343 68 110 0 73341 0
Current children cumulated CPU time (s) 4989.63
Current children cumulated vsize (KiB) 296984

[startup+4995.1 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=873608/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=293816 CPUtime=4976.42
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73364 0 0 0 497578 64 0 0 25 0 1 0 279245394 300867584 73359 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73454 73359 68 110 0 73341 0
Current children cumulated CPU time (s) 4992.83
Current children cumulated vsize (KiB) 296984

[startup+4998.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=873544/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=293816 CPUtime=4979.62
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73380 0 0 0 497898 64 0 0 25 0 1 0 279245394 300867584 73375 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73454 73375 68 110 0 73341 0
Current children cumulated CPU time (s) 4996.03
Current children cumulated vsize (KiB) 296984

[startup+4999.9 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=873480/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=293816 CPUtime=4981.21
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73395 0 0 0 498057 64 0 0 25 0 1 0 279245394 300867584 73390 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73454 73390 68 110 0 73341 0
Current children cumulated CPU time (s) 4997.62
Current children cumulated vsize (KiB) 296984

[startup+5000.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=873416/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=294052 CPUtime=4982.01
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73408 0 0 0 498137 64 0 0 25 0 1 0 279245394 301109248 73403 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73513 73403 68 110 0 73400 0
Current children cumulated CPU time (s) 4998.42
Current children cumulated vsize (KiB) 297220

[startup+5000.9 s]
/proc/loadavg: 1.00 1.00 1.00 2/66 5389
/proc/meminfo: memFree=873416/2055920 swapFree=4191900/4192956
[pid=5375] ppid=5373 vsize=3168 CPUtime=16.41
/proc/5375/stat : 5375 (SATzilla2009_C) S 5373 5375 5284 0 -1 4194304 449 2095 0 0 401 41 1196 3 25 0 1 0 279243750 3244032 325 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/5375/statm: 792 325 219 399 0 389 0
[pid=5381] ppid=5375 vsize=294052 CPUtime=4982.21
/proc/5381/stat : 5381 (tts-4-0) R 5375 5375 5284 0 -1 4194304 73415 0 0 0 498157 64 0 0 25 0 1 0 279245394 301109248 73410 1992294400 134512640 134965848 4294956208 18446744073709551615 134534071 0 0 8392704 0 0 0 0 17 0 0 0
/proc/5381/statm: 73513 73410 68 110 0 73400 0
Current children cumulated CPU time (s) 4998.62
Current children cumulated vsize (KiB) 297220

Child status: 17
Real time (s): 5000.97
CPU time (s): 4998.72
CPU user time (s): 4997.58
CPU system time (s): 1.14083
CPU usage (%): 99.955
Max. virtual memory (cumulated for all children) (KiB): 297220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4997.58
system time used= 1.14083
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 75975
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 17203

runsolver used 4.01139 second user time and 14.1808 second system time

The end

Launcher Data

Begin job on node3 at 2009-05-17 00:14:57
IDJOB=1825796
IDBENCH=71124
IDSOLVER=668
FILE ID=node3/1825796-1242512097
PBS_JOBID= 9307008
Free space on /tmp= 66304 MiB

SOLVER NAME= SATzilla2009_C 2009-03-22
BENCH NAME= SAT09/CRAFTED/sgen/sat/sgen1-sat-200-100.cnf
COMMAND LINE= HOME/SATzilla2009_C BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1825796-1242512097/watcher-1825796-1242512097 -o /tmp/evaluation-result-1825796-1242512097/solver-1825796-1242512097 -C 5000 -W 6000 -M 1800  HOME/SATzilla2009_C HOME/instance-1825796-1242512097.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 3eff3d0cb86e42a8fbb844259e0c7beb
RANDOM SEED=1311134803

node3.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.212
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1168184 kB
Buffers:         80708 kB
Cached:         709872 kB
SwapCached:        260 kB
Active:          99204 kB
Inactive:       705212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1168184 kB
SwapTotal:     4192956 kB
SwapFree:      4191900 kB
Dirty:           31452 kB
Writeback:           0 kB
Mapped:          22344 kB
Slab:            69388 kB
Committed_AS:  1066268 kB
PageTables:       1372 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66272 MiB
End job on node3 at 2009-05-17 01:38:18