Trace number 1728705

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SATzilla2009_C 2009-03-22? (exit code) 1199.71 1200.31

General information on the benchmark

Namecrafted/Hard/contest02/
ezfact256_1.sat05-464.reshuffled-07.cnf
MD5SUM69151394f3e0e8838dc6693844061945
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables49153
Number of clauses324873
Sum of the clauses size1232169
Maximum clause length4
Minimum clause length1
Number of clauses of size 1257
Number of clauses of size 20
Number of clauses of size 366552
Number of clauses of size 4258064
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

33.73/33.83	c SATzilla is building models for class 2
33.73/33.83	c run presolver march_dl2004 for 5 seconds ... 
33.73/33.83	c Bin: Executing march_dl2004
33.73/33.83	c spawning binary file with 5 seconds ...
33.73/33.83	c child exit by a signal
33.73/33.83	c march_dl2004 returned code 137.
33.73/33.83	c run presolver mxc-sr08 for 5 seconds ... 
33.73/33.83	c Bin: Executing mxc-sr08
33.73/33.83	c spawning binary file with 5 seconds ...
33.73/33.83	c child exit by a signal
33.73/33.83	c mxc-sr08 returned code 137.
33.73/33.83	c Orignal number of varibales is 49153, number of clauses is 324873 
33.73/33.83	c predicted feature computation time is 20.399460 
33.73/33.83	c Bin: Executing satelite
33.73/33.83	c spawning binary file with 240 seconds ...
33.73/33.83	c child exited successfully
33.73/33.83	c satzilla computing base features
33.73/33.83	c Number of variabe is: 48560, Number of clause is : 317822 
33.73/33.83	c Initializing...
33.73/33.83	c satzilla compute diameter ...
33.73/33.83	c start diameter features ...
33.73/33.83	c satzilla doing clause learning
33.73/33.83	c start clause learning features ...
33.73/33.83	c Bin: Executing zchaff07
33.73/33.83	c spawning binary file with 2 seconds ...
33.73/33.83	c child exit by a signal
33.73/33.83	c satzilla doing survey propogation probe
33.73/33.83	c do survay propogation for 2 second ...
33.73/33.83	c satzilla doing local search probe
33.73/33.83	c satzilla doing lobjois search-space size estimate
33.73/33.83	c features are:49153 324873 48560 317822 0.0122117 0.0221854 0.15279 0.399085 0.827178 1.29093 7.80147e-05 0.115993 4.11862e-05 0.000102965 0.546785 0.0131206 0.198498 7.80147e-05 1.34604 2.51713e-05 0.00161726 0.87464 0.0304091 0.0463368 0 0.333333 0.659763 2.67415e-05 2.04283 6.29283e-06 0.000865264 2.15741 0.352839 2.45558e-05 2.17576 9.43925e-06 0.000802336 7.54545 0.0659907 7 8 0.689009 415.5 0.184116 339 492 492 339 492 339 492 26.8173 0.313708 18.4045 35.2301 35.2301 18.4045 35.2301 18.4045 35.2301 0.139782 1.14904 0 0.722423 0.386205 0.00139853 0.366295 0.00866562 0.0733039 0.146484 0.29288 0 0.263984 0.205647 0.094676 0.178469 0.115228 0.143083 3259 0 7799 0 7799 7799 7799 0.366611 0 0.729339 0 0.00540303 0.0165147 
33.73/33.83	c satzilla's ranking:
33.73/33.83	c 1) minisat20SAT07: 2.030732
33.73/33.83	c 2) minisat20: 1.511057
33.73/33.83	c 3) march_dl2004: 1.373791
33.73/33.83	c 4) zchaff_rand: 1.237043
33.73/33.83	c 5) mxc-sr08: 0.992260
33.73/33.83	c 6) tts-4-0: 0.019832
33.73/33.83	c 7) vallst: -4.352474
33.73/33.83	c 8) SATenstein: -10000.000000
33.73/33.83	c 9) gnovelty+: -10000.000000
33.73/33.83	c 10) adaptg2wsat+: -10000.000000
33.73/33.83	c 11) adaptg2wsat0: -10000.000000
33.73/33.83	c 12) picosat846: -10000.000000
33.73/33.83	c 13) kcnfs04SAT07: -10000.000000
33.73/33.83	c satzilla running minisat20SAT07 ... 
1199.56/1200.30	c Bin: Executing minisat20SAT07
1199.56/1200.30	c spawning binary file with 1166 seconds ...
1199.56/1200.30	c child exit by a signal
1199.56/1200.30	c minisat20SAT07 returned code 137.
1199.56/1200.30	c satzilla running minisat20 ... 
1199.56/1200.30	c Bin: Executing minisat20
1199.56/1200.30	c minisat20 returned code 1.
1199.56/1200.30	c satzilla running march_dl2004 ... 
1199.56/1200.30	c Bin: Executing march_dl2004
1199.56/1200.30	c march_dl2004 returned code 1.
1199.56/1200.30	c satzilla running zchaff_rand ... 
1199.56/1200.30	c Bin: Executing zchaff_rand
1199.56/1200.30	c zchaff_rand returned code 1.
1199.56/1200.30	c satzilla running mxc-sr08 ... 
1199.56/1200.30	c Bin: Executing mxc-sr08
1199.56/1200.30	c mxc-sr08 returned code 1.
1199.56/1200.30	c satzilla running tts-4-0 ... 
1199.56/1200.30	c Bin: Executing tts-4-0
1199.56/1200.30	c tts-4-0 returned code 1.
1199.56/1200.30	c satzilla running vallst ... 
1199.56/1200.30	c Bin: Executing vallst
1199.56/1200.30	c vallst returned code 1.
1199.56/1200.30	c satzilla running SATenstein ... 
1199.56/1200.30	c Bin: Executing SATenstein
1199.56/1200.30	c SATenstein returned code 1.
1199.56/1200.30	c satzilla running gnovelty+ ... 
1199.56/1200.30	c Bin: Executing gnovelty+
1199.56/1200.30	c gnovelty+ returned code 1.
1199.56/1200.30	c satzilla running adaptg2wsat+ ... 
1199.56/1200.30	c Bin: Executing adaptg2wsat+
1199.56/1200.30	c adaptg2wsat+ returned code 1.
1199.56/1200.30	c satzilla running adaptg2wsat0 ... 
1199.56/1200.30	c Bin: Executing adaptg2wsat0
1199.56/1200.30	c adaptg2wsat0 returned code 1.
1199.56/1200.30	c satzilla running picosat846 ... 
1199.56/1200.30	c Bin: Executing picosat846
1199.56/1200.30	c picosat846 returned code 1.
1199.56/1200.30	c satzilla running kcnfs04SAT07 ... 
1199.56/1200.30	c Bin: Executing kcnfs04SAT07
1199.56/1200.30	c kcnfs04SAT07 returned code 1.
1199.56/1200.30	c ERROR: All Failed! 
1199.56/1200.30	c SATZILLA_TIME=1199.870000

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1728705-1240740174/watcher-1728705-1240740174 -o /tmp/evaluation-result-1728705-1240740174/solver-1728705-1240740174 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/SATzilla2009_C HOME/instance-1728705-1240740174.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 27165
/proc/meminfo: memFree=1474496/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=0
/proc/27165/stat : 27165 (SATzilla2009_C) R 27163 27165 27094 0 -1 4194304 128 0 0 0 0 0 0 0 18 0 1 0 102050824 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135543087 0 0 4096 0 0 0 0 17 0 0 0
/proc/27165/statm: 514 112 96 399 0 111 0
[pid=27166] ppid=27165 vsize=4680 CPUtime=0
/proc/27166/stat : 27166 (march_dl2004) R 27165 27165 27094 0 -1 4194304 584 0 0 0 0 0 0 0 18 0 1 0 102050824 4792320 579 1992294400 134512640 134996440 4294956192 18446744073709551615 134652876 0 0 8392704 0 0 0 0 17 0 0 0
/proc/27166/statm: 1170 583 49 118 0 1049 0

[startup+0.018233 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 27165
/proc/meminfo: memFree=1474496/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=0
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 102050824 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/27165/statm: 514 112 96 399 0 111 0
[pid=27166] ppid=27165 vsize=6320 CPUtime=0.01
/proc/27166/stat : 27166 (march_dl2004) R 27165 27165 27094 0 -1 4194304 1135 0 0 0 1 0 0 0 19 0 1 0 102050824 6471680 1130 1992294400 134512640 134996440 4294956192 18446744073709551615 134652876 0 0 8392704 0 0 0 0 17 0 0 0
/proc/27166/statm: 1580 1130 50 118 0 1459 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8376

[startup+0.10224 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 27165
/proc/meminfo: memFree=1474496/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=0
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 102050824 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/27165/statm: 514 112 96 399 0 111 0
[pid=27166] ppid=27165 vsize=7376 CPUtime=0.09
/proc/27166/stat : 27166 (march_dl2004) R 27165 27165 27094 0 -1 4194304 1447 0 0 0 9 0 0 0 19 0 1 0 102050824 7553024 1442 1992294400 134512640 134996440 4294956192 18446744073709551615 134652876 0 0 8392704 0 0 0 0 17 0 0 0
/proc/27166/statm: 1844 1442 50 118 0 1723 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9432

[startup+0.301261 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 27165
/proc/meminfo: memFree=1474496/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=0
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 102050824 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/27165/statm: 514 112 96 399 0 111 0
[pid=27166] ppid=27165 vsize=9884 CPUtime=0.29
/proc/27166/stat : 27166 (march_dl2004) R 27165 27165 27094 0 -1 4194304 2191 0 0 0 28 1 0 0 21 0 1 0 102050824 10121216 2186 1992294400 134512640 134996440 4294956192 18446744073709551615 134669245 0 0 8392704 0 0 0 0 17 0 0 0
/proc/27166/statm: 2471 2186 50 118 0 2350 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 11940

[startup+0.702303 s]
/proc/loadavg: 0.91 0.95 0.98 3/64 27165
/proc/meminfo: memFree=1474496/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=0
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 102050824 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/27165/statm: 514 112 96 399 0 111 0
[pid=27166] ppid=27165 vsize=28296 CPUtime=0.69
/proc/27166/stat : 27166 (march_dl2004) R 27165 27165 27094 0 -1 4194304 5675 0 0 0 67 2 0 0 25 0 1 0 102050824 28975104 5668 1992294400 134512640 134996440 4294956192 18446744073709551615 134542421 0 0 8392704 0 0 0 0 17 0 0 0
/proc/27166/statm: 7074 5668 52 118 0 6953 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 30352

[startup+1.50239 s]
/proc/loadavg: 0.91 0.95 0.98 2/66 27167
/proc/meminfo: memFree=1451696/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=0
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 102050824 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/27165/statm: 514 112 96 399 0 111 0
[pid=27166] ppid=27165 vsize=34188 CPUtime=1.49
/proc/27166/stat : 27166 (march_dl2004) R 27165 27165 27094 0 -1 4194304 8388 0 0 0 145 4 0 0 25 0 1 0 102050824 35008512 7207 1992294400 134512640 134996440 4294956192 18446744073709551615 134542894 0 0 8392704 0 0 0 0 17 0 0 0
/proc/27166/statm: 8547 7207 55 118 0 8426 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 36244

[startup+3.10157 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27167
/proc/meminfo: memFree=1451632/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=0
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 132 0 0 0 0 0 0 0 18 0 1 0 102050824 2105344 112 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 1 0 0
/proc/27165/statm: 514 112 96 399 0 111 0
[pid=27166] ppid=27165 vsize=28552 CPUtime=3.08
/proc/27166/stat : 27166 (march_dl2004) R 27165 27165 27094 0 -1 4194304 11980 0 0 0 302 6 0 0 25 0 1 0 102050824 29237248 5806 1992294400 134512640 134996440 4294956192 18446744073709551615 134650634 0 0 8392704 0 0 0 0 17 1 0 0
/proc/27166/statm: 7138 5806 55 118 0 7017 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 30608

[startup+6.3019 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27168
/proc/meminfo: memFree=1450480/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=2056 CPUtime=4.99
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 152 19097 0 0 0 0 490 9 16 0 1 0 102050824 2105344 121 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 514 121 104 399 0 111 0
[pid=27168] ppid=27165 vsize=34588 CPUtime=1.27
/proc/27168/stat : 27168 (mxc-sr08) R 27165 27165 27094 0 -1 4194304 9750 0 0 0 123 4 0 0 25 0 1 0 102051326 35418112 7676 1992294400 134512640 135078026 4294956192 18446744073709551615 134558510 0 0 8392704 0 0 0 0 17 0 0 0
/proc/27168/statm: 8647 7676 55 138 0 8506 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 36644

[startup+12.7016 s]
/proc/loadavg: 1.00 0.97 0.99 2/65 27169
/proc/meminfo: memFree=1447032/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=34816 CPUtime=12.65
/proc/27165/stat : 27165 (SATzilla2009_C) R 27163 27165 27094 0 -1 4194304 8116 41180 0 0 139 4 1093 29 25 0 1 0 102050824 35651584 8067 1992294400 134512640 136149437 4294956224 18446744073709551615 134535653 0 0 4096 0 0 0 0 17 0 0 0
/proc/27165/statm: 8704 8067 135 399 0 8301 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 34816

[startup+25.502 s]
/proc/loadavg: 1.00 0.97 0.99 2/65 27170
/proc/meminfo: memFree=1437816/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36676 CPUtime=25.44
/proc/27165/stat : 27165 (SATzilla2009_C) R 27163 27165 27094 0 -1 4194304 15475 50569 0 0 1216 6 1287 35 20 0 1 0 102050824 37556224 8567 1992294400 134512640 136149437 4294956224 18446744073709551615 135485446 0 0 4096 3 0 0 0 17 0 0 0
/proc/27165/statm: 9169 8567 150 399 0 8766 0
Current children cumulated CPU time (s) 25.44
Current children cumulated vsize (KiB) 36676

[startup+51.1017 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1404336/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=30128 CPUtime=17.25
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 8084 0 0 0 1720 5 0 0 25 0 1 0 102054208 30851072 7058 1992294400 134512640 135078472 4294956192 18446744073709551615 134550573 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 7532 7058 74 138 0 7391 0
Current children cumulated CPU time (s) 51.01
Current children cumulated vsize (KiB) 66900

[startup+102.306 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1377200/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=57168 CPUtime=68.39
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 14848 0 0 0 6829 10 0 0 25 0 1 0 102054208 58540032 13822 1992294400 134512640 135078472 4294956192 18446744073709551615 134550582 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 14292 13822 74 138 0 14151 0
Current children cumulated CPU time (s) 102.15
Current children cumulated vsize (KiB) 93940

[startup+162.302 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1346544/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=88104 CPUtime=128.36
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 22552 0 0 0 12820 16 0 0 25 0 1 0 102054208 90218496 21526 1992294400 134512640 135078472 4294956192 18446744073709551615 134550573 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 22026 21526 74 138 0 21885 0
Current children cumulated CPU time (s) 162.12
Current children cumulated vsize (KiB) 124876

[startup+222.301 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1319536/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=114744 CPUtime=188.33
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 29242 0 0 0 18813 20 0 0 25 0 1 0 102054208 117497856 28216 1992294400 134512640 135078472 4294956192 18446744073709551615 134550573 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 28686 28216 74 138 0 28545 0
Current children cumulated CPU time (s) 222.09
Current children cumulated vsize (KiB) 151516

[startup+282.302 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1281200/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=153408 CPUtime=248.31
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 38891 0 0 0 24803 28 0 0 25 0 1 0 102054208 157089792 37865 1992294400 134512640 135078472 4294956192 18446744073709551615 134550582 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 38352 37865 74 138 0 38211 0
Current children cumulated CPU time (s) 282.07
Current children cumulated vsize (KiB) 190180

[startup+342.302 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1239920/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=194348 CPUtime=308.28
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 49122 0 0 0 30792 36 0 0 25 0 1 0 102054208 199012352 48096 1992294400 134512640 135078472 4294956192 18446744073709551615 134550706 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 48587 48096 74 138 0 48446 0
Current children cumulated CPU time (s) 342.04
Current children cumulated vsize (KiB) 231120

[startup+402.301 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1205424/2055920 swapFree=4181324/4192956

################
# More data... #
################

/proc/27171/statm: 95276 94751 74 138 0 95135 0
Current children cumulated CPU time (s) 701.88
Current children cumulated vsize (KiB) 417876

[startup+762.307 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=1017456/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=416224 CPUtime=728.1
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 104578 0 0 0 72736 74 0 0 25 0 1 0 102054208 426213376 103552 1992294400 134512640 135078472 4294956192 18446744073709551615 134550582 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 104056 103552 74 138 0 103915 0
Current children cumulated CPU time (s) 761.86
Current children cumulated vsize (KiB) 452996

[startup+822.302 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=985904/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=448020 CPUtime=788.08
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 112531 0 0 0 78729 79 0 0 25 0 1 0 102054208 458772480 111505 1992294400 134512640 135078472 4294956192 18446744073709551615 134556013 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 112005 111505 74 138 0 111864 0
Current children cumulated CPU time (s) 821.84
Current children cumulated vsize (KiB) 484792

[startup+882.303 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=957104/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=476476 CPUtime=848.05
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 119648 0 0 0 84720 85 0 0 25 0 1 0 102054208 487911424 118622 1992294400 134512640 135078472 4294956192 18446744073709551615 134550720 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 119119 118622 74 138 0 118978 0
Current children cumulated CPU time (s) 881.81
Current children cumulated vsize (KiB) 513248

[startup+942.302 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=926000/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=508024 CPUtime=908.02
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 127480 0 0 0 90710 92 0 0 25 0 1 0 102054208 520216576 126454 1992294400 134512640 135078472 4294956192 18446744073709551615 134551946 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 127006 126454 74 138 0 126865 0
Current children cumulated CPU time (s) 941.78
Current children cumulated vsize (KiB) 544796

[startup+1002.3 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=891248/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=542400 CPUtime=968.01
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 136079 0 0 0 96702 99 0 0 25 0 1 0 102054208 555417600 135053 1992294400 134512640 135078472 4294956192 18446744073709551615 134550729 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 135600 135053 74 138 0 135459 0
Current children cumulated CPU time (s) 1001.77
Current children cumulated vsize (KiB) 579172

[startup+1062.3 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=858544/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=575488 CPUtime=1027.98
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 144354 0 0 0 102693 105 0 0 25 0 1 0 102054208 589299712 143328 1992294400 134512640 135078472 4294956192 18446744073709551615 134552052 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 143872 143328 74 138 0 143731 0
Current children cumulated CPU time (s) 1061.74
Current children cumulated vsize (KiB) 612260

[startup+1122.3 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=828336/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=605100 CPUtime=1087.94
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 151763 0 0 0 108683 111 0 0 25 0 1 0 102054208 619622400 150737 1992294400 134512640 135078472 4294956192 18446744073709551615 134550729 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 151275 150737 74 138 0 151134 0
Current children cumulated CPU time (s) 1121.7
Current children cumulated vsize (KiB) 641872

[startup+1182.3 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=797168/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=636528 CPUtime=1147.92
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 159643 0 0 0 114677 115 0 0 25 0 1 0 102054208 651804672 158617 1992294400 134512640 135078472 4294956192 18446744073709551615 134550582 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 159132 158617 74 138 0 158991 0
Current children cumulated CPU time (s) 1181.68
Current children cumulated vsize (KiB) 673300

Solver just ended. Dumping a history of the last processes samples

[startup+1190.3 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=792944/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=640296 CPUtime=1155.92
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 160593 0 0 0 115476 116 0 0 25 0 1 0 102054208 655663104 159567 1992294400 134512640 135078472 4294956192 18446744073709551615 134550582 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 160074 159567 74 138 0 159933 0
Current children cumulated CPU time (s) 1189.68
Current children cumulated vsize (KiB) 677068

[startup+1196.7 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=789808/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=643232 CPUtime=1162.31
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 161333 0 0 0 116114 117 0 0 25 0 1 0 102054208 658669568 160307 1992294400 134512640 135078472 4294956192 18446744073709551615 134552688 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 160808 160307 74 138 0 160667 0
Current children cumulated CPU time (s) 1196.07
Current children cumulated vsize (KiB) 680004

[startup+1198.3 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=789360/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=643900 CPUtime=1163.91
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 161484 0 0 0 116274 117 0 0 25 0 1 0 102054208 659353600 160458 1992294400 134512640 135078472 4294956192 18446744073709551615 134555832 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 160975 160458 74 138 0 160834 0
Current children cumulated CPU time (s) 1197.67
Current children cumulated vsize (KiB) 680672

[startup+1199.1 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=788976/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=644172 CPUtime=1164.71
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 161569 0 0 0 116354 117 0 0 25 0 1 0 102054208 659632128 160543 1992294400 134512640 135078472 4294956192 18446744073709551615 134550720 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 161043 160543 74 138 0 160902 0
Current children cumulated CPU time (s) 1198.47
Current children cumulated vsize (KiB) 680944

[startup+1199.9 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=788976/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=36772 CPUtime=33.76
/proc/27165/stat : 27165 (SATzilla2009_C) S 27163 27165 27094 0 -1 4194304 23835 50569 0 0 2040 14 1287 35 25 0 1 0 102050824 37654528 8878 1992294400 134512640 136149437 4294956224 18446744073709551615 135542781 0 0 4096 3 18446744071563356171 0 0 17 0 0 0
/proc/27165/statm: 9193 8878 219 399 0 8790 0
[pid=27171] ppid=27165 vsize=644572 CPUtime=1165.5
/proc/27171/stat : 27171 (minisat20SAT07) R 27165 27165 27094 0 -1 4194304 161663 0 0 0 116433 117 0 0 25 0 1 0 102054208 660041728 160637 1992294400 134512640 135078472 4294956192 18446744073709551615 134550741 0 0 8392704 3 0 0 0 17 0 0 0
/proc/27171/statm: 161143 160637 74 138 0 161002 0
Current children cumulated CPU time (s) 1199.26
Current children cumulated vsize (KiB) 681344

[startup+1200.3 s]
/proc/loadavg: 1.00 0.97 0.99 2/66 27171
/proc/meminfo: memFree=788336/2055920 swapFree=4181324/4192956
[pid=27165] ppid=27163 vsize=0 CPUtime=1199.68
/proc/27165/stat : 27165 (SATzilla2009_C) R 27163 27165 27094 0 -1 4194308 23852 212284 0 0 2040 14 117751 163 16 0 1 0 102050824 0 0 1992294400 0 0 0 0 0 0 0 4096 3 0 0 0 17 0 0 0
/proc/27165/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1199.68
Current children cumulated vsize (KiB) 0

Child status: 17
Real time (s): 1200.31
CPU time (s): 1199.71
CPU user time (s): 1197.93
CPU system time (s): 1.78673
CPU usage (%): 99.9502
Max. virtual memory (cumulated for all children) (KiB): 681608

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1197.93
system time used= 1.78673
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 236136
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 2949

runsolver used 1.02784 second user time and 3.34549 second system time

The end

Launcher Data 

Begin job on node19 at 2009-04-26 12:02:55
IDJOB=1728705
IDBENCH=24683
IDSOLVER=527
FILE ID=node19/1728705-1240740174
PBS_JOBID= 9187038
Free space on /tmp= 66300 MiB

SOLVER NAME= SATzilla2009_C 2009-03-22
BENCH NAME= SAT07/crafted/Hard/contest02/ezfact256_1.sat05-464.reshuffled-07.cnf
COMMAND LINE= HOME/SATzilla2009_C BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1728705-1240740174/watcher-1728705-1240740174 -o /tmp/evaluation-result-1728705-1240740174/solver-1728705-1240740174 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/SATzilla2009_C HOME/instance-1728705-1240740174.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 69151394f3e0e8838dc6693844061945
RANDOM SEED=272340843

node19.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.236
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1475040 kB
Buffers:         66348 kB
Cached:         433596 kB
SwapCached:       5500 kB
Active:         229348 kB
Inactive:       278484 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1475040 kB
SwapTotal:     4192956 kB
SwapFree:      4181324 kB
Dirty:           39636 kB
Writeback:           0 kB
Mapped:          13504 kB
Slab:            59140 kB
Committed_AS:   368184 kB
PageTables:       1452 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66272 MiB
End job on node19 at 2009-04-26 12:22:56