Trace number 3250816

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 1300.05 1300.01

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
MD5SUMb61e426b264831836f140414cdcf3e23
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables238
Number of clauses15812
Sum of the clauses size70446
Maximum clause length16
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 314042
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51770

Solver Data

0.00/0.00	c Parsing...
0.00/0.00	c ==============================================================================
0.00/0.00	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.00	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.00	c ==============================================================================
0.00/0.00	c |         0 |   15812    70446 |    4743       0        0     nan |  0.000 % |
0.00/0.00	c ==============================================================================
0.00/0.00	c Result  :   #vars: 238   #clauses: 15812   #literals: 70446
0.00/0.00	c CPU time:   0.005999 s
0.00/0.00	c ==============================================================================

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250816-1303545710/watcher-3250816-1303545710 -o /tmp/evaluation-result-3250816-1303545710/solver-3250816-1303545710 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3250816-1303545710.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.02 3.98 3.79 4/192 13265
/proc/meminfo: memFree=15584880/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) R 13263 13265 12177 0 -1 4202496 312 0 0 0 0 0 0 0 25 0 1 0 466169784 8908800 250 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272509333 0 65538 4100 65536 0 0 0 17 4 0 0 0
/proc/13265/statm: 2175 250 209 178 0 68 0

[startup+0.0418629 s]
/proc/loadavg: 4.02 3.98 3.79 4/192 13265
/proc/meminfo: memFree=15584880/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.100852 s]
/proc/loadavg: 4.02 3.98 3.79 4/192 13265
/proc/meminfo: memFree=15584880/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.300815 s]
/proc/loadavg: 4.02 3.98 3.79 4/192 13265
/proc/meminfo: memFree=15584880/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+0.700755 s]
/proc/loadavg: 4.02 3.98 3.79 4/192 13265
/proc/meminfo: memFree=15584880/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 8700

[startup+1.50055 s]
/proc/loadavg: 4.02 3.98 3.79 5/194 13268
/proc/meminfo: memFree=15580776/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=10496 CPUtime=1.48 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 1101 0 0 0 148 0 0 0 25 0 1 0 466169786 10747904 1012 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208542 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 2624 1012 130 6 0 1094 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 19196

[startup+3.10032 s]
/proc/loadavg: 4.02 3.98 3.79 5/194 13268
/proc/meminfo: memFree=15579164/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=11692 CPUtime=3.08 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 1399 0 0 0 308 0 0 0 25 0 1 0 466169786 11972608 1310 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208516 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 2923 1310 130 6 0 1393 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 20392

[startup+6.30076 s]
/proc/loadavg: 4.02 3.98 3.79 5/194 13268
/proc/meminfo: memFree=15577544/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=12808 CPUtime=6.28 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 1679 0 0 0 628 0 0 0 25 0 1 0 466169786 13115392 1590 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208579 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 3202 1590 131 6 0 1672 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 21508

[startup+12.7007 s]
/proc/loadavg: 4.02 3.98 3.80 5/194 13268
/proc/meminfo: memFree=15575548/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=14760 CPUtime=12.67 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 2178 0 0 0 1267 0 0 0 25 0 1 0 466169786 15114240 2082 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 3690 2082 131 6 0 2160 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 23460

[startup+25.5004 s]
/proc/loadavg: 4.01 3.98 3.80 5/194 13268
/proc/meminfo: memFree=15572784/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=16836 CPUtime=25.47 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 2749 0 0 0 2547 0 0 0 25 0 1 0 466169786 17240064 2618 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 4209 2618 131 6 0 2679 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 25536

[startup+51.1008 s]
/proc/loadavg: 4.01 3.98 3.80 5/194 13269
/proc/meminfo: memFree=15567040/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=20696 CPUtime=51.07 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 3875 0 0 0 5107 0 0 0 25 0 1 0 466169786 21192704 3575 33554432000 4194304 4218580 140735442531264 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 5174 3575 131 6 0 3644 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 29396

[startup+102.307 s]
/proc/loadavg: 4.00 3.98 3.81 5/194 13270
/proc/meminfo: memFree=15558596/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=26160 CPUtime=102.28 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 5614 0 0 0 10227 1 0 0 25 0 1 0 466169786 26787840 4932 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208458 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 6540 4932 131 6 0 5010 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 34860

[startup+162.301 s]
/proc/loadavg: 4.00 3.98 3.82 5/194 13275
/proc/meminfo: memFree=15549484/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=29896 CPUtime=162.28 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 7184 0 0 0 16226 2 0 0 25 0 1 0 466169786 30613504 5886 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208458 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 7474 5886 131 6 0 5944 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 38596

[startup+222.3 s]
/proc/loadavg: 4.00 3.98 3.83 5/194 13277
/proc/meminfo: memFree=15543480/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=32408 CPUtime=222.28 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 8335 0 0 0 22226 2 0 0 25 0 1 0 466169786 33185792 6495 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208516 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 8102 6495 131 6 0 6572 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 41108

[startup+282.301 s]
/proc/loadavg: 4.07 3.99 3.84 5/194 13278
/proc/meminfo: memFree=15537636/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=36408 CPUtime=282.28 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 9791 0 0 0 28225 3 0 0 25 0 1 0 466169786 37281792 7494 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 9102 7494 131 6 0 7572 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 45108

[startup+342.301 s]
/proc/loadavg: 4.02 3.99 3.84 5/194 13280
/proc/meminfo: memFree=15530420/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=37884 CPUtime=342.28 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 10754 0 0 0 34225 3 0 0 25 0 1 0 466169786 38793216 7874 33554432000 4194304 4218580 140735442531264 18446744073709551615 4209445 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 9471 7874 131 6 0 7941 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 46584

[startup+402.301 s]
/proc/loadavg: 4.01 3.99 3.85 5/194 13281
/proc/meminfo: memFree=15521836/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6

################
# More data... #
################

[pid=13268] ppid=13265 vsize=42120 CPUtime=522.29 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 13484 0 0 0 52225 4 0 0 25 0 1 0 466169786 43130880 8916 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 10530 8916 131 6 0 9000 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 50820

[startup+582.301 s]
/proc/loadavg: 4.01 4.01 3.88 5/194 13286
/proc/meminfo: memFree=15508752/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=42528 CPUtime=582.29 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 14203 0 0 0 58225 4 0 0 25 0 1 0 466169786 43548672 9014 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 10632 9014 131 6 0 9102 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 51228

[startup+642.3 s]
/proc/loadavg: 4.00 4.01 3.88 5/194 13288
/proc/meminfo: memFree=15506372/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=44420 CPUtime=642.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 15224 0 0 0 64225 5 0 0 25 0 1 0 466169786 45486080 9504 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208426 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 11105 9504 131 6 0 9575 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 53120

[startup+702.301 s]
/proc/loadavg: 4.00 4.00 3.89 5/194 13289
/proc/meminfo: memFree=15500148/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=46616 CPUtime=702.29 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 16205 0 0 0 70224 5 0 0 25 0 1 0 466169786 47734784 10066 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208467 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 11654 10066 131 6 0 10124 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 55316

[startup+762.307 s]
/proc/loadavg: 4.00 4.00 3.90 5/194 13291
/proc/meminfo: memFree=15496528/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=48960 CPUtime=762.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 17218 0 0 0 76224 6 0 0 25 0 1 0 466169786 50135040 10623 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 12240 10623 131 6 0 10710 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 57660

[startup+822.3 s]
/proc/loadavg: 4.00 4.00 3.90 5/194 13293
/proc/meminfo: memFree=15495144/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=49280 CPUtime=822.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 17953 0 0 0 82223 7 0 0 25 0 1 0 466169786 50462720 10709 33554432000 4194304 4218580 140735442531264 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 12320 10709 131 6 0 10790 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 57980

[startup+882.301 s]
/proc/loadavg: 4.04 4.01 3.91 5/194 13294
/proc/meminfo: memFree=15492516/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=49620 CPUtime=882.29 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 18638 0 0 0 88222 7 0 0 25 0 1 0 466169786 50810880 10790 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208519 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 12405 10790 131 6 0 10875 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 58320

[startup+942.301 s]
/proc/loadavg: 3.55 3.91 3.88 2/173 13351
/proc/meminfo: memFree=15646380/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=50712 CPUtime=942.29 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 19432 0 0 0 94222 7 0 0 25 0 1 0 466169786 51929088 11059 33554432000 4194304 4218580 140735442531264 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 12678 11059 131 6 0 11148 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 59412

[startup+1002.3 s]
/proc/loadavg: 1.93 3.38 3.69 2/173 13352
/proc/meminfo: memFree=15646136/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=51840 CPUtime=1002.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 20386 0 0 0 100222 8 0 0 25 0 1 0 466169786 53084160 11337 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 12960 11337 131 6 0 11430 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 60540

[startup+1062.3 s]
/proc/loadavg: 1.34 2.94 3.52 2/173 13354
/proc/meminfo: memFree=15645224/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=52584 CPUtime=1062.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 21256 0 0 0 106222 8 0 0 25 0 1 0 466169786 53846016 11532 33554432000 4194304 4218580 140735442531264 18446744073709551615 4211265 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 13146 11532 131 6 0 11616 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 61284

[startup+1122.3 s]
/proc/loadavg: 1.12 2.59 3.36 2/173 13356
/proc/meminfo: memFree=15644576/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=53544 CPUtime=1122.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 22123 0 0 0 112222 8 0 0 25 0 1 0 466169786 54829056 11768 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208579 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 13386 11768 131 6 0 11856 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 62244

[startup+1182.3 s]
/proc/loadavg: 1.04 2.29 3.21 2/173 13357
/proc/meminfo: memFree=15643780/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=54368 CPUtime=1182.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 23036 0 0 0 118222 8 0 0 25 0 1 0 466169786 55672832 11974 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208512 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 13592 11974 131 6 0 12062 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 63068

[startup+1242.3 s]
/proc/loadavg: 1.01 2.06 3.07 2/173 13359
/proc/meminfo: memFree=15643488/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=54608 CPUtime=1242.3 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 23820 0 0 0 124222 8 0 0 25 0 1 0 466169786 55918592 12028 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 13652 12028 131 6 0 12122 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 63308



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 1.00 1.86 2.94 2/173 13360
/proc/meminfo: memFree=15643196/32950928 swapFree=67111528/67111528
[pid=13265] ppid=13263 vsize=8700 CPUtime=0.01 cores=4,6
/proc/13265/stat : 13265 (esg_static.sh) S 13263 13265 12177 0 -1 4202496 355 414 0 0 0 0 1 0 25 0 1 0 466169784 8908800 253 33554432000 4194304 4922060 140735742857856 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/13265/statm: 2175 253 209 178 0 68 0
[pid=13268] ppid=13265 vsize=55148 CPUtime=1300.01 cores=4,6
/proc/13268/stat : 13268 (cdcl) R 13265 13265 12177 0 -1 4202496 24643 0 0 0 129992 9 0 0 25 0 1 0 466169786 56471552 12167 33554432000 4194304 4218580 140735442531264 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/13268/statm: 13787 12167 131 6 0 12257 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 63848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.01
CPU time (s): 1300.05
CPU user time (s): 1299.95
CPU system time (s): 0.096985
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 63848

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.95
system time used= 0.096985
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25424
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 31
involuntary context switches= 829

runsolver used 2.02869 second user time and 4.74328 second system time

The end

Launcher Data

Begin job on node122 at 2011-04-23 10:01:50
IDJOB=3250816
IDBENCH=83365
IDSOLVER=1609
FILE ID=node122/3250816-1303545710
RUNJOBID= node122-1303545341-13169
PBS_JOBID= 13143116
Free space on /tmp= 70904 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250816-1303545710/watcher-3250816-1303545710 -o /tmp/evaluation-result-3250816-1303545710/solver-3250816-1303545710 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3250816-1303545710.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= b61e426b264831836f140414cdcf3e23
RANDOM SEED=1309621890

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15585160 kB
Buffers:       1773472 kB
Cached:       14874832 kB
SwapCached:          0 kB
Active:        5387508 kB
Inactive:     11426324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15585160 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1220 kB
Writeback:           0 kB
AnonPages:      165196 kB
Mapped:          15364 kB
Slab:           486644 kB
PageTables:       5772 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   352720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 70908 MiB
End job on node122 at 2011-04-23 10:23:32