Trace number 3718523

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PBPASSolver-CARD.DP 2012-05-28? (MO) 273.64 276.125

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/liu/
dbst/normalized-dbst_v40_e600_d20_mw10_9.opb.PB06.opb
MD5SUMd54403a51e1ff3d34cd210d836adfe84
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark1.42878
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables2800
Total number of constraints990001
Number of constraints which are clauses986760
Number of constraints which are cardinality constraints (but not clauses)81
Number of constraints which are nor clauses,nor cardinality constraints3160
Minimum length of a constraint2
Maximum length of a constraint1200
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 344
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 1239
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

273.64/276.12	cpython RunMakeCNF.py HOME/instance-3718523-1338269148.opb PrimePower CARD.DP ./CryptoMiniSat
273.64/276.12	s Unknown

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3718523-1338269148/watcher-3718523-1338269148 -o /tmp/evaluation-result-3718523-1338269148/solver-3718523-1338269148 -C 1800 -W 1900 -M 15500 python HOME/RunSolver.py HOME/instance-3718523-1338269148.opb PrimePower CARD.DP ./CryptoMiniSat 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 1.26 0.54 3/178 18325
/proc/meminfo: memFree=30336316/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=15276 CPUtime=0 cores=0,2,4,6
/proc/18325/stat : 18325 (python) R 18323 18325 18142 0 -1 4202496 671 0 0 0 0 0 0 0 20 0 1 0 293040800 15642624 559 33554432000 4194304 5683644 140737054344016 140737054329928 259112387472 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 3819 559 324 364 0 261 0

[startup+0.051638 s]
/proc/loadavg: 2.00 1.26 0.54 3/178 18325
/proc/meminfo: memFree=30336316/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=16472 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) R 18323 18325 18142 0 -1 4202496 1124 0 0 0 1 0 0 0 20 0 1 0 293040800 16867328 944 33554432000 4194304 5683644 140737054344016 140737054326648 259112016341 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4118 944 392 364 0 560 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16472

[startup+0.100214 s]
/proc/loadavg: 2.00 1.26 0.54 3/178 18325
/proc/meminfo: memFree=30336316/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 17000

[startup+0.300226 s]
/proc/loadavg: 2.00 1.26 0.54 3/178 18325
/proc/meminfo: memFree=30336316/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 17000

[startup+0.700228 s]
/proc/loadavg: 2.00 1.26 0.54 3/178 18325
/proc/meminfo: memFree=30336316/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 17000

[startup+1.50038 s]
/proc/loadavg: 2.00 1.26 0.54 3/183 18330
/proc/meminfo: memFree=30300104/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=61644 CPUtime=1.39 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 149498 0 0 0 78 61 0 0 20 0 1 0 293040810 63123456 8390 33554432000 4194304 4943705 140735664777168 140735664774304 4270812 0 0 16781312 17608 0 0 0 17 0 0 0 0 0 0
/proc/18330/statm: 15411 8390 329 183 0 11781 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 113680

[startup+3.10041 s]
/proc/loadavg: 2.00 1.26 0.54 3/183 18330
/proc/meminfo: memFree=30285520/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=82892 CPUtime=2.98 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 223929 0 0 0 167 131 0 0 20 0 1 0 293040810 84881408 10166 33554432000 4194304 4943705 140735664777168 140735664774304 4270812 0 0 16781312 17608 0 0 0 17 2 0 0 0 0 0
/proc/18330/statm: 20723 10166 329 183 0 17093 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 134928

[startup+6.30039 s]
/proc/loadavg: 2.00 1.27 0.54 3/183 18330
/proc/meminfo: memFree=29785304/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=1455788 CPUtime=6.19 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 385204 0 0 0 389 230 0 0 20 0 1 0 293040810 1490726912 163027 33554432000 4194304 4943705 140735664777168 140735664775440 4358535 0 0 16781312 17608 0 0 0 17 2 0 0 0 0 0
/proc/18330/statm: 363947 163027 357 183 0 360317 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 1507824

[startup+12.7004 s]
/proc/loadavg: 2.00 1.28 0.55 3/183 18330
/proc/meminfo: memFree=29056016/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=2953900 CPUtime=12.48 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 549078 0 0 0 922 326 0 0 20 0 1 0 293040810 3024793600 326900 33554432000 4194304 4943705 140735664777168 140735664776080 4267542 0 0 16781312 17608 0 0 0 17 2 0 0 10 0 0
/proc/18330/statm: 738475 326904 357 183 0 734845 0
Current children cumulated CPU time (s) 12.5
Current children cumulated vsize (KiB) 3005936

[startup+25.5012 s]
/proc/loadavg: 2.00 1.32 0.57 3/183 18330
/proc/meminfo: memFree=28256264/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=4670636 CPUtime=25.19 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 736837 0 0 0 2084 435 0 0 20 0 1 0 293040810 4782731264 514659 33554432000 4194304 4943705 140735664777168 140735664776080 4358535 0 0 16781312 17608 0 0 0 17 2 0 0 20 0 0
/proc/18330/statm: 1167659 514664 357 183 0 1164029 0
Current children cumulated CPU time (s) 25.21
Current children cumulated vsize (KiB) 4722672

[startup+51.1004 s]
/proc/loadavg: 2.00 1.37 0.61 3/185 18372
/proc/meminfo: memFree=26265376/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=6699436 CPUtime=50.59 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 958755 0 0 0 4488 571 0 0 20 0 1 0 293040810 6860222464 740897 33554432000 4194304 4943705 140735664777168 140735664776080 4361008 0 0 16781312 17608 0 0 0 17 2 0 0 32 0 0
/proc/18330/statm: 1674859 740897 357 183 0 1671229 0
Current children cumulated CPU time (s) 50.61
Current children cumulated vsize (KiB) 6751472

[startup+102.3 s]
/proc/loadavg: 2.00 1.47 0.68 3/186 18373
/proc/meminfo: memFree=22922636/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=9532588 CPUtime=101.44 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 1268634 0 0 0 9383 761 0 0 20 0 1 0 293040810 9761370112 1062293 33554432000 4194304 4943705 140735664777168 140735664776080 4361008 0 0 16781312 17608 0 0 0 17 2 0 0 57 0 0
/proc/18330/statm: 2383147 1062293 357 183 0 2379517 0
Current children cumulated CPU time (s) 101.46
Current children cumulated vsize (KiB) 9584624

[startup+162.3 s]
/proc/loadavg: 2.00 1.56 0.76 3/185 18373
/proc/meminfo: memFree=20456016/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=12054444 CPUtime=160.78 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 1544462 0 0 0 15158 920 0 0 20 0 1 0 293040810 12343750656 1351945 33554432000 4194304 4943705 140735664777168 140735664776080 4361008 0 0 16781312 17608 0 0 0 17 2 0 0 86 0 0
/proc/18330/statm: 3013611 1351945 357 183 0 3009981 0
Current children cumulated CPU time (s) 160.8
Current children cumulated vsize (KiB) 12106480

[startup+222.307 s]
/proc/loadavg: 2.00 1.64 0.84 3/185 18373
/proc/meminfo: memFree=18426860/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=14156204 CPUtime=220.17 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 1774338 0 0 0 20958 1059 0 0 20 0 1 0 293040810 14495952896 1595642 33554432000 4194304 4943705 140735664777168 140735664776080 4267542 0 0 16781312 17608 0 0 0 17 2 0 0 114 0 0
/proc/18330/statm: 3539051 1595642 357 183 0 3535421 0
Current children cumulated CPU time (s) 220.19
Current children cumulated vsize (KiB) 14208240



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+276.101 s]
/proc/loadavg: 2.08 1.71 0.91 3/186 18377
/proc/meminfo: memFree=16852420/32873648 swapFree=6852/6852
[pid=18325] ppid=18323 vsize=17000 CPUtime=0.01 cores=0,2,4,6
/proc/18325/stat : 18325 (python) S 18323 18325 18142 0 -1 4202496 1332 0 0 0 1 0 0 0 20 0 1 0 293040800 17408000 1082 33554432000 4194304 5683644 140737054344016 140737054341864 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18325/statm: 4250 1082 429 364 0 692 0
[pid=18327] ppid=18325 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18327/stat : 18327 (sh) S 18325 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040807 9367552 267 33554432000 4194304 5064252 140734030555216 140734030553920 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18327/statm: 2287 267 226 213 0 72 0
[pid=18328] ppid=18327 vsize=16740 CPUtime=0.01 cores=0,2,4,6
/proc/18328/stat : 18328 (python) S 18327 18325 18142 0 -1 4202496 1298 0 0 0 1 0 0 0 20 0 1 0 293040807 17141760 1058 33554432000 4194304 5683644 140733323769968 140733323767816 259112387968 0 0 16781312 2 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/18328/statm: 4185 1058 429 364 0 627 0
[pid=18329] ppid=18328 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/18329/stat : 18329 (sh) S 18328 18325 18142 0 -1 4202496 325 0 0 0 0 0 0 0 20 0 1 0 293040810 9367552 267 33554432000 4194304 5064252 140735180190336 140735180189040 259112199758 0 65536 16781316 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/18329/statm: 2287 267 226 213 0 72 0
[pid=18330] ppid=18329 vsize=15820972 CPUtime=273.62 cores=0,2,4,6
/proc/18330/stat : 18330 (PBPASSolver-817) R 18329 18325 18142 0 -1 4202496 1956432 0 0 0 26197 1165 0 0 20 0 1 0 293040810 16200675328 1789253 33554432000 4194304 4943705 140735664777168 140735664776080 4361008 0 0 16781312 17608 0 0 0 17 2 0 0 136 0 0
/proc/18330/statm: 3955243 1789253 357 183 0 3951613 0
Current children cumulated CPU time (s) 273.64
Current children cumulated vsize (KiB) 15873008

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18325 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=34994
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=13997
# CPU time returned by wait4() is 0.048991
# while last known CPU time is 273.64
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 276.125
CPU time (s): 273.64
CPU user time (s): 261.99
CPU system time (s): 11.65
CPU usage (%): 99.1
Max. virtual memory (cumulated for all children) (KiB): 15873008

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.034994
system time used= 0.013997
maximum resident set size= 4332
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3491
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 171
involuntary context switches= 3

runsolver used 0.526919 second user time and 1.2928 second system time

The end

Launcher Data 

Begin job on node124 at 2012-05-29 07:25:49
IDJOB=3718523
IDBENCH=1377
IDSOLVER=2302
FILE ID=node124/3718523-1338269148
RUNJOBID= node124-1338268844-18158
PBS_JOBID= 14625697
Free space on /tmp= 71384 MiB

SOLVER NAME= PBPASSolver-CARD.DP 2012-05-28
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/liu/dbst/normalized-dbst_v40_e600_d20_mw10_9.opb.PB06.opb
COMMAND LINE= python HOME/RunSolver.py BENCHNAME PrimePower CARD.DP ./CryptoMiniSat
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3718523-1338269148/watcher-3718523-1338269148 -o /tmp/evaluation-result-3718523-1338269148/solver-3718523-1338269148 -C 1800 -W 1900 -M 15500  python HOME/RunSolver.py HOME/instance-3718523-1338269148.opb PrimePower CARD.DP ./CryptoMiniSat

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d54403a51e1ff3d34cd210d836adfe84
RANDOM SEED=436391377

node124.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5357.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30336588 kB
Buffers:          434428 kB
Cached:          1078704 kB
SwapCached:         2160 kB
Active:          1257108 kB
Inactive:         414828 kB
Active(anon):     148680 kB
Inactive(anon):    12180 kB
Active(file):    1108428 kB
Inactive(file):   402648 kB
Unevictable:        6852 kB
Mlocked:            6852 kB
SwapTotal:      67108856 kB
SwapFree:       67105496 kB
Dirty:             46908 kB
Writeback:             0 kB
AnonPages:        165456 kB
Mapped:            15884 kB
Shmem:                84 kB
Slab:             725628 kB
SReclaimable:     169740 kB
SUnreclaim:       555888 kB
KernelStack:        1464 kB
PageTables:         4528 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     289156 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71336 MiB
End job on node124 at 2012-05-29 07:30:25