Trace number 3754720

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver 1.0 (fixed)? (TO) 1800.09 1800.42

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/
normalized-elf.rf9.ucl--soft-33-100-0.wbo
MD5SUM77b6d97d3956f909997161d03ad8f07d
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark4.64629
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables20445
Total number of constraints58444
Number of soft constraints38856
Number of constraints which are clauses56420
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2024
Minimum length of a constraint1
Maximum length of a constraint13
Top cost 1963811
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 1963810
Biggest number in a constraint 65
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 254
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.60	c run usual solver
3.18/3.24	o 281
3.18/3.24	c current bound: 140
3.18/3.24	c fallback to adder encoding
1800.09/1800.41	c error: unexpected solver exit code
1800.09/1800.41	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3754720-1339183373/watcher-3754720-1339183373 -o /tmp/evaluation-result-3754720-1339183373/solver-3754720-1339183373 -C 1800 -W 1900 -M 15500 HOME/npSolver-wbo.sh HOME/instance-3754720-1339183373.wbo 911807006 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/173 401
/proc/meminfo: memFree=31515336/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0

[startup+0.068135 s]
/proc/loadavg: 2.00 2.00 2.00 3/173 401
/proc/meminfo: memFree=31515336/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100329 s]
/proc/loadavg: 2.00 2.00 2.00 3/173 401
/proc/meminfo: memFree=31515336/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300264 s]
/proc/loadavg: 2.00 2.00 2.00 3/173 401
/proc/meminfo: memFree=31515336/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700193 s]
/proc/loadavg: 2.00 2.00 2.00 3/173 401
/proc/meminfo: memFree=31515336/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50034 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 416
/proc/meminfo: memFree=31287312/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=36740 CPUtime=0.72 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 8920 0 0 0 61 11 0 0 20 0 1 0 384465873 37621760 8439 33554432000 4194304 6006132 140733740557840 140733740550944 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 9185 8439 158 443 0 8738 0
[pid=415] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/415/stat : 415 (cp2_pre.sh) S 402 401 31464 0 -1 4202496 608 0 0 0 0 0 0 0 20 0 1 0 384465946 9367552 276 33554432000 4194304 5064252 140734776328640 140734776327344 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/415/statm: 2287 276 234 213 0 72 0
[pid=416] ppid=415 vsize=69760 CPUtime=0.75 cores=1,3,5,7
/proc/416/stat : 416 (coprocessor) R 415 401 31464 0 -1 4202496 12834 0 0 0 73 2 0 0 20 0 1 0 384465946 71434240 16858 33554432000 4194304 6586260 140734022073728 140734022069720 5599305 0 0 4096 8404994 0 0 0 17 5 0 0 0 0 0
/proc/416/statm: 17440 16858 192 584 0 16852 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 124796

[startup+3.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 416
/proc/meminfo: memFree=31276396/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=36740 CPUtime=3.08 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) R 401 401 31464 0 -1 4202496 9732 24089 0 0 62 14 223 9 20 0 1 0 384465873 37621760 8442 33554432000 4194304 6006132 140733740557840 140733740551520 5192048 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/402/statm: 9185 8442 161 443 0 8738 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 45888

[startup+6.30032 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 429
/proc/meminfo: memFree=31075676/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=346164 CPUtime=6.28 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) R 401 401 31464 0 -1 4202496 21529 24605 0 0 360 35 223 10 20 0 1 0 384465873 354471936 73805 33554432000 4194304 6006132 140733740557840 140733740550200 4580462 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/402/statm: 86541 73805 179 443 0 86094 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 355312

[startup+12.7004 s]
/proc/loadavg: 2.08 2.02 2.01 3/180 437
/proc/meminfo: memFree=29797884/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=588992 CPUtime=5.69 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 94359 0 0 0 537 32 0 0 20 0 1 0 384466572 603127808 136440 33554432000 4194304 5208918 140733285867648 140733285865320 4228997 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 147248 136440 103 248 0 146997 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 913396

[startup+25.5005 s]
/proc/loadavg: 2.14 2.03 2.01 3/183 440
/proc/meminfo: memFree=27368836/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=588992 CPUtime=18.49 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 94359 0 0 0 1817 32 0 0 20 0 1 0 384466572 603127808 136440 33554432000 4194304 5208918 140733285867648 140733285865320 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 147248 136440 103 248 0 146997 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 913396

[startup+51.1005 s]
/proc/loadavg: 2.21 2.06 2.02 3/183 440
/proc/meminfo: memFree=26453016/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=588992 CPUtime=44.08 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 94359 0 0 0 4376 32 0 0 20 0 1 0 384466572 603127808 136440 33554432000 4194304 5208918 140733285867648 140733285865320 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 147248 136440 103 248 0 146997 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 913396

[startup+102.301 s]
/proc/loadavg: 2.09 2.05 2.01 3/183 440
/proc/meminfo: memFree=26453884/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=589124 CPUtime=95.28 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 94372 0 0 0 9496 32 0 0 20 0 1 0 384466572 603262976 136453 33554432000 4194304 5208918 140733285867648 140733285865496 4211553 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 147281 136453 103 248 0 147030 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 913528

[startup+162.3 s]
/proc/loadavg: 2.03 2.04 2.01 3/183 440
/proc/meminfo: memFree=26453636/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=589124 CPUtime=155.27 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 94390 0 0 0 15495 32 0 0 20 0 1 0 384466572 603262976 136471 33554432000 4194304 5208918 140733285867648 140733285865496 4211553 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 147281 136471 103 248 0 147030 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 913528

[startup+222.307 s]
/proc/loadavg: 2.09 2.04 2.01 3/183 440
/proc/meminfo: memFree=26453636/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 94978 0 0 0 141473 33 0 0 20 0 1 0 384466572 605757440 138185 33554432000 4194304 5208918 140733285867648 140733285865544 4205261 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 147890 138185 104 248 0 147639 0
Current children cumulated CPU time (s) 1422.04
Current children cumulated vsize (KiB) 915964

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 451
/proc/meminfo: memFree=26446000/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=592356 CPUtime=1475.05 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95182 0 0 0 147472 33 0 0 20 0 1 0 384466572 606572544 138389 33554432000 4194304 5208918 140733285867648 140733285865400 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148089 138389 104 248 0 147838 0
Current children cumulated CPU time (s) 1482.03
Current children cumulated vsize (KiB) 916760

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 452
/proc/meminfo: memFree=26445656/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=593016 CPUtime=1535.04 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95348 0 0 0 153471 33 0 0 20 0 1 0 384466572 607248384 138555 33554432000 4194304 5208918 140733285867648 140733285865544 4229039 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148254 138555 104 248 0 148003 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 917420

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 452
/proc/meminfo: memFree=26444940/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=593280 CPUtime=1595.02 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95446 0 0 0 159469 33 0 0 20 0 1 0 384466572 607518720 138653 33554432000 4194304 5208918 140733285867648 140733285865496 4232808 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148320 138653 104 248 0 148069 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 917684

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 455
/proc/meminfo: memFree=26444836/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=593676 CPUtime=1655.02 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95527 0 0 0 165468 34 0 0 20 0 1 0 384466572 607924224 138734 33554432000 4194304 5208918 140733285867648 140733285865496 4205631 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148419 138734 104 248 0 148168 0
Current children cumulated CPU time (s) 1662
Current children cumulated vsize (KiB) 918080

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 455
/proc/meminfo: memFree=26444144/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=593808 CPUtime=1715.01 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95550 0 0 0 171467 34 0 0 20 0 1 0 384466572 608059392 138757 33554432000 4194304 5208918 140733285867648 140733285865496 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148452 138757 104 248 0 148201 0
Current children cumulated CPU time (s) 1721.99
Current children cumulated vsize (KiB) 918212

[startup+1782.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/183 455
/proc/meminfo: memFree=26442772/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=595056 CPUtime=1775 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95808 0 0 0 177466 34 0 0 20 0 1 0 384466572 609337344 139015 33554432000 4194304 5208918 140733285867648 140733285865608 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148764 139015 104 248 0 148513 0
Current children cumulated CPU time (s) 1781.98
Current children cumulated vsize (KiB) 919460



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.02 2.01 2.00 3/183 455
/proc/meminfo: memFree=26440724/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=595056 CPUtime=1793.11 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95811 0 0 0 179277 34 0 0 20 0 1 0 384466572 609337344 139529 33554432000 4194304 5208918 140733285867648 140733285865608 4211176 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148764 139529 104 248 0 148513 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 919460

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.02 2.01 2.00 3/183 455
/proc/meminfo: memFree=26440724/32873844 swapFree=8656/8656
[pid=401] ppid=399 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/401/stat : 401 (npSolver-wbo.sh) S 399 401 31464 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 384465873 9367552 275 33554432000 4194304 5064252 140734070493920 140734070492832 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/401/statm: 2287 275 233 213 0 72 0
[pid=402] ppid=401 vsize=306108 CPUtime=6.98 cores=1,3,5,7
/proc/402/stat : 402 (npSolver-wbo) S 401 401 31464 0 -1 4202496 22178 24605 0 0 392 73 223 10 20 0 1 0 384465873 313454592 68424 33554432000 4194304 6006132 140733740557840 140733740549248 5187998 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/402/statm: 76527 68424 180 443 0 76080 0
[pid=436] ppid=402 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/436/stat : 436 (satsolver.sh) S 402 401 31464 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384466572 9367552 266 33554432000 4194304 5064252 140734603922176 140734603921088 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/436/statm: 2287 266 226 213 0 72 0
[pid=437] ppid=436 vsize=595056 CPUtime=1793.11 cores=1,3,5,7
/proc/437/stat : 437 (glucose) R 436 401 31464 0 -1 4202496 95811 0 0 0 179277 34 0 0 20 0 1 0 384466572 609337344 139529 33554432000 4194304 5208918 140733285867648 140733285865608 4211176 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/437/statm: 148764 139529 104 248 0 148513 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 919460

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 401 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=157063
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=840872
# CPU time returned by wait4() is 6.99794
# while last known CPU time is 1800.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.42
CPU time (s): 1800.09
CPU user time (s): 1798.92
CPU system time (s): 1.17
CPU usage (%): 99.9818
Max. virtual memory (cumulated for all children) (KiB): 1103324

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.15706
system time used= 0.840872
maximum resident set size= 505172
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 47761
page faults= 0
swaps= 0
block input operations= 0
block output operations= 485504
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 237
involuntary context switches= 27

runsolver used 3.00854 second user time and 8.46871 second system time

The end

Launcher Data 

Begin job on node102 at 2012-06-08 21:22:53
IDJOB=3754720
IDBENCH=78618
IDSOLVER=2339
FILE ID=node102/3754720-1339183373
RUNJOBID= node102-1339183373-384
PBS_JOBID= 14643844
Free space on /tmp= 71104 MiB

SOLVER NAME= npSolver 1.0
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/normalized-elf.rf9.ucl--soft-33-100-0.wbo
COMMAND LINE= DIR/npSolver-wbo.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3754720-1339183373/watcher-3754720-1339183373 -o /tmp/evaluation-result-3754720-1339183373/solver-3754720-1339183373 -C 1800 -W 1900 -M 15500  HOME/npSolver-wbo.sh HOME/instance-3754720-1339183373.wbo 911807006 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 77b6d97d3956f909997161d03ad8f07d
RANDOM SEED=911807006

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31516080 kB
Buffers:          283480 kB
Cached:           193340 kB
SwapCached:         2672 kB
Active:           438948 kB
Inactive:          46544 kB
Active(anon):       4908 kB
Inactive(anon):     6024 kB
Active(file):     434040 kB
Inactive(file):    40520 kB
Unevictable:        8656 kB
Mlocked:            8656 kB
SwapTotal:      67108856 kB
SwapFree:       67099984 kB
Dirty:             16920 kB
Writeback:             0 kB
AnonPages:         15384 kB
Mapped:             8236 kB
Shmem:                 0 kB
Slab:             733252 kB
SReclaimable:     173904 kB
SUnreclaim:       559348 kB
KernelStack:        1432 kB
PageTables:         3900 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     108816 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69928 MiB
End job on node102 at 2012-06-08 21:52:54