Trace number 3347425

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 450.455 62.4132

General information on the benchmark

Nameapplication/jarvisalo/AAAI2010-SATPlanning/
aaai10-planning-ipc5-pipesworld-27-step13.cnf
MD5SUM52e16341bcff805ef2d6abe4e95359a0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark450.455
Satisfiable
(Un)Satisfiability was proved
Number of variables224228
Number of clauses5314673
Sum of the clauses size11732345
Maximum clause length3193
Minimum clause length1
Number of clauses of size 1556
Number of clauses of size 25229536
Number of clauses of size 36084
Number of clauses of size 49856
Number of clauses of size 58159
Number of clauses of size over 560482

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
0.00/0.01	
447.77/61.67	s UNSATISFIABLE
450.41/62.41	solver [1] cryptominisat 2.7.1 answered
450.41/62.41	Done

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347425-1305158159/watcher-3347425-1305158159 -o /tmp/evaluation-result-3347425-1305158159/solver-3347425-1305158159 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347425-1305158159.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 20.50 15.83 18.81 1/413 12924
/proc/meminfo: memFree=255703180/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 20 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197619763380224 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0

[startup+0.0949821 s]
/proc/loadavg: 20.50 15.83 18.81 1/413 12924
/proc/meminfo: memFree=255703180/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 20 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197619763380224 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100975 s]
/proc/loadavg: 20.50 15.83 18.81 1/413 12924
/proc/meminfo: memFree=255703180/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 20 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197619763380224 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300989 s]
/proc/loadavg: 20.50 15.83 18.81 1/413 12924
/proc/meminfo: memFree=255703180/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 20 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197619763380224 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700987 s]
/proc/loadavg: 20.50 15.83 18.81 1/413 12924
/proc/meminfo: memFree=255703180/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 20 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197619763380224 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50099 s]
/proc/loadavg: 19.17 15.63 18.73 5/418 12935
/proc/meminfo: memFree=255334448/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 20 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197619763380224 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=225128 CPUtime=1.48 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 50230 0 0 0 136 12 0 0 20 0 1 0 627302735 230531072 49830 268435456000 4194304 4587354 140735146107872 18446744073709551615 258650616632 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12925/statm: 56282 49830 287 96 0 52844 0
[pid=12926] ppid=12924 vsize=93156 CPUtime=1.48 cores=1
/proc/12926/stat : 12926 (clasp) R 12924 12924 12559 0 -1 4202496 21954 0 0 0 139 9 0 0 20 0 1 0 627302735 95391744 20204 268435456000 4194304 4785740 140733710815408 18446744073709551615 258650955760 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12926/statm: 23289 20204 307 145 0 20334 0
[pid=12928] ppid=12924 vsize=146712 CPUtime=1.48 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4194304 31515 0 0 0 136 12 0 0 20 0 1 0 627302735 150233088 31411 268435456000 4194304 4331988 140735701062352 18446744073709551615 258650616632 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12928/statm: 36678 31412 112 34 0 35120 0
[pid=12929] ppid=12924 vsize=146128 CPUtime=1.47 cores=4-31
/proc/12929/stat : 12929 (plingeling) R 12924 12924 12559 0 -1 4202496 35344 1247 0 0 139 8 0 0 23 0 1 0 627302735 149635072 35191 268435456000 4194304 4356188 140734327478704 18446744073709551615 4210562 0 0 4096 17442 0 0 0 17 17 0 0 0
/proc/12929/statm: 36532 35191 129 40 0 35076 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 629448

[startup+3.10105 s]
/proc/loadavg: 19.17 15.63 18.73 5/418 12935
/proc/meminfo: memFree=254949436/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 18 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197971950698496 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=379476 CPUtime=3.08 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 89653 0 0 0 285 23 0 0 25 0 1 0 627302735 388583424 89253 268435456000 4194304 4587354 140735146107872 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12925/statm: 94869 89253 304 96 0 91431 0
[pid=12926] ppid=12924 vsize=115016 CPUtime=3.09 cores=1
/proc/12926/stat : 12926 (clasp) R 12924 12924 12559 0 -1 4202496 32001 0 0 0 296 13 0 0 25 0 1 0 627302735 117776384 25817 268435456000 4194304 4785740 140733710815408 18446744073709551615 4290633 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12926/statm: 28754 25817 327 145 0 25799 0
[pid=12928] ppid=12924 vsize=235548 CPUtime=3.09 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4194304 56501 0 0 0 287 22 0 0 25 0 1 0 627302735 241201152 56397 268435456000 4194304 4331988 140735701062352 18446744073709551615 258650616632 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12928/statm: 58887 56397 112 34 0 57329 0
[pid=12929] ppid=12924 vsize=283412 CPUtime=3.08 cores=4-31
/proc/12929/stat : 12929 (plingeling) R 12924 12924 12559 0 -1 4202496 70095 1247 0 0 292 16 0 0 25 0 1 0 627302735 290213888 69512 268435456000 4194304 4356188 140734327478704 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 17 0 0 0
/proc/12929/statm: 70853 69512 129 40 0 69397 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 1031776

[startup+6.30117 s]
/proc/loadavg: 19.17 15.63 18.73 5/418 12935
/proc/meminfo: memFree=254263672/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633296 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=470988 CPUtime=6.28 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 112487 0 0 0 601 27 0 0 25 0 1 0 627302735 482291712 112086 268435456000 4194304 4587354 140735146107872 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12925/statm: 117747 112086 308 96 0 114309 0
[pid=12926] ppid=12924 vsize=118360 CPUtime=6.28 cores=1
/proc/12926/stat : 12926 (clasp) R 12924 12924 12559 0 -1 4202496 32853 0 0 0 615 13 0 0 25 0 1 0 627302735 121200640 26669 268435456000 4194304 4785740 140733710815408 18446744073709551615 258650616632 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12926/statm: 29590 26669 334 145 0 26635 0
[pid=12928] ppid=12924 vsize=549432 CPUtime=6.28 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4194304 98909 0 0 0 596 32 0 0 25 0 1 0 627302735 562618368 78812 268435456000 4194304 4331988 140735701062352 18446744073709551615 4257024 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12928/statm: 137358 78812 124 34 0 135800 0
[pid=12929] ppid=12924 vsize=587340 CPUtime=6.28 cores=4-31
/proc/12929/stat : 12929 (plingeling) R 12924 12924 12559 0 -1 4202496 146077 1247 0 0 597 31 0 0 25 0 1 0 627302735 601436160 145494 268435456000 4194304 4356188 140734327478704 18446744073709551615 4278267 0 0 4096 17442 0 0 0 17 17 0 0 0
/proc/12929/statm: 146835 145494 129 40 0 145379 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 1744444

[startup+12.7014 s]
/proc/loadavg: 16.84 15.25 18.57 5/418 12935
/proc/meminfo: memFree=253916648/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633296 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=465532 CPUtime=12.69 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 112731 0 0 0 1241 28 0 0 25 0 1 0 627302735 476704768 110578 268435456000 4194304 4587354 140735146107872 18446744073709551615 4268292 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12925/statm: 116383 110578 314 96 0 112945 0
[pid=12926] ppid=12924 vsize=124084 CPUtime=12.68 cores=1
/proc/12926/stat : 12926 (clasp) R 12924 12924 12559 0 -1 4202496 34303 0 0 0 1254 14 0 0 25 0 1 0 627302735 127062016 28119 268435456000 4194304 4785740 140733710815408 18446744073709551615 4552646 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12926/statm: 31021 28119 334 145 0 28066 0
[pid=12928] ppid=12924 vsize=529624 CPUtime=12.68 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4194304 183638 0 0 0 1217 51 0 0 25 0 1 0 627302735 542334976 79064 268435456000 4194304 4331988 140735701062352 18446744073709551615 4262064 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12928/statm: 132406 79064 127 34 0 130848 0
[pid=12929] ppid=12924 vsize=1037644 CPUtime=12.67 cores=4-31
/proc/12929/stat : 12929 (plingeling) R 12924 12924 12559 0 -1 4202496 257432 1247 0 0 1212 55 0 0 25 0 1 0 627302735 1062547456 256707 268435456000 4194304 4356188 140734327478704 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 17 0 0 0
/proc/12929/statm: 259411 256714 129 40 0 257955 0
Current children cumulated CPU time (s) 50.72
Current children cumulated vsize (KiB) 2175208

[startup+25.5008 s]
/proc/loadavg: 14.87 14.87 18.42 5/418 12935
/proc/meminfo: memFree=253116376/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633296 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=465532 CPUtime=25.48 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 113461 0 0 0 2519 29 0 0 25 0 1 0 627302735 476704768 111307 268435456000 4194304 4587354 140735146107872 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12925/statm: 116383 111307 323 96 0 112945 0
[pid=12926] ppid=12924 vsize=139748 CPUtime=25.48 cores=1
/proc/12926/stat : 12926 (clasp) R 12924 12924 12559 0 -1 4202496 38214 0 0 0 2533 15 0 0 25 0 1 0 627302735 143101952 32030 268435456000 4194304 4785740 140733710815408 18446744073709551615 4553302 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12926/statm: 34937 32030 334 145 0 31982 0
[pid=12928] ppid=12924 vsize=643516 CPUtime=25.48 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4202496 448120 0 0 0 2440 108 0 0 25 0 1 0 627302735 658960384 107557 268435456000 4194304 4331988 140735701062352 18446744073709551615 4252174 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12928/statm: 160879 107557 148 34 0 159321 0
[pid=12929] ppid=12924 vsize=1594700 CPUtime=25.47 cores=4-31
/proc/12929/stat : 12929 (plingeling) R 12924 12924 12559 0 -1 4202496 398059 1247 0 0 2462 85 0 0 25 0 1 0 627302735 1632972800 397334 268435456000 4194304 4356188 140734327478704 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 17 0 0 0
/proc/12929/statm: 398675 397334 129 40 0 397219 0
Current children cumulated CPU time (s) 101.91
Current children cumulated vsize (KiB) 2861820

[startup+51.1007 s]
/proc/loadavg: 11.16 14.00 18.03 5/418 12937
/proc/meminfo: memFree=242744704/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633296 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=465532 CPUtime=51.07 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 113461 0 0 0 5078 29 0 0 25 0 1 0 627302735 476704768 111307 268435456000 4194304 4587354 140735146107872 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12925/statm: 116383 111307 323 96 0 112945 0
[pid=12926] ppid=12924 vsize=161592 CPUtime=51.07 cores=1
/proc/12926/stat : 12926 (clasp) R 12924 12924 12559 0 -1 4202496 43659 0 0 0 5090 17 0 0 25 0 1 0 627302735 165470208 37475 268435456000 4194304 4785740 140733710815408 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12926/statm: 40398 37475 334 145 0 37443 0
[pid=12928] ppid=12924 vsize=10394700 CPUtime=51.07 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4202496 3011145 0 0 0 4561 546 0 0 25 0 1 0 627302735 10644172800 2543120 268435456000 4194304 4331988 140735701062352 18446744073709551615 4271468 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12928/statm: 2598675 2543123 151 34 0 2597117 0
[pid=12929] ppid=12924 vsize=2512204 CPUtime=51.06 cores=4-31
/proc/12929/stat : 12929 (plingeling) R 12924 12924 12559 0 -1 4202496 627435 1247 0 0 4968 138 0 0 25 0 1 0 627302735 2572496896 626710 268435456000 4194304 4356188 140734327478704 18446744073709551615 4213347 0 0 4096 17442 0 0 0 17 17 0 0 0
/proc/12929/statm: 628051 626710 129 40 0 626595 0
Current children cumulated CPU time (s) 204.27
Current children cumulated vsize (KiB) 13552352

Solver just ended. Dumping a history of the last processes samples

[startup+57.502 s]
/proc/loadavg: 12.22 14.12 18.03 15/446 12965
/proc/meminfo: memFree=237438612/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197976245633296 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=465532 CPUtime=57.47 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 113461 0 0 0 5718 29 0 0 25 0 1 0 627302735 476704768 111307 268435456000 4194304 4587354 140735146107872 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=12929/tid=12941] ppid=12924 vsize=4851308 CPUtime=6.51 cores=4-31
/proc/12929/task/12941/stat : 12941 (plingeling) R 12924 12924 12559 0 -1 4202560 38161 1247 0 0 495 156 0 0 19 0 29 0 627307958 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=12929/tid=12942] ppid=12924 vsize=4851308 CPUtime=7.2 cores=4-31
/proc/12929/task/12942/stat : 12942 (plingeling) R 12924 12924 12559 0 -1 4202560 36609 1247 0 0 617 103 0 0 19 0 29 0 627307958 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=12929/tid=12943] ppid=12924 vsize=4851308 CPUtime=6.68 cores=4-31
/proc/12929/task/12943/stat : 12943 (plingeling) R 12924 12924 12559 0 -1 4202560 41892 1247 0 0 517 151 0 0 18 0 29 0 627307958 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4262787 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12929/tid=12944] ppid=12924 vsize=4851308 CPUtime=6.37 cores=4-31
/proc/12929/task/12944/stat : 12944 (plingeling) R 12924 12924 12559 0 -1 4202560 39679 1247 0 0 500 137 0 0 19 0 29 0 627307958 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4259320 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=12929/tid=12945] ppid=12924 vsize=4851308 CPUtime=6.67 cores=4-31
/proc/12929/task/12945/stat : 12945 (plingeling) R 12924 12924 12559 0 -1 4202560 40884 1247 0 0 515 152 0 0 18 0 29 0 627307959 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=12929/tid=12946] ppid=12924 vsize=4851308 CPUtime=6.51 cores=4-31
/proc/12929/task/12946/stat : 12946 (plingeling) R 12924 12924 12559 0 -1 4202560 39229 1247 0 0 499 152 0 0 18 0 29 0 627307959 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4267675 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=12929/tid=12947] ppid=12924 vsize=4851308 CPUtime=6.55 cores=4-31
/proc/12929/task/12947/stat : 12947 (plingeling) R 12924 12924 12559 0 -1 4202560 40529 1247 0 0 497 158 0 0 19 0 29 0 627307959 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260315 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12929/tid=12948] ppid=12924 vsize=4851308 CPUtime=6.62 cores=4-31
/proc/12929/task/12948/stat : 12948 (plingeling) R 12924 12924 12559 0 -1 4202560 37885 1247 0 0 506 156 0 0 20 0 29 0 627307959 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4245558 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=12929/tid=12949] ppid=12924 vsize=4851308 CPUtime=6.92 cores=4-31
/proc/12929/task/12949/stat : 12949 (plingeling) R 12924 12924 12559 0 -1 4202560 37430 1247 0 0 542 150 0 0 21 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4245442 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=12929/tid=12950] ppid=12924 vsize=4851308 CPUtime=6.44 cores=4-31
/proc/12929/task/12950/stat : 12950 (plingeling) R 12924 12924 12559 0 -1 4202560 36660 1247 0 0 498 146 0 0 18 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4262952 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=12929/tid=12951] ppid=12924 vsize=4851308 CPUtime=6.98 cores=4-31
/proc/12929/task/12951/stat : 12951 (plingeling) R 12924 12924 12559 0 -1 4202560 36183 1247 0 0 549 149 0 0 20 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4262830 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=12929/tid=12952] ppid=12924 vsize=4851308 CPUtime=6.58 cores=4-31
/proc/12929/task/12952/stat : 12952 (plingeling) R 12924 12924 12559 0 -1 4202560 37246 1247 0 0 509 149 0 0 18 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260273 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=12929/tid=12953] ppid=12924 vsize=4851308 CPUtime=6.6 cores=4-31
/proc/12929/task/12953/stat : 12953 (plingeling) R 12924 12924 12559 0 -1 4202560 40843 1247 0 0 502 158 0 0 18 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260341 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=12929/tid=12954] ppid=12924 vsize=4851308 CPUtime=6.58 cores=4-31
/proc/12929/task/12954/stat : 12954 (plingeling) R 12924 12924 12559 0 -1 4202560 38694 1247 0 0 503 155 0 0 20 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=12929/tid=12955] ppid=12924 vsize=4851308 CPUtime=6.42 cores=4-31
/proc/12929/task/12955/stat : 12955 (plingeling) R 12924 12924 12559 0 -1 4202560 36914 1247 0 0 505 137 0 0 18 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4259314 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=12929/tid=12956] ppid=12924 vsize=4851308 CPUtime=6.67 cores=4-31
/proc/12929/task/12956/stat : 12956 (plingeling) R 12924 12924 12559 0 -1 4202560 38050 1247 0 0 508 159 0 0 19 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260315 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12929/tid=12957] ppid=12924 vsize=4851308 CPUtime=6.41 cores=4-31
/proc/12929/task/12957/stat : 12957 (plingeling) R 12924 12924 12559 0 -1 4202560 36549 1247 0 0 507 134 0 0 19 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4259314 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=12929/tid=12958] ppid=12924 vsize=4851308 CPUtime=6.47 cores=4-31
/proc/12929/task/12958/stat : 12958 (plingeling) R 12924 12924 12559 0 -1 4202560 37659 1247 0 0 511 136 0 0 19 0 29 0 627307960 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4210605 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=12929/tid=12959] ppid=12924 vsize=4851308 CPUtime=6.55 cores=4-31
/proc/12929/task/12959/stat : 12959 (plingeling) R 12924 12924 12559 0 -1 4202560 37704 1247 0 0 505 150 0 0 19 0 29 0 627307961 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=12929/tid=12960] ppid=12924 vsize=4851308 CPUtime=7.19 cores=4-31
/proc/12929/task/12960/stat : 12960 (plingeling) R 12924 12924 12559 0 -1 4202560 40062 1247 0 0 588 131 0 0 19 0 29 0 627307961 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4258285 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=12929/tid=12961] ppid=12924 vsize=4851308 CPUtime=6.97 cores=4-31
/proc/12929/task/12961/stat : 12961 (plingeling) R 12924 12924 12559 0 -1 4202560 37158 1247 0 0 557 140 0 0 22 0 29 0 627307961 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260224 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=12929/tid=12962] ppid=12924 vsize=4851308 CPUtime=6.09 cores=4-31
/proc/12929/task/12962/stat : 12962 (plingeling) R 12924 12924 12559 0 -1 4202560 37639 1247 0 0 453 156 0 0 19 0 29 0 627307961 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260341 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=12929/tid=12963] ppid=12924 vsize=4851308 CPUtime=6.59 cores=4-31
/proc/12929/task/12963/stat : 12963 (plingeling) R 12924 12924 12559 0 -1 4202560 41417 1247 0 0 497 162 0 0 19 0 29 0 627307961 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12929/tid=12964] ppid=12924 vsize=4851308 CPUtime=5.59 cores=4-31
/proc/12929/task/12964/stat : 12964 (plingeling) R 12924 12924 12559 0 -1 4202560 36797 1247 0 0 449 110 0 0 18 0 29 0 627307961 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=12929/tid=12965] ppid=12924 vsize=4851308 CPUtime=6.4 cores=4-31
/proc/12929/task/12965/stat : 12965 (plingeling) R 12924 12924 12559 0 -1 4202560 40003 1247 0 0 491 149 0 0 18 0 29 0 627307961 4967739392 1088564 268435456000 4194304 4356188 140734327478704 18446744073709551615 4267690 0 0 4096 17442 0 0 0 -1 23 0 0 0
Current children cumulated CPU time (s) 419.26
Current children cumulated vsize (KiB) 20545708

[startup+61.5021 s]
/proc/loadavg: 13.72 14.40 18.10 32/446 12965
/proc/meminfo: memFree=235473264/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=0 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 213 0 0 0 0 0 0 16 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9224197971950698496 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12925] ppid=12924 vsize=464048 CPUtime=61.49 cores=0
/proc/12925/stat : 12925 (cryptominisat) R 12924 12924 12559 0 -1 4202496 113476 0 0 0 6120 29 0 0 25 0 1 0 627302735 475185152 110992 268435456000 4194304 4587354 140735146107872 18446744073709551615 4297024 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12925/statm: 116012 110992 337 96 0 112574 0
[pid=12926] ppid=12924 vsize=166592 CPUtime=61.49 cores=1
/proc/12926/stat : 12926 (clasp) R 12924 12924 12559 0 -1 4202496 44920 0 0 0 6131 18 0 0 25 0 1 0 627302735 170590208 38736 268435456000 4194304 4785740 140733710815408 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12926/statm: 41648 38736 334 145 0 38693 0
[pid=12928] ppid=12924 vsize=15430248 CPUtime=61.49 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4202496 4270826 0 0 0 5357 792 0 0 25 0 1 0 627302735 15800573952 3802801 268435456000 4194304 4331988 140735701062352 18446744073709551615 4271468 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12928/statm: 3857562 3802805 151 34 0 3856004 0
[pid=12929] ppid=12924 vsize=4837812 CPUtime=260.18 cores=4-31
/proc/12929/stat : 12929 (plingeling) S 12924 12924 12559 0 -1 4202496 1717351 1247 0 0 21760 4258 0 0 18 0 29 0 627302735 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/12929/statm: 1209453 1092055 155 40 0 1207997 0
[pid=12929/tid=12938] ppid=12924 vsize=4837812 CPUtime=7.44 cores=4-31
/proc/12929/task/12938/stat : 12938 (plingeling) R 12924 12924 12559 0 -1 4202560 39936 1247 0 0 601 143 0 0 21 0 29 0 627307958 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4314925 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=12929/tid=12939] ppid=12924 vsize=4837812 CPUtime=7.57 cores=4-31
/proc/12929/task/12939/stat : 12939 (plingeling) R 12924 12924 12559 0 -1 4202560 40141 1247 0 0 614 143 0 0 20 0 29 0 627307958 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4315078 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=12929/tid=12940] ppid=12924 vsize=4837812 CPUtime=7.63 cores=4-31
/proc/12929/task/12940/stat : 12940 (plingeling) R 12924 12924 12559 0 -1 4202560 37571 1247 0 0 583 180 0 0 23 0 29 0 627307958 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4315078 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=12929/tid=12941] ppid=12924 vsize=4837812 CPUtime=7.33 cores=4-31
/proc/12929/task/12941/stat : 12941 (plingeling) R 12924 12924 12559 0 -1 4202560 38161 1247 0 0 577 156 0 0 21 0 29 0 627307958 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4297540 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=12929/tid=12942] ppid=12924 vsize=4837812 CPUtime=8.02 cores=4-31
/proc/12929/task/12942/stat : 12942 (plingeling) R 12924 12924 12559 0 -1 4202560 36610 1247 0 0 699 103 0 0 21 0 29 0 627307958 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4286818 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=12929/tid=12943] ppid=12924 vsize=4837812 CPUtime=7.5 cores=4-31
/proc/12929/task/12943/stat : 12943 (plingeling) R 12924 12924 12559 0 -1 4202560 41892 1247 0 0 599 151 0 0 20 0 29 0 627307958 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4315945 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12929/tid=12944] ppid=12924 vsize=4837812 CPUtime=7.19 cores=4-31
/proc/12929/task/12944/stat : 12944 (plingeling) R 12924 12924 12559 0 -1 4202560 40427 1247 0 0 582 137 0 0 21 0 29 0 627307958 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4314867 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=12929/tid=12945] ppid=12924 vsize=4837812 CPUtime=7.49 cores=4-31
/proc/12929/task/12945/stat : 12945 (plingeling) R 12924 12924 12559 0 -1 4202560 40884 1247 0 0 597 152 0 0 19 0 29 0 627307959 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4315681 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=12929/tid=12946] ppid=12924 vsize=4837812 CPUtime=7.33 cores=4-31
/proc/12929/task/12946/stat : 12946 (plingeling) R 12924 12924 12559 0 -1 4202560 40231 1247 0 0 581 152 0 0 19 0 29 0 627307959 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4315082 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=12929/tid=12947] ppid=12924 vsize=4837812 CPUtime=7.37 cores=4-31
/proc/12929/task/12947/stat : 12947 (plingeling) R 12924 12924 12559 0 -1 4202560 40529 1247 0 0 579 158 0 0 21 0 29 0 627307959 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12929/tid=12948] ppid=12924 vsize=4837812 CPUtime=7.45 cores=4-31
/proc/12929/task/12948/stat : 12948 (plingeling) R 12924 12924 12559 0 -1 4202560 40387 1247 0 0 588 157 0 0 23 0 29 0 627307959 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4315093 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=12929/tid=12949] ppid=12924 vsize=4837812 CPUtime=7.74 cores=4-31
/proc/12929/task/12949/stat : 12949 (plingeling) R 12924 12924 12559 0 -1 4202560 37561 1247 0 0 624 150 0 0 23 0 29 0 627307960 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=12929/tid=12950] ppid=12924 vsize=4837812 CPUtime=7.26 cores=4-31
/proc/12929/task/12950/stat : 12950 (plingeling) R 12924 12924 12559 0 -1 4202560 36660 1247 0 0 580 146 0 0 19 0 29 0 627307960 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4250782 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=12929/tid=12951] ppid=12924 vsize=4837812 CPUtime=7.81 cores=4-31
/proc/12929/task/12951/stat : 12951 (plingeling) R 12924 12924 12559 0 -1 4202560 36183 1247 0 0 631 150 0 0 23 0 29 0 627307960 4953919488 1092055 268435456000 4194304 4356188 140734327478704 18446744073709551615 4315889 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=12929/tid=12952] ppid=12924 vsize=4838836 CPUtime=7.41 cores=4-31
/proc/12929/task/12952/stat : 12952 (plingeling) R 12924 12924 12559 0 -1 4202560 37246 1247 0 0 592 149 0 0 20 0 29 0 627307960 4954968064 1092061 268435456000 4194304 4356188 140734327478704 18446744073709551615 4316016 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=12929/tid=12953] ppid=12924 vsize=4838836 CPUtime=7.42 cores=4-31
/proc/12929/task/12953/stat : 12953 (plingeling) R 12924 12924 12559 0 -1 4202560 41589 1247 0 0 584 158 0 0 19 0 29 0 627307960 4954968064 1092073 268435456000 4194304 4356188 140734327478704 18446744073709551615 4261946 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=12929/tid=12954] ppid=12924 vsize=4838836 CPUtime=7.4 cores=4-31
/proc/12929/task/12954/stat : 12954 (plingeling) R 12924 12924 12559 0 -1 4202560 38694 1247 0 0 585 155 0 0 22 0 29 0 627307960 4954968064 1092082 268435456000 4194304 4356188 140734327478704 18446744073709551615 4261940 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=12929/tid=12955] ppid=12924 vsize=4838836 CPUtime=7.24 cores=4-31
/proc/12929/task/12955/stat : 12955 (plingeling) S 12924 12924 12559 0 -1 4202560 39899 1247 0 0 587 137 0 0 19 0 29 0 627307960 4954968064 1092088 268435456000 4194304 4356188 140734327478704 18446744073709551615 258651060958 0 0 4096 17442 18446744071566929944 0 0 -1 10 0 0 0
[pid=12929/tid=12956] ppid=12924 vsize=4838836 CPUtime=7.49 cores=4-31
/proc/12929/task/12956/stat : 12956 (plingeling) R 12924 12924 12559 0 -1 4202560 38050 1247 0 0 590 159 0 0 20 0 29 0 627307960 4954968064 1092096 268435456000 4194304 4356188 140734327478704 18446744073709551615 4212994 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12929/tid=12957] ppid=12924 vsize=4838836 CPUtime=7.23 cores=4-31
/proc/12929/task/12957/stat : 12957 (plingeling) R 12924 12924 12559 0 -1 4202560 36549 1247 0 0 589 134 0 0 21 0 29 0 627307960 4954968064 1092103 268435456000 4194304 4356188 140734327478704 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=12929/tid=12958] ppid=12924 vsize=4838836 CPUtime=7.29 cores=4-31
/proc/12929/task/12958/stat : 12958 (plingeling) R 12924 12924 12559 0 -1 4202560 37659 1247 0 0 593 136 0 0 21 0 29 0 627307960 4954968064 1092111 268435456000 4194304 4356188 140734327478704 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=12929/tid=12959] ppid=12924 vsize=4838836 CPUtime=7.34 cores=4-31
/proc/12929/task/12959/stat : 12959 (plingeling) R 12924 12924 12559 0 -1 4202560 37704 1247 0 0 584 150 0 0 21 0 29 0 627307961 4954968064 1092117 268435456000 4194304 4356188 140734327478704 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=12929/tid=12960] ppid=12924 vsize=4838836 CPUtime=8.01 cores=4-31
/proc/12929/task/12960/stat : 12960 (plingeling) R 12924 12924 12559 0 -1 4202560 40062 1247 0 0 670 131 0 0 20 0 29 0 627307961 4954968064 1092125 268435456000 4194304 4356188 140734327478704 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=12929/tid=12961] ppid=12924 vsize=4838836 CPUtime=7.79 cores=4-31
/proc/12929/task/12961/stat : 12961 (plingeling) R 12924 12924 12559 0 -1 4202560 37158 1247 0 0 639 140 0 0 25 0 29 0 627307961 4954968064 1092132 268435456000 4194304 4356188 140734327478704 18446744073709551615 4321511 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=12929/tid=12962] ppid=12924 vsize=4838836 CPUtime=6.91 cores=4-31
/proc/12929/task/12962/stat : 12962 (plingeling) R 12924 12924 12559 0 -1 4202560 37639 1247 0 0 535 156 0 0 21 0 29 0 627307961 4954968064 1092140 268435456000 4194304 4356188 140734327478704 18446744073709551615 4261937 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=12929/tid=12963] ppid=12924 vsize=4838836 CPUtime=7.41 cores=4-31
/proc/12929/task/12963/stat : 12963 (plingeling) R 12924 12924 12559 0 -1 4202560 43656 1247 0 0 578 163 0 0 20 0 29 0 627307961 4954968064 1092147 268435456000 4194304 4356188 140734327478704 18446744073709551615 4261940 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12929/tid=12964] ppid=12924 vsize=4838836 CPUtime=6.41 cores=4-31
/proc/12929/task/12964/stat : 12964 (plingeling) R 12924 12924 12559 0 -1 4202560 36797 1247 0 0 531 110 0 0 20 0 29 0 627307961 4954968064 1092154 268435456000 4194304 4356188 140734327478704 18446744073709551615 4250576 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=12929/tid=12965] ppid=12924 vsize=4838836 CPUtime=7.22 cores=4-31
/proc/12929/task/12965/stat : 12965 (plingeling) R 12924 12924 12559 0 -1 4202560 40004 1247 0 0 573 149 0 0 19 0 29 0 627307961 4954968064 1092162 268435456000 4194304 4356188 140734327478704 18446744073709551615 4210605 0 0 4096 17442 0 0 0 -1 23 0 0 0
Current children cumulated CPU time (s) 444.65
Current children cumulated vsize (KiB) 20917024

[startup+61.9012 s]
/proc/loadavg: 13.72 14.40 18.10 32/446 12965
/proc/meminfo: memFree=235473264/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=123.31 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 158631 0 0 0 0 12278 53 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9216425601563328816 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12928] ppid=12924 vsize=0 CPUtime=61.86 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4203524 4289062 0 0 0 5368 818 0 0 25 0 1 0 627302735 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/12928/statm: 0 0 0 0 0 0 0
[pid=12929] ppid=12924 vsize=0 CPUtime=264.63 cores=4-31
/proc/12929/stat : 12929 (plingeling) Z 12924 12924 12559 0 -1 4203548 1731370 1247 0 0 22176 4287 0 0 18 0 2 0 627302735 0 0 268435456000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/12929/statm: 0 0 0 0 0 0 0
[pid=12929/tid=12948] ppid=12924 vsize=0 CPUtime=7.83 cores=4-31
/proc/12929/task/12948/stat : 12948 (plingeling) R 12924 12924 12559 0 -1 4203588 40387 1247 0 0 603 180 0 0 25 0 2 0 627307959 0 0 268435456000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 -1 17 0 0 0
Current children cumulated CPU time (s) 449.8
Current children cumulated vsize (KiB) 18324

[startup+62.3012 s]
/proc/loadavg: 13.72 14.40 18.10 32/446 12965
/proc/meminfo: memFree=235473264/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=388.05 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 1891248 0 0 0 0 34455 4350 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9192446627351101439 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12928] ppid=12924 vsize=0 CPUtime=62.26 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4203524 4289062 0 0 0 5368 858 0 0 25 0 1 0 627302735 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/12928/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 450.31
Current children cumulated vsize (KiB) 18324

[startup+62.4012 s]
/proc/loadavg: 13.72 14.40 18.10 32/446 12965
/proc/meminfo: memFree=235473264/264257624 swapFree=67111528/67111528
[pid=12924] ppid=12922 vsize=18324 CPUtime=388.05 cores=0-31
/proc/12924/stat : 12924 (ppfolio) S 12922 12924 12559 0 -1 4202496 513 1891248 0 0 0 0 34455 4350 15 0 1 0 627302734 18763776 387 268435456000 4194304 4287625 140733346822768 18446744073709551615 258650975999 0 0 4096 65536 9192446627351101439 0 0 17 12 0 0 0
/proc/12924/statm: 4581 387 338 23 0 91 0
[pid=12928] ppid=12924 vsize=0 CPUtime=62.36 cores=3
/proc/12928/stat : 12928 (march_hi) R 12924 12924 12559 0 -1 4203524 4289062 0 0 0 5368 868 0 0 25 0 1 0 627302735 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/12928/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 450.41
Current children cumulated vsize (KiB) 18324

Child status: 0
Real time (s): 62.4132
CPU time (s): 450.455
CPU user time (s): 398.248
CPU system time (s): 52.2061
CPU usage (%): 721.73
Max. virtual memory (cumulated for all children) (KiB): 21643904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 398.248
system time used= 52.2061
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6180842
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5404
involuntary context switches= 786

runsolver used 0.233964 second user time and 1.01684 second system time

The end

Launcher Data

Begin job on node200 at 2011-05-12 01:56:03
IDJOB=3347425
IDBENCH=82430
IDSOLVER=1808
FILE ID=node200/3347425-1305158159
RUNJOBID= node200-1305157881-12573
PBS_JOBID= 13282071
Free space on /tmp= 61960 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/jarvisalo/AAAI2010-SATPlanning/aaai10-planning-ipc5-pipesworld-27-step13.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347425-1305158159/watcher-3347425-1305158159 -o /tmp/evaluation-result-3347425-1305158159/solver-3347425-1305158159 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347425-1305158159.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 52e16341bcff805ef2d6abe4e95359a0
RANDOM SEED=814087008

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255703584 kB
Buffers:        423904 kB
Cached:        7726468 kB
SwapCached:          0 kB
Active:        7300792 kB
Inactive:       919112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255703584 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          103340 kB
Writeback:           0 kB
AnonPages:       69780 kB
Mapped:          14536 kB
Slab:           250960 kB
PageTables:       4428 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   190972 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61952 MiB
End job on node200 at 2011-05-12 01:57:06