Trace number 3347597

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 789.23 25.8727

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E02F17.cnf
MD5SUM4f20f237857124f0eb214df627f84b82
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark195.187
Satisfiable
(Un)Satisfiability was proved
Number of variables6664
Number of clauses69700
Sum of the clauses size326536
Maximum clause length45
Minimum clause length1
Number of clauses of size 132
Number of clauses of size 217506
Number of clauses of size 312802
Number of clauses of size 46698
Number of clauses of size 59775
Number of clauses of size over 522887

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
789.23/25.83	s UNSATISFIABLE
789.23/25.87	solver [5] plingeling 276-6264d55-100731 answered
789.23/25.87	Done

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347597-1305388118/watcher-3347597-1305388118 -o /tmp/evaluation-result-3347597-1305388118/solver-3347597-1305388118 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347597-1305388118.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 27.03 30.25 31.34 1/413 30990
/proc/meminfo: memFree=255595396/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 20 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0

[startup+0.0849219 s]
/proc/loadavg: 27.03 30.25 31.34 1/413 30990
/proc/meminfo: memFree=255595396/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 20 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100913 s]
/proc/loadavg: 27.03 30.25 31.34 1/413 30990
/proc/meminfo: memFree=255595396/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 20 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300931 s]
/proc/loadavg: 27.03 30.25 31.34 1/413 30990
/proc/meminfo: memFree=255595396/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 20 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700906 s]
/proc/loadavg: 27.03 30.25 31.34 1/413 30990
/proc/meminfo: memFree=255595396/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 20 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50088 s]
/proc/loadavg: 27.03 30.25 31.34 6/419 31001
/proc/meminfo: memFree=255434312/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 20 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
[pid=30991] ppid=30990 vsize=30128 CPUtime=1.48 cores=0
/proc/30991/stat : 30991 (cryptominisat) R 30990 30990 30763 0 -1 4202496 2629 0 0 0 148 0 0 0 25 0 1 0 650298264 30851072 2458 268435456000 4194304 4587354 140735477555872 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30991/statm: 7532 2458 305 96 0 4094 0
[pid=30992] ppid=30990 vsize=24204 CPUtime=1.48 cores=1
/proc/30992/stat : 30992 (clasp) R 30990 30990 30763 0 -1 4202496 3977 0 0 0 147 1 0 0 20 0 1 0 650298264 24784896 3377 268435456000 4194304 4785740 140734044216256 18446744073709551615 258650652667 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30992/statm: 6051 3377 339 145 0 3096 0
[pid=30993] ppid=30990 vsize=458204 CPUtime=1.48 cores=2
/proc/30993/stat : 30993 (TNM) R 30990 30990 30763 0 -1 4202496 2140 0 0 0 147 1 0 0 20 0 1 0 650298264 469200896 2037 268435456000 134512640 134534564 4292633904 18446744073709551615 134524736 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30993/statm: 114551 2037 91 6 0 113216 0
[pid=30994] ppid=30990 vsize=69736 CPUtime=1.49 cores=3
/proc/30994/stat : 30994 (march_hi) R 30990 30990 30763 0 -1 4202496 23859 0 0 0 144 5 0 0 20 0 1 0 650298264 71409664 15111 268435456000 4194304 4331988 140733752816064 18446744073709551615 4271412 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30994/statm: 17434 15111 149 34 0 15876 0
[pid=30995] ppid=30990 vsize=671876 CPUtime=8.28 cores=4-31
/proc/30995/stat : 30995 (plingeling) S 30990 30990 30763 0 -1 4202496 52753 1241 0 0 817 11 0 0 21 0 29 0 650298264 688001024 45852 268435456000 4194304 4356188 140734259027856 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/30995/statm: 167969 45852 142 40 0 166513 0
Current children cumulated CPU time (s) 14.21
Current children cumulated vsize (KiB) 1272472

[startup+3.10193 s]
/proc/loadavg: 27.03 30.25 31.34 33/447 31029
/proc/meminfo: memFree=255269984/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 16 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
[pid=30991] ppid=30990 vsize=40544 CPUtime=3.08 cores=0
/proc/30991/stat : 30991 (cryptominisat) R 30990 30990 30763 0 -1 4202496 6403 0 0 0 307 1 0 0 25 0 1 0 650298264 41517056 5242 268435456000 4194304 4587354 140735477555872 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30991/statm: 10136 5242 325 96 0 6698 0
[pid=30992] ppid=30990 vsize=28568 CPUtime=3.08 cores=1
/proc/30992/stat : 30992 (clasp) R 30990 30990 30763 0 -1 4202496 5063 0 0 0 307 1 0 0 25 0 1 0 650298264 29253632 4463 268435456000 4194304 4785740 140734044216256 18446744073709551615 4546137 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30992/statm: 7142 4463 339 145 0 4187 0
[pid=30993] ppid=30990 vsize=458204 CPUtime=3.08 cores=2
/proc/30993/stat : 30993 (TNM) R 30990 30990 30763 0 -1 4202496 2140 0 0 0 307 1 0 0 25 0 1 0 650298264 469200896 2037 268435456000 134512640 134534564 4292633904 18446744073709551615 134524664 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30993/statm: 114551 2037 91 6 0 113216 0
[pid=30994] ppid=30990 vsize=168244 CPUtime=3.08 cores=3
/proc/30994/stat : 30994 (march_hi) R 30990 30990 30763 0 -1 4202496 43540 0 0 0 300 8 0 0 25 0 1 0 650298264 172281856 34792 268435456000 4194304 4331988 140733752816064 18446744073709551615 258650616632 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30994/statm: 42061 34792 149 34 0 40503 0
[pid=30995] ppid=30990 vsize=690888 CPUtime=52.42 cores=4-31
/proc/30995/stat : 30995 (plingeling) S 30990 30990 30763 0 -1 4202496 66933 1241 0 0 5216 26 0 0 21 0 29 0 650298264 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/30995/statm: 172722 51954 158 40 0 171266 0
[pid=30995/tid=31002] ppid=30990 vsize=690888 CPUtime=1.83 cores=4-31
/proc/30995/task/31002/stat : 31002 (plingeling) R 30990 30990 30763 0 -1 4202560 543 1241 0 0 183 0 0 0 19 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331170 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30995/tid=31003] ppid=30990 vsize=690888 CPUtime=1.84 cores=4-31
/proc/30995/task/31003/stat : 31003 (plingeling) R 30990 30990 30763 0 -1 4202560 546 1241 0 0 184 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4284205 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30995/tid=31004] ppid=30990 vsize=690888 CPUtime=1.85 cores=4-31
/proc/30995/task/31004/stat : 31004 (plingeling) R 30990 30990 30763 0 -1 4202560 697 1241 0 0 184 1 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4281624 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30995/tid=31005] ppid=30990 vsize=690888 CPUtime=1.79 cores=4-31
/proc/30995/task/31005/stat : 31005 (plingeling) R 30990 30990 30763 0 -1 4202560 1063 1241 0 0 179 0 0 0 24 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=30995/tid=31006] ppid=30990 vsize=690888 CPUtime=1.84 cores=4-31
/proc/30995/task/31006/stat : 31006 (plingeling) R 30990 30990 30763 0 -1 4202560 737 1241 0 0 184 0 0 0 25 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4281375 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=30995/tid=31007] ppid=30990 vsize=690888 CPUtime=1.82 cores=4-31
/proc/30995/task/31007/stat : 31007 (plingeling) R 30990 30990 30763 0 -1 4202560 672 1241 0 0 182 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4332293 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=30995/tid=31008] ppid=30990 vsize=690888 CPUtime=1.84 cores=4-31
/proc/30995/task/31008/stat : 31008 (plingeling) R 30990 30990 30763 0 -1 4202560 735 1241 0 0 184 0 0 0 19 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=30995/tid=31009] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31009/stat : 31009 (plingeling) R 30990 30990 30763 0 -1 4202560 649 1241 0 0 181 0 0 0 18 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=30995/tid=31010] ppid=30990 vsize=690888 CPUtime=1.83 cores=4-31
/proc/30995/task/31010/stat : 31010 (plingeling) R 30990 30990 30763 0 -1 4202560 580 1241 0 0 183 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4234151 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=30995/tid=31011] ppid=30990 vsize=690888 CPUtime=1.83 cores=4-31
/proc/30995/task/31011/stat : 31011 (plingeling) R 30990 30990 30763 0 -1 4202560 722 1241 0 0 182 1 0 0 19 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330827 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=30995/tid=31012] ppid=30990 vsize=690888 CPUtime=1.84 cores=4-31
/proc/30995/task/31012/stat : 31012 (plingeling) R 30990 30990 30763 0 -1 4202560 687 1241 0 0 184 0 0 0 21 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4279596 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30995/tid=31013] ppid=30990 vsize=690888 CPUtime=1.82 cores=4-31
/proc/30995/task/31013/stat : 31013 (plingeling) R 30990 30990 30763 0 -1 4202560 1236 1241 0 0 182 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=30995/tid=31014] ppid=30990 vsize=690888 CPUtime=1.84 cores=4-31
/proc/30995/task/31014/stat : 31014 (plingeling) R 30990 30990 30763 0 -1 4202560 719 1241 0 0 184 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=30995/tid=31015] ppid=30990 vsize=690888 CPUtime=1.8 cores=4-31
/proc/30995/task/31015/stat : 31015 (plingeling) R 30990 30990 30763 0 -1 4202560 537 1241 0 0 180 0 0 0 19 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4260124 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=30995/tid=31016] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31016/stat : 31016 (plingeling) R 30990 30990 30763 0 -1 4202560 740 1241 0 0 181 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=30995/tid=31017] ppid=30990 vsize=690888 CPUtime=1.83 cores=4-31
/proc/30995/task/31017/stat : 31017 (plingeling) R 30990 30990 30763 0 -1 4202560 772 1241 0 0 183 0 0 0 25 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4284134 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=30995/tid=31018] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31018/stat : 31018 (plingeling) R 30990 30990 30763 0 -1 4202560 571 1241 0 0 181 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=30995/tid=31019] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31019/stat : 31019 (plingeling) R 30990 30990 30763 0 -1 4202560 524 1241 0 0 181 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4210875 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=30995/tid=31020] ppid=30990 vsize=690888 CPUtime=1.82 cores=4-31
/proc/30995/task/31020/stat : 31020 (plingeling) R 30990 30990 30763 0 -1 4202560 568 1241 0 0 182 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331951 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=30995/tid=31021] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31021/stat : 31021 (plingeling) R 30990 30990 30763 0 -1 4202560 1013 1241 0 0 181 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331504 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=30995/tid=31022] ppid=30990 vsize=690888 CPUtime=1.83 cores=4-31
/proc/30995/task/31022/stat : 31022 (plingeling) R 30990 30990 30763 0 -1 4202560 656 1241 0 0 183 0 0 0 20 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4260290 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=30995/tid=31023] ppid=30990 vsize=690888 CPUtime=1.8 cores=4-31
/proc/30995/task/31023/stat : 31023 (plingeling) R 30990 30990 30763 0 -1 4202560 564 1241 0 0 180 0 0 0 25 0 29 0 650298388 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4210600 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=30995/tid=31024] ppid=30990 vsize=690888 CPUtime=1.8 cores=4-31
/proc/30995/task/31024/stat : 31024 (plingeling) R 30990 30990 30763 0 -1 4202560 548 1241 0 0 180 0 0 0 20 0 29 0 650298389 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4210842 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=30995/tid=31025] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31025/stat : 31025 (plingeling) R 30990 30990 30763 0 -1 4202560 602 1241 0 0 181 0 0 0 20 0 29 0 650298389 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4234300 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=30995/tid=31026] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31026/stat : 31026 (plingeling) R 30990 30990 30763 0 -1 4202560 564 1241 0 0 180 1 0 0 25 0 29 0 650298389 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331035 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=30995/tid=31027] ppid=30990 vsize=690888 CPUtime=1.8 cores=4-31
/proc/30995/task/31027/stat : 31027 (plingeling) R 30990 30990 30763 0 -1 4202560 577 1241 0 0 180 0 0 0 25 0 29 0 650298389 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330896 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=30995/tid=31028] ppid=30990 vsize=690888 CPUtime=1.81 cores=4-31
/proc/30995/task/31028/stat : 31028 (plingeling) R 30990 30990 30763 0 -1 4202560 578 1241 0 0 181 0 0 0 25 0 29 0 650298389 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330780 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=30995/tid=31029] ppid=30990 vsize=690888 CPUtime=1.8 cores=4-31
/proc/30995/task/31029/stat : 31029 (plingeling) R 30990 30990 30763 0 -1 4202560 1126 1241 0 0 180 0 0 0 25 0 29 0 650298389 707469312 51954 268435456000 4194304 4356188 140734259027856 18446744073709551615 4281760 0 0 4096 17442 0 0 0 -1 29 0 0 0
Current children cumulated CPU time (s) 64.74
Current children cumulated vsize (KiB) 1404772

[startup+6.30205 s]
/proc/loadavg: 27.43 30.28 31.34 33/447 31029
/proc/meminfo: memFree=255056368/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 16 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
[pid=30991] ppid=30990 vsize=1490428 CPUtime=6.28 cores=0
/proc/30991/stat : 30991 (cryptominisat) R 30990 30990 30763 0 -1 4202496 9690 0 0 0 626 2 0 0 25 0 1 0 650298264 1526198272 7215 268435456000 4194304 4587354 140735477555872 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30991/statm: 372607 7215 336 96 0 369169 0
[pid=30992] ppid=30990 vsize=32936 CPUtime=6.28 cores=1
/proc/30992/stat : 30992 (clasp) R 30990 30990 30763 0 -1 4202496 6169 0 0 0 626 2 0 0 25 0 1 0 650298264 33726464 5569 268435456000 4194304 4785740 140734044216256 18446744073709551615 4553088 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30992/statm: 8234 5569 339 145 0 5279 0
[pid=30993] ppid=30990 vsize=458204 CPUtime=6.28 cores=2
/proc/30993/stat : 30993 (TNM) R 30990 30990 30763 0 -1 4202496 2140 0 0 0 627 1 0 0 25 0 1 0 650298264 469200896 2037 268435456000 134512640 134534564 4292633904 18446744073709551615 134524736 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30993/statm: 114551 2037 91 6 0 113216 0
[pid=30994] ppid=30990 vsize=252736 CPUtime=6.28 cores=3
/proc/30994/stat : 30994 (march_hi) R 30990 30990 30763 0 -1 4202496 111689 0 0 0 605 23 0 0 25 0 1 0 650298264 258801664 61085 268435456000 4194304 4331988 140733752816064 18446744073709551615 258650616632 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30994/statm: 63184 61085 149 34 0 61626 0
[pid=30995] ppid=30990 vsize=717064 CPUtime=141.9 cores=4-31
/proc/30995/stat : 30995 (plingeling) S 30990 30990 30763 0 -1 4202496 85447 1241 0 0 14160 30 0 0 21 0 29 0 650298264 734273536 62211 268435456000 4194304 4356188 140734259027856 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/30995/statm: 179266 62211 158 40 0 177810 0
[pid=30995/tid=31002] ppid=30990 vsize=717064 CPUtime=5.03 cores=4-31
/proc/30995/task/31002/stat : 31002 (plingeling) R 30990 30990 30763 0 -1 4202560 1034 1241 0 0 503 0 0 0 25 0 29 0 650298388 734273536 62211 268435456000 4194304 4356188 140734259027856 18446744073709551615 4322041 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30995/tid=31003] ppid=30990 vsize=717064 CPUtime=5.04 cores=4-31
/proc/30995/task/31003/stat : 31003 (plingeling) R 30990 30990 30763 0 -1 4202560 1026 1241 0 0 504 0 0 0 25 0 29 0 650298388 734273536 62211 268435456000 4194304 4356188 140734259027856 18446744073709551615 4271303 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30995/tid=31004] ppid=30990 vsize=717064 CPUtime=5.05 cores=4-31
/proc/30995/task/31004/stat : 31004 (plingeling) R 30990 30990 30763 0 -1 4202560 1380 1241 0 0 504 1 0 0 25 0 29 0 650298388 734273536 62211 268435456000 4194304 4356188 140734259027856 18446744073709551615 4281596 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30995/tid=31005] ppid=30990 vsize=717064 CPUtime=4.9 cores=4-31
/proc/30995/task/31005/stat : 31005 (plingeling) R 30990 30990 30763 0 -1 4202560 1535 1241 0 0 490 0 0 0 25 0 29 0 650298388 734273536 62211 268435456000 4194304 4356188 140734259027856 18446744073709551615 4234212 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=30995/tid=31006] ppid=30990 vsize=717064 CPUtime=5.04 cores=4-31
/proc/30995/task/31006/stat : 31006 (plingeling) R 30990 30990 30763 0 -1 4202560 1281 1241 0 0 504 0 0 0 25 0 29 0 650298388 734273536 62211 268435456000 4194304 4356188 140734259027856 18446744073709551615 4312408 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=30995/tid=31007] ppid=30990 vsize=717064 CPUtime=5.02 cores=4-31

################
# More data... #
################

[pid=30995/tid=31008] ppid=30990 vsize=816672 CPUtime=24.22 cores=4-31
/proc/30995/task/31008/stat : 31008 (plingeling) R 30990 30990 30763 0 -1 4202560 3840 1241 0 0 2418 4 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=30995/tid=31009] ppid=30990 vsize=816672 CPUtime=24.21 cores=4-31
/proc/30995/task/31009/stat : 31009 (plingeling) R 30990 30990 30763 0 -1 4202560 7642 1241 0 0 2415 6 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331072 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=30995/tid=31010] ppid=30990 vsize=816672 CPUtime=24.23 cores=4-31
/proc/30995/task/31010/stat : 31010 (plingeling) R 30990 30990 30763 0 -1 4202560 1806 1241 0 0 2423 0 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=30995/tid=31011] ppid=30990 vsize=816672 CPUtime=24.22 cores=4-31
/proc/30995/task/31011/stat : 31011 (plingeling) R 30990 30990 30763 0 -1 4202560 3369 1241 0 0 2420 2 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4286118 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=30995/tid=31012] ppid=30990 vsize=816672 CPUtime=24.24 cores=4-31
/proc/30995/task/31012/stat : 31012 (plingeling) R 30990 30990 30763 0 -1 4202560 1897 1241 0 0 2423 1 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4237419 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30995/tid=31013] ppid=30990 vsize=816672 CPUtime=24.2 cores=4-31
/proc/30995/task/31013/stat : 31013 (plingeling) R 30990 30990 30763 0 -1 4202560 4702 1241 0 0 2419 1 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=30995/tid=31014] ppid=30990 vsize=816672 CPUtime=24.22 cores=4-31
/proc/30995/task/31014/stat : 31014 (plingeling) R 30990 30990 30763 0 -1 4202560 3132 1241 0 0 2419 3 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331366 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=30995/tid=31015] ppid=30990 vsize=816672 CPUtime=24.18 cores=4-31
/proc/30995/task/31015/stat : 31015 (plingeling) R 30990 30990 30763 0 -1 4202560 1764 1241 0 0 2418 0 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=30995/tid=31016] ppid=30990 vsize=816672 CPUtime=24.2 cores=4-31
/proc/30995/task/31016/stat : 31016 (plingeling) R 30990 30990 30763 0 -1 4202560 4481 1241 0 0 2417 3 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=30995/tid=31017] ppid=30990 vsize=816672 CPUtime=24.22 cores=4-31
/proc/30995/task/31017/stat : 31017 (plingeling) R 30990 30990 30763 0 -1 4202560 6566 1241 0 0 2418 4 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331035 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=30995/tid=31018] ppid=30990 vsize=816672 CPUtime=24.2 cores=4-31
/proc/30995/task/31018/stat : 31018 (plingeling) R 30990 30990 30763 0 -1 4202560 4716 1241 0 0 2414 6 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4234310 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=30995/tid=31019] ppid=30990 vsize=816672 CPUtime=24.21 cores=4-31
/proc/30995/task/31019/stat : 31019 (plingeling) R 30990 30990 30763 0 -1 4202560 1996 1241 0 0 2420 1 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330819 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=30995/tid=31020] ppid=30990 vsize=816672 CPUtime=24.2 cores=4-31
/proc/30995/task/31020/stat : 31020 (plingeling) R 30990 30990 30763 0 -1 4202560 1915 1241 0 0 2419 1 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4238718 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=30995/tid=31021] ppid=30990 vsize=816672 CPUtime=24.21 cores=4-31
/proc/30995/task/31021/stat : 31021 (plingeling) R 30990 30990 30763 0 -1 4202560 3381 1241 0 0 2420 1 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=30995/tid=31022] ppid=30990 vsize=816672 CPUtime=24.22 cores=4-31
/proc/30995/task/31022/stat : 31022 (plingeling) R 30990 30990 30763 0 -1 4202560 2757 1241 0 0 2420 2 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4281585 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=30995/tid=31023] ppid=30990 vsize=816672 CPUtime=24.2 cores=4-31
/proc/30995/task/31023/stat : 31023 (plingeling) R 30990 30990 30763 0 -1 4202560 2247 1241 0 0 2419 1 0 0 25 0 29 0 650298388 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331975 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=30995/tid=31024] ppid=30990 vsize=816672 CPUtime=24.2 cores=4-31
/proc/30995/task/31024/stat : 31024 (plingeling) R 30990 30990 30763 0 -1 4202560 3082 1241 0 0 2419 1 0 0 25 0 29 0 650298389 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=30995/tid=31025] ppid=30990 vsize=816672 CPUtime=24.18 cores=4-31
/proc/30995/task/31025/stat : 31025 (plingeling) R 30990 30990 30763 0 -1 4202560 7333 1241 0 0 2412 6 0 0 25 0 29 0 650298389 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4332109 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=30995/tid=31026] ppid=30990 vsize=816672 CPUtime=24.19 cores=4-31
/proc/30995/task/31026/stat : 31026 (plingeling) R 30990 30990 30763 0 -1 4202560 2994 1241 0 0 2415 4 0 0 25 0 29 0 650298389 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=30995/tid=31027] ppid=30990 vsize=816672 CPUtime=24.17 cores=4-31
/proc/30995/task/31027/stat : 31027 (plingeling) R 30990 30990 30763 0 -1 4202560 3134 1241 0 0 2414 3 0 0 25 0 29 0 650298389 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=30995/tid=31028] ppid=30990 vsize=816672 CPUtime=24.2 cores=4-31
/proc/30995/task/31028/stat : 31028 (plingeling) R 30990 30990 30763 0 -1 4202560 1586 1241 0 0 2420 0 0 0 25 0 29 0 650298389 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=30995/tid=31029] ppid=30990 vsize=816672 CPUtime=24.19 cores=4-31
/proc/30995/task/31029/stat : 31029 (plingeling) R 30990 30990 30763 0 -1 4202560 2911 1241 0 0 2417 2 0 0 25 0 29 0 650298389 836272128 90631 268435456000 4194304 4356188 140734259027856 18446744073709551615 4239989 0 0 4096 17442 0 0 0 -1 29 0 0 0
Current children cumulated CPU time (s) 780.57
Current children cumulated vsize (KiB) 3387488

Solver just ended. Dumping a history of the last processes samples

[startup+25.7017 s]
/proc/loadavg: 28.80 30.41 31.36 33/447 31031
/proc/meminfo: memFree=254734336/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 16 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
[pid=30991] ppid=30990 vsize=1518376 CPUtime=25.68 cores=0
/proc/30991/stat : 30991 (cryptominisat) R 30990 30990 30763 0 -1 4202496 17550 0 0 0 2563 5 0 0 25 0 1 0 650298264 1554817024 9053 268435456000 4194304 4587354 140735477555872 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30991/statm: 379594 9053 336 96 0 376156 0
[pid=30992] ppid=30990 vsize=44664 CPUtime=25.68 cores=1
/proc/30992/stat : 30992 (clasp) R 30990 30990 30763 0 -1 4202496 9013 0 0 0 2565 3 0 0 25 0 1 0 650298264 45735936 8413 268435456000 4194304 4785740 140734044216256 18446744073709551615 4287078 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30992/statm: 11166 8413 339 145 0 8211 0
[pid=30993] ppid=30990 vsize=458872 CPUtime=25.68 cores=2
/proc/30993/stat : 30993 (TNM) R 30990 30990 30763 0 -1 4202496 2813 0 0 0 2567 1 0 0 25 0 1 0 650298264 469884928 2710 268435456000 134512640 134534564 4292633904 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30993/statm: 114718 2710 95 6 0 113383 0
[pid=30994] ppid=30990 vsize=530580 CPUtime=25.68 cores=3
/proc/30994/stat : 30994 (march_hi) R 30990 30990 30763 0 -1 4202496 282503 0 0 0 2506 62 0 0 25 0 1 0 650298264 543313920 102104 268435456000 4194304 4331988 140733752816064 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30994/statm: 132645 102104 174 34 0 131087 0
[pid=30995] ppid=30990 vsize=816352 CPUtime=684.25 cores=4-31
/proc/30995/stat : 30995 (plingeling) S 30990 30990 30763 0 -1 4202496 140268 1241 0 0 68341 84 0 0 21 0 29 0 650298264 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/30995/statm: 204088 90551 159 40 0 202632 0
[pid=30995/tid=31002] ppid=30990 vsize=816352 CPUtime=24.41 cores=4-31
/proc/30995/task/31002/stat : 31002 (plingeling) R 30990 30990 30763 0 -1 4202560 2877 1241 0 0 2438 3 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4234306 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30995/tid=31003] ppid=30990 vsize=816352 CPUtime=24.43 cores=4-31
/proc/30995/task/31003/stat : 31003 (plingeling) R 30990 30990 30763 0 -1 4202560 3253 1241 0 0 2443 0 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30995/tid=31004] ppid=30990 vsize=816352 CPUtime=24.43 cores=4-31
/proc/30995/task/31004/stat : 31004 (plingeling) R 30990 30990 30763 0 -1 4202560 2277 1241 0 0 2442 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30995/tid=31005] ppid=30990 vsize=816352 CPUtime=23.74 cores=4-31
/proc/30995/task/31005/stat : 31005 (plingeling) R 30990 30990 30763 0 -1 4202560 3263 1241 0 0 2371 3 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=30995/tid=31006] ppid=30990 vsize=816352 CPUtime=24.44 cores=4-31
/proc/30995/task/31006/stat : 31006 (plingeling) R 30990 30990 30763 0 -1 4202560 1908 1241 0 0 2444 0 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=30995/tid=31007] ppid=30990 vsize=816352 CPUtime=24.42 cores=4-31
/proc/30995/task/31007/stat : 31007 (plingeling) R 30990 30990 30763 0 -1 4202560 2032 1241 0 0 2441 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4237203 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=30995/tid=31008] ppid=30990 vsize=816352 CPUtime=24.42 cores=4-31
/proc/30995/task/31008/stat : 31008 (plingeling) R 30990 30990 30763 0 -1 4202560 3840 1241 0 0 2438 4 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=30995/tid=31009] ppid=30990 vsize=816352 CPUtime=24.41 cores=4-31
/proc/30995/task/31009/stat : 31009 (plingeling) R 30990 30990 30763 0 -1 4202560 7642 1241 0 0 2435 6 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=30995/tid=31010] ppid=30990 vsize=816352 CPUtime=24.43 cores=4-31
/proc/30995/task/31010/stat : 31010 (plingeling) R 30990 30990 30763 0 -1 4202560 1806 1241 0 0 2443 0 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=30995/tid=31011] ppid=30990 vsize=816352 CPUtime=24.42 cores=4-31
/proc/30995/task/31011/stat : 31011 (plingeling) R 30990 30990 30763 0 -1 4202560 3369 1241 0 0 2440 2 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=30995/tid=31012] ppid=30990 vsize=816352 CPUtime=24.44 cores=4-31
/proc/30995/task/31012/stat : 31012 (plingeling) R 30990 30990 30763 0 -1 4202560 1897 1241 0 0 2443 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30995/tid=31013] ppid=30990 vsize=816352 CPUtime=24.4 cores=4-31
/proc/30995/task/31013/stat : 31013 (plingeling) R 30990 30990 30763 0 -1 4202560 4702 1241 0 0 2439 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=30995/tid=31014] ppid=30990 vsize=816352 CPUtime=24.42 cores=4-31
/proc/30995/task/31014/stat : 31014 (plingeling) R 30990 30990 30763 0 -1 4202560 3132 1241 0 0 2439 3 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4281624 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=30995/tid=31015] ppid=30990 vsize=816352 CPUtime=24.38 cores=4-31
/proc/30995/task/31015/stat : 31015 (plingeling) R 30990 30990 30763 0 -1 4202560 1764 1241 0 0 2438 0 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331106 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=30995/tid=31016] ppid=30990 vsize=816352 CPUtime=24.4 cores=4-31
/proc/30995/task/31016/stat : 31016 (plingeling) R 30990 30990 30763 0 -1 4202560 4481 1241 0 0 2437 3 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=30995/tid=31017] ppid=30990 vsize=816352 CPUtime=24.42 cores=4-31
/proc/30995/task/31017/stat : 31017 (plingeling) R 30990 30990 30763 0 -1 4202560 6566 1241 0 0 2438 4 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331345 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=30995/tid=31018] ppid=30990 vsize=816352 CPUtime=24.4 cores=4-31
/proc/30995/task/31018/stat : 31018 (plingeling) R 30990 30990 30763 0 -1 4202560 4716 1241 0 0 2434 6 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=30995/tid=31019] ppid=30990 vsize=816352 CPUtime=24.41 cores=4-31
/proc/30995/task/31019/stat : 31019 (plingeling) R 30990 30990 30763 0 -1 4202560 1996 1241 0 0 2440 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4241952 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=30995/tid=31020] ppid=30990 vsize=816352 CPUtime=24.4 cores=4-31
/proc/30995/task/31020/stat : 31020 (plingeling) R 30990 30990 30763 0 -1 4202560 1915 1241 0 0 2439 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4237251 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=30995/tid=31021] ppid=30990 vsize=816352 CPUtime=24.41 cores=4-31
/proc/30995/task/31021/stat : 31021 (plingeling) R 30990 30990 30763 0 -1 4202560 3381 1241 0 0 2440 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=30995/tid=31022] ppid=30990 vsize=816352 CPUtime=24.42 cores=4-31
/proc/30995/task/31022/stat : 31022 (plingeling) R 30990 30990 30763 0 -1 4202560 2757 1241 0 0 2440 2 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=30995/tid=31023] ppid=30990 vsize=816352 CPUtime=24.4 cores=4-31
/proc/30995/task/31023/stat : 31023 (plingeling) R 30990 30990 30763 0 -1 4202560 2247 1241 0 0 2439 1 0 0 25 0 29 0 650298388 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=30995/tid=31024] ppid=30990 vsize=816352 CPUtime=24.4 cores=4-31
/proc/30995/task/31024/stat : 31024 (plingeling) R 30990 30990 30763 0 -1 4202560 3082 1241 0 0 2439 1 0 0 25 0 29 0 650298389 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=30995/tid=31025] ppid=30990 vsize=816352 CPUtime=24.38 cores=4-31
/proc/30995/task/31025/stat : 31025 (plingeling) R 30990 30990 30763 0 -1 4202560 7333 1241 0 0 2432 6 0 0 25 0 29 0 650298389 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4279522 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=30995/tid=31026] ppid=30990 vsize=816352 CPUtime=24.39 cores=4-31
/proc/30995/task/31026/stat : 31026 (plingeling) R 30990 30990 30763 0 -1 4202560 2994 1241 0 0 2435 4 0 0 25 0 29 0 650298389 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331092 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=30995/tid=31027] ppid=30990 vsize=816352 CPUtime=24.37 cores=4-31
/proc/30995/task/31027/stat : 31027 (plingeling) R 30990 30990 30763 0 -1 4202560 3134 1241 0 0 2434 3 0 0 25 0 29 0 650298389 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331335 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=30995/tid=31028] ppid=30990 vsize=816352 CPUtime=24.4 cores=4-31
/proc/30995/task/31028/stat : 31028 (plingeling) R 30990 30990 30763 0 -1 4202560 1586 1241 0 0 2440 0 0 0 25 0 29 0 650298389 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=30995/tid=31029] ppid=30990 vsize=816352 CPUtime=24.39 cores=4-31
/proc/30995/task/31029/stat : 31029 (plingeling) R 30990 30990 30763 0 -1 4202560 2911 1241 0 0 2437 2 0 0 25 0 29 0 650298389 835944448 90551 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 29 0 0 0
Current children cumulated CPU time (s) 786.97
Current children cumulated vsize (KiB) 3387168

[startup+25.8018 s]
/proc/loadavg: 28.80 30.41 31.36 33/447 31031
/proc/meminfo: memFree=254734336/264257624 swapFree=67111528/67111528
[pid=30990] ppid=30988 vsize=18324 CPUtime=0 cores=0-31
/proc/30990/stat : 30990 (ppfolio) S 30988 30990 30763 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 650298264 18763776 386 268435456000 4194304 4287625 140736718533808 18446744073709551615 258650975999 0 0 4096 65536 9199649390585708543 0 0 17 16 0 0 0
/proc/30990/statm: 4581 386 337 23 0 91 0
[pid=30991] ppid=30990 vsize=1518376 CPUtime=25.78 cores=0
/proc/30991/stat : 30991 (cryptominisat) R 30990 30990 30763 0 -1 4202496 17580 0 0 0 2573 5 0 0 25 0 1 0 650298264 1554817024 9081 268435456000 4194304 4587354 140735477555872 18446744073709551615 4238043 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30991/statm: 379594 9081 336 96 0 376156 0
[pid=30992] ppid=30990 vsize=44664 CPUtime=25.78 cores=1
/proc/30992/stat : 30992 (clasp) R 30990 30990 30763 0 -1 4202496 9013 0 0 0 2575 3 0 0 25 0 1 0 650298264 45735936 8413 268435456000 4194304 4785740 140734044216256 18446744073709551615 4552562 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30992/statm: 11166 8413 339 145 0 8211 0
[pid=30993] ppid=30990 vsize=458872 CPUtime=25.78 cores=2
/proc/30993/stat : 30993 (TNM) R 30990 30990 30763 0 -1 4202496 2813 0 0 0 2577 1 0 0 25 0 1 0 650298264 469884928 2710 268435456000 134512640 134534564 4292633904 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30993/statm: 114718 2710 95 6 0 113383 0
[pid=30994] ppid=30990 vsize=530580 CPUtime=25.78 cores=3
/proc/30994/stat : 30994 (march_hi) R 30990 30990 30763 0 -1 4202496 282503 0 0 0 2516 62 0 0 25 0 1 0 650298264 543313920 102104 268435456000 4194304 4331988 140733752816064 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30994/statm: 132645 102104 174 34 0 131087 0
[pid=30995] ppid=30990 vsize=773352 CPUtime=686.11 cores=4-31
/proc/30995/stat : 30995 (plingeling) S 30990 30990 30763 0 -1 4202496 140269 1241 0 0 68527 84 0 0 17 0 3 0 650298264 791912448 90038 268435456000 4194304 4356188 140734259027856 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 8 0 0 0
/proc/30995/statm: 193338 90038 160 40 0 191882 0
[pid=30995/tid=31009] ppid=30990 vsize=773352 CPUtime=24.51 cores=4-31
/proc/30995/task/31009/stat : 31009 (plingeling) R 30990 30990 30763 0 -1 4202560 7642 1241 0 0 2445 6 0 0 25 0 3 0 650298388 791912448 90038 268435456000 4194304 4356188 140734259027856 18446744073709551615 4279677 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=30995/tid=31025] ppid=30990 vsize=773352 CPUtime=24.48 cores=4-31
/proc/30995/task/31025/stat : 31025 (plingeling) R 30990 30990 30763 0 -1 4202560 7333 1241 0 0 2442 6 0 0 25 0 3 0 650298389 791912448 90038 268435456000 4194304 4356188 140734259027856 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 22 0 0 0
Current children cumulated CPU time (s) 789.23
Current children cumulated vsize (KiB) 3344168

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30990 and gives
#  childrusage.ru_utime.tv_sec=762
#  childrusage.ru_utime.tv_usec=666057
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=993848
# CPU time returned by wait4() is 763.66
# while last known CPU time is 789.23
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 25.8727
CPU time (s): 789.23
CPU user time (s): 787.68
CPU system time (s): 1.55
CPU usage (%): 3050.43
Max. virtual memory (cumulated for all children) (KiB): 4443568

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 762.666
system time used= 0.993848
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 171464
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1580
involuntary context switches= 1827

runsolver used 0.163975 second user time and 0.573912 second system time

The end

Launcher Data

Begin job on node200 at 2011-05-14 17:48:38
IDJOB=3347597
IDBENCH=83438
IDSOLVER=1808
FILE ID=node200/3347597-1305388118
RUNJOBID= node200-1305387880-30777
PBS_JOBID= 13285490
Free space on /tmp= 62048 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E02F17.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347597-1305388118/watcher-3347597-1305388118 -o /tmp/evaluation-result-3347597-1305388118/solver-3347597-1305388118 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347597-1305388118.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 4f20f237857124f0eb214df627f84b82
RANDOM SEED=234223142

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255595676 kB
Buffers:        436456 kB
Cached:        7812508 kB
SwapCached:          0 kB
Active:        7384252 kB
Inactive:       933676 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255595676 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           11720 kB
Writeback:           0 kB
AnonPages:       69268 kB
Mapped:          14372 kB
Slab:           250592 kB
PageTables:       4200 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   183180 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62040 MiB
End job on node200 at 2011-05-14 17:49:04