Trace number 3347427

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 10089.3 323.387

General information on the benchmark

Nameapplication/jarvisalo/AAAI2010-SATPlanning/
aaai10-planning-ipc5-TPP-21-step11.cnf
MD5SUM00d93f117a3253605ad3ac6a153ec61f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark6000.93
Satisfiable
(Un)Satisfiability was proved
Number of variables99736
Number of clauses783991
Sum of the clauses size1708562
Maximum clause length91
Minimum clause length1
Number of clauses of size 1139
Number of clauses of size 2756759
Number of clauses of size 37636
Number of clauses of size 411357
Number of clauses of size 5745
Number of clauses of size over 57355

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
10088.81/323.36	s UNSATISFIABLE
10088.81/323.38	solver [5] plingeling 276-6264d55-100731 answered
10088.81/323.38	Done

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347427-1305158884/watcher-3347427-1305158884 -o /tmp/evaluation-result-3347427-1305158884/solver-3347427-1305158884 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347427-1305158884.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.60 29.51 24.86 1/413 13104
/proc/meminfo: memFree=255779468/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0

[startup+0.116876 s]
/proc/loadavg: 29.60 29.51 24.86 1/413 13104
/proc/meminfo: memFree=255779468/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200841 s]
/proc/loadavg: 29.60 29.51 24.86 1/413 13104
/proc/meminfo: memFree=255779468/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300861 s]
/proc/loadavg: 29.60 29.51 24.86 1/413 13104
/proc/meminfo: memFree=255779468/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700832 s]
/proc/loadavg: 29.60 29.51 24.86 1/413 13104
/proc/meminfo: memFree=255779468/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 18 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50091 s]
/proc/loadavg: 29.60 29.51 24.86 6/419 13115
/proc/meminfo: memFree=255425496/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 18 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
[pid=13105] ppid=13104 vsize=91776 CPUtime=1.49 cores=0
/proc/13105/stat : 13105 (cryptominisat) R 13104 13104 13078 0 -1 4202496 16810 0 0 0 144 5 0 0 20 0 1 0 627374887 93978624 16523 268435456000 4194304 4587354 140737390360448 18446744073709551615 4237649 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13105/statm: 22944 16523 304 96 0 19506 0
[pid=13106] ppid=13104 vsize=88628 CPUtime=1.48 cores=1
/proc/13106/stat : 13106 (clasp) R 13104 13104 13078 0 -1 4202496 23521 0 0 0 140 8 0 0 20 0 1 0 627374887 90755072 18413 268435456000 4194304 4785740 140734656753968 18446744073709551615 258650604940 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13106/statm: 22157 18413 318 145 0 19202 0
[pid=13107] ppid=13104 vsize=492524 CPUtime=1.48 cores=2
/proc/13107/stat : 13107 (TNM) R 13104 13104 13078 0 -1 4202496 13952 0 0 0 144 4 0 0 20 0 1 0 627374887 504344576 13849 268435456000 134512640 134534564 4293379376 18446744073709551615 134524700 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13107/statm: 123131 13849 91 6 0 121796 0
[pid=13108] ppid=13104 vsize=120672 CPUtime=1.49 cores=3
/proc/13108/stat : 13108 (march_hi) R 13104 13104 13078 0 -1 4194304 32164 0 0 0 140 9 0 0 20 0 1 0 627374887 123568128 21057 268435456000 4194304 4331988 140734927133568 18446744073709551615 4252211 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13108/statm: 30168 21057 126 34 0 28610 0
[pid=13109] ppid=13104 vsize=196584 CPUtime=1.48 cores=4-31
/proc/13109/stat : 13109 (plingeling) R 13104 13104 13078 0 -1 4202496 48001 1242 0 0 138 10 0 0 21 0 1 0 627374887 201302016 47805 268435456000 4194304 4356188 140736811743824 18446744073709551615 4277592 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/13109/statm: 49146 47805 129 40 0 47690 0
Current children cumulated CPU time (s) 7.42
Current children cumulated vsize (KiB) 1008508

[startup+3.10097 s]
/proc/loadavg: 29.60 29.51 24.86 6/419 13115
/proc/meminfo: memFree=255159396/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
[pid=13105] ppid=13104 vsize=109800 CPUtime=3.08 cores=0
/proc/13105/stat : 13105 (cryptominisat) R 13104 13104 13078 0 -1 4202496 21274 0 0 0 303 5 0 0 25 0 1 0 627374887 112435200 20986 268435456000 4194304 4587354 140737390360448 18446744073709551615 4421096 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13105/statm: 27450 20986 310 96 0 24012 0
[pid=13106] ppid=13104 vsize=80424 CPUtime=3.08 cores=1
/proc/13106/stat : 13106 (clasp) R 13104 13104 13078 0 -1 4202496 23604 0 0 0 300 8 0 0 25 0 1 0 627374887 82354176 16965 268435456000 4194304 4785740 140734656753968 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13106/statm: 20106 16965 338 145 0 17151 0
[pid=13107] ppid=13104 vsize=511400 CPUtime=3.08 cores=2
/proc/13107/stat : 13107 (TNM) R 13104 13104 13078 0 -1 4202496 24561 0 0 0 302 6 0 0 25 0 1 0 627374887 523673600 24458 268435456000 134512640 134534564 4293379376 18446744073709551615 134529964 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13107/statm: 127850 24458 95 6 0 126515 0
[pid=13108] ppid=13104 vsize=120664 CPUtime=3.09 cores=3
/proc/13108/stat : 13108 (march_hi) R 13104 13104 13078 0 -1 4194304 60378 0 0 0 294 15 0 0 25 0 1 0 627374887 123559936 21052 268435456000 4194304 4331988 140734927133568 18446744073709551615 4252174 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13108/statm: 30166 21052 127 34 0 28608 0
[pid=13109] ppid=13104 vsize=314016 CPUtime=3.07 cores=4-31
/proc/13109/stat : 13109 (plingeling) R 13104 13104 13078 0 -1 4202496 77487 1242 0 0 292 15 0 0 25 0 1 0 627374887 321552384 77163 268435456000 4194304 4356188 140736811743824 18446744073709551615 4213270 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/13109/statm: 78504 77163 129 40 0 77048 0
Current children cumulated CPU time (s) 15.4
Current children cumulated vsize (KiB) 1154628

[startup+6.30106 s]
/proc/loadavg: 27.63 29.10 24.76 6/419 13115
/proc/meminfo: memFree=254936100/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
[pid=13105] ppid=13104 vsize=137504 CPUtime=6.28 cores=0
/proc/13105/stat : 13105 (cryptominisat) R 13104 13104 13078 0 -1 4202496 35681 0 0 0 620 8 0 0 25 0 1 0 627374887 140804096 26731 268435456000 4194304 4587354 140737390360448 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13105/statm: 34376 26731 328 96 0 30938 0
[pid=13106] ppid=13104 vsize=80424 CPUtime=6.28 cores=1
/proc/13106/stat : 13106 (clasp) R 13104 13104 13078 0 -1 4202496 23604 0 0 0 620 8 0 0 25 0 1 0 627374887 82354176 16965 268435456000 4194304 4785740 140734656753968 18446744073709551615 4552628 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13106/statm: 20106 16965 338 145 0 17151 0
[pid=13107] ppid=13104 vsize=511400 CPUtime=6.28 cores=2
/proc/13107/stat : 13107 (TNM) R 13104 13104 13078 0 -1 4202496 24561 0 0 0 622 6 0 0 25 0 1 0 627374887 523673600 24458 268435456000 134512640 134534564 4293379376 18446744073709551615 134528875 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13107/statm: 127850 24458 95 6 0 126515 0
[pid=13108] ppid=13104 vsize=255968 CPUtime=6.28 cores=3
/proc/13108/stat : 13108 (march_hi) R 13104 13104 13078 0 -1 4202496 130273 0 0 0 600 28 0 0 25 0 1 0 627374887 262111232 26843 268435456000 4194304 4331988 140734927133568 18446744073709551615 4257088 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13108/statm: 63992 26843 158 34 0 62434 0
[pid=13109] ppid=13104 vsize=486048 CPUtime=6.28 cores=4-31
/proc/13109/stat : 13109 (plingeling) R 13104 13104 13078 0 -1 4202496 120495 1242 0 0 604 24 0 0 25 0 1 0 627374887 497713152 120171 268435456000 4194304 4356188 140736811743824 18446744073709551615 4277412 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/13109/statm: 121512 120171 129 40 0 120056 0
Current children cumulated CPU time (s) 31.4
Current children cumulated vsize (KiB) 1489668

[startup+12.7022 s]
/proc/loadavg: 27.98 29.15 24.79 33/447 13143
/proc/meminfo: memFree=254675236/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
[pid=13105] ppid=13104 vsize=137504 CPUtime=12.68 cores=0
/proc/13105/stat : 13105 (cryptominisat) R 13104 13104 13078 0 -1 4202496 37006 0 0 0 1259 9 0 0 25 0 1 0 627374887 140804096 28049 268435456000 4194304 4587354 140737390360448 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13105/statm: 34376 28049 328 96 0 30938 0
[pid=13106] ppid=13104 vsize=80424 CPUtime=12.68 cores=1
/proc/13106/stat : 13106 (clasp) R 13104 13104 13078 0 -1 4202496 23604 0 0 0 1260 8 0 0 25 0 1 0 627374887 82354176 16965 268435456000 4194304 4785740 140734656753968 18446744073709551615 4304045 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13106/statm: 20106 16965 338 145 0 17151 0
[pid=13107] ppid=13104 vsize=511400 CPUtime=12.68 cores=2
/proc/13107/stat : 13107 (TNM) R 13104 13104 13078 0 -1 4202496 24561 0 0 0 1262 6 0 0 25 0 1 0 627374887 523673600 24458 268435456000 134512640 134534564 4293379376 18446744073709551615 134528273 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13107/statm: 127850 24458 95 6 0 126515 0
[pid=13108] ppid=13104 vsize=264880 CPUtime=12.69 cores=3
/proc/13108/stat : 13108 (march_hi) R 13104 13104 13078 0 -1 4202496 148034 0 0 0 1237 32 0 0 25 0 1 0 627374887 271237120 31948 268435456000 4194304 4331988 140734927133568 18446744073709551615 4210412 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13108/statm: 66220 31948 174 34 0 64662 0
[pid=13109] ppid=13104 vsize=1091168 CPUtime=110.75 cores=4-31
/proc/13109/stat : 13109 (plingeling) S 13104 13104 13078 0 -1 4202496 271141 1242 0 0 11008 67 0 0 18 0 29 0 627374887 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13109/statm: 272792 174372 159 40 0 271336 0
[pid=13109/tid=13116] ppid=13104 vsize=1091168 CPUtime=3.62 cores=4-31
/proc/13109/task/13116/stat : 13116 (plingeling) R 13104 13104 13078 0 -1 4202560 3194 1242 0 0 362 0 0 0 21 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4276732 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=13109/tid=13117] ppid=13104 vsize=1091168 CPUtime=3.64 cores=4-31
/proc/13109/task/13117/stat : 13117 (plingeling) R 13104 13104 13078 0 -1 4202560 3598 1242 0 0 364 0 0 0 25 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4320422 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=13109/tid=13118] ppid=13104 vsize=1091168 CPUtime=3.65 cores=4-31
/proc/13109/task/13118/stat : 13118 (plingeling) R 13104 13104 13078 0 -1 4202560 2626 1242 0 0 364 1 0 0 25 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4211178 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=13109/tid=13119] ppid=13104 vsize=1091168 CPUtime=3.65 cores=4-31
/proc/13109/task/13119/stat : 13119 (plingeling) R 13104 13104 13078 0 -1 4202560 3423 1242 0 0 364 1 0 0 21 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=13109/tid=13120] ppid=13104 vsize=1091168 CPUtime=3.63 cores=4-31
/proc/13109/task/13120/stat : 13120 (plingeling) R 13104 13104 13078 0 -1 4202560 3455 1242 0 0 363 0 0 0 25 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4260341 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13109/tid=13121] ppid=13104 vsize=1091168 CPUtime=3.64 cores=4-31
/proc/13109/task/13121/stat : 13121 (plingeling) R 13104 13104 13078 0 -1 4202560 4777 1242 0 0 363 1 0 0 22 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 258650648512 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=13109/tid=13122] ppid=13104 vsize=1091168 CPUtime=3.64 cores=4-31
/proc/13109/task/13122/stat : 13122 (plingeling) R 13104 13104 13078 0 -1 4202560 5009 1242 0 0 363 1 0 0 25 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4270554 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=13109/tid=13123] ppid=13104 vsize=1091168 CPUtime=3.64 cores=4-31
/proc/13109/task/13123/stat : 13123 (plingeling) R 13104 13104 13078 0 -1 4202560 4005 1242 0 0 364 0 0 0 25 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4211161 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13109/tid=13124] ppid=13104 vsize=1091168 CPUtime=3.63 cores=4-31
/proc/13109/task/13124/stat : 13124 (plingeling) R 13104 13104 13078 0 -1 4202560 3035 1242 0 0 362 1 0 0 25 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=13109/tid=13125] ppid=13104 vsize=1091168 CPUtime=3.55 cores=4-31
/proc/13109/task/13125/stat : 13125 (plingeling) R 13104 13104 13078 0 -1 4202560 3066 1242 0 0 355 0 0 0 25 0 29 0 627375790 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4231387 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=13109/tid=13126] ppid=13104 vsize=1091168 CPUtime=3.63 cores=4-31
/proc/13109/task/13126/stat : 13126 (plingeling) R 13104 13104 13078 0 -1 4202560 4053 1242 0 0 362 1 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4211881 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=13109/tid=13127] ppid=13104 vsize=1091168 CPUtime=3.61 cores=4-31
/proc/13109/task/13127/stat : 13127 (plingeling) R 13104 13104 13078 0 -1 4202560 3904 1242 0 0 361 0 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=13109/tid=13128] ppid=13104 vsize=1091168 CPUtime=3.63 cores=4-31
/proc/13109/task/13128/stat : 13128 (plingeling) R 13104 13104 13078 0 -1 4202560 5897 1242 0 0 362 1 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=13109/tid=13129] ppid=13104 vsize=1091168 CPUtime=3.63 cores=4-31
/proc/13109/task/13129/stat : 13129 (plingeling) R 13104 13104 13078 0 -1 4202560 3299 1242 0 0 363 0 0 0 21 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4211178 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=13109/tid=13130] ppid=13104 vsize=1091168 CPUtime=3.6 cores=4-31
/proc/13109/task/13130/stat : 13130 (plingeling) R 13104 13104 13078 0 -1 4202560 2065 1242 0 0 359 1 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210591 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=13109/tid=13131] ppid=13104 vsize=1091168 CPUtime=3.64 cores=4-31
/proc/13109/task/13131/stat : 13131 (plingeling) R 13104 13104 13078 0 -1 4202560 3337 1242 0 0 363 1 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210557 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=13109/tid=13132] ppid=13104 vsize=1091168 CPUtime=3.63 cores=4-31
/proc/13109/task/13132/stat : 13132 (plingeling) R 13104 13104 13078 0 -1 4202560 2567 1242 0 0 362 1 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4208879 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=13109/tid=13133] ppid=13104 vsize=1091168 CPUtime=3.59 cores=4-31
/proc/13109/task/13133/stat : 13133 (plingeling) R 13104 13104 13078 0 -1 4202560 4627 1242 0 0 358 1 0 0 21 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210596 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=13109/tid=13134] ppid=13104 vsize=1091168 CPUtime=3.62 cores=4-31
/proc/13109/task/13134/stat : 13134 (plingeling) R 13104 13104 13078 0 -1 4202560 3226 1242 0 0 361 1 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4270512 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=13109/tid=13135] ppid=13104 vsize=1091168 CPUtime=3.63 cores=4-31
/proc/13109/task/13135/stat : 13135 (plingeling) R 13104 13104 13078 0 -1 4202560 3271 1242 0 0 363 0 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=13109/tid=13136] ppid=13104 vsize=1091168 CPUtime=3.61 cores=4-31
/proc/13109/task/13136/stat : 13136 (plingeling) R 13104 13104 13078 0 -1 4202560 2168 1242 0 0 361 0 0 0 25 0 29 0 627375791 1117356032 174372 268435456000 4194304 4356188 140736811743824 18446744073709551615 4211506 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=13109/tid=13137] ppid=13104 vsize=1091168 CPUtime=3.61 cores=4-31

################
# More data... #
################

/proc/13107/stat : 13107 (TNM) R 13104 13104 13078 0 -1 4202496 24561 0 0 0 32266 6 0 0 25 0 1 0 627374887 523673600 24458 268435456000 134512640 134534564 4293379376 18446744073709551615 134529374 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13107/statm: 127850 24458 95 6 0 126515 0
[pid=13108] ppid=13104 vsize=267340 CPUtime=322.72 cores=3
/proc/13108/stat : 13108 (march_hi) R 13104 13104 13078 0 -1 4202496 148605 0 0 0 32240 32 0 0 25 0 1 0 627374887 273756160 32519 268435456000 4194304 4331988 140734927133568 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13108/statm: 66835 32519 174 34 0 65277 0
[pid=13109] ppid=13104 vsize=1380080 CPUtime=8782.81 cores=4-31
/proc/13109/stat : 13109 (plingeling) S 13104 13104 13078 0 -1 4202496 551843 1242 0 0 878142 139 0 0 18 0 29 0 627374887 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13109/statm: 345020 240273 159 40 0 343564 0
[pid=13109/tid=13116] ppid=13104 vsize=1380080 CPUtime=313.66 cores=4-31
/proc/13109/task/13116/stat : 13116 (plingeling) R 13104 13104 13078 0 -1 4202560 11085 1242 0 0 31364 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4279753 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=13109/tid=13117] ppid=13104 vsize=1380080 CPUtime=313.69 cores=4-31
/proc/13109/task/13117/stat : 13117 (plingeling) R 13104 13104 13078 0 -1 4202560 14343 1242 0 0 31366 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=13109/tid=13118] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13118/stat : 13118 (plingeling) R 13104 13104 13078 0 -1 4202560 9262 1242 0 0 31365 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=13109/tid=13119] ppid=13104 vsize=1380080 CPUtime=313.68 cores=4-31
/proc/13109/task/13119/stat : 13119 (plingeling) R 13104 13104 13078 0 -1 4202560 9757 1242 0 0 31366 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=13109/tid=13120] ppid=13104 vsize=1380080 CPUtime=313.68 cores=4-31
/proc/13109/task/13120/stat : 13120 (plingeling) R 13104 13104 13078 0 -1 4202560 13767 1242 0 0 31365 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13109/tid=13121] ppid=13104 vsize=1380080 CPUtime=313.69 cores=4-31
/proc/13109/task/13121/stat : 13121 (plingeling) R 13104 13104 13078 0 -1 4202560 15513 1242 0 0 31366 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4332293 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=13109/tid=13122] ppid=13104 vsize=1380080 CPUtime=313.59 cores=4-31
/proc/13109/task/13122/stat : 13122 (plingeling) R 13104 13104 13078 0 -1 4202560 17505 1242 0 0 31355 4 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=13109/tid=13123] ppid=13104 vsize=1380080 CPUtime=313.68 cores=4-31
/proc/13109/task/13123/stat : 13123 (plingeling) R 13104 13104 13078 0 -1 4202560 21008 1242 0 0 31364 4 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13109/tid=13124] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13124/stat : 13124 (plingeling) R 13104 13104 13078 0 -1 4202560 10389 1242 0 0 31364 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=13109/tid=13125] ppid=13104 vsize=1380080 CPUtime=313.56 cores=4-31
/proc/13109/task/13125/stat : 13125 (plingeling) R 13104 13104 13078 0 -1 4202560 13073 1242 0 0 31354 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=13109/tid=13126] ppid=13104 vsize=1380080 CPUtime=313.66 cores=4-31
/proc/13109/task/13126/stat : 13126 (plingeling) R 13104 13104 13078 0 -1 4202560 12587 1242 0 0 31363 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=13109/tid=13127] ppid=13104 vsize=1380080 CPUtime=313.65 cores=4-31
/proc/13109/task/13127/stat : 13127 (plingeling) R 13104 13104 13078 0 -1 4202560 20934 1242 0 0 31360 5 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=13109/tid=13128] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13128/stat : 13128 (plingeling) R 13104 13104 13078 0 -1 4202560 19943 1242 0 0 31362 5 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=13109/tid=13129] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13129/stat : 13129 (plingeling) R 13104 13104 13078 0 -1 4202560 11441 1242 0 0 31364 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4242634 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=13109/tid=13130] ppid=13104 vsize=1380080 CPUtime=313.64 cores=4-31
/proc/13109/task/13130/stat : 13130 (plingeling) R 13104 13104 13078 0 -1 4202560 13133 1242 0 0 31361 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=13109/tid=13131] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13131/stat : 13131 (plingeling) R 13104 13104 13078 0 -1 4202560 14215 1242 0 0 31364 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4244557 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=13109/tid=13132] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13132/stat : 13132 (plingeling) R 13104 13104 13078 0 -1 4202560 10591 1242 0 0 31364 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=13109/tid=13133] ppid=13104 vsize=1380080 CPUtime=313.49 cores=4-31
/proc/13109/task/13133/stat : 13133 (plingeling) R 13104 13104 13078 0 -1 4202560 11428 1242 0 0 31343 6 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=13109/tid=13134] ppid=13104 vsize=1380080 CPUtime=313.65 cores=4-31
/proc/13109/task/13134/stat : 13134 (plingeling) R 13104 13104 13078 0 -1 4202560 16527 1242 0 0 31361 4 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=13109/tid=13135] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13135/stat : 13135 (plingeling) R 13104 13104 13078 0 -1 4202560 14842 1242 0 0 31364 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4279711 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=13109/tid=13136] ppid=13104 vsize=1380080 CPUtime=304.86 cores=4-31
/proc/13109/task/13136/stat : 13136 (plingeling) R 13104 13104 13078 0 -1 4202560 8757 1242 0 0 30484 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=13109/tid=13137] ppid=13104 vsize=1380080 CPUtime=313.65 cores=4-31
/proc/13109/task/13137/stat : 13137 (plingeling) R 13104 13104 13078 0 -1 4202560 9916 1242 0 0 31363 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4283920 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=13109/tid=13138] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13138/stat : 13138 (plingeling) R 13104 13104 13078 0 -1 4202560 12421 1242 0 0 31365 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210721 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=13109/tid=13139] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13139/stat : 13139 (plingeling) R 13104 13104 13078 0 -1 4202560 14326 1242 0 0 31363 4 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=13109/tid=13140] ppid=13104 vsize=1380080 CPUtime=313.65 cores=4-31
/proc/13109/task/13140/stat : 13140 (plingeling) R 13104 13104 13078 0 -1 4202560 6347 1242 0 0 31363 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=13109/tid=13141] ppid=13104 vsize=1380080 CPUtime=313.65 cores=4-31
/proc/13109/task/13141/stat : 13141 (plingeling) R 13104 13104 13078 0 -1 4202560 15266 1242 0 0 31362 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=13109/tid=13142] ppid=13104 vsize=1380080 CPUtime=313.67 cores=4-31
/proc/13109/task/13142/stat : 13142 (plingeling) R 13104 13104 13078 0 -1 4202560 10149 1242 0 0 31365 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331251 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=13109/tid=13143] ppid=13104 vsize=1380080 CPUtime=313.69 cores=4-31
/proc/13109/task/13143/stat : 13143 (plingeling) R 13104 13104 13078 0 -1 4202560 15443 1242 0 0 31366 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10073.7
Current children cumulated vsize (KiB) 4249840

[startup+323.202 s]
/proc/loadavg: 32.06 31.05 26.86 33/447 13151
/proc/meminfo: memFree=254155952/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
[pid=13105] ppid=13104 vsize=1787016 CPUtime=323.12 cores=0
/proc/13105/stat : 13105 (cryptominisat) R 13104 13104 13078 0 -1 4202496 65794 0 0 0 32289 23 0 0 25 0 1 0 627374887 1829904384 43736 268435456000 4194304 4587354 140737390360448 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13105/statm: 446754 43736 336 96 0 443316 0
[pid=13106] ppid=13104 vsize=285680 CPUtime=323.12 cores=1
/proc/13106/stat : 13106 (clasp) R 13104 13104 13078 0 -1 4202496 74578 0 0 0 32264 48 0 0 25 0 1 0 627374887 292536320 67939 268435456000 4194304 4785740 140734656753968 18446744073709551615 4416773 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13106/statm: 71420 67939 338 145 0 68465 0
[pid=13107] ppid=13104 vsize=511400 CPUtime=323.12 cores=2
/proc/13107/stat : 13107 (TNM) R 13104 13104 13078 0 -1 4202496 24561 0 0 0 32306 6 0 0 25 0 1 0 627374887 523673600 24458 268435456000 134512640 134534564 4293379376 18446744073709551615 134529632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13107/statm: 127850 24458 95 6 0 126515 0
[pid=13108] ppid=13104 vsize=267340 CPUtime=323.12 cores=3
/proc/13108/stat : 13108 (march_hi) R 13104 13104 13078 0 -1 4202496 148605 0 0 0 32280 32 0 0 25 0 1 0 627374887 273756160 32519 268435456000 4194304 4331988 140734927133568 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13108/statm: 66835 32519 174 34 0 65277 0
[pid=13109] ppid=13104 vsize=1380080 CPUtime=8794.01 cores=4-31
/proc/13109/stat : 13109 (plingeling) S 13104 13104 13078 0 -1 4202496 551843 1242 0 0 879262 139 0 0 18 0 29 0 627374887 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13109/statm: 345020 240273 159 40 0 343564 0
[pid=13109/tid=13116] ppid=13104 vsize=1380080 CPUtime=314.06 cores=4-31
/proc/13109/task/13116/stat : 13116 (plingeling) R 13104 13104 13078 0 -1 4202560 11085 1242 0 0 31404 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=13109/tid=13117] ppid=13104 vsize=1380080 CPUtime=314.09 cores=4-31
/proc/13109/task/13117/stat : 13117 (plingeling) R 13104 13104 13078 0 -1 4202560 14343 1242 0 0 31406 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=13109/tid=13118] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13118/stat : 13118 (plingeling) R 13104 13104 13078 0 -1 4202560 9262 1242 0 0 31405 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=13109/tid=13119] ppid=13104 vsize=1380080 CPUtime=314.08 cores=4-31
/proc/13109/task/13119/stat : 13119 (plingeling) R 13104 13104 13078 0 -1 4202560 9757 1242 0 0 31406 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210562 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=13109/tid=13120] ppid=13104 vsize=1380080 CPUtime=314.08 cores=4-31
/proc/13109/task/13120/stat : 13120 (plingeling) R 13104 13104 13078 0 -1 4202560 13767 1242 0 0 31405 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13109/tid=13121] ppid=13104 vsize=1380080 CPUtime=314.09 cores=4-31
/proc/13109/task/13121/stat : 13121 (plingeling) R 13104 13104 13078 0 -1 4202560 15513 1242 0 0 31406 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=13109/tid=13122] ppid=13104 vsize=1380080 CPUtime=313.99 cores=4-31
/proc/13109/task/13122/stat : 13122 (plingeling) R 13104 13104 13078 0 -1 4202560 17505 1242 0 0 31395 4 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330945 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=13109/tid=13123] ppid=13104 vsize=1380080 CPUtime=314.08 cores=4-31
/proc/13109/task/13123/stat : 13123 (plingeling) R 13104 13104 13078 0 -1 4202560 21008 1242 0 0 31404 4 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=13109/tid=13124] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13124/stat : 13124 (plingeling) R 13104 13104 13078 0 -1 4202560 10389 1242 0 0 31404 3 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210740 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=13109/tid=13125] ppid=13104 vsize=1380080 CPUtime=313.96 cores=4-31
/proc/13109/task/13125/stat : 13125 (plingeling) R 13104 13104 13078 0 -1 4202560 13073 1242 0 0 31394 2 0 0 25 0 29 0 627375790 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=13109/tid=13126] ppid=13104 vsize=1380080 CPUtime=314.06 cores=4-31
/proc/13109/task/13126/stat : 13126 (plingeling) R 13104 13104 13078 0 -1 4202560 12587 1242 0 0 31403 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4244269 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=13109/tid=13127] ppid=13104 vsize=1380080 CPUtime=314.05 cores=4-31
/proc/13109/task/13127/stat : 13127 (plingeling) R 13104 13104 13078 0 -1 4202560 20934 1242 0 0 31400 5 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4332302 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=13109/tid=13128] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13128/stat : 13128 (plingeling) R 13104 13104 13078 0 -1 4202560 19943 1242 0 0 31402 5 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=13109/tid=13129] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13129/stat : 13129 (plingeling) R 13104 13104 13078 0 -1 4202560 11441 1242 0 0 31404 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=13109/tid=13130] ppid=13104 vsize=1380080 CPUtime=314.04 cores=4-31
/proc/13109/task/13130/stat : 13130 (plingeling) R 13104 13104 13078 0 -1 4202560 13133 1242 0 0 31401 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4242651 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=13109/tid=13131] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13131/stat : 13131 (plingeling) R 13104 13104 13078 0 -1 4202560 14215 1242 0 0 31404 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=13109/tid=13132] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13132/stat : 13132 (plingeling) R 13104 13104 13078 0 -1 4202560 10591 1242 0 0 31404 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330896 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=13109/tid=13133] ppid=13104 vsize=1380080 CPUtime=313.89 cores=4-31
/proc/13109/task/13133/stat : 13133 (plingeling) R 13104 13104 13078 0 -1 4202560 11428 1242 0 0 31383 6 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=13109/tid=13134] ppid=13104 vsize=1380080 CPUtime=314.05 cores=4-31
/proc/13109/task/13134/stat : 13134 (plingeling) R 13104 13104 13078 0 -1 4202560 16527 1242 0 0 31401 4 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=13109/tid=13135] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13135/stat : 13135 (plingeling) R 13104 13104 13078 0 -1 4202560 14842 1242 0 0 31404 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331023 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=13109/tid=13136] ppid=13104 vsize=1380080 CPUtime=305.25 cores=4-31
/proc/13109/task/13136/stat : 13136 (plingeling) R 13104 13104 13078 0 -1 4202560 8757 1242 0 0 30523 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=13109/tid=13137] ppid=13104 vsize=1380080 CPUtime=314.05 cores=4-31
/proc/13109/task/13137/stat : 13137 (plingeling) R 13104 13104 13078 0 -1 4202560 9916 1242 0 0 31403 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=13109/tid=13138] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13138/stat : 13138 (plingeling) R 13104 13104 13078 0 -1 4202560 12421 1242 0 0 31405 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=13109/tid=13139] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13139/stat : 13139 (plingeling) R 13104 13104 13078 0 -1 4202560 14326 1242 0 0 31403 4 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4281574 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=13109/tid=13140] ppid=13104 vsize=1380080 CPUtime=314.05 cores=4-31
/proc/13109/task/13140/stat : 13140 (plingeling) R 13104 13104 13078 0 -1 4202560 6347 1242 0 0 31403 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331996 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=13109/tid=13141] ppid=13104 vsize=1380080 CPUtime=314.05 cores=4-31
/proc/13109/task/13141/stat : 13141 (plingeling) R 13104 13104 13078 0 -1 4202560 15266 1242 0 0 31402 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4244576 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=13109/tid=13142] ppid=13104 vsize=1380080 CPUtime=314.07 cores=4-31
/proc/13109/task/13142/stat : 13142 (plingeling) R 13104 13104 13078 0 -1 4202560 10149 1242 0 0 31405 2 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4331504 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=13109/tid=13143] ppid=13104 vsize=1380080 CPUtime=314.09 cores=4-31
/proc/13109/task/13143/stat : 13143 (plingeling) R 13104 13104 13078 0 -1 4202560 15443 1242 0 0 31406 3 0 0 25 0 29 0 627375791 1413201920 240273 268435456000 4194304 4356188 140736811743824 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10086.5
Current children cumulated vsize (KiB) 4249840

[startup+323.302 s]
/proc/loadavg: 32.06 31.05 26.86 33/447 13151
/proc/meminfo: memFree=254155952/264257624 swapFree=67111528/67111528
[pid=13104] ppid=13102 vsize=18324 CPUtime=0 cores=0-31
/proc/13104/stat : 13104 (ppfolio) S 13102 13104 13078 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 627374887 18763776 386 268435456000 4194304 4287625 140734709220432 18446744073709551615 258650975999 0 0 4096 65536 9201663558448840703 0 0 17 28 0 0 0
/proc/13104/statm: 4581 386 337 23 0 91 0
[pid=13105] ppid=13104 vsize=1787016 CPUtime=323.22 cores=0
/proc/13105/stat : 13105 (cryptominisat) R 13104 13104 13078 0 -1 4202496 65808 0 0 0 32299 23 0 0 25 0 1 0 627374887 1829904384 43750 268435456000 4194304 4587354 140737390360448 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/13105/statm: 446754 43750 336 96 0 443316 0
[pid=13106] ppid=13104 vsize=285680 CPUtime=323.22 cores=1
/proc/13106/stat : 13106 (clasp) R 13104 13104 13078 0 -1 4202496 74578 0 0 0 32274 48 0 0 25 0 1 0 627374887 292536320 67939 268435456000 4194304 4785740 140734656753968 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/13106/statm: 71420 67939 338 145 0 68465 0
[pid=13107] ppid=13104 vsize=511400 CPUtime=323.22 cores=2
/proc/13107/stat : 13107 (TNM) R 13104 13104 13078 0 -1 4202496 24561 0 0 0 32316 6 0 0 25 0 1 0 627374887 523673600 24458 268435456000 134512640 134534564 4293379376 18446744073709551615 134530260 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/13107/statm: 127850 24458 95 6 0 126515 0
[pid=13108] ppid=13104 vsize=267340 CPUtime=323.22 cores=3
/proc/13108/stat : 13108 (march_hi) R 13104 13104 13078 0 -1 4202496 148605 0 0 0 32290 32 0 0 25 0 1 0 627374887 273756160 32519 268435456000 4194304 4331988 140734927133568 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/13108/statm: 66835 32519 174 34 0 65277 0
[pid=13109] ppid=13104 vsize=914700 CPUtime=8795.93 cores=4-31
/proc/13109/stat : 13109 (plingeling) R 13104 13104 13078 0 -1 4202496 551844 1242 0 0 879452 141 0 0 17 0 1 0 627374887 936652800 185817 268435456000 4194304 4356188 140736811743824 18446744073709551615 258650999383 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/13109/statm: 228675 185817 160 40 0 227219 0
Current children cumulated CPU time (s) 10088.8
Current children cumulated vsize (KiB) 3784460

Child status: 0
Real time (s): 323.387
CPU time (s): 10089.3
CPU user time (s): 10086.6
CPU system time (s): 2.6506
CPU usage (%): 3119.87
Max. virtual memory (cumulated for all children) (KiB): 5840424

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10086.6
system time used= 2.6506
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 867187
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2182
involuntary context switches= 24910

runsolver used 1.89371 second user time and 7.2229 second system time

The end

Launcher Data

Begin job on node200 at 2011-05-12 02:08:05
IDJOB=3347427
IDBENCH=82431
IDSOLVER=1808
FILE ID=node200/3347427-1305158884
RUNJOBID= node200-1305158884-13092
PBS_JOBID= 13282072
Free space on /tmp= 62040 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/jarvisalo/AAAI2010-SATPlanning/aaai10-planning-ipc5-TPP-21-step11.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347427-1305158884/watcher-3347427-1305158884 -o /tmp/evaluation-result-3347427-1305158884/solver-3347427-1305158884 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347427-1305158884.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 00d93f117a3253605ad3ac6a153ec61f
RANDOM SEED=1869868305

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255779756 kB
Buffers:        424032 kB
Cached:        7648272 kB
SwapCached:          0 kB
Active:        7221960 kB
Inactive:       919036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255779756 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           22384 kB
Writeback:           0 kB
AnonPages:       69000 kB
Mapped:          14480 kB
Slab:           248836 kB
PageTables:       4436 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   183556 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62028 MiB
End job on node200 at 2011-05-12 02:13:28