Trace number 3372096

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 505.763 24.3756

General information on the benchmark

Nameindustrial/anbulagan/
medium-unsat/dated-5-11-u.cnf
MD5SUM083d28c2adf10233f37f8b5a078c94a9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark241.061
Satisfiable
(Un)Satisfiability was proved
Number of variables108786
Number of clauses482639
Sum of the clauses size1096328
Maximum clause length10
Minimum clause length1
Number of clauses of size 19230
Number of clauses of size 2395289
Number of clauses of size 357400
Number of clauses of size 42300
Number of clauses of size 59200
Number of clauses of size over 59220

Solver Data

505.65/24.37	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372096-1305419448/watcher-3372096-1305419448 -o /tmp/evaluation-result-3372096-1305419448/solver-3372096-1305419448 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372096-1305419448.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 27.24 31.07 31.72 1/413 970
/proc/meminfo: memFree=255577692/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=10412 CPUtime=0.01 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 688 1240 0 0 0 0 0 1 18 0 1 0 653431286 10661888 619 268435456000 4194304 4417452 140733210787520 18446744073709551615 258650616632 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 2603 619 144 55 0 489 0

[startup+0.115285 s]
/proc/loadavg: 27.24 31.07 31.72 1/413 970
/proc/meminfo: memFree=255577692/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=30904 CPUtime=0.11 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 5807 1240 0 0 9 1 0 1 18 0 1 0 653431286 31645696 5738 268435456000 4194304 4417452 140733210787520 18446744073709551615 4264900 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 7726 5738 145 55 0 5612 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 30904

[startup+0.201295 s]
/proc/loadavg: 27.24 31.07 31.72 1/413 970
/proc/meminfo: memFree=255577692/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=51436 CPUtime=0.2 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 10916 1240 0 0 16 3 0 1 19 0 1 0 653431286 52670464 10847 268435456000 4194304 4417452 140733210787520 18446744073709551615 4231277 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 12859 10847 145 55 0 10745 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 51436

[startup+0.301293 s]
/proc/loadavg: 27.24 31.07 31.72 1/413 970
/proc/meminfo: memFree=255577692/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=52396 CPUtime=0.3 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 11188 1240 0 0 26 3 0 1 19 0 1 0 653431286 53653504 11119 268435456000 4194304 4417452 140733210787520 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 13099 11119 145 55 0 10985 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 52396

[startup+0.70033 s]
/proc/loadavg: 27.24 31.07 31.72 1/413 970
/proc/meminfo: memFree=255577692/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=67944 CPUtime=0.69 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 15187 1240 0 0 64 4 0 1 19 0 1 0 653431286 69574656 15006 268435456000 4194304 4417452 140733210787520 18446744073709551615 4227899 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 16986 15006 145 55 0 14872 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 67944

[startup+1.50034 s]
/proc/loadavg: 27.24 31.07 31.72 2/414 976
/proc/meminfo: memFree=255445632/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=196316 CPUtime=1.49 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 47368 1240 0 0 138 10 0 1 21 0 1 0 653431286 201027584 47099 268435456000 4194304 4417452 140733210787520 18446744073709551615 4264976 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 49079 47099 145 55 0 46965 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 196316

[startup+3.10039 s]
/proc/loadavg: 27.24 31.07 31.72 2/414 976
/proc/meminfo: memFree=255324856/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=379392 CPUtime=3.1 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 93337 1240 0 0 288 21 0 1 25 0 1 0 653431286 388497408 92868 268435456000 4194304 4417452 140733210787520 18446744073709551615 258650574330 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 94848 92868 145 55 0 92734 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 379392

[startup+6.30051 s]
/proc/loadavg: 25.13 30.57 31.55 2/414 976
/proc/meminfo: memFree=255108248/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=607672 CPUtime=6.29 cores=0-31
/proc/970/stat : 970 (plingeling) R 968 970 944 0 -1 4202496 150569 1240 0 0 597 31 0 1 25 0 1 0 653431286 622256128 149794 268435456000 4194304 4417452 140733210787520 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/970/statm: 151918 149811 146 55 0 149804 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 607672

[startup+12.7016 s]
/proc/loadavg: 25.68 30.59 31.55 33/446 1008
/proc/meminfo: memFree=255061928/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=941560 CPUtime=134.97 cores=0-31
/proc/970/stat : 970 (plingeling) S 968 970 944 0 -1 4202496 262660 1240 0 0 13286 210 0 1 20 0 33 0 653431286 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 25 0 0 0
/proc/970/statm: 235390 98116 175 55 0 233276 0
[pid=970/tid=977] ppid=968 vsize=941560 CPUtime=4.02 cores=0-31
/proc/970/task/977/stat : 977 (plingeling) R 968 970 944 0 -1 4202560 2878 1240 0 0 400 1 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=970/tid=978] ppid=968 vsize=941560 CPUtime=3.93 cores=0-31
/proc/970/task/978/stat : 978 (plingeling) R 968 970 944 0 -1 4202560 5096 1240 0 0 384 8 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366029 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=970/tid=979] ppid=968 vsize=941560 CPUtime=3.98 cores=0-31
/proc/970/task/979/stat : 979 (plingeling) R 968 970 944 0 -1 4202560 2544 1240 0 0 390 7 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=970/tid=980] ppid=968 vsize=941560 CPUtime=4.07 cores=0-31
/proc/970/task/980/stat : 980 (plingeling) R 968 970 944 0 -1 4202560 1951 1240 0 0 403 3 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=970/tid=981] ppid=968 vsize=941560 CPUtime=3.96 cores=0-31
/proc/970/task/981/stat : 981 (plingeling) R 968 970 944 0 -1 4202560 2861 1240 0 0 389 6 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=970/tid=982] ppid=968 vsize=941560 CPUtime=3.98 cores=0-31
/proc/970/task/982/stat : 982 (plingeling) R 968 970 944 0 -1 4202560 2500 1240 0 0 394 3 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=970/tid=983] ppid=968 vsize=941560 CPUtime=4.03 cores=0-31
/proc/970/task/983/stat : 983 (plingeling) R 968 970 944 0 -1 4202560 2542 1240 0 0 398 4 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366631 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=970/tid=984] ppid=968 vsize=941560 CPUtime=3.92 cores=0-31
/proc/970/task/984/stat : 984 (plingeling) R 968 970 944 0 -1 4202560 4547 1240 0 0 385 6 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4236554 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=970/tid=985] ppid=968 vsize=941560 CPUtime=3.91 cores=0-31
/proc/970/task/985/stat : 985 (plingeling) R 968 970 944 0 -1 4202560 4333 1240 0 0 386 4 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=970/tid=986] ppid=968 vsize=941560 CPUtime=3.94 cores=0-31
/proc/970/task/986/stat : 986 (plingeling) R 968 970 944 0 -1 4202560 2327 1240 0 0 388 5 0 1 25 0 33 0 653432143 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364474 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=970/tid=987] ppid=968 vsize=941560 CPUtime=4.05 cores=0-31
/proc/970/task/987/stat : 987 (plingeling) R 968 970 944 0 -1 4202560 2523 1240 0 0 402 2 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364453 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=970/tid=988] ppid=968 vsize=941560 CPUtime=3.87 cores=0-31
/proc/970/task/988/stat : 988 (plingeling) R 968 970 944 0 -1 4202560 2571 1240 0 0 383 3 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=970/tid=989] ppid=968 vsize=941560 CPUtime=3.9 cores=0-31
/proc/970/task/989/stat : 989 (plingeling) R 968 970 944 0 -1 4202560 4632 1240 0 0 384 5 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=970/tid=990] ppid=968 vsize=941560 CPUtime=3.97 cores=0-31
/proc/970/task/990/stat : 990 (plingeling) R 968 970 944 0 -1 4202560 2884 1240 0 0 390 6 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366412 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=970/tid=991] ppid=968 vsize=941560 CPUtime=4.01 cores=0-31
/proc/970/task/991/stat : 991 (plingeling) R 968 970 944 0 -1 4202560 2447 1240 0 0 395 5 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4250648 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=970/tid=992] ppid=968 vsize=941560 CPUtime=3.96 cores=0-31
/proc/970/task/992/stat : 992 (plingeling) R 968 970 944 0 -1 4202560 5135 1240 0 0 389 6 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4237211 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=970/tid=993] ppid=968 vsize=941560 CPUtime=3.89 cores=0-31
/proc/970/task/993/stat : 993 (plingeling) R 968 970 944 0 -1 4202560 2904 1240 0 0 385 3 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4236928 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=970/tid=994] ppid=968 vsize=941560 CPUtime=3.96 cores=0-31
/proc/970/task/994/stat : 994 (plingeling) R 968 970 944 0 -1 4202560 4352 1240 0 0 388 7 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4281683 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=970/tid=995] ppid=968 vsize=941560 CPUtime=3.97 cores=0-31
/proc/970/task/995/stat : 995 (plingeling) R 968 970 944 0 -1 4202560 2543 1240 0 0 390 6 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 18446744073699065913 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=970/tid=996] ppid=968 vsize=941560 CPUtime=3.89 cores=0-31
/proc/970/task/996/stat : 996 (plingeling) R 968 970 944 0 -1 4202560 5131 1240 0 0 379 9 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=970/tid=997] ppid=968 vsize=941560 CPUtime=3.93 cores=0-31
/proc/970/task/997/stat : 997 (plingeling) R 968 970 944 0 -1 4202560 3536 1240 0 0 388 4 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364842 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=970/tid=998] ppid=968 vsize=941560 CPUtime=3.84 cores=0-31
/proc/970/task/998/stat : 998 (plingeling) R 968 970 944 0 -1 4202560 4129 1240 0 0 380 3 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=970/tid=999] ppid=968 vsize=941560 CPUtime=3.98 cores=0-31
/proc/970/task/999/stat : 999 (plingeling) R 968 970 944 0 -1 4202560 3073 1240 0 0 391 6 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4365946 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=970/tid=1000] ppid=968 vsize=941560 CPUtime=3.93 cores=0-31
/proc/970/task/1000/stat : 1000 (plingeling) R 968 970 944 0 -1 4202560 2593 1240 0 0 386 6 0 1 19 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=970/tid=1001] ppid=968 vsize=941560 CPUtime=3.99 cores=0-31
/proc/970/task/1001/stat : 1001 (plingeling) R 968 970 944 0 -1 4202560 3403 1240 0 0 391 7 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=970/tid=1002] ppid=968 vsize=941560 CPUtime=3.87 cores=0-31
/proc/970/task/1002/stat : 1002 (plingeling) R 968 970 944 0 -1 4202560 2293 1240 0 0 384 2 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=970/tid=1003] ppid=968 vsize=941560 CPUtime=3.99 cores=0-31
/proc/970/task/1003/stat : 1003 (plingeling) R 968 970 944 0 -1 4202560 4034 1240 0 0 391 7 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=970/tid=1004] ppid=968 vsize=941560 CPUtime=3.92 cores=0-31
/proc/970/task/1004/stat : 1004 (plingeling) R 968 970 944 0 -1 4202560 2968 1240 0 0 387 4 0 1 25 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4355437 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=970/tid=1005] ppid=968 vsize=941560 CPUtime=3.99 cores=0-31
/proc/970/task/1005/stat : 1005 (plingeling) R 968 970 944 0 -1 4202560 5708 1240 0 0 390 8 0 1 19 0 33 0 653432144 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=970/tid=1006] ppid=968 vsize=941560 CPUtime=3.96 cores=0-31
/proc/970/task/1006/stat : 1006 (plingeling) R 968 970 944 0 -1 4202560 5364 1240 0 0 389 6 0 1 25 0 33 0 653432145 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=970/tid=1007] ppid=968 vsize=941560 CPUtime=3.87 cores=0-31
/proc/970/task/1007/stat : 1007 (plingeling) R 968 970 944 0 -1 4202560 2557 1240 0 0 383 3 0 1 25 0 33 0 653432145 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4265485 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=970/tid=1008] ppid=968 vsize=941560 CPUtime=3.95 cores=0-31
/proc/970/task/1008/stat : 1008 (plingeling) R 968 970 944 0 -1 4202560 4724 1240 0 0 387 7 0 1 25 0 33 0 653432146 964157440 98116 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364607 0 0 4096 17442 0 0 0 -1 14 0 0 0
Current children cumulated CPU time (s) 134.97
Current children cumulated vsize (KiB) 941560

Solver just ended. Dumping a history of the last processes samples

[startup+12.8026 s]
/proc/loadavg: 25.68 30.59 31.55 33/446 1008
/proc/meminfo: memFree=255061928/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=939512 CPUtime=138.2 cores=0-31
/proc/970/stat : 970 (plingeling) S 968 970 944 0 -1 4202496 262800 1240 0 0 13609 210 0 1 20 0 33 0 653431286 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 25 0 0 0
/proc/970/statm: 234878 97744 175 55 0 232764 0
[pid=970/tid=977] ppid=968 vsize=939512 CPUtime=4.12 cores=0-31
/proc/970/task/977/stat : 977 (plingeling) R 968 970 944 0 -1 4202560 2910 1240 0 0 410 1 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=970/tid=978] ppid=968 vsize=939512 CPUtime=4.03 cores=0-31
/proc/970/task/978/stat : 978 (plingeling) R 968 970 944 0 -1 4202560 5096 1240 0 0 394 8 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4357621 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=970/tid=979] ppid=968 vsize=939512 CPUtime=4.08 cores=0-31
/proc/970/task/979/stat : 979 (plingeling) R 968 970 944 0 -1 4202560 2544 1240 0 0 400 7 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=970/tid=980] ppid=968 vsize=939512 CPUtime=4.17 cores=0-31
/proc/970/task/980/stat : 980 (plingeling) R 968 970 944 0 -1 4202560 1951 1240 0 0 413 3 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4281949 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=970/tid=981] ppid=968 vsize=939512 CPUtime=4.06 cores=0-31
/proc/970/task/981/stat : 981 (plingeling) R 968 970 944 0 -1 4202560 2861 1240 0 0 399 6 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=970/tid=982] ppid=968 vsize=939512 CPUtime=4.09 cores=0-31
/proc/970/task/982/stat : 982 (plingeling) R 968 970 944 0 -1 4202560 2537 1240 0 0 405 3 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364675 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=970/tid=983] ppid=968 vsize=939512 CPUtime=4.13 cores=0-31
/proc/970/task/983/stat : 983 (plingeling) R 968 970 944 0 -1 4202560 2542 1240 0 0 408 4 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=970/tid=984] ppid=968 vsize=939512 CPUtime=4.02 cores=0-31
/proc/970/task/984/stat : 984 (plingeling) R 968 970 944 0 -1 4202560 4547 1240 0 0 395 6 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 18446744073699065980 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=970/tid=985] ppid=968 vsize=939512 CPUtime=4.02 cores=0-31
/proc/970/task/985/stat : 985 (plingeling) R 968 970 944 0 -1 4202560 4333 1240 0 0 397 4 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=970/tid=986] ppid=968 vsize=939512 CPUtime=4.04 cores=0-31
/proc/970/task/986/stat : 986 (plingeling) R 968 970 944 0 -1 4202560 2327 1240 0 0 398 5 0 1 25 0 33 0 653432143 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=970/tid=987] ppid=968 vsize=939512 CPUtime=4.15 cores=0-31
/proc/970/task/987/stat : 987 (plingeling) R 968 970 944 0 -1 4202560 2523 1240 0 0 412 2 0 1 25 0 33 0 653432144 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4281851 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=970/tid=988] ppid=968 vsize=939512 CPUtime=3.97 cores=0-31
/proc/970/task/988/stat : 988 (plingeling) R 968 970 944 0 -1 4202560 2571 1240 0 0 393 3 0 1 25 0 33 0 653432144 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=970/tid=989] ppid=968 vsize=939512 CPUtime=4 cores=0-31
/proc/970/task/989/stat : 989 (plingeling) R 968 970 944 0 -1 4202560 4632 1240 0 0 394 5 0 1 25 0 33 0 653432144 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4250505 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=970/tid=990] ppid=968 vsize=939512 CPUtime=4.07 cores=0-31
/proc/970/task/990/stat : 990 (plingeling) R 968 970 944 0 -1 4202560 2884 1240 0 0 400 6 0 1 25 0 33 0 653432144 962060288 97744 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 22 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 919428

[startup+24.002 s]
/proc/loadavg: 26.65 30.64 31.56 33/446 1008
/proc/meminfo: memFree=255165780/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=899128 CPUtime=496.15 cores=0-31
/proc/970/stat : 970 (plingeling) S 968 970 944 0 -1 4202496 309440 1240 0 0 49388 226 0 1 20 0 33 0 653431286 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 25 0 0 0
/proc/970/statm: 224782 92373 175 55 0 222668 0
[pid=970/tid=977] ppid=968 vsize=899128 CPUtime=15.31 cores=0-31
/proc/970/task/977/stat : 977 (plingeling) R 968 970 944 0 -1 4202560 5537 1240 0 0 1528 2 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366105 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=970/tid=978] ppid=968 vsize=899128 CPUtime=15.04 cores=0-31
/proc/970/task/978/stat : 978 (plingeling) R 968 970 944 0 -1 4202560 6781 1240 0 0 1494 9 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=970/tid=979] ppid=968 vsize=899128 CPUtime=15.27 cores=0-31
/proc/970/task/979/stat : 979 (plingeling) R 968 970 944 0 -1 4202560 3640 1240 0 0 1519 7 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=970/tid=980] ppid=968 vsize=899128 CPUtime=15.37 cores=0-31
/proc/970/task/980/stat : 980 (plingeling) R 968 970 944 0 -1 4202560 1951 1240 0 0 1533 3 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=970/tid=981] ppid=968 vsize=899128 CPUtime=15.25 cores=0-31
/proc/970/task/981/stat : 981 (plingeling) R 968 970 944 0 -1 4202560 4996 1240 0 0 1518 6 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4250873 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=970/tid=982] ppid=968 vsize=899128 CPUtime=15.29 cores=0-31
/proc/970/task/982/stat : 982 (plingeling) R 968 970 944 0 -1 4202560 4662 1240 0 0 1524 4 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=970/tid=983] ppid=968 vsize=899128 CPUtime=15.32 cores=0-31
/proc/970/task/983/stat : 983 (plingeling) R 968 970 944 0 -1 4202560 3164 1240 0 0 1527 4 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=970/tid=984] ppid=968 vsize=899128 CPUtime=15.21 cores=0-31
/proc/970/task/984/stat : 984 (plingeling) R 968 970 944 0 -1 4202560 5941 1240 0 0 1514 6 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=970/tid=985] ppid=968 vsize=899128 CPUtime=15.2 cores=0-31
/proc/970/task/985/stat : 985 (plingeling) R 968 970 944 0 -1 4202560 6870 1240 0 0 1515 4 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=970/tid=986] ppid=968 vsize=899128 CPUtime=15.23 cores=0-31
/proc/970/task/986/stat : 986 (plingeling) R 968 970 944 0 -1 4202560 3865 1240 0 0 1517 5 0 1 25 0 33 0 653432143 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=970/tid=987] ppid=968 vsize=899128 CPUtime=15.34 cores=0-31
/proc/970/task/987/stat : 987 (plingeling) R 968 970 944 0 -1 4202560 3402 1240 0 0 1531 2 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=970/tid=988] ppid=968 vsize=899128 CPUtime=15.17 cores=0-31
/proc/970/task/988/stat : 988 (plingeling) R 968 970 944 0 -1 4202560 4519 1240 0 0 1512 4 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=970/tid=989] ppid=968 vsize=899128 CPUtime=15.19 cores=0-31
/proc/970/task/989/stat : 989 (plingeling) R 968 970 944 0 -1 4202560 5408 1240 0 0 1513 5 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=970/tid=990] ppid=968 vsize=899128 CPUtime=15.27 cores=0-31
/proc/970/task/990/stat : 990 (plingeling) R 968 970 944 0 -1 4202560 4616 1240 0 0 1519 7 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=970/tid=991] ppid=968 vsize=899128 CPUtime=15.32 cores=0-31
/proc/970/task/991/stat : 991 (plingeling) R 968 970 944 0 -1 4202560 3297 1240 0 0 1525 6 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4365111 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=970/tid=992] ppid=968 vsize=899128 CPUtime=15.26 cores=0-31
/proc/970/task/992/stat : 992 (plingeling) R 968 970 944 0 -1 4202560 6925 1240 0 0 1518 7 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=970/tid=993] ppid=968 vsize=899128 CPUtime=15.1 cores=0-31
/proc/970/task/993/stat : 993 (plingeling) R 968 970 944 0 -1 4202560 4081 1240 0 0 1506 3 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=970/tid=994] ppid=968 vsize=899128 CPUtime=15.27 cores=0-31
/proc/970/task/994/stat : 994 (plingeling) R 968 970 944 0 -1 4202560 6473 1240 0 0 1518 8 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4309496 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=970/tid=995] ppid=968 vsize=899128 CPUtime=15.26 cores=0-31
/proc/970/task/995/stat : 995 (plingeling) R 968 970 944 0 -1 4202560 3418 1240 0 0 1519 6 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4352405 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=970/tid=996] ppid=968 vsize=899128 CPUtime=15.18 cores=0-31
/proc/970/task/996/stat : 996 (plingeling) R 968 970 944 0 -1 4202560 6037 1240 0 0 1508 9 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364619 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=970/tid=997] ppid=968 vsize=899128 CPUtime=15.23 cores=0-31
/proc/970/task/997/stat : 997 (plingeling) R 968 970 944 0 -1 4202560 7180 1240 0 0 1517 5 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4236574 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=970/tid=998] ppid=968 vsize=899128 CPUtime=15.08 cores=0-31
/proc/970/task/998/stat : 998 (plingeling) R 968 970 944 0 -1 4202560 5337 1240 0 0 1504 3 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4309888 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=970/tid=999] ppid=968 vsize=899128 CPUtime=15.28 cores=0-31
/proc/970/task/999/stat : 999 (plingeling) R 968 970 944 0 -1 4202560 4494 1240 0 0 1520 7 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=970/tid=1000] ppid=968 vsize=899128 CPUtime=15.21 cores=0-31
/proc/970/task/1000/stat : 1000 (plingeling) R 968 970 944 0 -1 4202560 4077 1240 0 0 1514 6 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=970/tid=1001] ppid=968 vsize=899128 CPUtime=15.28 cores=0-31
/proc/970/task/1001/stat : 1001 (plingeling) R 968 970 944 0 -1 4202560 5046 1240 0 0 1520 7 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=970/tid=1002] ppid=968 vsize=899128 CPUtime=15.16 cores=0-31
/proc/970/task/1002/stat : 1002 (plingeling) R 968 970 944 0 -1 4202560 3197 1240 0 0 1513 2 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=970/tid=1003] ppid=968 vsize=899128 CPUtime=15.28 cores=0-31
/proc/970/task/1003/stat : 1003 (plingeling) R 968 970 944 0 -1 4202560 4784 1240 0 0 1520 7 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=970/tid=1004] ppid=968 vsize=899128 CPUtime=15.22 cores=0-31
/proc/970/task/1004/stat : 1004 (plingeling) R 968 970 944 0 -1 4202560 4255 1240 0 0 1516 5 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4263213 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=970/tid=1005] ppid=968 vsize=899128 CPUtime=15.28 cores=0-31
/proc/970/task/1005/stat : 1005 (plingeling) R 968 970 944 0 -1 4202560 6484 1240 0 0 1519 8 0 1 25 0 33 0 653432144 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=970/tid=1006] ppid=968 vsize=899128 CPUtime=15.25 cores=0-31
/proc/970/task/1006/stat : 1006 (plingeling) R 968 970 944 0 -1 4202560 7814 1240 0 0 1518 6 0 1 25 0 33 0 653432145 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=970/tid=1007] ppid=968 vsize=899128 CPUtime=15.16 cores=0-31
/proc/970/task/1007/stat : 1007 (plingeling) R 968 970 944 0 -1 4202560 3354 1240 0 0 1512 3 0 1 25 0 33 0 653432145 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=970/tid=1008] ppid=968 vsize=899128 CPUtime=15.24 cores=0-31
/proc/970/task/1008/stat : 1008 (plingeling) R 968 970 944 0 -1 4202560 6258 1240 0 0 1516 7 0 1 25 0 33 0 653432146 920707072 92373 268435456000 4194304 4417452 140733210787520 18446744073709551615 4365962 0 0 4096 17442 0 0 0 -1 14 0 0 0
Current children cumulated CPU time (s) 496.15
Current children cumulated vsize (KiB) 899128

[startup+24.202 s]
/proc/loadavg: 26.65 30.64 31.56 33/446 1008
/proc/meminfo: memFree=255184876/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=895092 CPUtime=502.77 cores=0-31
/proc/970/stat : 970 (plingeling) S 968 970 944 0 -1 4202496 309951 1240 0 0 50049 227 0 1 20 0 33 0 653431286 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 25 0 0 0
/proc/970/statm: 223773 91857 175 55 0 221659 0
[pid=970/tid=977] ppid=968 vsize=895092 CPUtime=15.53 cores=0-31
/proc/970/task/977/stat : 977 (plingeling) R 968 970 944 0 -1 4202560 6033 1240 0 0 1550 2 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=970/tid=978] ppid=968 vsize=895092 CPUtime=15.24 cores=0-31
/proc/970/task/978/stat : 978 (plingeling) R 968 970 944 0 -1 4202560 6781 1240 0 0 1514 9 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=970/tid=979] ppid=968 vsize=895092 CPUtime=15.49 cores=0-31
/proc/970/task/979/stat : 979 (plingeling) R 968 970 944 0 -1 4202560 3640 1240 0 0 1541 7 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=970/tid=980] ppid=968 vsize=895092 CPUtime=15.59 cores=0-31
/proc/970/task/980/stat : 980 (plingeling) R 968 970 944 0 -1 4202560 1951 1240 0 0 1555 3 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=970/tid=981] ppid=968 vsize=895092 CPUtime=15.47 cores=0-31
/proc/970/task/981/stat : 981 (plingeling) R 968 970 944 0 -1 4202560 4996 1240 0 0 1540 6 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=970/tid=982] ppid=968 vsize=895092 CPUtime=15.51 cores=0-31
/proc/970/task/982/stat : 982 (plingeling) R 968 970 944 0 -1 4202560 4662 1240 0 0 1546 4 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=970/tid=983] ppid=968 vsize=895092 CPUtime=15.54 cores=0-31
/proc/970/task/983/stat : 983 (plingeling) R 968 970 944 0 -1 4202560 3164 1240 0 0 1549 4 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4237002 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=970/tid=984] ppid=968 vsize=895092 CPUtime=15.43 cores=0-31
/proc/970/task/984/stat : 984 (plingeling) R 968 970 944 0 -1 4202560 5941 1240 0 0 1536 6 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=970/tid=985] ppid=968 vsize=895092 CPUtime=15.42 cores=0-31
/proc/970/task/985/stat : 985 (plingeling) R 968 970 944 0 -1 4202560 6870 1240 0 0 1537 4 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=970/tid=986] ppid=968 vsize=895092 CPUtime=15.45 cores=0-31
/proc/970/task/986/stat : 986 (plingeling) R 968 970 944 0 -1 4202560 3870 1240 0 0 1539 5 0 1 25 0 33 0 653432143 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4253198 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=970/tid=987] ppid=968 vsize=895092 CPUtime=15.56 cores=0-31
/proc/970/task/987/stat : 987 (plingeling) R 968 970 944 0 -1 4202560 3402 1240 0 0 1553 2 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=970/tid=988] ppid=968 vsize=895092 CPUtime=15.39 cores=0-31
/proc/970/task/988/stat : 988 (plingeling) R 968 970 944 0 -1 4202560 4519 1240 0 0 1534 4 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=970/tid=989] ppid=968 vsize=895092 CPUtime=15.41 cores=0-31
/proc/970/task/989/stat : 989 (plingeling) R 968 970 944 0 -1 4202560 5408 1240 0 0 1535 5 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=970/tid=990] ppid=968 vsize=895092 CPUtime=15.49 cores=0-31
/proc/970/task/990/stat : 990 (plingeling) R 968 970 944 0 -1 4202560 4616 1240 0 0 1541 7 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=970/tid=991] ppid=968 vsize=895092 CPUtime=15.54 cores=0-31
/proc/970/task/991/stat : 991 (plingeling) R 968 970 944 0 -1 4202560 3297 1240 0 0 1547 6 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=970/tid=992] ppid=968 vsize=895092 CPUtime=15.48 cores=0-31
/proc/970/task/992/stat : 992 (plingeling) R 968 970 944 0 -1 4202560 6925 1240 0 0 1540 7 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=970/tid=993] ppid=968 vsize=895092 CPUtime=15.32 cores=0-31
/proc/970/task/993/stat : 993 (plingeling) R 968 970 944 0 -1 4202560 4081 1240 0 0 1528 3 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4236930 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=970/tid=994] ppid=968 vsize=895092 CPUtime=15.49 cores=0-31
/proc/970/task/994/stat : 994 (plingeling) R 968 970 944 0 -1 4202560 6478 1240 0 0 1540 8 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 18446744073699065980 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=970/tid=995] ppid=968 vsize=895092 CPUtime=15.48 cores=0-31
/proc/970/task/995/stat : 995 (plingeling) R 968 970 944 0 -1 4202560 3418 1240 0 0 1541 6 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 18446744073699065958 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=970/tid=996] ppid=968 vsize=895092 CPUtime=15.41 cores=0-31
/proc/970/task/996/stat : 996 (plingeling) R 968 970 944 0 -1 4202560 6037 1240 0 0 1531 9 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=970/tid=997] ppid=968 vsize=895092 CPUtime=15.45 cores=0-31
/proc/970/task/997/stat : 997 (plingeling) R 968 970 944 0 -1 4202560 7180 1240 0 0 1539 5 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4244684 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=970/tid=998] ppid=968 vsize=895092 CPUtime=15.3 cores=0-31
/proc/970/task/998/stat : 998 (plingeling) R 968 970 944 0 -1 4202560 5342 1240 0 0 1526 3 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4236910 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=970/tid=999] ppid=968 vsize=895092 CPUtime=15.5 cores=0-31
/proc/970/task/999/stat : 999 (plingeling) R 968 970 944 0 -1 4202560 4494 1240 0 0 1542 7 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=970/tid=1000] ppid=968 vsize=895092 CPUtime=15.43 cores=0-31
/proc/970/task/1000/stat : 1000 (plingeling) R 968 970 944 0 -1 4202560 4077 1240 0 0 1536 6 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=970/tid=1001] ppid=968 vsize=895092 CPUtime=15.5 cores=0-31
/proc/970/task/1001/stat : 1001 (plingeling) R 968 970 944 0 -1 4202560 5046 1240 0 0 1542 7 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4237169 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=970/tid=1002] ppid=968 vsize=895092 CPUtime=15.38 cores=0-31
/proc/970/task/1002/stat : 1002 (plingeling) R 968 970 944 0 -1 4202560 3197 1240 0 0 1535 2 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=970/tid=1003] ppid=968 vsize=895092 CPUtime=15.5 cores=0-31
/proc/970/task/1003/stat : 1003 (plingeling) R 968 970 944 0 -1 4202560 4784 1240 0 0 1542 7 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4365946 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=970/tid=1004] ppid=968 vsize=895092 CPUtime=15.44 cores=0-31
/proc/970/task/1004/stat : 1004 (plingeling) R 968 970 944 0 -1 4202560 4255 1240 0 0 1538 5 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364589 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=970/tid=1005] ppid=968 vsize=895092 CPUtime=15.5 cores=0-31
/proc/970/task/1005/stat : 1005 (plingeling) R 968 970 944 0 -1 4202560 6484 1240 0 0 1541 8 0 1 25 0 33 0 653432144 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4265403 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=970/tid=1006] ppid=968 vsize=895092 CPUtime=15.47 cores=0-31
/proc/970/task/1006/stat : 1006 (plingeling) R 968 970 944 0 -1 4202560 7814 1240 0 0 1540 6 0 1 25 0 33 0 653432145 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=970/tid=1007] ppid=968 vsize=895092 CPUtime=15.38 cores=0-31
/proc/970/task/1007/stat : 1007 (plingeling) R 968 970 944 0 -1 4202560 3354 1240 0 0 1534 3 0 1 25 0 33 0 653432145 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=970/tid=1008] ppid=968 vsize=895092 CPUtime=15.46 cores=0-31
/proc/970/task/1008/stat : 1008 (plingeling) R 968 970 944 0 -1 4202560 6258 1240 0 0 1538 7 0 1 25 0 33 0 653432146 916574208 91857 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 14 0 0 0
Current children cumulated CPU time (s) 502.77
Current children cumulated vsize (KiB) 895092

[startup+24.3221 s]
/proc/loadavg: 26.65 30.64 31.56 33/446 1008
/proc/meminfo: memFree=255184876/264257624 swapFree=67111528/67111528
[pid=970] ppid=968 vsize=844664 CPUtime=505.65 cores=0-31
/proc/970/stat : 970 (plingeling) S 968 970 944 0 -1 4202496 310959 1240 0 0 50337 227 0 1 17 0 8 0 653431286 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 25 0 0 0
/proc/970/statm: 211166 92060 176 55 0 209052 0
[pid=970/tid=985] ppid=968 vsize=844664 CPUtime=15.53 cores=0-31
/proc/970/task/985/stat : 985 (plingeling) R 968 970 944 0 -1 4202560 7167 1240 0 0 1547 5 0 1 25 0 8 0 653432143 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 4353543 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=970/tid=987] ppid=968 vsize=844664 CPUtime=15.66 cores=0-31
/proc/970/task/987/stat : 987 (plingeling) R 968 970 944 0 -1 4202560 3402 1240 0 0 1563 2 0 1 25 0 8 0 653432144 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 4265499 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=970/tid=988] ppid=968 vsize=844664 CPUtime=15.49 cores=0-31
/proc/970/task/988/stat : 988 (plingeling) R 968 970 944 0 -1 4202560 4519 1240 0 0 1544 4 0 1 25 0 8 0 653432144 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 4250571 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=970/tid=991] ppid=968 vsize=844664 CPUtime=15.64 cores=0-31
/proc/970/task/991/stat : 991 (plingeling) R 968 970 944 0 -1 4202560 3297 1240 0 0 1557 6 0 1 25 0 8 0 653432144 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=970/tid=993] ppid=968 vsize=844664 CPUtime=15.42 cores=0-31
/proc/970/task/993/stat : 993 (plingeling) R 968 970 944 0 -1 4202560 4081 1240 0 0 1538 3 0 1 25 0 8 0 653432144 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=970/tid=998] ppid=968 vsize=844664 CPUtime=15.4 cores=0-31
/proc/970/task/998/stat : 998 (plingeling) R 968 970 944 0 -1 4202560 5342 1240 0 0 1536 3 0 1 25 0 8 0 653432144 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 4354259 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=970/tid=1002] ppid=968 vsize=844664 CPUtime=15.48 cores=0-31
/proc/970/task/1002/stat : 1002 (plingeling) R 968 970 944 0 -1 4202560 3197 1240 0 0 1545 2 0 1 25 0 8 0 653432144 864935936 92060 268435456000 4194304 4417452 140733210787520 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 17 0 0 0
Current children cumulated CPU time (s) 505.65
Current children cumulated vsize (KiB) 844664

Child status: 20
Real time (s): 24.3756
CPU time (s): 505.763
CPU user time (s): 503.435
CPU system time (s): 2.32765
CPU usage (%): 2074.88
Max. virtual memory (cumulated for all children) (KiB): 1186712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 503.435
system time used= 2.32765
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 312203
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4733
involuntary context switches= 1350

runsolver used 0.160975 second user time and 0.598908 second system time

The end

Launcher Data

Begin job on node200 at 2011-05-15 02:30:49
IDJOB=3372096
IDBENCH=20346
IDSOLVER=1852
FILE ID=node200/3372096-1305419448
RUNJOBID= node200-1305419448-958
PBS_JOBID= 13285497
Free space on /tmp= 62044 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT07/industrial/anbulagan/medium-unsat/dated-5-11-u.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372096-1305419448/watcher-3372096-1305419448 -o /tmp/evaluation-result-3372096-1305419448/solver-3372096-1305419448 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372096-1305419448.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 083d28c2adf10233f37f8b5a078c94a9
RANDOM SEED=1547678730

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255577840 kB
Buffers:        438476 kB
Cached:        7835528 kB
SwapCached:          0 kB
Active:        7384520 kB
Inactive:       957956 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255577840 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            8092 kB
Writeback:           0 kB
AnonPages:       69924 kB
Mapped:          13332 kB
Slab:           250256 kB
PageTables:       4524 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   192292 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62044 MiB
End job on node200 at 2011-05-15 02:31:13