Trace number 3372810

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 160002 5068.77

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00N23.cnf
MD5SUM1a1f0dddf727883e0973677dd00e9269
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2210893
Sum of the clauses size20370578
Maximum clause length105
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 241189
Number of clauses of size 336730
Number of clauses of size 432798
Number of clauses of size 5188784
Number of clauses of size over 51911364

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372810-1306054231/watcher-3372810-1306054231 -o /tmp/evaluation-result-3372810-1306054231/solver-3372810-1306054231 -C 160000 -W 5100 -M 266338304 plingeling -t 32 HOME/instance-3372810-1306054231.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 27.16 30.97 31.66 2/413 25034
/proc/meminfo: memFree=255385136/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=18516 CPUtime=0.03 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 2718 1241 0 0 2 0 0 1 24 0 1 0 716909973 18960384 2649 268435456000 4194304 4417452 140737404881296 18446744073709551615 258650649801 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 4629 2649 145 55 0 2515 0

[startup+0.07713 s]
/proc/loadavg: 27.16 30.97 31.66 2/413 25034
/proc/meminfo: memFree=255385136/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=22904 CPUtime=0.07 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 3816 1241 0 0 6 0 0 1 24 0 1 0 716909973 23453696 3747 268435456000 4194304 4417452 140737404881296 18446744073709551615 4320823 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 5726 3747 146 55 0 3612 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 22904

[startup+0.101172 s]
/proc/loadavg: 27.16 30.97 31.66 2/413 25034
/proc/meminfo: memFree=255385136/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=31372 CPUtime=0.1 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 6061 1241 0 0 8 1 0 1 24 0 1 0 716909973 32124928 5864 268435456000 4194304 4417452 140737404881296 18446744073709551615 4259618 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 7843 5864 146 55 0 5729 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 31372

[startup+0.301138 s]
/proc/loadavg: 27.16 30.97 31.66 2/413 25034
/proc/meminfo: memFree=255385136/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=39412 CPUtime=0.29 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 8111 1241 0 0 27 1 0 1 25 0 1 0 716909973 40357888 7874 268435456000 4194304 4417452 140737404881296 18446744073709551615 4231468 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 9853 7874 146 55 0 7739 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 39412

[startup+0.701153 s]
/proc/loadavg: 27.16 30.97 31.66 2/413 25034
/proc/meminfo: memFree=255385136/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=64268 CPUtime=0.7 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 14645 1241 0 0 65 4 0 1 25 0 1 0 716909973 65810432 14088 268435456000 4194304 4417452 140737404881296 18446744073709551615 4231569 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 16067 14088 146 55 0 13953 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 64268

[startup+1.50118 s]
/proc/loadavg: 27.16 30.97 31.66 2/414 25040
/proc/meminfo: memFree=255280956/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=173332 CPUtime=1.5 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 41741 1241 0 0 140 9 0 1 25 0 1 0 716909973 177491968 41056 268435456000 4194304 4417452 140737404881296 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 43333 41074 146 55 0 41219 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 173332

[startup+3.10124 s]
/proc/loadavg: 27.16 30.97 31.66 2/414 25040
/proc/meminfo: memFree=255214588/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=343316 CPUtime=3.09 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 84535 1241 0 0 291 17 0 1 25 0 1 0 716909973 351555584 83850 268435456000 4194304 4417452 140737404881296 18446744073709551615 4231480 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 85829 83850 146 55 0 83715 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 343316

[startup+6.30036 s]
/proc/loadavg: 25.06 30.47 31.50 2/414 25040
/proc/meminfo: memFree=254789180/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=605460 CPUtime=6.3 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 150071 1241 0 0 599 30 0 1 25 0 1 0 716909973 619991040 149386 268435456000 4194304 4417452 140737404881296 18446744073709551615 4320831 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 151365 149386 146 55 0 149251 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 605460

[startup+12.7006 s]
/proc/loadavg: 23.30 30.01 31.34 2/414 25040
/proc/meminfo: memFree=253774012/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=1620508 CPUtime=12.7 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 403801 1241 0 0 1191 78 0 1 25 0 1 0 716909973 1659400192 403116 268435456000 4194304 4417452 140737404881296 18446744073709551615 4231554 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 405127 403116 146 55 0 403013 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 1620508

[startup+25.501 s]
/proc/loadavg: 18.36 28.59 30.86 2/414 25042
/proc/meminfo: memFree=252201068/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=3193372 CPUtime=25.49 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 797017 1241 0 0 2395 153 0 1 25 0 1 0 716909973 3270012928 796332 268435456000 4194304 4417452 140737404881296 18446744073709551615 4323376 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 798343 796332 146 55 0 796229 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 3193372

[startup+51.101 s]
/proc/loadavg: 12.43 26.37 30.06 2/414 25042
/proc/meminfo: memFree=249050924/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=6339100 CPUtime=51.08 cores=0-31
/proc/25034/stat : 25034 (plingeling) R 25032 25034 25008 0 -1 4202496 1583449 1241 0 0 4804 303 0 1 25 0 1 0 716909973 6491238400 1582764 268435456000 4194304 4417452 140737404881296 18446744073709551615 4231256 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/25034/statm: 1584775 1582764 146 55 0 1582661 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 6339100

[startup+102.324 s]
/proc/loadavg: 22.38 26.81 30.01 33/446 25076
/proc/meminfo: memFree=247155492/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=8804324 CPUtime=1286.7 cores=0-31
/proc/25034/stat : 25034 (plingeling) S 25032 25034 25008 0 -1 4202496 3490053 1241 0 0 120342 8327 0 1 19 0 33 0 716909973 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/25034/statm: 2201081 2052400 175 55 0 2198967 0
[pid=25034/tid=25043] ppid=25032 vsize=8804324 CPUtime=39.97 cores=0-31
/proc/25034/task/25043/stat : 25043 (plingeling) R 25032 25034 25008 0 -1 4202560 52445 1241 0 0 3752 244 0 1 25 0 33 0 716915810 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=25034/tid=25044] ppid=25032 vsize=8804324 CPUtime=38.08 cores=0-31
/proc/25034/task/25044/stat : 25044 (plingeling) R 25032 25034 25008 0 -1 4202560 73773 1241 0 0 3530 277 0 1 25 0 33 0 716915810 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4302932 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=25034/tid=25045] ppid=25032 vsize=8804324 CPUtime=40.19 cores=0-31
/proc/25034/task/25045/stat : 25045 (plingeling) R 25032 25034 25008 0 -1 4202560 49988 1241 0 0 3914 104 0 1 25 0 33 0 716915811 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=25034/tid=25046] ppid=25032 vsize=8804324 CPUtime=40.96 cores=0-31
/proc/25034/task/25046/stat : 25046 (plingeling) R 25032 25034 25008 0 -1 4202560 18793 1241 0 0 4051 44 0 1 25 0 33 0 716915811 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=25034/tid=25047] ppid=25032 vsize=8804324 CPUtime=40.14 cores=0-31
/proc/25034/task/25047/stat : 25047 (plingeling) R 25032 25034 25008 0 -1 4202560 52142 1241 0 0 3796 217 0 1 25 0 33 0 716915811 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=25034/tid=25048] ppid=25032 vsize=8804324 CPUtime=36.1 cores=0-31
/proc/25034/task/25048/stat : 25048 (plingeling) R 25032 25034 25008 0 -1 4202560 73637 1241 0 0 3280 329 0 1 25 0 33 0 716915812 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4302847 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=25034/tid=25049] ppid=25032 vsize=8804324 CPUtime=36.94 cores=0-31
/proc/25034/task/25049/stat : 25049 (plingeling) R 25032 25034 25008 0 -1 4202560 50189 1241 0 0 3374 319 0 1 25 0 33 0 716915812 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=25034/tid=25050] ppid=25032 vsize=8804324 CPUtime=39.25 cores=0-31
/proc/25034/task/25050/stat : 25050 (plingeling) R 25032 25034 25008 0 -1 4202560 52108 1241 0 0 3712 212 0 1 25 0 33 0 716915813 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=25034/tid=25051] ppid=25032 vsize=8804324 CPUtime=37.97 cores=0-31
/proc/25034/task/25051/stat : 25051 (plingeling) R 25032 25034 25008 0 -1 4202560 74396 1241 0 0 3487 309 0 1 25 0 33 0 716915813 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=25034/tid=25052] ppid=25032 vsize=8804324 CPUtime=37.24 cores=0-31
/proc/25034/task/25052/stat : 25052 (plingeling) R 25032 25034 25008 0 -1 4202560 74494 1241 0 0 3403 320 0 1 25 0 33 0 716915814 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4278168 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=25034/tid=25053] ppid=25032 vsize=8804324 CPUtime=36.51 cores=0-31
/proc/25034/task/25053/stat : 25053 (plingeling) R 25032 25034 25008 0 -1 4202560 49953 1241 0 0 3361 289 0 1 25 0 33 0 716915814 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=25034/tid=25054] ppid=25032 vsize=8804324 CPUtime=37.84 cores=0-31
/proc/25034/task/25054/stat : 25054 (plingeling) R 25032 25034 25008 0 -1 4202560 73439 1241 0 0 3506 277 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=25034/tid=25055] ppid=25032 vsize=8804324 CPUtime=40.29 cores=0-31
/proc/25034/task/25055/stat : 25055 (plingeling) R 25032 25034 25008 0 -1 4202560 52741 1241 0 0 3782 246 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25034/tid=25056] ppid=25032 vsize=8804324 CPUtime=37.54 cores=0-31
/proc/25034/task/25056/stat : 25056 (plingeling) R 25032 25034 25008 0 -1 4202560 73775 1241 0 0 3467 286 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=25034/tid=25057] ppid=25032 vsize=8804324 CPUtime=36.78 cores=0-31
/proc/25034/task/25057/stat : 25057 (plingeling) R 25032 25034 25008 0 -1 4202560 50150 1241 0 0 3344 333 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4344154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25034/tid=25058] ppid=25032 vsize=8804324 CPUtime=37.45 cores=0-31
/proc/25034/task/25058/stat : 25058 (plingeling) R 25032 25034 25008 0 -1 4202560 73875 1241 0 0 3461 283 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364576 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=25034/tid=25059] ppid=25032 vsize=8804324 CPUtime=39.89 cores=0-31
/proc/25034/task/25059/stat : 25059 (plingeling) R 25032 25034 25008 0 -1 4202560 52686 1241 0 0 3751 237 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=25034/tid=25060] ppid=25032 vsize=8804324 CPUtime=38.22 cores=0-31
/proc/25034/task/25060/stat : 25060 (plingeling) R 25032 25034 25008 0 -1 4202560 74744 1241 0 0 3680 141 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=25034/tid=25061] ppid=25032 vsize=8804324 CPUtime=36.83 cores=0-31
/proc/25034/task/25061/stat : 25061 (plingeling) R 25032 25034 25008 0 -1 4202560 50057 1241 0 0 3406 276 0 1 25 0 33 0 716915815 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25034/tid=25062] ppid=25032 vsize=8804324 CPUtime=38.67 cores=0-31
/proc/25034/task/25062/stat : 25062 (plingeling) R 25032 25034 25008 0 -1 4202560 73826 1241 0 0 3583 283 0 1 25 0 33 0 716915816 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=25034/tid=25063] ppid=25032 vsize=8804324 CPUtime=38.68 cores=0-31
/proc/25034/task/25063/stat : 25063 (plingeling) R 25032 25034 25008 0 -1 4202560 73541 1241 0 0 3587 280 0 1 25 0 33 0 716915818 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=25034/tid=25064] ppid=25032 vsize=8804324 CPUtime=40.47 cores=0-31
/proc/25034/task/25064/stat : 25064 (plingeling) R 25032 25034 25008 0 -1 4202560 53060 1241 0 0 3816 230 0 1 25 0 33 0 716915818 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4277897 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25034/tid=25065] ppid=25032 vsize=8804324 CPUtime=40.87 cores=0-31
/proc/25034/task/25065/stat : 25065 (plingeling) R 25032 25034 25008 0 -1 4202560 51034 1241 0 0 3887 199 0 1 25 0 33 0 716915818 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=25034/tid=25066] ppid=25032 vsize=8804324 CPUtime=40.63 cores=0-31
/proc/25034/task/25066/stat : 25066 (plingeling) R 25032 25034 25008 0 -1 4202560 52198 1241 0 0 3827 235 0 1 25 0 33 0 716915818 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=25034/tid=25067] ppid=25032 vsize=8804324 CPUtime=40.74 cores=0-31
/proc/25034/task/25067/stat : 25067 (plingeling) R 25032 25034 25008 0 -1 4202560 52632 1241 0 0 3832 241 0 1 25 0 33 0 716915818 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25034/tid=25068] ppid=25032 vsize=8804324 CPUtime=35.02 cores=0-31
/proc/25034/task/25068/stat : 25068 (plingeling) R 25032 25034 25008 0 -1 4202560 52375 1241 0 0 3281 220 0 1 25 0 33 0 716915819 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25034/tid=25069] ppid=25032 vsize=8804324 CPUtime=36.51 cores=0-31
/proc/25034/task/25069/stat : 25069 (plingeling) R 25032 25034 25008 0 -1 4202560 51027 1241 0 0 3402 248 0 1 25 0 33 0 716915819 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25034/tid=25070] ppid=25032 vsize=8804324 CPUtime=39.48 cores=0-31
/proc/25034/task/25070/stat : 25070 (plingeling) R 25032 25034 25008 0 -1 4202560 52175 1241 0 0 3712 235 0 1 25 0 33 0 716915819 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=25034/tid=25071] ppid=25032 vsize=8804324 CPUtime=37.63 cores=0-31
/proc/25034/task/25071/stat : 25071 (plingeling) R 25032 25034 25008 0 -1 4202560 73807 1241 0 0 3477 285 0 1 25 0 33 0 716915820 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=25034/tid=25072] ppid=25032 vsize=8804324 CPUtime=37.8 cores=0-31
/proc/25034/task/25072/stat : 25072 (plingeling) R 25032 25034 25008 0 -1 4202560 74442 1241 0 0 3497 282 0 1 25 0 33 0 716915820 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=25034/tid=25073] ppid=25032 vsize=8804324 CPUtime=36.64 cores=0-31
/proc/25034/task/25073/stat : 25073 (plingeling) R 25032 25034 25008 0 -1 4202560 49729 1241 0 0 3396 267 0 1 25 0 33 0 716915820 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=25034/tid=25074] ppid=25032 vsize=8804324 CPUtime=37.05 cores=0-31
/proc/25034/task/25074/stat : 25074 (plingeling) R 25032 25034 25008 0 -1 4202560 73332 1241 0 0 3444 260 0 1 25 0 33 0 716915820 9015627776 2052400 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 27 0 0 0
Current children cumulated CPU time (s) 1286.7
Current children cumulated vsize (KiB) 8804324

[startup+162.302 s]
/proc/loadavg: 28.55 27.78 30.14 33/446 25076
/proc/meminfo: memFree=247727628/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=8114140 CPUtime=3203.64 cores=0-31
/proc/25034/stat : 25034 (plingeling) S 25032 25034 25008 0 -1 4202496 4587496 1241 0 0 311668 8695 0 1 19 0 33 0 716909973 8308879360 1880613 268435456000 4194304 4417452 140737404881296 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/25034/statm: 2028535 1880613 175 55 0 2026421 0
[pid=25034/tid=25043] ppid=25032 vsize=8114140 CPUtime=99.93 cores=0-31
/proc/25034/task/25043/stat : 25043 (plingeling) R 25032 25034 25008 0 -1 4202560 85213 1241 0 0 9740 252 0 1 25 0 33 0 716915810 8308879360 1880613 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=25034/tid=25044] ppid=25032 vsize=8114140 CPUtime=98.04 cores=0-31

################
# More data... #
################

/proc/25034/task/25048/stat : 25048 (plingeling) R 25032 25034 25008 0 -1 4202560 634137 1241 0 0 492648 987 0 1 25 0 33 0 716915812 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=25034/tid=25049] ppid=25032 vsize=9019232 CPUtime=4952.49 cores=0-31
/proc/25034/task/25049/stat : 25049 (plingeling) R 25032 25034 25008 0 -1 4202560 391871 1241 0 0 494510 738 0 1 25 0 33 0 716915812 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=25034/tid=25050] ppid=25032 vsize=9019232 CPUtime=4946.05 cores=0-31
/proc/25034/task/25050/stat : 25050 (plingeling) R 25032 25034 25008 0 -1 4202560 367099 1241 0 0 494037 567 0 1 25 0 33 0 716915813 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25034/tid=25051] ppid=25032 vsize=9019232 CPUtime=4956.71 cores=0-31
/proc/25034/task/25051/stat : 25051 (plingeling) R 25032 25034 25008 0 -1 4202560 458755 1241 0 0 494956 714 0 1 25 0 33 0 716915813 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=25034/tid=25052] ppid=25032 vsize=9019232 CPUtime=4949.77 cores=0-31
/proc/25034/task/25052/stat : 25052 (plingeling) R 25032 25034 25008 0 -1 4202560 473302 1241 0 0 494173 803 0 1 25 0 33 0 716915814 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=25034/tid=25053] ppid=25032 vsize=9019232 CPUtime=4950.08 cores=0-31
/proc/25034/task/25053/stat : 25053 (plingeling) R 25032 25034 25008 0 -1 4202560 394943 1241 0 0 494360 647 0 1 25 0 33 0 716915814 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=25034/tid=25054] ppid=25032 vsize=9019232 CPUtime=4956.32 cores=0-31
/proc/25034/task/25054/stat : 25054 (plingeling) R 25032 25034 25008 0 -1 4202560 583296 1241 0 0 494722 909 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4358093 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=25034/tid=25055] ppid=25032 vsize=9019232 CPUtime=4935.18 cores=0-31
/proc/25034/task/25055/stat : 25055 (plingeling) R 25032 25034 25008 0 -1 4202560 454039 1241 0 0 492785 732 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=25034/tid=25056] ppid=25032 vsize=9019232 CPUtime=4956.28 cores=0-31
/proc/25034/task/25056/stat : 25056 (plingeling) R 25032 25034 25008 0 -1 4202560 287924 1241 0 0 495127 500 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=25034/tid=25057] ppid=25032 vsize=9019232 CPUtime=4955.34 cores=0-31
/proc/25034/task/25057/stat : 25057 (plingeling) R 25032 25034 25008 0 -1 4202560 429611 1241 0 0 494694 839 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=25034/tid=25058] ppid=25032 vsize=9019232 CPUtime=4955.36 cores=0-31
/proc/25034/task/25058/stat : 25058 (plingeling) R 25032 25034 25008 0 -1 4202560 441950 1241 0 0 494752 783 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25034/tid=25059] ppid=25032 vsize=9019232 CPUtime=4952.01 cores=0-31
/proc/25034/task/25059/stat : 25059 (plingeling) R 25032 25034 25008 0 -1 4202560 581575 1241 0 0 494330 870 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25034/tid=25060] ppid=25032 vsize=9019232 CPUtime=4954.92 cores=0-31
/proc/25034/task/25060/stat : 25060 (plingeling) R 25032 25034 25008 0 -1 4202560 807078 1241 0 0 494336 1155 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=25034/tid=25061] ppid=25032 vsize=9019232 CPUtime=4949.16 cores=0-31
/proc/25034/task/25061/stat : 25061 (plingeling) R 25032 25034 25008 0 -1 4202560 319409 1241 0 0 494310 605 0 1 25 0 33 0 716915815 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4263206 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25034/tid=25062] ppid=25032 vsize=9019232 CPUtime=4957.24 cores=0-31
/proc/25034/task/25062/stat : 25062 (plingeling) R 25032 25034 25008 0 -1 4202560 397752 1241 0 0 495118 605 0 1 25 0 33 0 716915816 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=25034/tid=25063] ppid=25032 vsize=9019232 CPUtime=4947.15 cores=0-31
/proc/25034/task/25063/stat : 25063 (plingeling) R 25032 25034 25008 0 -1 4202560 766981 1241 0 0 493754 960 0 1 25 0 33 0 716915818 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=25034/tid=25064] ppid=25032 vsize=9019232 CPUtime=4955.46 cores=0-31
/proc/25034/task/25064/stat : 25064 (plingeling) R 25032 25034 25008 0 -1 4202560 576387 1241 0 0 494726 819 0 1 25 0 33 0 716915818 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=25034/tid=25065] ppid=25032 vsize=9019232 CPUtime=4958.75 cores=0-31
/proc/25034/task/25065/stat : 25065 (plingeling) R 25032 25034 25008 0 -1 4202560 516931 1241 0 0 494946 928 0 1 25 0 33 0 716915818 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=25034/tid=25066] ppid=25032 vsize=9019232 CPUtime=4958.96 cores=0-31
/proc/25034/task/25066/stat : 25066 (plingeling) R 25032 25034 25008 0 -1 4202560 503926 1241 0 0 495105 790 0 1 25 0 33 0 716915818 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364861 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=25034/tid=25067] ppid=25032 vsize=9019232 CPUtime=4957.63 cores=0-31
/proc/25034/task/25067/stat : 25067 (plingeling) R 25032 25034 25008 0 -1 4202560 432269 1241 0 0 494981 781 0 1 25 0 33 0 716915818 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=25034/tid=25068] ppid=25032 vsize=9019232 CPUtime=4953.72 cores=0-31
/proc/25034/task/25068/stat : 25068 (plingeling) R 25032 25034 25008 0 -1 4202560 357277 1241 0 0 494728 643 0 1 25 0 33 0 716915819 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=25034/tid=25069] ppid=25032 vsize=9019232 CPUtime=4948.79 cores=0-31
/proc/25034/task/25069/stat : 25069 (plingeling) R 25032 25034 25008 0 -1 4202560 372846 1241 0 0 494239 639 0 1 25 0 33 0 716915819 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=25034/tid=25070] ppid=25032 vsize=9019232 CPUtime=4958.07 cores=0-31
/proc/25034/task/25070/stat : 25070 (plingeling) R 25032 25034 25008 0 -1 4202560 451667 1241 0 0 494976 830 0 1 25 0 33 0 716915819 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25034/tid=25071] ppid=25032 vsize=9019232 CPUtime=4956.17 cores=0-31
/proc/25034/task/25071/stat : 25071 (plingeling) R 25032 25034 25008 0 -1 4202560 415193 1241 0 0 494935 681 0 1 25 0 33 0 716915820 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=25034/tid=25072] ppid=25032 vsize=9019232 CPUtime=4942.39 cores=0-31
/proc/25034/task/25072/stat : 25072 (plingeling) R 25032 25034 25008 0 -1 4202560 589886 1241 0 0 493399 839 0 1 25 0 33 0 716915820 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=25034/tid=25073] ppid=25032 vsize=9019232 CPUtime=4949.83 cores=0-31
/proc/25034/task/25073/stat : 25073 (plingeling) R 25032 25034 25008 0 -1 4202560 285925 1241 0 0 494511 471 0 1 25 0 33 0 716915820 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25034/tid=25074] ppid=25032 vsize=9019232 CPUtime=4954.87 cores=0-31
/proc/25034/task/25074/stat : 25074 (plingeling) R 25032 25034 25008 0 -1 4202560 467310 1241 0 0 494829 657 0 1 25 0 33 0 716915820 9235693568 2106739 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 158536
Current children cumulated vsize (KiB) 9019232



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5068.1 s]
/proc/loadavg: 32.12 32.07 32.06 33/446 25229
/proc/meminfo: memFree=247002848/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=8970088 CPUtime=160001 cores=0-31
/proc/25034/stat : 25034 (plingeling) S 25032 25034 25008 0 -1 4202496 16686922 1241 0 0 15975602 24478 0 1 19 0 33 0 716909973 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/25034/statm: 2242522 2094028 175 55 0 2240408 0
[pid=25034/tid=25043] ppid=25032 vsize=8970088 CPUtime=5004.59 cores=0-31
/proc/25034/task/25043/stat : 25043 (plingeling) R 25032 25034 25008 0 -1 4202560 341848 1241 0 0 499814 644 0 1 25 0 33 0 716915810 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=25034/tid=25044] ppid=25032 vsize=8970088 CPUtime=5002.6 cores=0-31
/proc/25034/task/25044/stat : 25044 (plingeling) R 25032 25034 25008 0 -1 4202560 488291 1241 0 0 499422 837 0 1 25 0 33 0 716915810 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=25034/tid=25045] ppid=25032 vsize=8970088 CPUtime=5003.57 cores=0-31
/proc/25034/task/25045/stat : 25045 (plingeling) R 25032 25034 25008 0 -1 4202560 441667 1241 0 0 499797 559 0 1 25 0 33 0 716915811 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25034/tid=25046] ppid=25032 vsize=8970088 CPUtime=4986.54 cores=0-31
/proc/25034/task/25046/stat : 25046 (plingeling) R 25032 25034 25008 0 -1 4202560 636522 1241 0 0 497678 975 0 1 25 0 33 0 716915811 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=25034/tid=25047] ppid=25032 vsize=8970088 CPUtime=5004.64 cores=0-31
/proc/25034/task/25047/stat : 25047 (plingeling) R 25032 25034 25008 0 -1 4202560 341412 1241 0 0 499927 536 0 1 25 0 33 0 716915811 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=25034/tid=25048] ppid=25032 vsize=8970088 CPUtime=4982.18 cores=0-31
/proc/25034/task/25048/stat : 25048 (plingeling) R 25032 25034 25008 0 -1 4202560 635702 1241 0 0 497225 992 0 1 25 0 33 0 716915812 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=25034/tid=25049] ppid=25032 vsize=8970088 CPUtime=4998.3 cores=0-31
/proc/25034/task/25049/stat : 25049 (plingeling) R 25032 25034 25008 0 -1 4202560 391871 1241 0 0 499091 738 0 1 25 0 33 0 716915812 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=25034/tid=25050] ppid=25032 vsize=8970088 CPUtime=4991.86 cores=0-31
/proc/25034/task/25050/stat : 25050 (plingeling) R 25032 25034 25008 0 -1 4202560 369175 1241 0 0 498612 573 0 1 25 0 33 0 716915813 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25034/tid=25051] ppid=25032 vsize=8970088 CPUtime=5002.52 cores=0-31
/proc/25034/task/25051/stat : 25051 (plingeling) R 25032 25034 25008 0 -1 4202560 460078 1241 0 0 499533 718 0 1 25 0 33 0 716915813 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=25034/tid=25052] ppid=25032 vsize=8970088 CPUtime=4995.58 cores=0-31
/proc/25034/task/25052/stat : 25052 (plingeling) R 25032 25034 25008 0 -1 4202560 479065 1241 0 0 498750 807 0 1 25 0 33 0 716915814 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4262481 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=25034/tid=25053] ppid=25032 vsize=8970088 CPUtime=4995.89 cores=0-31
/proc/25034/task/25053/stat : 25053 (plingeling) R 25032 25034 25008 0 -1 4202560 396741 1241 0 0 498941 647 0 1 25 0 33 0 716915814 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=25034/tid=25054] ppid=25032 vsize=8970088 CPUtime=5002.1 cores=0-31
/proc/25034/task/25054/stat : 25054 (plingeling) R 25032 25034 25008 0 -1 4202560 588507 1241 0 0 499291 918 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=25034/tid=25055] ppid=25032 vsize=8970088 CPUtime=4980.98 cores=0-31
/proc/25034/task/25055/stat : 25055 (plingeling) R 25032 25034 25008 0 -1 4202560 454039 1241 0 0 497365 732 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=25034/tid=25056] ppid=25032 vsize=8970088 CPUtime=5002.1 cores=0-31
/proc/25034/task/25056/stat : 25056 (plingeling) R 25032 25034 25008 0 -1 4202560 287924 1241 0 0 499709 500 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=25034/tid=25057] ppid=25032 vsize=8970088 CPUtime=5001.15 cores=0-31
/proc/25034/task/25057/stat : 25057 (plingeling) R 25032 25034 25008 0 -1 4202560 434945 1241 0 0 499264 850 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=25034/tid=25058] ppid=25032 vsize=8970088 CPUtime=5001.17 cores=0-31
/proc/25034/task/25058/stat : 25058 (plingeling) R 25032 25034 25008 0 -1 4202560 446045 1241 0 0 499327 789 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25034/tid=25059] ppid=25032 vsize=8970088 CPUtime=4997.82 cores=0-31
/proc/25034/task/25059/stat : 25059 (plingeling) R 25032 25034 25008 0 -1 4202560 585397 1241 0 0 498909 872 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25034/tid=25060] ppid=25032 vsize=8970088 CPUtime=5000.68 cores=0-31
/proc/25034/task/25060/stat : 25060 (plingeling) R 25032 25034 25008 0 -1 4202560 811734 1241 0 0 498909 1158 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=25034/tid=25061] ppid=25032 vsize=8970088 CPUtime=4994.96 cores=0-31
/proc/25034/task/25061/stat : 25061 (plingeling) R 25032 25034 25008 0 -1 4202560 321938 1241 0 0 498885 610 0 1 25 0 33 0 716915815 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25034/tid=25062] ppid=25032 vsize=8970088 CPUtime=5003.05 cores=0-31
/proc/25034/task/25062/stat : 25062 (plingeling) R 25032 25034 25008 0 -1 4202560 399628 1241 0 0 499699 605 0 1 25 0 33 0 716915816 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=25034/tid=25063] ppid=25032 vsize=8970088 CPUtime=4992.97 cores=0-31
/proc/25034/task/25063/stat : 25063 (plingeling) R 25032 25034 25008 0 -1 4202560 773269 1241 0 0 498329 967 0 1 25 0 33 0 716915818 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=25034/tid=25064] ppid=25032 vsize=8970088 CPUtime=5001.26 cores=0-31
/proc/25034/task/25064/stat : 25064 (plingeling) R 25032 25034 25008 0 -1 4202560 589719 1241 0 0 499304 821 0 1 25 0 33 0 716915818 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=25034/tid=25065] ppid=25032 vsize=8970088 CPUtime=5004.55 cores=0-31
/proc/25034/task/25065/stat : 25065 (plingeling) R 25032 25034 25008 0 -1 4202560 519766 1241 0 0 499524 930 0 1 25 0 33 0 716915818 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=25034/tid=25066] ppid=25032 vsize=8970088 CPUtime=5004.77 cores=0-31
/proc/25034/task/25066/stat : 25066 (plingeling) R 25032 25034 25008 0 -1 4202560 507186 1241 0 0 499679 797 0 1 25 0 33 0 716915818 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=25034/tid=25067] ppid=25032 vsize=8970088 CPUtime=5003.44 cores=0-31
/proc/25034/task/25067/stat : 25067 (plingeling) R 25032 25034 25008 0 -1 4202560 434583 1241 0 0 499559 784 0 1 25 0 33 0 716915818 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=25034/tid=25068] ppid=25032 vsize=8970088 CPUtime=4999.52 cores=0-31
/proc/25034/task/25068/stat : 25068 (plingeling) R 25032 25034 25008 0 -1 4202560 364802 1241 0 0 499292 659 0 1 25 0 33 0 716915819 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=25034/tid=25069] ppid=25032 vsize=8970088 CPUtime=4993.28 cores=0-31
/proc/25034/task/25069/stat : 25069 (plingeling) R 25032 25034 25008 0 -1 4202560 372846 1241 0 0 498688 639 0 1 25 0 33 0 716915819 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=25034/tid=25070] ppid=25032 vsize=8970088 CPUtime=5003.88 cores=0-31
/proc/25034/task/25070/stat : 25070 (plingeling) R 25032 25034 25008 0 -1 4202560 453078 1241 0 0 499555 832 0 1 25 0 33 0 716915819 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25034/tid=25071] ppid=25032 vsize=8970088 CPUtime=5001.99 cores=0-31
/proc/25034/task/25071/stat : 25071 (plingeling) R 25032 25034 25008 0 -1 4202560 419559 1241 0 0 499516 682 0 1 25 0 33 0 716915820 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=25034/tid=25072] ppid=25032 vsize=8970088 CPUtime=4988.21 cores=0-31
/proc/25034/task/25072/stat : 25072 (plingeling) R 25032 25034 25008 0 -1 4202560 594198 1241 0 0 497976 844 0 1 25 0 33 0 716915820 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=25034/tid=25073] ppid=25032 vsize=8970088 CPUtime=4995.64 cores=0-31
/proc/25034/task/25073/stat : 25073 (plingeling) R 25032 25034 25008 0 -1 4202560 290141 1241 0 0 499083 480 0 1 25 0 33 0 716915820 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25034/tid=25074] ppid=25032 vsize=8970088 CPUtime=5000.68 cores=0-31
/proc/25034/task/25074/stat : 25074 (plingeling) R 25032 25034 25008 0 -1 4202560 471756 1241 0 0 499405 662 0 1 25 0 33 0 716915820 9185370112 2094028 268435456000 4194304 4417452 140737404881296 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 160001
Current children cumulated vsize (KiB) 8970088

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5068.23 s]
/proc/loadavg: 32.12 32.07 32.06 33/446 25229
/proc/meminfo: memFree=247002848/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=0 CPUtime=160001 cores=0-31
/proc/25034/stat : 25034 (plingeling) Z 25032 25034 25008 0 -1 4203548 16686922 1241 0 0 15975625 24488 0 1 18 0 2 0 716909973 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 17 0 0 0
/proc/25034/statm: 0 0 0 0 0 0 0
[pid=25034/tid=25055] ppid=25032 vsize=0 CPUtime=4981.09 cores=0-31
/proc/25034/task/25055/stat : 25055 (plingeling) R 25032 25034 25008 0 -1 4203588 454039 1241 0 0 497366 742 0 1 25 0 2 0 716915815 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 17 0 0 0
Current children cumulated CPU time (s) 160001
Current children cumulated vsize (KiB) 0

[startup+5068.6 s]
/proc/loadavg: 32.12 32.07 32.06 33/446 25229
/proc/meminfo: memFree=247002848/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=0 CPUtime=160002 cores=0-31
/proc/25034/stat : 25034 (plingeling) Z 25032 25034 25008 0 -1 4203548 16686922 1241 0 0 15975625 24525 0 1 18 0 2 0 716909973 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 17 0 0 0
/proc/25034/statm: 0 0 0 0 0 0 0
[pid=25034/tid=25055] ppid=25032 vsize=0 CPUtime=4981.46 cores=0-31
/proc/25034/task/25055/stat : 25055 (plingeling) R 25032 25034 25008 0 -1 4203588 454039 1241 0 0 497366 779 0 1 25 0 2 0 716915815 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 17 0 0 0
Current children cumulated CPU time (s) 160002
Current children cumulated vsize (KiB) 0

[startup+5068.7 s]
/proc/loadavg: 32.12 32.07 32.06 2/416 25230
/proc/meminfo: memFree=254402544/264257624 swapFree=67111528/67111528
[pid=25034] ppid=25032 vsize=0 CPUtime=160002 cores=0-31
/proc/25034/stat : 25034 (plingeling) Z 25032 25034 25008 0 -1 4203548 16686922 1241 0 0 15975625 24539 0 1 18 0 2 0 716909973 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 17 0 0 0
/proc/25034/statm: 0 0 0 0 0 0 0
[pid=25034/tid=25055] ppid=25032 vsize=0 CPUtime=4981.6 cores=0-31
/proc/25034/task/25055/stat : 25055 (plingeling) R 25032 25034 25008 0 -1 4203588 454039 1241 0 0 497366 793 0 1 25 0 2 0 716915815 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 17 0 0 0
Current children cumulated CPU time (s) 160002
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5068.77
CPU time (s): 160002
CPU user time (s): 159756
CPU system time (s): 245.44
CPU usage (%): 3156.61
Max. virtual memory (cumulated for all children) (KiB): 12304668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 159756
system time used= 245.44
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16688163
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3623
involuntary context switches= 410955

runsolver used 28.3747 second user time and 115.081 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-22 10:50:36
IDJOB=3372810
IDBENCH=83466
IDSOLVER=1852
FILE ID=node200/3372810-1306054231
RUNJOBID= node200-1306054231-25022
PBS_JOBID= 13387809
Free space on /tmp= 61936 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00N23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372810-1306054231/watcher-3372810-1306054231 -o /tmp/evaluation-result-3372810-1306054231/solver-3372810-1306054231 -C 160000 -W 5100 -M 266338304  plingeling -t 32 HOME/instance-3372810-1306054231.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 1a1f0dddf727883e0973677dd00e9269
RANDOM SEED=149308298

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255385540 kB
Buffers:        455064 kB
Cached:        8012664 kB
SwapCached:          0 kB
Active:        7558160 kB
Inactive:       978848 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255385540 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          114416 kB
Writeback:           0 kB
AnonPages:       68968 kB
Mapped:          14480 kB
Slab:           255556 kB
PageTables:       4436 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   186740 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 61932 MiB
End job on node200 at 2011-05-22 12:15:06