Trace number 3736692

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB07: PB-clasp 2007-04-10SAT (TO)21 1802.17 1802.63

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_500_60_4.opb
MD5SUMefe239846afd4f2627c83cec32ebc27d
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark14
Best CPU time to get the best result obtained on this benchmark1796.86
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 17
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint61
Maximum length of a constraint107
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)37458
Sum of products size (including duplicates)74916
Number of different products37458
Sum of products size74916

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

4.06/4.18	o 26
5.27/5.31	o 25
6.68/6.74	o 24
8.78/8.86	o 23
23.36/23.48	o 22
30.56/30.67	o 21
1128.70/1129.03	sh: line 1: 14359 Done                    cat HOME/temp/instance-3736692-1338732001.opb.op
1128.70/1129.03	     14360 Terminated              | clasp-1.0 --trans=no > HOME/temp/instance-3736692-1338732001.opb.clasp
1800.11/1800.61	sh: line 1: 14416 Done                    cat HOME/temp/instance-3736692-1338732001.opb.op
1800.11/1800.61	     14417 Terminated              | clasp-1.0 --trans=no > HOME/temp/instance-3736692-1338732001.opb.clasp
1800.11/1800.62	c Somebody sent me a SIGTERM
1800.11/1800.62	s SATISFIABLE
1800.11/1800.62	v x9 x30 x109 x127 x163 x168 x215 x252 x297 x303 x308 x317 x341 x380 x387 x448 x449 x458 x479 x490 x498 x512 x540 x551 x559 x562 x585 x635 x638 x682 x690 x737 x740 x744 x750 x751 x759 x795 x821 x829 x888 x889 x899 x907 x909 x917 x956 x963 x986 x992 x1000 x1004 x1038 x1065 x1082 x1092 x1178 x1180 x1181 x1238 x1355 x1412 x1435 x1442 x1467 x1473 x1477 x1534 x1536 x1559 x1575 x1654 x1668 x1727 x1728 x1826 x1854 x1858 x1910 x1915 x2002 x2026 x2045 x2081 x2101 x2117 x2185 x2251 x2288 x2294 x2379 x2394 x2405 x2406 x2436 x2461 x2489 x2523 x2567 x2592 x2651 x2754 x2793 x2897 x2933 x2934 x2954 x2967 x2978 x2980 x3026 x3056 x3069 x3092 x3098 x3131 x3141 x3159 x3170 x3192 x3197 x3323 x3355 x3371 x3385 x3391 x3445 x3479 x3487 x3504 x3520 x3610 x3620 x3622 x3650 x3700 x3719 x3764 x3787 x3819 x3832 x3856 x3866 x3867 x3874 x3897 x3960 x3984 x4050 x4056 x4077 x4096 x4098 x4128 x4160 x4174 x4180 x4210 x4220 x4250 x4297 x4302 x4374 x4375 x4393 x4394 x4469 x4477 x4499 x4541 x4551 x4595 x4657 x4664 x4671 x4700 x4704 x4742 x4744 x4774 x4799 x4818 x4835 x4865 x4877 x4887 x4889 x4903 x4914 x4932 x4962 x5005 x5053 x5087 x5146 x5174 x5180 x5181 x5193 x5270 x5281 x5283 x5313 x5363 x5381 x5409 x5515 x5562 x5565 x5573 x5575 x5583 x5611 x5640 x5687 x5711 x5722 x5743 x5746 x5763 x5788 x5821 x5845 x5916 x5953 x6027 x6167 x6182 x6192 x6264 x6345 x6357 x6372 x6383 x6384 x6387 x6417 x6433 x6449 x6484 x6487 x6537 x6557 x6562 x6597 x6623 x6645 x6655 x6726 x6744 x6750 x6826 x6845 x6860 x6869 x6881 x6887 x6931 x6941 x6952 x6965 x7000 x7039 x7066 x7068 x7127 x7148 x7229 x7253 x7300 x7344 x7345 x7409 x7415 x7478 x7485 x7517 x7519 x7523 x7547 x7548 x7564 x7606 x7632 x7635 x7648 x7733 x7734 x7745 x7747 x7759 x7763 x7768 x7817 x7822 x7846 x7851 x7874 x7892 x7899 x7962 x7980 x8025 x8062 x8132 x8146 x8181 x8187 x8230 x8239 x8300 x8306 x8336 x8358 x8377 x8393 x8416 x8421 x8426 x8432 x8434 x8451 x8485 x8489 x8500 x8543 x8572 x8585 x8591 x8596 x8636 x8650 x8656 x8657 x8697 x8702 x8714 x8717 x8744 x8748 x8756 x8793 x8844 x8850 x8856 x8857 x8871 x8876 x8892 x8923 x8971 x9010 x9031 x9051 x9069 x9083 x9097 x9118 x9120 x9136 x9212 x9227 x9269 x9276 x9285 x9291 x9334 x9340 x9352 x9417 x9454 x9476 x9553 x9597 x9606 x9620 x9643 x9676 x9695 x9699 x9787 x9800 x9803 x9825 x9860 x9866 x9867 x9872 x9919 x9927 x9938 x9947 x9957 x9974 x9996 x10026 x10038 x10041 x10064 x10096 x10104 x10119 x10234 x10259 x10267 x10292 x10308 x10324 x10341 x10364 x10418 x10421 x10436 x10462 x10473 x10542 x10598 x10608 x10616 x10670 x10734 x10741 x10752 x10813 x10844 x10855 x10878 x10885 x10954 x11019 x11028 x11069 x11112 x11127 x11140 x11152 x11154 x11211 x11273 x11285 x11291 x11301 x11353 x11391 x11403 x11474 x11517 x11539 x11578 x11593 x11606 x11632 x11757 x11767 x11775 x11801 x11853 x11869 x11873 x11920 x11989 x11994 x11996 x12019 x12031 x12032 x12051 x12054 x12065 x12067 x12070 x12075 x12116 x12138 x12163 x12164 x12211 x12248 x12251 x12324 x12344 x12465 x12498 x12515 x12520 x12521 x12532 x12541 x12608 x12613 x12691 x12695 x12707 x12750 x12777 x12797 x12807 x12832 x12872 x12894 x12947 x12966 x12981 x13003 x13059 x13065 x13091 x13093 x13133 x13142 x13161 x13206 x13224 x13299 x13300 x13307 x13310 x13337 x13444 x13472 x13501 x13540 x13577 x13599 x13607 x13625 x13656 x13679 x13684 x13689 x13703 x13747 x13773 x13795 x13853 x13870 x13885 x13918 x13921 x13953 x13984 x13991 x13992 x14016 x14034 x14045 x14085 x14105 x14114 x14123 x14204 x14242 x14266 x14309 x14322 x14325 x14382 x14424 x14439 x14519 x14563 x14598 x14603 x14720 x14723 x14745 x14754 x14756 x14776 x14807 x14812 x14820 x14829 x14853 x14876 x14886 x14933 x14941 x14957 x14961 x15064 x15133 x15198 x15229 x15258 x15262 x15280 x15358 x15359 x15374 x15415 x15435 x15456 x15482 x15485 x15504 x15532 x15538 x15557 x15569 x15570 x15579 x15610 x15623 x15652 x15673 x15683 x15685 x15697 x15702 x15718 x15761 x15773 x15777 x15834 x15836 x15842 x15883 x15897 x15903 x15908 x15938 x15946 x16048 x16068 x16104 x16135 x16140 x16160 x16172 x16215 x16229 x16230 x16247 x16288 x16298 x16389 x16402 x16411 x16445 x16454 x16462 x16493 x16498 x16550 x16557 x16603 x16663 x16673 x16676 x16677 x16718 x16724 x16774 x16784 x16839 x16847 x16851 x16912 x16918 x16927 x16972 x16985 x16994 x17005 x17071 x17163 x17182 x17220 x17240 x17291 x17308 x17331 x17353 x17384 x17393 x17403 x17409 x17418 x17462 x17497 x17501 x17543 x17637 x17640 x17642 x17656 x17675 x17702 x17731 x17770 x17772 x17790 x17812 x17830 x17912 x17943 x17960 x17963 x18005 x18074 x18083 x18142 x18152 x18157 x18171 x18179 x18212 x18244 x18297 x18324 x18382 x18399 x18474 x18531 x18595 x18605 x18765 x18796 x18825 x18831 x18834 x18880 x18885 x18892 x18899 x18906 x18916 x18941 x18982 x18986 x19034 x19062 x19137 x19172 x19187 x19251 x19265 x19273 x19290 x19315 x19374 x19395 x19434 x19439 x19452 x19476 x19483 x19495 x19502 x19503 x19505 x19517 x19543 x19549 x19565 x19567 x19569 x19580 x19644 x19647 x19648 x19650 x19668 x19725 x19772 x19802 x19804 x19807 x19808 x19832 x19927 x19935 x19950 x20010 x20051 x20068 x20091 x20097 x20100 x20130 x20165 x20222 x20272 x20277 x20307 x20332 x20391 x20446 x20479 x20496 x20499 x20517 x20528 x20538 x20573 x20632 x20639 x20649 x20671 x20681 x20683 x20718 x20751 x20794 x20803 x20858 x20860 x20861 x20898 x20904 x20947 x21003 x21007 x21011 x21096 x21132 x21156 x21200 x21226 x21298 x21328 x21378 x21480 x21487 x21499 x21507 x21519 x21564 x21568 x21583 x21587 x21633 x21634 x21665 x21676 x21722 x21793 x21822 x21846 x21896 x21980 x21994 x22008 x22040 x22044 x22090 x22122 x22133 x22147 x22153 x22177 x22187 x22192 x22199 x22200 x22250 x22320 x22331 x22332 x22395 x22401 x22430 x22480 x22491 x22560 x22588 x22617 x22619 x22652 x22663 x22712 x22714 x22716 x22763 x22771 x22780 x22784 x22792 x22814 x22827 x22845 x22846 x22860 x22906 x22910 x22935 x22982 x23005 x23017 x23035 x23063 x23071 x23074 x23116 x23133 x23141 x23155 x23176 x23182 x23189 x23211 x23222 x23261 x23263 x23291 x23295 x23325 x23356 x23364 x23398 x23415 x23424 x23428 x23435 x23462 x23468 x23484 x23564 x23588 x23625 x23663 x23696 x23727 x23789 x23791 x23801 x23878 x23879 x23895 x23926 x23927 x23954 x23978 x23992 x24009 x24026 x24058 x24139 x24146 x24151 x24153 x24165 x24221 x24223 x24240 x24261 x24307 x24309 x24333 x24345 x24348 x24461 x24475 x24562 x24576 x24589 x24623 x24656 x24668 x24781 x24787 x24791 x24881 x24942 x24958 x25028 x25048 x25192 x25232 x25238 x25299 x25304 x25332 x25337 x25347 x25381 x25540 x25588 x25596 x25618 x25625 x25645 x25665 x25696 x25715 x25758 x25764 x25771 x25787 x25791 x25842 x25845 x25863 x25916 x25926 x25937 x25956 x25981 x25982 x25990 x26051 x26071 x26147 x26199 x26211 x26252 x26267 x26304 x26323 x26377 x26390 x26406 x26418 x26432 x26495 x26499 x26515 x26529 x26543 x26557 x26567 x26616 x26628 x26657 x26680 x26687 x26697 x26708 x26775 x26776 x26820 x26822 x26824 x26886 x26903 x26915 x26934 x26944 x26955 x26961 x26969 x26981 x27016 x27033 x27035 x27067 x27077 x27131 x27165 x27170 x27186 x27189 x27217 x27233 x27293 x27298 x27338 x27375 x27403 x27423 x27446 x27447 x27453 x27472 x27487 x27490 x27492 x27531 x27533 x27539 x27561 x27574 x27581 x27591 x27595 x27599 x27607 x27629 x27647 x27664 x27669 x27726 x27859 x27904 x27932 x27938 x27979 x27988 x28010 x28053 x28057 x28059 x28098 x28135 x28185 x28205 x28233 x28241 x28251 x28268 x28290 x28297 x28308 x28364 x28387 x28396 x28437 x28450 x28456 x28508 x28552 x28576 x28613 x28617 x28632 x28680 x28751 x28754 x28804 x28829 x28875 x28883 x28887 x28895 x28928 x28958 x29024 x29072 x29098 x29115 x29139 x29151 x29154 x29157 x29160 x29190 x29194 x29199 x29214 x29222 x29263 x29292 x29297 x29343 x29371 x29383 x29387 x29398 x29402 x29439 x29483 x29490 x29520 x29546 x29570 x29591 x29609 x29614 x29636 x29648 x29664 x29704 x29723 x29823 x29886 x29892 x29936 x29952 x29959 x30003 x30011 x30013 x30045 x30046 x30064 x30067 x30081 x30082 x30083 x30126 x30156 x30163 x30192 x30282 x30295 x30312 x30453 x30459 x30489 x30526 x30563 x30608 x30615 x30655 x30669 x30675 x30695 x30745 x30763 x30771 x30793 x30795 x30813 x30922 x30960 x30962 x30965 x31017 x31023 x31085 x31089 x31092 x31135 x31144 x31150 x31216 x31252 x31263 x31264 x31265 x31306 x31401 x31454 x31460 x31461 x31517 x31575 x31587 x31594 x31676 x31681 x31708 x31728 x31736 x31796 x31803 x31826 x31832 x31849 x31856 x31861 x31869 x31886 x31949 x31964 x31984 x31985 x31995 x31997 x32035 x32047 x32071 x32123 x32127 x32153 x32169 x32175 x32183 x32185 x32216 x32232 x32241 x32252 x32286 x32345 x32408 x32410 x32434 x32506 x32529 x32541 x32568 x32573 x32581 x32630 x32691 x32725 x32731 x32758 x32778 x32780 x32805 x32819 x32831 x32884 x32895 x32979 x33049 x33073 x33086 x33096 x33111 x33125 x33142 x33143 x33154 x33184 x33259 x33307 x33386 x33395 x33404 x33431 x33450 x33461 x33466 x33487 x33493 x33565 x33571 x33577 x33580 x33592 x33621 x33684 x33692 x33700 x33762 x33764 x33781 x33795 x33802 x33841 x33846 x33848 x33860 x33909 x33911 x33913 x33928 x33974 x34004 x34073 x34096 x34114 x34123 x34134 x34165 x34178 x34184 x34239 x34257 x34258 x34268 x34278 x34279 x34305 x34336 x34406 x34408 x34415 x34436 x34457 x34486 x34513 x34515 x34542 x34575 x34627 x34656 x34675 x34701 x34709 x34715 x34719 x34849 x34860 x34870 x34905 x34963 x34969 x34988 x35009 x35050 x35109 x35131 x35133 x35155 x35182 x35201 x35214 x35257 x35262 x35302 x35342 x35413 x35441 x35487 x35511 x35550 x35561 x35570 x35646 x35651 x35694 x35729 x35736 x35758 x35778 x35830 x35885 x35942 x35943 x35945 x35954 x35981 x36000 x36035 x36076 x36093 x36094 x36099 x36136 x36196 x36201 x36248 x36266 x36289 x36301 x36308 x36376 x36444 x36497 x36533 x36535 x36624 x36713 x36727 x36731 x36749 x36757 x36774 x36834 x36842 x36856 x36867 x36899 x36921 x36940 x36952 x37006 x37052 x37077 x37102 x37171 x37177 x37180 x37222 x37298 x37371 x37392 x37474 x37504 x37505 x37514 x37516 x37526 x37528 x37537 x37540 x37565 x37595 x37641 x37653 x37656 x37668 x37723 x37735 x37759 x37856 x37927 
1800.11/1800.62	pb2clasp1: no process killed
1802.11/1802.62	sh: line 1: 14618 Done                    cat HOME/temp/instance-3736692-1338732001.opb.op
1802.11/1802.62	     14619 Killed                  | clasp-1.0 --trans=no > HOME/temp/instance-3736692-1338732001.opb.clasp

Verifier Data 

OK	21

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3736692-1338732001/watcher-3736692-1338732001 -o /tmp/evaluation-result-3736692-1338732001/solver-3736692-1338732001 -C 1800 -W 1900 -M 15500 pbclasp instance-3736692-1338732001.opb HOME/temp 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 14302
/proc/meminfo: memFree=27637892/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=25872 CPUtime=0 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) R 14300 14302 2078 0 -1 4202496 606 0 0 0 0 0 0 0 20 0 1 0 339325515 26492928 536 33554432000 4194304 4198148 140735696447456 140733604977560 273588653972 0 0 4224 16384 0 0 0 17 2 0 0 0 0 0
/proc/14302/statm: 6468 537 355 1 0 263 0

[startup+0.099058 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 14302
/proc/meminfo: memFree=27637892/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27176 CPUtime=0.01 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 987 0 0 0 1 0 0 0 20 0 1 0 339325515 27828224 898 33554432000 4194304 4198148 140735696447456 140735696446344 273592411376 0 0 4224 16384 18446744071580380219 0 0 17 2 0 0 0 0 0
/proc/14302/statm: 6794 898 369 1 0 589 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 27176

[startup+0.100234 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 14302
/proc/meminfo: memFree=27637892/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27176 CPUtime=0.01 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 987 0 0 0 1 0 0 0 20 0 1 0 339325515 27828224 898 33554432000 4194304 4198148 140735696447456 140735696446344 273592411376 0 0 4224 16384 18446744071580380219 0 0 17 2 0 0 0 0 0
/proc/14302/statm: 6794 898 369 1 0 589 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 27176

[startup+0.300199 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 14302
/proc/meminfo: memFree=27637892/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27176 CPUtime=0.01 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 987 0 0 0 1 0 0 0 20 0 1 0 339325515 27828224 898 33554432000 4194304 4198148 140735696447456 140735696446344 273592411376 0 0 4224 16384 18446744071580380219 0 0 17 2 0 0 0 0 0
/proc/14302/statm: 6794 898 369 1 0 589 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 27176

[startup+0.700199 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 14302
/proc/meminfo: memFree=27637892/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27176 CPUtime=0.01 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 987 0 0 0 1 0 0 0 20 0 1 0 339325515 27828224 898 33554432000 4194304 4198148 140735696447456 140735696446344 273592411376 0 0 4224 16384 18446744071580380219 0 0 17 2 0 0 0 0 0
/proc/14302/statm: 6794 898 369 1 0 589 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 27176

[startup+1.50028 s]
/proc/loadavg: 2.00 2.01 2.00 3/184 14305
/proc/meminfo: memFree=27634032/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27176 CPUtime=0.01 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 987 0 0 0 1 0 0 0 20 0 1 0 339325515 27828224 898 33554432000 4194304 4198148 140735696447456 140735696446344 273592411376 0 0 4224 16384 18446744071580380219 0 0 17 2 0 0 0 0 0
/proc/14302/statm: 6794 898 369 1 0 589 0
[pid=14304] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14304/stat : 14304 (sh) S 14302 14302 2078 0 -1 4202496 351 0 0 0 0 0 0 0 20 0 1 0 339325517 9367552 267 33554432000 4194304 5064252 140734544180176 140734544179056 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/14304/statm: 2287 267 226 213 0 72 0
[pid=14305] ppid=14304 vsize=25592 CPUtime=1.47 cores=0,2,4,6
/proc/14305/stat : 14305 (pb2clasp1) R 14304 14302 2078 0 -1 4202496 606 0 0 0 147 0 0 0 20 0 1 0 339325517 26206208 515 33554432000 4194304 4198148 140735941020096 140735941019080 273601787536 0 0 4224 0 0 0 0 17 2 0 0 0 0 0
/proc/14305/statm: 6398 515 378 1 0 193 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 61916

[startup+3.1002 s]
/proc/loadavg: 2.00 2.01 2.00 3/184 14305
/proc/meminfo: memFree=27632792/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=3.04 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1083 2105 0 0 1 0 302 1 20 0 1 0 339325515 27963392 927 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/14302/statm: 6827 927 387 1 0 622 0
Current children cumulated CPU time (s) 3.04
Current children cumulated vsize (KiB) 27308

[startup+6.30026 s]
/proc/loadavg: 2.00 2.01 2.00 3/185 14328
/proc/meminfo: memFree=27624344/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=5.32 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1362 32551 0 0 4 0 518 10 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14326] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14326/stat : 14326 (sh) S 14302 14302 2078 0 -1 4202496 372 221 0 0 0 0 0 0 20 0 1 0 339326048 9367552 264 33554432000 4194304 5064252 140736958757216 140736958755472 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14326/statm: 2287 264 223 213 0 72 0
[pid=14328] ppid=14326 vsize=51528 CPUtime=0.96 cores=0,2,4,6
/proc/14328/stat : 14328 (clasp-1.0) R 14326 14302 2078 0 -1 4202496 13254 0 0 0 94 2 0 0 20 0 1 0 339326048 52764672 12223 33554432000 134512640 134847168 4292888688 4292887456 134617498 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14328/statm: 12882 12223 270 82 0 12123 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 87984

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.00 3/184 14344
/proc/meminfo: memFree=27579216/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=8.86 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1656 62992 0 0 6 0 863 17 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14342] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14342/stat : 14342 (sh) S 14302 14302 2078 0 -1 4202496 372 220 0 0 0 0 0 0 20 0 1 0 339326402 9367552 264 33554432000 4194304 5064252 140734937976128 140734937974384 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14342/statm: 2287 264 223 213 0 72 0
[pid=14344] ppid=14342 vsize=51528 CPUtime=3.81 cores=0,2,4,6
/proc/14344/stat : 14344 (clasp-1.0) R 14342 14302 2078 0 -1 4202496 13270 0 0 0 380 1 0 0 20 0 1 0 339326402 52764672 12240 33554432000 134512640 134847168 4287650576 4287649344 134617553 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14344/statm: 12882 12240 272 82 0 12123 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 87984

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.00 3/184 14352
/proc/meminfo: memFree=27579424/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=23.47 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1803 81910 0 0 7 0 2319 21 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14350] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14350/stat : 14350 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339327864 9367552 263 33554432000 4194304 5064252 140733601758240 140733601756496 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14350/statm: 2287 263 223 213 0 72 0
[pid=14352] ppid=14350 vsize=51528 CPUtime=2 cores=0,2,4,6
/proc/14352/stat : 14352 (clasp-1.0) R 14350 14302 2078 0 -1 4202496 13268 0 0 0 197 3 0 0 20 0 1 0 339327864 52764672 12238 33554432000 134512640 134847168 4289064512 4289063280 134617496 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14352/statm: 12882 12238 270 82 0 12123 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 87984

[startup+51.1003 s]
/proc/loadavg: 2.00 2.01 2.00 3/184 14361
/proc/meminfo: memFree=27555404/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=30.66 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1953 97155 0 0 8 0 3032 26 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14358] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14358/stat : 14358 (sh) S 14302 14302 2078 0 -1 4202496 372 221 0 0 0 0 0 0 20 0 1 0 339328583 9367552 264 33554432000 4194304 5064252 140736507603232 140736507601488 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14358/statm: 2287 264 223 213 0 72 0
[pid=14360] ppid=14358 vsize=75492 CPUtime=20.39 cores=0,2,4,6
/proc/14360/stat : 14360 (clasp-1.0) R 14358 14302 2078 0 -1 4202496 19270 0 0 0 2037 2 0 0 20 0 1 0 339328583 77303808 18256 33554432000 134512640 134847168 4294165808 4294164436 134616350 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14360/statm: 18873 18256 270 82 0 18114 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 111948

[startup+102.307 s]
/proc/loadavg: 2.04 2.02 2.00 3/184 14384
/proc/meminfo: memFree=27498300/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=30.66 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1953 97155 0 0 8 0 3032 26 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14358] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14358/stat : 14358 (sh) S 14302 14302 2078 0 -1 4202496 372 221 0 0 0 0 0 0 20 0 1 0 339328583 9367552 264 33554432000 4194304 5064252 140736507603232 140736507601488 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14358/statm: 2287 264 223 213 0 72 0
[pid=14360] ppid=14358 vsize=129904 CPUtime=71.57 cores=0,2,4,6
/proc/14360/stat : 14360 (clasp-1.0) R 14358 14302 2078 0 -1 4202496 32847 0 0 0 7151 6 0 0 20 0 1 0 339328583 133021696 31820 33554432000 134512640 134847168 4294165808 4294164500 134616619 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14360/statm: 32476 31820 270 82 0 31717 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 166360

[startup+162.3 s]
/proc/loadavg: 2.08 2.03 2.00 3/183 14384
/proc/meminfo: memFree=27412868/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=30.66 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1953 97155 0 0 8 0 3032 26 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14358] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14358/stat : 14358 (sh) S 14302 14302 2078 0 -1 4202496 372 221 0 0 0 0 0 0 20 0 1 0 339328583 9367552 264 33554432000 4194304 5064252 140736507603232 140736507601488 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14358/statm: 2287 264 223 213 0 72 0
[pid=14360] ppid=14358 vsize=215812 CPUtime=131.56 cores=0,2,4,6
/proc/14360/stat : 14360 (clasp-1.0) R 14358 14302 2078 0 -1 4202496 54352 0 0 0 13143 13 0 0 20 0 1 0 339328583 220991488 53189 33554432000 134512640 134847168 4294165808 4294164384 134714478 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14360/statm: 53953 53189 270 82 0 53194 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 252268

[startup+222.3 s]
/proc/loadavg: 2.07 2.04 2.00 3/183 14384
/proc/meminfo: memFree=27368012/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=30.66 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1953 97155 0 0 8 0 3032 26 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14358] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14358/stat : 14358 (sh) S 14302 14302 2078 0 -1 4202496 372 221 0 0 0 0 0 0 20 0 1 0 339328583 9367552 264 33554432000 4194304 5064252 140736507603232 140736507601488 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14358/statm: 2287 264 223 213 0 72 0
[pid=14360] ppid=14358 vsize=258128 CPUtime=191.52 cores=0,2,4,6
/proc/14360/stat : 14360 (clasp-1.0) R 14358 14302 2078 0 -1 4202496 64963 0 0 0 19137 15 0 0 20 0 1 0 339328583 264323072 63820 33554432000 134512640 134847168 4294165808 4294164564 134737608 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14360/statm: 64532 63820 270 82 0 63773 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 294584

[startup+282.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/183 14384
/proc/meminfo: memFree=27337988/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=30.66 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 1953 97155 0 0 8 0 3032 26 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14358] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

/proc/loadavg: 2.00 2.00 2.00 3/183 14596
/proc/meminfo: memFree=27315808/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=302936 CPUtime=293.13 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 76277 0 0 0 29295 18 0 0 20 0 1 0 339438419 310206464 74983 33554432000 134512640 134847168 4289763584 4289762208 134784667 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 75734 74983 272 82 0 74975 0
Current children cumulated CPU time (s) 1421.88
Current children cumulated vsize (KiB) 339392

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 14596
/proc/meminfo: memFree=27313328/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=302936 CPUtime=353.11 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 76288 0 0 0 35293 18 0 0 20 0 1 0 339438419 310206464 74994 33554432000 134512640 134847168 4289763584 4289762148 134714971 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 75734 74994 272 82 0 74975 0
Current children cumulated CPU time (s) 1481.86
Current children cumulated vsize (KiB) 339392

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 14596
/proc/meminfo: memFree=27311916/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=302936 CPUtime=413.1 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 76298 0 0 0 41292 18 0 0 20 0 1 0 339438419 310206464 75009 33554432000 134512640 134847168 4289763584 4289762320 134741032 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 75734 75009 272 82 0 74975 0
Current children cumulated CPU time (s) 1541.85
Current children cumulated vsize (KiB) 339392

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 14597
/proc/meminfo: memFree=27311040/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=302936 CPUtime=473.09 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 76298 0 0 0 47291 18 0 0 20 0 1 0 339438419 310206464 75009 33554432000 134512640 134847168 4289763584 4289762208 134784684 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 75734 75009 272 82 0 74975 0
Current children cumulated CPU time (s) 1601.84
Current children cumulated vsize (KiB) 339392

[startup+1662.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/183 14597
/proc/meminfo: memFree=27278676/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=334724 CPUtime=533.08 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 87447 0 0 0 53287 21 0 0 20 0 1 0 339438419 342757376 82857 33554432000 134512640 134847168 4289763584 4289762276 134616619 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 83681 82857 272 82 0 82922 0
Current children cumulated CPU time (s) 1661.83
Current children cumulated vsize (KiB) 371180

[startup+1722.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/183 14597
/proc/meminfo: memFree=27232176/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=378852 CPUtime=593.07 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 98427 0 0 0 59283 24 0 0 20 0 1 0 339438419 387944448 93837 33554432000 134512640 134847168 4289763584 4289762160 134714333 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 94713 93837 272 82 0 93954 0
Current children cumulated CPU time (s) 1721.82
Current children cumulated vsize (KiB) 415308

[startup+1782.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/183 14597
/proc/meminfo: memFree=27227084/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=382580 CPUtime=653.05 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 99465 0 0 0 65281 24 0 0 20 0 1 0 339438419 391761920 94956 33554432000 134512640 134847168 4289763584 4289762048 134713707 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 95645 94956 272 82 0 94886 0
Current children cumulated CPU time (s) 1781.8
Current children cumulated vsize (KiB) 419036



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 14600
/proc/meminfo: memFree=27226688/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1128.75 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2058 210483 0 0 8 0 112810 57 20 0 1 0 339325515 27963392 947 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 947 387 1 0 622 0
[pid=14415] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14415/stat : 14415 (sh) S 14302 14302 2078 0 -1 4202496 371 219 0 0 0 0 0 0 20 0 1 0 339438419 9367552 263 33554432000 4194304 5064252 140733231149360 140733231147616 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/14415/statm: 2287 263 223 213 0 72 0
[pid=14417] ppid=14415 vsize=382580 CPUtime=671.36 cores=0,2,4,6
/proc/14417/stat : 14417 (clasp-1.0) R 14415 14302 2078 0 -1 4202496 99466 0 0 0 67112 24 0 0 20 0 1 0 339438419 391761920 94957 33554432000 134512640 134847168 4289763584 4289762276 134616619 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14417/statm: 95645 94957 272 82 0 94886 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 419036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -14302

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 14600
/proc/meminfo: memFree=27226688/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1800.16 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2232 312726 0 0 8 0 179923 85 20 0 1 0 339325515 27963392 949 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 949 387 1 0 622 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 27308

[startup+1802.2 s]
/proc/loadavg: 2.00 2.00 2.00 3/185 14619
/proc/meminfo: memFree=27588636/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1800.16 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2232 312726 0 0 8 0 179923 85 20 0 1 0 339325515 27963392 949 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 949 387 1 0 622 0
[pid=14615] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14615/stat : 14615 (sh) S 14302 14302 2078 0 -1 4202496 373 220 0 0 0 0 0 0 20 0 1 0 339505579 9367552 264 33554432000 4194304 5064252 140736880952032 140736880950288 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/14615/statm: 2287 264 223 213 0 72 0
[pid=14619] ppid=14615 vsize=51528 CPUtime=1.55 cores=0,2,4,6
/proc/14619/stat : 14619 (clasp-1.0) R 14615 14302 2078 0 -1 4202496 13361 0 0 0 153 2 0 0 20 0 1 0 339505579 52764672 12330 33554432000 134512640 134847168 4293945744 4293944512 134617536 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14619/statm: 12882 12330 270 82 0 12123 0
Current children cumulated CPU time (s) 1801.71
Current children cumulated vsize (KiB) 87984

[startup+1802.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/185 14619
/proc/meminfo: memFree=27588636/32873844 swapFree=7112/7112
[pid=14302] ppid=14300 vsize=27308 CPUtime=1800.16 cores=0,2,4,6
/proc/14302/stat : 14302 (pbclasp) S 14300 14302 2078 0 -1 4202496 2232 312726 0 0 8 0 179923 85 20 0 1 0 339325515 27963392 949 33554432000 4194304 4198148 140735696447456 140735696446384 273592414238 0 0 4230 16384 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/14302/statm: 6827 949 387 1 0 622 0
[pid=14615] ppid=14302 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/14615/stat : 14615 (sh) S 14302 14302 2078 0 -1 4202496 373 220 0 0 0 0 0 0 20 0 1 0 339505579 9367552 264 33554432000 4194304 5064252 140736880952032 140736880950288 273588840014 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/14615/statm: 2287 264 223 213 0 72 0
[pid=14619] ppid=14615 vsize=51528 CPUtime=1.95 cores=0,2,4,6
/proc/14619/stat : 14619 (clasp-1.0) R 14615 14302 2078 0 -1 4202496 13361 0 0 0 193 2 0 0 20 0 1 0 339505579 52764672 12330 33554432000 134512640 134847168 4293945744 4293944512 134617496 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/14619/statm: 12882 12330 270 82 0 12123 0
Current children cumulated CPU time (s) 1802.11
Current children cumulated vsize (KiB) 87984

Child status: 0
Real time (s): 1802.63
CPU time (s): 1802.17
CPU user time (s): 1801.27
CPU system time (s): 0.897863
CPU usage (%): 99.9746
Max. virtual memory (cumulated for all children) (KiB): 467376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1801.27
system time used= 0.897863
maximum resident set size= 428172
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 329348
page faults= 0
swaps= 0
block input operations= 0
block output operations= 72144
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8414
involuntary context switches= 2222

runsolver used 3.51047 second user time and 7.67083 second system time

The end

Launcher Data 

Begin job on node132 at 2012-06-03 16:00:01
IDJOB=3736692
IDBENCH=48104
IDSOLVER=2317
FILE ID=node132/3736692-1338732001
RUNJOBID= node132-1338702930-2094
PBS_JOBID= 14636717
Free space on /tmp= 71216 MiB

SOLVER NAME= PB07: PB-clasp 2007-04-10
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_500_60_4.opb
COMMAND LINE= pbclasp BENCHNAMENOPATH TMPDIR/temp
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3736692-1338732001/watcher-3736692-1338732001 -o /tmp/evaluation-result-3736692-1338732001/solver-3736692-1338732001 -C 1800 -W 1900 -M 15500  pbclasp instance-3736692-1338732001.opb HOME/temp

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= efe239846afd4f2627c83cec32ebc27d
RANDOM SEED=960813933

node132.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.832
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        27640792 kB
Buffers:         1182212 kB
Cached:          3106512 kB
SwapCached:         2288 kB
Active:          2197856 kB
Inactive:        2120288 kB
Active(anon):      20520 kB
Inactive(anon):     7108 kB
Active(file):    2177336 kB
Inactive(file):  2113180 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67102712 kB
Dirty:               588 kB
Writeback:             0 kB
AnonPages:         30048 kB
Mapped:            13272 kB
Shmem:                 8 kB
Slab:             776404 kB
SReclaimable:     217312 kB
SUnreclaim:       559092 kB
KernelStack:        1520 kB
PageTables:         4424 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     142592 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:     12288 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3736692-1338732001.opb

Free space on /tmp at the end= 71204 MiB
End job on node132 at 2012-06-03 16:30:05