Trace number 3190871

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parSAT 328.067 82.1343

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1250-c25000-S936047914-093-UNKNOWN.cnf
MD5SUMc578ae902020675717dd7f7fb0a11360
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark4.33034
Satisfiable
(Un)Satisfiability was proved
Number of variables1250
Number of clauses25000
Sum of the clauses size125000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 525000
Number of clauses of size over 50

Solver Data 

0.00/0.80	This is pico-portfolio, a naive parallel portfolio
0.00/0.80	Copyright (C) 2011 Olivier Roussel
0.00/0.80	Using 4 processing units
0.00/0.80	This portfolio uses the following solvers:
0.00/0.80	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.80	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.80	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.80	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.80	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.80	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.80	Starting clasp 1.3.6 on core(s) 4
0.00/0.80	Starting TNM 2009 on core(s) 6
0.00/0.80	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.80	Starting march_hi 2009 on core(s) 6
327.90/82.12	s SATISFIABLE
327.90/82.12	v 1 -2 -3 4 5 6 7 8 -9 -10 -11 12 -13 14 -15 -16 -17 -18 19 20 21 22 23 -24 25 26 -27 28 29 30 31 -32 33 34 35 -36 37 -38 -39 -40 -41 -42 -43 44 45 -46 -47 -48 49 -50 -51 52 -53 -54 -55 56 57 58 -59 -60 -61 -62 63 -64 65 66 67 68 -69 -70 71 72 73 -74 75 -76 77 -78 -79 -80 -81 82 -83 -84 -85 86 -87 88 89 90 -91 -92 -93 -94 95 -96 -97 -98 -99 100 -101 -102 103 -104 105 -106 -107 -108 109 110 111 112 113 114 115 -116 117 -118 -119 120 121 122 -123 124 -125 -126 127 -128 -129 130 -131 -132 133 -134 135 -136 -137 -138 -139 140 -141 142 -143 -144 -145 146 -147 -148 149 -150 -151 -152 153 -154 -155 -156 157 158 159 160 -161 162 163 -164 -165 166 167 168 -169 170 171 172 -173 -174 -175 -176 177 -178 179 180 -181 -182 -183 184 185 186 187 -188 189 190 -191 192 -193 -194 -195 196 -197 198 -199 -200 -201 -202 -203 204 205 -206 207 -208 209 210 -211 212 -213 -214 215 216 -217 -218 -219 -220 221 -222 -223 -224 225 226 -227 228 229 230 231 -232 233 -234 -235 -236 -237 238 -239 -240 -241 -242 243 -244 245 246 -247 248 -249 250 251 -252 -253 254 -255 256 -257 -258 259 260 -261 -262 263 -264 265 -266 -267 -268 269 -270 271 -272 -273 274 275 276 277 278 279 280 -281 -282 -283 284 -285 286 -287 288 289 290 291 292 -293 -294 -295 296 297 -298 299 300 -301 302 -303 304 -305 306 307 308 309 -310 -311 -312 313 314 315 -316 317 -318 319 320 321 -322 323 -324 325 -326 -327 328 329 330 331 332 333 -334 335 -336 -337 338 339 -340 341 -342 343 344 345 346 -347 -348 349 -350 351 -352 353 354 -355 -356 357 358 -359 360 361 362 363 -364 -365 -366 -367 368 369 370 -371 -372 373 374 -375 -376 -377 378 -379 -380 381 -382 -383 -384 385 -386 -387 388 -389 390 -391 -392 393 394 395 396 -397 -398 399 -400 401 -402 -403 -404 -405 406 -407 408 409 -410 -411 -412 413 414 415 -416 417 418 -419 420 -421 422 -423 424 425 426 -427 -428 429 430 431 -432 -433 -434 435 436 437 -438 -439 -440 -441 442 -443 444 445 446 447 -448 449 -450 -451 452 -453 -454 455 -456 -457 458 -459 460 461 462 463 -464 465 -466 -467 468 -469 470 -471 -472 473 -474 475 476 477 -478 479 -480 -481 482 -483 -484 485 486 487 488 -489 -490 491 -492 493 494 495 496 -497 -498 499 -500 -501 -502 -503 -504 -505 -506 -507 -508 509 510 511 512 -513 -514 515 -516 -517 -518 -519 -520 -521 -522 -523 -524 -525 526 527 -528 529 -530 -531 -532 533 534 -535 536 -537 -538 539 540 -541 542 543 -544 545 546 547 548 -549 550 551 -552 553 554 555 556 -557 -558 -559 -560 561 -562 -563 -564 565 -566 -567 568 -569 -570 -571 572 -573 -574 575 -576 -577 -578 -579 -580 581 582 583 -584 585 -586 -587 588 589 -590 -591 -592 593 -594 595 -596 597 598 -599 600 -601 -602 603 604 -605 606 -607 -608 -609 610 -611 612 613 -614 615 616 617 618 -619 620 621 622 -623 624 -625 -626 627 -628 629 630 631 -632 633 -634 -635 -636 -637 -638 -639 -640 -641 -642 -643 644 645 646 -647 -648 649 650 651 -652 -653 654 -655 656 -657 -658 659 -660 661 -662 -663 664 -665 666 -667 668 669 670 -671 -672 -673 -674 -675 676 -677 678 -679 680 681 -682 683 -684 -685 686 687 -688 689 690 -691 -692 -693 -694 695 -696 -697 698 699 -700 701 702 703 -704 705 706 -707 -708 -709 -710 711 -712 -713 714 -715 716 717 -718 719 -720 -721 -722 723 -724 725 -726 -727 728 729 730 -731 -732 -733 734 -735 736 737 -738 739 -740 741 -742 743 -744 745 746 -747 748 749 -750 751 752 -753 -754 -755 756 757 758 759 -760 761 -762 763 764 -765 766 767 -768 -769 -770 771 -772 773 -774 775 776 777 -778 -779 780 -781 782 -783 -784 785 -786 -787 -788 789 -790 -791 -792 793 794 795 796 -797 798 799 800 801 -802 -803 804 805 -806 807 808 809 810 -811 -812 -813 -814 -815 816 -817 -818 819 -820 -821 -822 -823 -824 825 826 827 828 -829 830 831 832 833 -834 835 -836 -837 -838 839 -840 841 -842 -843 -844 845 846 847 -848 -849 850 -851 -852 853 -854 -855 856 857 -858 859 860 861 862 863 864 -865 -866 867 868 -869 870 871 -872 873 -874 -875 -876 -877 878 -879 880 -881 882 883 884 -885 886 887 888 -889 890 891 892 893 894 895 896 897 898 899 900 -901 902 -903 -904 -905 906 907 -908 909 910 911 912 913 914 915 -916 917 918 919 -920 -921 922 -923 924 -925 926 -927 -928 929 -930 931 932 -933 -934 -935 -936 -937 -938 939 -940 -941 942 943 -944 945 -946 -947 -948 -949 -950 951 -952 953 -954 955 956 -957 -958 959 -960 961 962 963 -964 965 966 967 968 -969 -970 -971 972 -973 974 975 976 977 978 -979 980 981 982 983 -984 985 986 987 988 -989 -990 991 -992 993 -994 -995 -996 -997 998 999 1000 -1001 -1002 -1003 1004 -1005 -1006 -1007 -1008 1009 1010 1011 1012 -1013 -1014 1015 -1016 -1017 1018 -1019 -1020 1021 -1022 -1023 -1024 1025 1026 1027 1028 -1029 -1030 -1031 1032 1033 -1034 1035 1036 -1037 -1038 1039 1040 1041 -1042 1043 1044 -1045 -1046 1047 1048 1049 -1050 1051 -1052 1053 1054 1055 1056 -1057 1058 1059 -1060 -1061 -1062 -1063 1064 1065 -1066 -1067 1068 -1069 1070 -1071 1072 1073 1074 -1075 -1076 1077 -1078 -1079 -1080 1081 1082 -1083 1084 -1085 1086 1087 1088 1089 -1090 1091 -1092 1093 -1094 -1095 1096 1097 1098 1099 -1100 1101 -1102 -1103 -1104 1105 1106 1107 -1108 1109 -1110 -1111 1112 1113 -1114 -1115 1116 -1117 -1118 -1119 -1120 -1121 -1122 1123 1124 1125 -1126 1127 -1128 1129 1130 1131 1132 1133 -1134 1135 1136 -1137 -1138 1139 -1140 -1141 -1142 1143 -1144 -1145 1146 1147 -1148 -1149 1150 1151 1152 1153 1154 -1155 1156 1157 -1158 1159 -1160 1161 -1162 1163 1164 -1165 1166 -1167 1168 -1169 -1170 -1171 1172 1173 -1174 1175 -1176 -1177 1178 -1179 1180 -1181 -1182 1183 1184 1185 1186 -1187 -1188 1189 1190 1191 -1192 -1193 1194 1195 1196 -1197 1198 1199 1200 1201 -1202 1203 -1204 -1205 1206 1207 -1208 1209 -1210 1211 1212 1213 -1214 -1215 -1216 -1217 -1218 1219 1220 1221 -1222 1223 1224 1225 1226 -1227 -1228 1229 1230 -1231 1232 -1233 -1234 1235 1236 1237 -1238 -1239 1240 -1241 -1242 -1243 -1244 -1245 -1246 -1247 1248 -1249 1250 
327.90/82.12	v 0 
327.90/82.13	solver [3] TNM 2009 answered
327.90/82.13	Done

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190871-1304040180/watcher-3190871-1304040180 -o /tmp/evaluation-result-3190871-1304040180/solver-3190871-1304040180 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190871-1304040180.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.10 9.84 9.40 7/182 11088
/proc/meminfo: memFree=13752004/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) R 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0

[startup+0.466919 s]
/proc/loadavg: 10.10 9.84 9.40 7/182 11088
/proc/meminfo: memFree=13752004/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.500914 s]
/proc/loadavg: 10.10 9.84 9.40 7/182 11088
/proc/meminfo: memFree=13752004/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.600898 s]
/proc/loadavg: 10.10 9.84 9.40 7/182 11088
/proc/meminfo: memFree=13752004/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 22 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70088 s]
/proc/loadavg: 10.10 9.84 9.40 7/182 11088
/proc/meminfo: memFree=13752004/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50674 s]
/proc/loadavg: 10.18 9.86 9.41 11/188 11094
/proc/meminfo: memFree=13712772/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2024508 CPUtime=1.5 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 5696 0 0 0 149 1 0 0 20 0 1 0 515617781 2073096192 3176 33554432000 4194304 4587354 140737379407440 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 506127 3176 327 96 0 502689 0
[pid=11090] ppid=11088 vsize=22788 CPUtime=1.49 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 3231 0 0 0 149 0 0 0 25 0 1 0 515617781 23334912 3027 33554432000 4194304 4785740 140737081034144 18446744073709551615 4278129 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 5697 3027 340 145 0 2742 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=0.78 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 78 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528993 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=7088 CPUtime=1.5 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 1229 0 0 0 150 0 0 0 25 0 1 0 515617781 7258112 959 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 1772 959 127 39 0 852 0
[pid=11093] ppid=11088 vsize=13828 CPUtime=0.7 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 4893 0 0 0 70 0 0 0 25 0 1 0 515617781 14159872 1400 33554432000 4194304 4331988 140735751061296 18446744073709551615 248089093830 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 3457 1400 174 34 0 1899 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 2546324

[startup+3.10046 s]
/proc/loadavg: 10.18 9.86 9.41 11/188 11094
/proc/meminfo: memFree=13709792/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2046872 CPUtime=3.08 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 13540 0 0 0 307 1 0 0 25 0 1 0 515617781 2095996928 8076 33554432000 4194304 4587354 140737379407440 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 511718 8076 337 96 0 508280 0
[pid=11090] ppid=11088 vsize=25708 CPUtime=3.08 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 3962 0 0 0 308 0 0 0 25 0 1 0 515617781 26324992 3758 33554432000 4194304 4785740 140737081034144 18446744073709551615 4546287 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 6427 3758 340 145 0 3472 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=1.57 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 157 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=7520 CPUtime=3.09 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 1312 0 0 0 309 0 0 0 25 0 1 0 515617781 7700480 1042 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328022 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 1880 1042 127 39 0 960 0
[pid=11093] ppid=11088 vsize=14104 CPUtime=1.5 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 4922 0 0 0 150 0 0 0 25 0 1 0 515617781 14442496 1429 33554432000 4194304 4331988 140735751061296 18446744073709551615 4263331 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 3526 1429 174 34 0 1968 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 2572316

[startup+6.30089 s]
/proc/loadavg: 10.24 9.88 9.42 11/188 11094
/proc/meminfo: memFree=13675924/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2045756 CPUtime=6.29 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 15308 0 0 0 627 2 0 0 25 0 1 0 515617781 2094854144 8102 33554432000 4194304 4587354 140737379407440 18446744073709551615 4364908 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 511439 8102 337 96 0 508001 0
[pid=11090] ppid=11088 vsize=28908 CPUtime=6.28 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 4750 0 0 0 628 0 0 0 25 0 1 0 515617781 29601792 4546 33554432000 4194304 4785740 140737081034144 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 7227 4546 340 145 0 4272 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=3.15 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 315 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=8160 CPUtime=6.29 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 1504 0 0 0 629 0 0 0 25 0 1 0 515617781 8355840 1234 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328544 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2040 1234 127 39 0 1120 0
[pid=11093] ppid=11088 vsize=14736 CPUtime=3.1 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 5030 0 0 0 310 0 0 0 25 0 1 0 515617781 15089664 1537 33554432000 4194304 4331988 140735751061296 18446744073709551615 4299257 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 3684 1537 174 34 0 2126 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 2575672

[startup+12.7008 s]
/proc/loadavg: 10.22 9.88 9.42 11/188 11094
/proc/meminfo: memFree=13692692/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2035972 CPUtime=12.69 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 18886 0 0 0 1267 2 0 0 25 0 1 0 515617781 2084835328 7395 33554432000 4194304 4587354 140737379407440 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 508993 7395 337 96 0 505555 0
[pid=11090] ppid=11088 vsize=33876 CPUtime=12.68 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 5988 0 0 0 1268 0 0 0 25 0 1 0 515617781 34689024 5784 33554432000 4194304 4785740 140737081034144 18446744073709551615 4286985 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 8469 5784 340 145 0 5514 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=6.34 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 634 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134530504 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=8548 CPUtime=12.69 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 1857 0 0 0 1269 0 0 0 25 0 1 0 515617781 8753152 1331 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328546 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2137 1331 127 39 0 1217 0
[pid=11093] ppid=11088 vsize=15760 CPUtime=6.27 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 5331 0 0 0 627 0 0 0 25 0 1 0 515617781 16138240 1838 33554432000 4194304 4331988 140735751061296 18446744073709551615 4226260 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 3940 1838 174 34 0 2382 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 2572268

[startup+25.5005 s]
/proc/loadavg: 10.19 9.89 9.43 11/188 11095
/proc/meminfo: memFree=13673840/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2037596 CPUtime=25.49 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 31254 0 0 0 2544 5 0 0 25 0 1 0 515617781 2086498304 6828 33554432000 4194304 4587354 140737379407440 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 509399 6828 337 96 0 505961 0
[pid=11090] ppid=11088 vsize=40664 CPUtime=25.48 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 7625 0 0 0 2547 1 0 0 25 0 1 0 515617781 41639936 7421 33554432000 4194304 4785740 140737081034144 18446744073709551615 4309557 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 10166 7421 340 145 0 7211 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=12.74 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 1274 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=8936 CPUtime=25.49 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 2107 0 0 0 2549 0 0 0 25 0 1 0 515617781 9150464 1421 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328126 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2234 1421 127 39 0 1314 0
[pid=11093] ppid=11088 vsize=17036 CPUtime=12.6 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 5568 0 0 0 1260 0 0 0 25 0 1 0 515617781 17444864 2075 33554432000 4194304 4331988 140735751061296 18446744073709551615 4299257 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 4259 2075 175 34 0 2701 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 2582344

[startup+51.101 s]
/proc/loadavg: 10.25 9.93 9.45 11/188 11095
/proc/meminfo: memFree=13642416/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2027216 CPUtime=51.09 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 56527 0 0 0 5099 10 0 0 25 0 1 0 515617781 2075869184 4895 33554432000 4194304 4587354 140737379407440 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 506804 4895 337 96 0 503366 0
[pid=11090] ppid=11088 vsize=48552 CPUtime=51.08 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 9576 0 0 0 5107 1 0 0 25 0 1 0 515617781 49717248 9372 33554432000 4194304 4785740 140737081034144 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 12138 9372 340 145 0 9183 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=25.44 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 2544 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=10220 CPUtime=51.09 cores=2

################
# More data... #
################

Current children cumulated CPU time (s) 205.66
Current children cumulated vsize (KiB) 2584448

[startup+64.3007 s]
/proc/loadavg: 10.21 9.93 9.46 11/188 11096
/proc/meminfo: memFree=13580684/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2095128 CPUtime=64.29 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 78228 0 0 0 6417 12 0 0 25 0 1 0 515617781 2145411072 23091 33554432000 4194304 4587354 140737379407440 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 523782 23091 337 96 0 520344 0
[pid=11090] ppid=11088 vsize=50560 CPUtime=64.28 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 10040 0 0 0 6427 1 0 0 25 0 1 0 515617781 51773440 9836 33554432000 4194304 4785740 140737081034144 18446744073709551615 4287178 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 12640 9836 340 145 0 9685 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=32.04 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 3204 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=10284 CPUtime=64.29 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 3244 0 0 0 6429 0 0 0 25 0 1 0 515617781 10530816 1758 33554432000 4194304 4352236 140734392015440 18446744073709551615 4276530 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2571 1758 127 39 0 1651 0
[pid=11093] ppid=11088 vsize=19912 CPUtime=31.9 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 6296 0 0 0 3189 1 0 0 25 0 1 0 515617781 20389888 2803 33554432000 4194304 4331988 140735751061296 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 4978 2803 175 34 0 3420 0
Current children cumulated CPU time (s) 256.8
Current children cumulated vsize (KiB) 2653996

[startup+70.7005 s]
/proc/loadavg: 10.17 9.93 9.46 11/188 11096
/proc/meminfo: memFree=13561000/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2095128 CPUtime=70.69 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 78228 0 0 0 7057 12 0 0 25 0 1 0 515617781 2145411072 23091 33554432000 4194304 4587354 140737379407440 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 523782 23091 337 96 0 520344 0
[pid=11090] ppid=11088 vsize=50864 CPUtime=70.68 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 10128 0 0 0 7067 1 0 0 25 0 1 0 515617781 52084736 9924 33554432000 4194304 4785740 140737081034144 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 12716 9924 340 145 0 9761 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=35.21 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 3521 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134530379 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=9260 CPUtime=70.69 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 3244 0 0 0 7069 0 0 0 25 0 1 0 515617781 9482240 1502 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328390 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2315 1502 127 39 0 1395 0
[pid=11093] ppid=11088 vsize=22500 CPUtime=35.1 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 6410 0 0 0 3509 1 0 0 25 0 1 0 515617781 23040000 2917 33554432000 4194304 4331988 140735751061296 18446744073709551615 4287447 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 5625 2917 175 34 0 4067 0
Current children cumulated CPU time (s) 282.37
Current children cumulated vsize (KiB) 2655864

[startup+77.1004 s]
/proc/loadavg: 10.16 9.93 9.47 11/188 11096
/proc/meminfo: memFree=13579972/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2095128 CPUtime=77.09 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 78228 0 0 0 7697 12 0 0 25 0 1 0 515617781 2145411072 23091 33554432000 4194304 4587354 140737379407440 18446744073709551615 4364688 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 523782 23091 337 96 0 520344 0
[pid=11090] ppid=11088 vsize=53960 CPUtime=77.08 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 10900 0 0 0 7706 2 0 0 25 0 1 0 515617781 55255040 10696 33554432000 4194304 4785740 140737081034144 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 13490 10696 340 145 0 10535 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=38.37 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 3837 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=9260 CPUtime=77.09 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 3244 0 0 0 7709 0 0 0 25 0 1 0 515617781 9482240 1502 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2315 1502 127 39 0 1395 0
[pid=11093] ppid=11088 vsize=22500 CPUtime=38.3 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 6511 0 0 0 3829 1 0 0 25 0 1 0 515617781 23040000 3018 33554432000 4194304 4331988 140735751061296 18446744073709551615 4287447 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 5625 3018 175 34 0 4067 0
Current children cumulated CPU time (s) 307.93
Current children cumulated vsize (KiB) 2658960

[startup+80.3008 s]
/proc/loadavg: 10.16 9.93 9.47 11/188 11096
/proc/meminfo: memFree=13578608/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2095128 CPUtime=80.29 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 78228 0 0 0 8017 12 0 0 25 0 1 0 515617781 2145411072 23091 33554432000 4194304 4587354 140737379407440 18446744073709551615 4364788 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 523782 23091 337 96 0 520344 0
[pid=11090] ppid=11088 vsize=54888 CPUtime=80.28 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 11130 0 0 0 8026 2 0 0 25 0 1 0 515617781 56205312 10926 33554432000 4194304 4785740 140737081034144 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 13722 10926 340 145 0 10767 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=39.95 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 3995 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=10284 CPUtime=80.29 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 3500 0 0 0 8029 0 0 0 25 0 1 0 515617781 10530816 1758 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328055 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2571 1758 127 39 0 1651 0
[pid=11093] ppid=11088 vsize=22500 CPUtime=39.9 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 6572 0 0 0 3989 1 0 0 25 0 1 0 515617781 23040000 3079 33554432000 4194304 4331988 140735751061296 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 5625 3079 175 34 0 4067 0
Current children cumulated CPU time (s) 320.71
Current children cumulated vsize (KiB) 2660912

[startup+81.1007 s]
/proc/loadavg: 10.16 9.93 9.47 11/188 11096
/proc/meminfo: memFree=13578608/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2095128 CPUtime=81.09 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 78228 0 0 0 8097 12 0 0 25 0 1 0 515617781 2145411072 23091 33554432000 4194304 4587354 140737379407440 18446744073709551615 4365336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 523782 23091 337 96 0 520344 0
[pid=11090] ppid=11088 vsize=54888 CPUtime=81.08 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 11132 0 0 0 8106 2 0 0 25 0 1 0 515617781 56205312 10928 33554432000 4194304 4785740 140737081034144 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 13722 10928 340 145 0 10767 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=40.35 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 4035 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528412 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=10284 CPUtime=81.09 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 3500 0 0 0 8109 0 0 0 25 0 1 0 515617781 10530816 1758 33554432000 4194304 4352236 140734392015440 18446744073709551615 4328039 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2571 1758 127 39 0 1651 0
[pid=11093] ppid=11088 vsize=22500 CPUtime=40.3 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 6588 0 0 0 4029 1 0 0 25 0 1 0 515617781 23040000 3095 33554432000 4194304 4331988 140735751061296 18446744073709551615 4228205 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 5625 3095 175 34 0 4067 0
Current children cumulated CPU time (s) 323.91
Current children cumulated vsize (KiB) 2660912

[startup+81.9005 s]
/proc/loadavg: 10.23 9.95 9.47 11/188 11096
/proc/meminfo: memFree=13577244/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2095128 CPUtime=81.89 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 78228 0 0 0 8177 12 0 0 25 0 1 0 515617781 2145411072 23091 33554432000 4194304 4587354 140737379407440 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 523782 23091 337 96 0 520344 0
[pid=11090] ppid=11088 vsize=55160 CPUtime=81.88 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 11195 0 0 0 8186 2 0 0 25 0 1 0 515617781 56483840 10991 33554432000 4194304 4785740 140737081034144 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 13790 10991 340 145 0 10835 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=40.74 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 4074 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=10284 CPUtime=81.89 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 3500 0 0 0 8189 0 0 0 25 0 1 0 515617781 10530816 1758 33554432000 4194304 4352236 140734392015440 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2571 1758 127 39 0 1651 0
[pid=11093] ppid=11088 vsize=22500 CPUtime=40.7 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 6605 0 0 0 4069 1 0 0 25 0 1 0 515617781 23040000 3112 33554432000 4194304 4331988 140735751061296 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 5625 3112 175 34 0 4067 0
Current children cumulated CPU time (s) 327.1
Current children cumulated vsize (KiB) 2661184

[startup+82.1005 s]
/proc/loadavg: 10.23 9.95 9.47 11/188 11096
/proc/meminfo: memFree=13577244/32950928 swapFree=67111528/67111528
[pid=11088] ppid=11086 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/11088/stat : 11088 (ppfolio) S 11086 11088 10696 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 515617780 18763776 390 33554432000 4194304 4287625 140736983078880 18446744073709551615 248089718287 0 0 4096 65536 4577593465679904767 0 0 17 4 0 0 0
/proc/11088/statm: 4581 390 341 23 0 91 0
[pid=11089] ppid=11088 vsize=2095128 CPUtime=82.09 cores=0
/proc/11089/stat : 11089 (cryptominisat) R 11088 11088 10696 0 -1 4202496 78228 0 0 0 8197 12 0 0 25 0 1 0 515617781 2145411072 23091 33554432000 4194304 4587354 140737379407440 18446744073709551615 4364908 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11089/statm: 523782 23091 337 96 0 520344 0
[pid=11090] ppid=11088 vsize=55556 CPUtime=82.08 cores=4
/proc/11090/stat : 11090 (clasp) R 11088 11088 10696 0 -1 4202496 11296 0 0 0 8206 2 0 0 25 0 1 0 515617781 56889344 11092 33554432000 4194304 4785740 140737081034144 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/11090/statm: 13889 11092 340 145 0 10934 0
[pid=11091] ppid=11088 vsize=459788 CPUtime=40.84 cores=6
/proc/11091/stat : 11091 (TNM) R 11088 11088 10696 0 -1 4202496 1543 0 0 0 4084 0 0 0 25 0 1 0 515617781 470822912 1440 33554432000 134512640 134534564 4294115056 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11091/statm: 114947 1440 95 6 0 113613 0
[pid=11092] ppid=11088 vsize=10284 CPUtime=82.09 cores=2
/proc/11092/stat : 11092 (lingeling) R 11088 11088 10696 0 -1 4202496 3500 0 0 0 8209 0 0 0 25 0 1 0 515617781 10530816 1758 33554432000 4194304 4352236 140734392015440 18446744073709551615 4329024 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/11092/statm: 2571 1758 127 39 0 1651 0
[pid=11093] ppid=11088 vsize=22500 CPUtime=40.8 cores=6
/proc/11093/stat : 11093 (march_hi) R 11088 11088 10696 0 -1 4202496 6609 0 0 0 4079 1 0 0 25 0 1 0 515617781 23040000 3116 33554432000 4194304 4331988 140735751061296 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/11093/statm: 5625 3116 175 34 0 4067 0
Current children cumulated CPU time (s) 327.9
Current children cumulated vsize (KiB) 2661580

Child status: 0
Real time (s): 82.1343
CPU time (s): 328.067
CPU user time (s): 327.887
CPU system time (s): 0.179972
CPU usage (%): 399.428
Max. virtual memory (cumulated for all children) (KiB): 2661580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 327.887
system time used= 0.179972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 101738
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 216
involuntary context switches= 2679

runsolver used 0.121981 second user time and 0.328949 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-29 03:23:00
IDJOB=3190871
IDBENCH=82602
IDSOLVER=1612
FILE ID=node123/3190871-1304040180
RUNJOBID= node123-1304037296-10714
PBS_JOBID= 13170370
Free space on /tmp= 72804 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k5-r20-v1250-c25000-S936047914-093-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190871-1304040180/watcher-3190871-1304040180 -o /tmp/evaluation-result-3190871-1304040180/solver-3190871-1304040180 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190871-1304040180.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c578ae902020675717dd7f7fb0a11360
RANDOM SEED=2068859759

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13752284 kB
Buffers:       2191500 kB
Cached:       16022692 kB
SwapCached:          0 kB
Active:        9471196 kB
Inactive:      9177700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13752284 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10528 kB
Writeback:           0 kB
AnonPages:      434060 kB
Mapped:          16944 kB
Slab:           486120 kB
PageTables:       5680 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2769532 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72796 MiB
End job on node123 at 2011-04-29 03:24:22