Trace number 3219688

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seqSAT 592.748 592.734

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1250-c25000-S269694958-008-UNKNOWN.cnf
MD5SUM320e47ec6251e96728575b0221aebaa2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark33.2099
Satisfiable
(Un)Satisfiability was proved
Number of variables1250
Number of clauses25000
Sum of the clauses size125000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 525000
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 0
0.00/0.00	Starting TNM 2009 on core(s) 0
592.67/592.72	s SATISFIABLE
592.67/592.72	v 1 2 -3 -4 -5 -6 -7 8 9 10 -11 -12 -13 14 -15 -16 17 -18 19 20 -21 -22 -23 24 25 -26 -27 -28 29 30 -31 32 33 34 35 36 -37 38 -39 40 -41 42 43 44 45 46 47 48 49 -50 -51 -52 -53 54 55 -56 -57 58 59 60 -61 -62 -63 64 65 66 -67 -68 -69 70 71 72 73 -74 75 76 77 -78 -79 80 81 -82 -83 -84 85 86 -87 -88 89 -90 91 -92 -93 94 95 96 97 98 99 100 -101 102 103 104 -105 106 -107 108 -109 110 111 -112 -113 114 115 116 -117 118 -119 120 -121 122 -123 124 -125 126 127 128 129 130 -131 -132 -133 134 135 136 -137 -138 139 140 141 142 -143 -144 -145 146 147 148 149 150 -151 152 -153 -154 -155 156 -157 158 -159 160 -161 162 163 164 -165 -166 167 -168 169 170 -171 172 -173 174 -175 -176 -177 -178 -179 180 -181 182 183 -184 -185 -186 187 -188 -189 190 -191 192 -193 194 195 196 -197 -198 -199 -200 201 202 203 204 -205 -206 207 -208 -209 210 -211 212 -213 -214 215 -216 217 -218 219 220 -221 222 223 -224 -225 226 -227 -228 229 230 231 -232 233 234 -235 -236 -237 238 239 -240 241 242 -243 -244 -245 -246 247 -248 -249 -250 -251 -252 -253 -254 -255 256 -257 258 -259 -260 261 -262 -263 -264 -265 266 -267 -268 269 270 271 272 -273 274 275 -276 -277 -278 279 -280 -281 -282 -283 -284 -285 286 287 -288 -289 -290 -291 292 293 -294 295 296 -297 298 299 300 301 302 303 -304 -305 306 307 308 309 -310 -311 312 313 314 -315 316 317 318 -319 -320 321 -322 -323 324 -325 326 327 -328 -329 330 331 -332 -333 -334 335 336 -337 -338 -339 340 -341 342 343 344 345 346 -347 -348 349 -350 -351 352 353 354 355 356 -357 -358 359 360 361 362 363 364 365 -366 -367 368 -369 -370 -371 -372 373 -374 375 -376 -377 -378 -379 -380 -381 -382 -383 384 -385 -386 387 -388 -389 390 -391 -392 -393 -394 395 -396 397 -398 399 -400 -401 402 403 -404 405 -406 -407 -408 409 410 411 -412 -413 -414 415 416 -417 -418 419 420 421 -422 423 -424 -425 -426 -427 -428 -429 -430 -431 -432 -433 -434 435 -436 -437 438 439 -440 441 442 -443 444 445 446 447 -448 -449 -450 451 452 453 -454 455 -456 457 -458 -459 -460 461 -462 -463 -464 465 466 -467 468 -469 -470 -471 472 473 -474 475 -476 -477 -478 479 480 481 482 483 -484 -485 -486 487 -488 -489 490 -491 -492 -493 -494 495 -496 497 498 499 500 -501 502 -503 504 -505 506 -507 508 -509 -510 -511 512 -513 514 515 516 517 -518 519 520 521 -522 -523 524 525 -526 527 528 -529 530 531 -532 533 -534 535 536 537 -538 539 -540 -541 -542 -543 -544 -545 546 -547 -548 549 -550 551 552 553 -554 -555 556 -557 -558 -559 -560 561 -562 563 -564 565 566 -567 568 569 -570 571 -572 573 -574 575 -576 577 578 -579 580 -581 582 -583 584 585 -586 -587 588 589 590 591 -592 -593 -594 595 596 597 -598 599 -600 -601 -602 603 604 -605 -606 607 608 609 -610 -611 612 -613 -614 615 -616 617 618 -619 -620 -621 622 623 624 625 626 -627 628 629 630 631 -632 633 -634 -635 -636 -637 -638 -639 -640 -641 -642 -643 -644 645 -646 647 -648 649 -650 -651 652 653 654 -655 -656 -657 658 659 660 -661 662 663 -664 665 666 -667 -668 -669 -670 671 672 -673 -674 675 -676 677 678 679 680 -681 -682 -683 684 685 686 -687 -688 689 690 691 692 693 694 695 696 -697 -698 -699 -700 -701 -702 -703 -704 -705 706 -707 708 -709 -710 -711 -712 -713 -714 -715 -716 -717 718 -719 -720 721 -722 -723 724 -725 -726 727 728 -729 730 731 -732 -733 734 735 -736 -737 738 -739 -740 741 -742 -743 744 -745 746 -747 748 -749 -750 -751 752 -753 754 755 -756 757 -758 759 -760 761 -762 -763 -764 -765 766 767 768 769 -770 -771 772 773 774 775 776 777 -778 -779 -780 -781 -782 783 784 -785 -786 -787 -788 -789 790 -791 -792 -793 -794 795 -796 797 798 799 -800 801 -802 -803 -804 -805 -806 807 808 -809 -810 811 812 813 -814 -815 816 -817 -818 819 820 -821 -822 -823 824 -825 -826 827 -828 829 -830 -831 832 -833 834 -835 -836 -837 -838 -839 -840 -841 -842 843 -844 -845 846 847 -848 849 -850 -851 852 -853 -854 -855 -856 857 -858 -859 860 -861 -862 863 -864 -865 866 -867 868 869 -870 871 872 -873 -874 875 876 877 -878 -879 880 881 882 -883 884 -885 886 887 888 889 890 891 -892 893 -894 -895 -896 897 -898 -899 -900 901 -902 -903 -904 905 906 -907 908 -909 910 -911 -912 -913 914 -915 916 -917 -918 -919 920 -921 922 -923 -924 -925 -926 -927 928 929 930 931 932 933 -934 -935 -936 -937 938 -939 940 941 -942 -943 944 -945 946 -947 -948 -949 -950 -951 952 953 954 -955 956 -957 958 -959 960 961 962 -963 964 965 -966 967 968 969 -970 -971 972 973 -974 975 976 -977 978 -979 -980 -981 982 -983 984 -985 -986 -987 988 -989 990 991 992 993 -994 -995 996 -997 998 -999 -1000 1001 1002 -1003 1004 -1005 -1006 1007 -1008 1009 -1010 1011 1012 -1013 1014 -1015 -1016 1017 1018 -1019 -1020 -1021 -1022 1023 -1024 1025 1026 -1027 -1028 -1029 -1030 1031 1032 -1033 1034 1035 -1036 1037 1038 1039 1040 -1041 1042 -1043 1044 -1045 -1046 1047 1048 1049 -1050 -1051 -1052 1053 1054 1055 -1056 -1057 1058 1059 -1060 1061 1062 1063 1064 1065 -1066 1067 -1068 -1069 -1070 -1071 1072 1073 -1074 1075 -1076 1077 -1078 -1079 1080 -1081 -1082 -1083 -1084 1085 1086 1087 1088 1089 -1090 1091 -1092 -1093 1094 1095 -1096 -1097 1098 -1099 -1100 -1101 -1102 -1103 -1104 1105 -1106 -1107 1108 1109 1110 1111 1112 -1113 1114 -1115 -1116 -1117 1118 1119 1120 1121 1122 -1123 -1124 1125 -1126 1127 -1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 -1138 -1139 1140 1141 1142 -1143 -1144 1145 -1146 1147 1148 1149 -1150 -1151 -1152 -1153 1154 -1155 1156 1157 -1158 -1159 -1160 1161 1162 -1163 1164 -1165 -1166 1167 -1168 -1169 1170 -1171 1172 -1173 1174 1175 -1176 -1177 1178 -1179 1180 -1181 -1182 -1183 -1184 1185 -1186 1187 -1188 -1189 -1190 -1191 -1192 1193 1194 1195 1196 -1197 1198 1199 -1200 -1201 -1202 1203 -1204 -1205 1206 1207 1208 1209 -1210 -1211 -1212 1213 -1214 1215 -1216 1217 -1218 -1219 1220 1221 1222 -1223 -1224 1225 1226 1227 -1228 -1229 -1230 -1231 1232 1233 1234 -1235 1236 1237 -1238 -1239 -1240 1241 -1242 -1243 -1244 -1245 1246 1247 -1248 -1249 1250 
592.67/592.72	v 0 
592.67/592.73	solver [3] TNM 2009 answered
592.67/592.73	Done

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3219688-1303257282/watcher-3219688-1303257282 -o /tmp/evaluation-result-3219688-1303257282/solver-3219688-1303257282 -C 5000 -W 5000 -M 15500 ppfolio --nbcore=1 HOME/instance-3219688-1303257282.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.00 5.00 5.00 3/179 21286
/proc/meminfo: memFree=17990480/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 1076989235887571202 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0

[startup+0.070559 s]
/proc/loadavg: 5.00 5.00 5.00 3/179 21286
/proc/meminfo: memFree=17990480/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 1076989235887571202 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100552 s]
/proc/loadavg: 5.00 5.00 5.00 3/179 21286
/proc/meminfo: memFree=17990480/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 1076989235887571202 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300401 s]
/proc/loadavg: 5.00 5.00 5.00 3/179 21286
/proc/meminfo: memFree=17990480/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 18 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70033 s]
/proc/loadavg: 5.00 5.00 5.00 3/179 21286
/proc/meminfo: memFree=17990480/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 16 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50025 s]
/proc/loadavg: 5.08 5.02 5.01 6/183 21290
/proc/meminfo: memFree=17972468/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121521260863684608 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=30112 CPUtime=0.49 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 3192 0 0 0 49 0 0 0 25 0 1 0 437327915 30834688 2819 33554432000 4194304 4587354 140734152017104 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 7528 2819 326 96 0 4090 0
[pid=21288] ppid=21286 vsize=19208 CPUtime=0.44 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 2356 0 0 0 44 0 0 0 25 0 1 0 437327915 19668992 2152 33554432000 4194304 4785740 140736307768880 18446744073709551615 4278016 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 4802 2152 340 145 0 1847 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=0.54 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 54 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 527428

[startup+3.10103 s]
/proc/loadavg: 5.08 5.02 5.01 6/183 21290
/proc/meminfo: memFree=17966756/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121521398302638080 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=464900 CPUtime=0.99 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 4379 0 0 0 99 0 0 0 25 0 1 0 437327915 476057600 3062 33554432000 4194304 4587354 140734152017104 18446744073709551615 4238766 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 116225 3062 327 96 0 112787 0
[pid=21288] ppid=21286 vsize=22696 CPUtime=0.96 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 3208 0 0 0 96 0 0 0 25 0 1 0 437327915 23240704 3004 33554432000 4194304 4785740 140736307768880 18446744073709551615 4286927 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 5674 3004 340 145 0 2719 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=1.12 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 112 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528926 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 965704

[startup+6.30048 s]
/proc/loadavg: 5.08 5.02 5.01 6/183 21291
/proc/meminfo: memFree=17963028/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121519611596242944 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=467976 CPUtime=2.09 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 6952 0 0 0 208 1 0 0 25 0 1 0 437327915 479207424 3006 33554432000 4194304 4587354 140734152017104 18446744073709551615 4236545 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 116994 3006 327 96 0 113556 0
[pid=21288] ppid=21286 vsize=24836 CPUtime=2.04 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 3748 0 0 0 204 0 0 0 25 0 1 0 437327915 25432064 3544 33554432000 4194304 4785740 140736307768880 18446744073709551615 4546107 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 6209 3544 340 145 0 3254 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=2.14 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 214 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 970920

[startup+12.7003 s]
/proc/loadavg: 5.07 5.02 5.00 6/183 21291
/proc/meminfo: memFree=17934896/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121521398302638080 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=467216 CPUtime=4.19 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 14347 0 0 0 417 2 0 0 25 0 1 0 437327915 478429184 3231 33554432000 4194304 4587354 140734152017104 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 116804 3231 337 96 0 113366 0
[pid=21288] ppid=21286 vsize=27716 CPUtime=4.16 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 4441 0 0 0 416 0 0 0 25 0 1 0 437327915 28381184 4237 33554432000 4194304 4785740 140736307768880 18446744073709551615 4538892 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 6929 4237 340 145 0 3974 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=4.32 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 432 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528473 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 973040

[startup+25.5011 s]
/proc/loadavg: 5.06 5.01 5.00 6/183 21291
/proc/meminfo: memFree=17944700/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520161352056832 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=467840 CPUtime=8.49 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 22222 0 0 0 845 4 0 0 25 0 1 0 437327915 479068160 5376 33554432000 4194304 4587354 140734152017104 18446744073709551615 4238602 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 116960 5376 337 96 0 113522 0
[pid=21288] ppid=21286 vsize=31332 CPUtime=8.44 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 5372 0 0 0 844 0 0 0 25 0 1 0 437327915 32083968 5168 33554432000 4194304 4785740 140736307768880 18446744073709551615 274473665134 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 7833 5168 340 145 0 4878 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=8.54 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 854 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 977280

[startup+51.1006 s]
/proc/loadavg: 5.04 5.01 5.00 6/183 21292
/proc/meminfo: memFree=17902916/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520298791010304 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=512868 CPUtime=16.99 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 33530 0 0 0 1693 6 0 0 25 0 1 0 437327915 525176832 14356 33554432000 4194304 4587354 140734152017104 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 128217 14356 337 96 0 124779 0
[pid=21288] ppid=21286 vsize=36320 CPUtime=16.97 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 6608 0 0 0 1696 1 0 0 25 0 1 0 437327915 37191680 6404 33554432000 4194304 4785740 140736307768880 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 9080 6404 340 145 0 6125 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=17.12 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 1712 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1027296

[startup+102.307 s]
/proc/loadavg: 5.01 5.01 5.00 6/183 21293
/proc/meminfo: memFree=17874356/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520848546824192 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=530816 CPUtime=34.09 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 55027 0 0 0 3400 9 0 0 25 0 1 0 437327915 543555584 19324 33554432000 4194304 4587354 140734152017104 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 132704 19324 337 96 0 129266 0
[pid=21288] ppid=21286 vsize=44104 CPUtime=34.03 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 8494 0 0 0 3402 1 0 0 25 0 1 0 437327915 45162496 8290 33554432000 4194304 4785740 140736307768880 18446744073709551615 4286964 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 11026 8290 340 145 0 8071 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=34.16 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 3416 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1053028

[startup+162.301 s]
/proc/loadavg: 5.00 5.00 5.00 6/183 21295
/proc/meminfo: memFree=17920072/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121519886474149888 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=477244 CPUtime=54.09 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 68035 0 0 0 5397 12 0 0 25 0 1 0 437327915 488697856 6799 33554432000 4194304 4587354 140734152017104 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 119311 6799 337 96 0 115873 0
[pid=21288] ppid=21286 vsize=49412 CPUtime=54.03 cores=0

################
# More data... #
################

/proc/21288/statm: 15726 12794 340 145 0 12771 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=114.18 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 11418 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530693 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 1096100

[startup+402.301 s]
/proc/loadavg: 5.02 5.03 5.00 6/183 21371
/proc/meminfo: memFree=18032200/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=471764 CPUtime=134.07 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 126340 0 0 0 13385 22 0 0 25 0 1 0 437327915 483086336 4998 33554432000 4194304 4587354 140734152017104 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 117941 4998 337 96 0 114503 0
[pid=21288] ppid=21286 vsize=66080 CPUtime=134.02 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 13747 0 0 0 13400 2 0 0 25 0 1 0 437327915 67665920 13543 33554432000 4194304 4785740 140736307768880 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 16520 13543 340 145 0 13565 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=134.19 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 13419 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 1015952

[startup+462.301 s]
/proc/loadavg: 5.00 5.02 5.00 6/183 21373
/proc/meminfo: memFree=18020148/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121521123424731136 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=474292 CPUtime=154.06 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 147180 0 0 0 15380 26 0 0 25 0 1 0 437327915 485675008 6653 33554432000 4194304 4587354 140734152017104 18446744073709551615 4238582 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 118573 6653 337 96 0 115135 0
[pid=21288] ppid=21286 vsize=67768 CPUtime=154.02 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 14191 0 0 0 15400 2 0 0 25 0 1 0 437327915 69394432 13987 33554432000 4194304 4785740 140736307768880 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 16942 13987 340 145 0 13987 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=154.2 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 15420 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530166 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 462.28
Current children cumulated vsize (KiB) 1020168

[startup+522.301 s]
/proc/loadavg: 5.08 5.04 5.01 6/183 21374
/proc/meminfo: memFree=17926740/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520436229963776 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=562632 CPUtime=174.06 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 173548 0 0 0 17376 30 0 0 25 0 1 0 437327915 576135168 27846 33554432000 4194304 4587354 140734152017104 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 140658 27846 337 96 0 137220 0
[pid=21288] ppid=21286 vsize=73040 CPUtime=174.02 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 15440 0 0 0 17400 2 0 0 25 0 1 0 437327915 74792960 15236 33554432000 4194304 4785740 140736307768880 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 18260 15236 340 145 0 15305 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=174.19 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 17419 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530712 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 522.27
Current children cumulated vsize (KiB) 1113780

[startup+582.301 s]
/proc/loadavg: 5.03 5.03 5.00 6/183 21379
/proc/meminfo: memFree=17916444/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520436229963776 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=569276 CPUtime=194.06 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 175129 0 0 0 19375 31 0 0 25 0 1 0 437327915 582938624 29427 33554432000 4194304 4587354 140734152017104 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 142319 29427 337 96 0 138881 0
[pid=21288] ppid=21286 vsize=75900 CPUtime=194.03 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 16126 0 0 0 19401 2 0 0 25 0 1 0 437327915 77721600 15922 33554432000 4194304 4785740 140736307768880 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 18975 15922 340 145 0 16020 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=194.19 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 19419 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 582.28
Current children cumulated vsize (KiB) 1123284

Solver just ended. Dumping a history of the last processes samples

[startup+588.701 s]
/proc/loadavg: 5.02 5.03 5.00 6/183 21379
/proc/meminfo: memFree=17916196/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520436229963776 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=569276 CPUtime=196.19 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 175129 0 0 0 19588 31 0 0 25 0 1 0 437327915 582938624 29427 33554432000 4194304 4587354 140734152017104 18446744073709551615 4364904 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 142319 29427 337 96 0 138881 0
[pid=21288] ppid=21286 vsize=76176 CPUtime=196.21 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 16189 0 0 0 19619 2 0 0 25 0 1 0 437327915 78004224 15985 33554432000 4194304 4785740 140736307768880 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 19044 15985 340 145 0 16089 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=196.29 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 19629 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 588.69
Current children cumulated vsize (KiB) 1123560

[startup+590.301 s]
/proc/loadavg: 5.02 5.03 5.00 6/183 21379
/proc/meminfo: memFree=17916196/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520436229963776 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=569276 CPUtime=196.76 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 175129 0 0 0 19645 31 0 0 25 0 1 0 437327915 582938624 29427 33554432000 4194304 4587354 140734152017104 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 142319 29427 337 96 0 138881 0
[pid=21288] ppid=21286 vsize=76176 CPUtime=196.71 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 16189 0 0 0 19669 2 0 0 25 0 1 0 437327915 78004224 15985 33554432000 4194304 4785740 140736307768880 18446744073709551615 4550319 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 19044 15985 340 145 0 16089 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=196.81 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 19681 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 590.28
Current children cumulated vsize (KiB) 1123560

[startup+591.9 s]
/proc/loadavg: 5.02 5.03 5.00 6/183 21379
/proc/meminfo: memFree=17916072/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520436229963776 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=569276 CPUtime=197.26 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 175129 0 0 0 19695 31 0 0 25 0 1 0 437327915 582938624 29427 33554432000 4194304 4587354 140734152017104 18446744073709551615 4364784 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 142319 29427 337 96 0 138881 0
[pid=21288] ppid=21286 vsize=76176 CPUtime=197.23 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 16189 0 0 0 19721 2 0 0 25 0 1 0 437327915 78004224 15985 33554432000 4194304 4785740 140736307768880 18446744073709551615 4278121 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 19044 15985 340 145 0 16089 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=197.39 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 19739 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 591.88
Current children cumulated vsize (KiB) 1123560

[startup+592.301 s]
/proc/loadavg: 5.02 5.03 5.00 6/183 21379
/proc/meminfo: memFree=17916072/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520436229963776 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=569276 CPUtime=197.39 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 175129 0 0 0 19708 31 0 0 25 0 1 0 437327915 582938624 29427 33554432000 4194304 4587354 140734152017104 18446744073709551615 4364910 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 142319 29427 337 96 0 138881 0
[pid=21288] ppid=21286 vsize=76176 CPUtime=197.4 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 16189 0 0 0 19738 2 0 0 25 0 1 0 437327915 78004224 15985 33554432000 4194304 4785740 140736307768880 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 19044 15985 340 145 0 16089 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=197.49 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 19749 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134528659 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 592.28
Current children cumulated vsize (KiB) 1123560

[startup+592.701 s]
/proc/loadavg: 5.02 5.03 5.00 6/183 21379
/proc/meminfo: memFree=17916072/32950928 swapFree=67111528/67111528
[pid=21286] ppid=21284 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/21286/stat : 21286 (ppfolio) S 21284 21286 20748 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 437327915 18763776 394 33554432000 4194304 4287625 140736096640752 18446744073709551615 274473987599 0 0 4096 65536 4121520436229963776 0 0 17 2 0 0 0
/proc/21286/statm: 4581 394 345 23 0 91 0
[pid=21287] ppid=21286 vsize=569276 CPUtime=197.56 cores=0
/proc/21287/stat : 21287 (cryptominisat) R 21286 21286 20748 0 -1 4202496 175129 0 0 0 19725 31 0 0 25 0 1 0 437327915 582938624 29427 33554432000 4194304 4587354 140734152017104 18446744073709551615 4365352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21287/statm: 142319 29427 337 96 0 138881 0
[pid=21288] ppid=21286 vsize=76176 CPUtime=197.5 cores=0
/proc/21288/stat : 21288 (clasp) R 21286 21286 20748 0 -1 4202496 16189 0 0 0 19748 2 0 0 25 0 1 0 437327915 78004224 15985 33554432000 4194304 4785740 140736307768880 18446744073709551615 4278573 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/21288/statm: 19044 15985 340 145 0 16089 0
[pid=21289] ppid=21286 vsize=459784 CPUtime=197.61 cores=0
/proc/21289/stat : 21289 (TNM) R 21286 21286 20748 0 -1 4202496 1541 0 0 0 19761 0 0 0 25 0 1 0 437327915 470818816 1438 33554432000 134512640 134534564 4291167664 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21289/statm: 114946 1438 95 6 0 113612 0
Current children cumulated CPU time (s) 592.67
Current children cumulated vsize (KiB) 1123560

Child status: 0
Real time (s): 592.734
CPU time (s): 592.748
CPU user time (s): 592.39
CPU system time (s): 0.357945
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 1449388

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 592.39
system time used= 0.357945
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 193396
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 190
involuntary context switches= 6866

runsolver used 1.01385 second user time and 2.22366 second system time

The end

Launcher Data 

Begin job on node125 at 2011-04-20 01:54:43
IDJOB=3219688
IDBENCH=82631
IDSOLVER=1639
FILE ID=node125/3219688-1303257282
RUNJOBID= node125-1303247464-20766
PBS_JOBID= 13042422
Free space on /tmp= 72412 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k5-r20-v1250-c25000-S269694958-008-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3219688-1303257282/watcher-3219688-1303257282 -o /tmp/evaluation-result-3219688-1303257282/solver-3219688-1303257282 -C 5000 -W 5000 -M 15500  ppfolio --nbcore=1 HOME/instance-3219688-1303257282.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 320e47ec6251e96728575b0221aebaa2
RANDOM SEED=1948722369

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17990636 kB
Buffers:        703776 kB
Cached:       13696040 kB
SwapCached:          0 kB
Active:        6449476 kB
Inactive:      8162112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17990636 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10504 kB
Writeback:           0 kB
AnonPages:      211252 kB
Mapped:          16084 kB
Slab:           284240 kB
PageTables:       5148 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   823364 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72404 MiB
End job on node125 at 2011-04-20 02:04:35