Trace number 3251171

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parSAT 579.56 145.142

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf
MD5SUM1bac7b96ea6eb843b1de7405a721cd87
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.861868
Satisfiable
(Un)Satisfiability was proved
Number of variables1244
Number of clauses150604
Sum of the clauses size302382
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2150569
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7
579.56/145.13	s SATISFIABLE
579.56/145.13	v 1 -2 -3 -4 -5 -6 -7 -8 -9 -10 -11 -12 -13 -14 -15 -16 -17 -18 -19 -20 -21 -22 -23 -24 -25 -26 -27 -28 -29 -30 -31 -32 -33 -34 -35 -36 -37 -38 39 -40 -41 -42 -43 -44 -45 -46 -47 -48 -49 -50 -51 -52 -53 -54 -55 -56 -57 -58 -59 -60 -61 -62 -63 -64 -65 -66 -67 -68 -69 -70 -71 -72 73 -74 -75 -76 -77 -78 -79 -80 -81 -82 -83 -84 -85 -86 -87 -88 -89 -90 -91 -92 -93 -94 -95 -96 -97 -98 -99 -100 -101 -102 -103 -104 -105 -106 -107 -108 -109 -110 111 -112 -113 -114 -115 -116 -117 -118 -119 -120 -121 -122 -123 -124 -125 -126 -127 -128 -129 -130 -131 -132 -133 -134 -135 -136 -137 -138 -139 -140 -141 -142 -143 -144 -145 -146 -147 -148 149 -150 -151 -152 -153 -154 -155 -156 -157 -158 -159 -160 -161 -162 -163 -164 -165 -166 -167 -168 -169 -170 -171 -172 -173 -174 -175 -176 -177 -178 -179 -180 -181 -182 -183 -184 -185 -186 187 -188 -189 -190 -191 -192 -193 -194 -195 -196 -197 -198 -199 -200 -201 -202 -203 -204 -205 -206 -207 -208 -209 -210 -211 -212 -213 -214 -215 -216 -217 -218 -219 -220 -221 -222 -223 224 -225 -226 -227 -228 -229 -230 -231 -232 -233 -234 -235 -236 -237 -238 -239 -240 -241 -242 -243 -244 -245 -246 -247 -248 -249 -250 -251 -252 -253 -254 -255 -256 -257 -258 -259 260 -261 -262 -263 -264 -265 -266 -267 -268 -269 -270 -271 -272 -273 -274 -275 -276 -277 -278 -279 -280 -281 -282 -283 -284 -285 -286 -287 -288 -289 -290 -291 -292 -293 -294 -295 296 -297 -298 -299 -300 -301 -302 -303 -304 -305 -306 -307 -308 -309 -310 -311 -312 -313 -314 -315 -316 -317 -318 -319 -320 -321 -322 -323 -324 -325 -326 -327 -328 -329 330 -331 -332 -333 -334 -335 -336 -337 -338 -339 -340 -341 -342 -343 -344 -345 -346 -347 -348 -349 -350 -351 -352 -353 -354 -355 -356 -357 -358 -359 -360 -361 -362 -363 -364 -365 -366 -367 368 -369 -370 -371 -372 -373 -374 -375 -376 -377 -378 -379 -380 -381 -382 -383 -384 -385 -386 -387 -388 -389 -390 -391 -392 -393 -394 -395 -396 -397 -398 -399 -400 -401 -402 -403 -404 -405 406 -407 -408 -409 -410 -411 -412 -413 -414 -415 -416 -417 -418 -419 -420 -421 -422 -423 -424 -425 -426 -427 -428 -429 -430 -431 -432 -433 -434 -435 -436 -437 -438 -439 440 -441 -442 -443 -444 -445 -446 -447 -448 -449 -450 -451 -452 -453 -454 -455 -456 -457 -458 -459 -460 -461 -462 -463 -464 -465 -466 -467 -468 -469 -470 -471 -472 -473 -474 -475 -476 477 -478 -479 -480 -481 -482 -483 -484 -485 -486 -487 -488 -489 -490 -491 -492 -493 -494 -495 -496 -497 -498 -499 -500 -501 -502 -503 -504 -505 -506 -507 -508 -509 -510 -511 -512 -513 -514 515 -516 -517 -518 -519 -520 -521 -522 -523 -524 -525 -526 -527 -528 -529 -530 -531 -532 -533 -534 -535 -536 -537 -538 -539 -540 -541 -542 -543 -544 -545 -546 -547 -548 -549 -550 551 -552 -553 -554 -555 -556 -557 -558 -559 -560 -561 -562 -563 -564 -565 -566 -567 -568 -569 -570 -571 -572 -573 -574 -575 -576 -577 -578 -579 -580 -581 -582 -583 -584 -585 -586 -587 588 -589 -590 -591 -592 -593 -594 -595 -596 -597 -598 -599 -600 -601 -602 -603 -604 -605 -606 -607 -608 -609 -610 -611 -612 -613 -614 -615 -616 -617 -618 -619 -620 -621 -622 -623 -624 625 -626 -627 -628 -629 -630 -631 -632 -633 -634 -635 -636 -637 -638 -639 -640 -641 -642 -643 -644 -645 -646 -647 -648 -649 -650 -651 -652 -653 -654 -655 -656 -657 -658 -659 -660 -661 -662 663 -664 -665 -666 -667 -668 -669 -670 -671 -672 -673 -674 -675 -676 -677 -678 -679 -680 -681 -682 -683 -684 -685 -686 -687 -688 -689 -690 -691 -692 -693 -694 -695 -696 -697 -698 -699 -700 701 -702 -703 -704 -705 -706 -707 -708 -709 -710 -711 -712 -713 -714 -715 -716 -717 -718 -719 -720 -721 -722 -723 -724 -725 -726 -727 -728 -729 -730 -731 -732 -733 -734 -735 -736 -737 -738 739 -740 -741 -742 -743 -744 -745 -746 -747 -748 -749 -750 -751 -752 -753 -754 -755 -756 -757 -758 -759 -760 -761 -762 -763 -764 -765 -766 -767 -768 -769 -770 -771 -772 -773 -774 775 -776 -777 -778 -779 -780 -781 -782 -783 -784 -785 -786 -787 -788 -789 -790 -791 -792 -793 -794 -795 -796 -797 -798 -799 -800 -801 -802 -803 -804 -805 -806 -807 -808 809 -810 -811 -812 -813 -814 -815 -816 -817 -818 -819 -820 -821 -822 -823 -824 -825 -826 -827 -828 -829 -830 -831 -832 -833 -834 -835 -836 -837 -838 -839 -840 -841 -842 -843 -844 845 -846 -847 -848 -849 -850 -851 -852 -853 -854 -855 -856 -857 -858 -859 -860 -861 -862 -863 -864 -865 -866 -867 -868 -869 -870 -871 -872 -873 -874 -875 -876 -877 -878 -879 -880 881 -882 -883 -884 -885 -886 -887 -888 -889 -890 -891 -892 -893 -894 -895 -896 -897 -898 -899 -900 -901 -902 -903 -904 -905 -906 -907 -908 -909 -910 -911 -912 -913 -914 -915 -916 917 -918 -919 -920 -921 -922 -923 -924 -925 -926 -927 -928 -929 -930 -931 -932 -933 -934 -935 -936 -937 -938 -939 -940 -941 -942 -943 -944 -945 -946 -947 -948 -949 -950 -951 -952 953 -954 -955 -956 -957 -958 -959 -960 -961 -962 -963 -964 -965 -966 -967 -968 -969 -970 -971 -972 -973 -974 -975 -976 -977 -978 -979 -980 -981 -982 -983 -984 -985 -986 -987 -988 -989 990 -991 -992 -993 -994 -995 -996 -997 -998 -999 -1000 -1001 -1002 -1003 -1004 -1005 -1006 -1007 -1008 -1009 -1010 -1011 -1012 -1013 -1014 -1015 -1016 -1017 -1018 -1019 -1020 -1021 -1022 -1023 -1024 -1025 1026 -1027 -1028 -1029 -1030 -1031 -1032 -1033 -1034 -1035 -1036 -1037 -1038 -1039 -1040 -1041 -1042 -1043 -1044 -1045 -1046 -1047 -1048 -1049 -1050 -1051 -1052 -1053 -1054 -1055 -1056 -1057 -1058 -1059 -1060 -1061 1062 -1063 -1064 -1065 -1066 -1067 -1068 -1069 -1070 -1071 -1072 -1073 -1074 -1075 -1076 -1077 -1078 -1079 -1080 -1081 -1082 -1083 -1084 -1085 -1086 -1087 -1088 -1089 -1090 -1091 -1092 -1093 -1094 -1095 -1096 -1097 -1098 -1099 1100 -1101 -1102 -1103 -1104 -1105 -1106 -1107 -1108 -1109 -1110 -1111 -1112 -1113 -1114 -1115 -1116 -1117 -1118 -1119 -1120 -1121 -1122 -1123 -1124 -1125 -1126 -1127 -1128 -1129 -1130 -1131 -1132 -1133 1134 -1135 -1136 -1137 -1138 -1139 -1140 -1141 -1142 -1143 -1144 -1145 -1146 -1147 -1148 -1149 -1150 -1151 -1152 -1153 -1154 -1155 -1156 -1157 -1158 -1159 -1160 -1161 -1162 -1163 -1164 -1165 -1166 -1167 -1168 -1169 1170 -1171 -1172 -1173 -1174 -1175 -1176 -1177 -1178 -1179 -1180 -1181 -1182 -1183 -1184 -1185 -1186 -1187 -1188 -1189 -1190 -1191 -1192 -1193 -1194 -1195 -1196 -1197 -1198 -1199 -1200 -1201 -1202 -1203 -1204 -1205 -1206 1207 -1208 -1209 -1210 -1211 -1212 -1213 -1214 -1215 -1216 -1217 -1218 -1219 -1220 -1221 -1222 -1223 -1224 -1225 -1226 -1227 -1228 -1229 -1230 -1231 -1232 -1233 -1234 -1235 -1236 -1237 -1238 -1239 -1240 -1241 -1242 -1243 1244 
579.56/145.13	v 0 
579.56/145.14	solver [3] TNM 2009 answered
579.56/145.14	Done

Verifier Data

OK

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251171-1304099157/watcher-3251171-1304099157 -o /tmp/evaluation-result-3251171-1304099157/solver-3251171-1304099157 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3251171-1304099157.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.11 9.17 9.28 6/182 29680
/proc/meminfo: memFree=15851668/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) R 29678 29680 28861 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0

[startup+0.237667 s]
/proc/loadavg: 9.11 9.17 9.28 6/182 29680
/proc/meminfo: memFree=15851668/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300659 s]
/proc/loadavg: 9.11 9.17 9.28 6/182 29680
/proc/meminfo: memFree=15851668/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.400644 s]
/proc/loadavg: 9.11 9.17 9.28 6/182 29680
/proc/meminfo: memFree=15851668/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 23 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700588 s]
/proc/loadavg: 9.11 9.17 9.28 6/182 29680
/proc/meminfo: memFree=15851668/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 20 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50045 s]
/proc/loadavg: 9.11 9.17 9.28 11/188 29686
/proc/meminfo: memFree=15786644/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=47168 CPUtime=1.48 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 9138 0 0 0 148 0 0 0 25 0 1 0 600146507 48300032 7006 33554432000 4194304 4587354 140734031612608 18446744073709551615 4243440 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 11792 7006 326 96 0 8354 0
[pid=29682] ppid=29680 vsize=24292 CPUtime=1.48 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 4576 0 0 0 148 0 0 0 25 0 1 0 600146507 24875008 3416 33554432000 4194304 4785740 140733379642560 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 6073 3416 340 145 0 3118 0
[pid=29683] ppid=29680 vsize=458860 CPUtime=0.77 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 2596 0 0 0 77 0 0 0 25 0 1 0 600146507 469872640 2492 33554432000 134512640 134534564 4292785600 18446744073709551615 134524727 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 114715 2492 91 6 0 113381 0
[pid=29684] ppid=29680 vsize=10880 CPUtime=1.49 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 2501 0 0 0 149 0 0 0 25 0 1 0 600146507 11141120 1878 33554432000 4194304 4352236 140733609669520 18446744073709551615 4267912 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 2720 1878 124 39 0 1800 0
[pid=29685] ppid=29680 vsize=27496 CPUtime=0.7 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 12066 0 0 0 69 1 0 0 25 0 1 0 600146507 28155904 2857 33554432000 4194304 4331988 140733897353520 18446744073709551615 4265440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 6874 2857 171 34 0 5316 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 587020

[startup+3.10117 s]
/proc/loadavg: 9.11 9.17 9.28 11/188 29686
/proc/meminfo: memFree=15769860/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1444684 CPUtime=3.09 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 10614 0 0 0 308 1 0 0 25 0 1 0 600146507 1479356416 7067 33554432000 4194304 4587354 140734031612608 18446744073709551615 4365352 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 361171 7067 337 96 0 357733 0
[pid=29682] ppid=29680 vsize=35952 CPUtime=3.09 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 7470 0 0 0 308 1 0 0 25 0 1 0 600146507 36814848 6310 33554432000 4194304 4785740 140733379642560 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 8988 6310 340 145 0 6033 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=1.57 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 157 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=17152 CPUtime=3.09 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 3817 0 0 0 309 0 0 0 25 0 1 0 600146507 17563648 3194 33554432000 4194304 4352236 140733609669520 18446744073709551615 4328359 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 4288 3194 127 39 0 3368 0
[pid=29685] ppid=29680 vsize=27496 CPUtime=1.5 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 12086 0 0 0 149 1 0 0 25 0 1 0 600146507 28155904 2877 33554432000 4194304 4331988 140733897353520 18446744073709551615 4226485 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 6874 2877 171 34 0 5316 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 2007628

[startup+6.30061 s]
/proc/loadavg: 9.27 9.20 9.29 11/188 29686
/proc/meminfo: memFree=15732056/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1452712 CPUtime=6.29 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 12141 0 0 0 628 1 0 0 25 0 1 0 600146507 1487577088 8594 33554432000 4194304 4587354 140734031612608 18446744073709551615 4365236 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 363178 8594 337 96 0 359740 0
[pid=29682] ppid=29680 vsize=56032 CPUtime=6.28 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 12404 0 0 0 627 1 0 0 25 0 1 0 600146507 57376768 11244 33554432000 4194304 4785740 140733379642560 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 14008 11244 340 145 0 11053 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=3.22 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 322 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=19072 CPUtime=6.29 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 4297 0 0 0 629 0 0 0 25 0 1 0 600146507 19529728 3674 33554432000 4194304 4352236 140733609669520 18446744073709551615 4207882 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 4768 3674 127 39 0 3848 0
[pid=29685] ppid=29680 vsize=27964 CPUtime=3.03 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 12192 0 0 0 302 1 0 0 25 0 1 0 600146507 28635136 2983 33554432000 4194304 4331988 140733897353520 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 6991 2983 174 34 0 5433 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 2038124

[startup+12.7005 s]
/proc/loadavg: 9.32 9.21 9.29 11/188 29686
/proc/meminfo: memFree=15689416/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1514040 CPUtime=12.69 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 19611 0 0 0 1267 2 0 0 25 0 1 0 600146507 1550376960 14190 33554432000 4194304 4587354 140734031612608 18446744073709551615 4365236 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 378510 14190 337 96 0 375072 0
[pid=29682] ppid=29680 vsize=65684 CPUtime=12.68 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 14758 0 0 0 1266 2 0 0 25 0 1 0 600146507 67260416 13598 33554432000 4194304 4785740 140733379642560 18446744073709551615 4287024 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 16421 13598 340 145 0 13466 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=6.41 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 641 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=20608 CPUtime=12.69 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 4936 0 0 0 1269 0 0 0 25 0 1 0 600146507 21102592 4313 33554432000 4194304 4352236 140733609669520 18446744073709551615 4268304 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 5152 4313 127 39 0 4232 0
[pid=29685] ppid=29680 vsize=27964 CPUtime=6.2 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 12207 0 0 0 619 1 0 0 25 0 1 0 600146507 28635136 2998 33554432000 4194304 4331988 140733897353520 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 6991 2998 174 34 0 5433 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 2110640

[startup+25.5072 s]
/proc/loadavg: 9.47 9.25 9.30 11/188 29686
/proc/meminfo: memFree=15647308/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1520316 CPUtime=25.49 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 26469 0 0 0 2546 3 0 0 25 0 1 0 600146507 1556803584 16205 33554432000 4194304 4587354 140734031612608 18446744073709551615 215988289047 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 380079 16205 337 96 0 376641 0
[pid=29682] ppid=29680 vsize=84576 CPUtime=25.49 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 19324 0 0 0 2546 3 0 0 25 0 1 0 600146507 86605824 18164 33554432000 4194304 4785740 140733379642560 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 21144 18164 340 145 0 18189 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=12.75 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 1275 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134530796 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=27812 CPUtime=25.49 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 8785 0 0 0 2549 0 0 0 25 0 1 0 600146507 28479488 6114 33554432000 4194304 4352236 140733609669520 18446744073709551615 4329015 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 6953 6114 127 39 0 6033 0
[pid=29685] ppid=29680 vsize=28244 CPUtime=12.6 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 12241 0 0 0 1259 1 0 0 25 0 1 0 600146507 28921856 3032 33554432000 4194304 4331988 140733897353520 18446744073709551615 4210412 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7061 3032 174 34 0 5503 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 2143292

[startup+51.1008 s]
/proc/loadavg: 9.71 9.33 9.32 11/188 29687
/proc/meminfo: memFree=15529356/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1515300 CPUtime=51.09 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 44011 0 0 0 5100 9 0 0 25 0 1 0 600146507 1551667200 18870 33554432000 4194304 4587354 140734031612608 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 378825 18870 337 96 0 375387 0
[pid=29682] ppid=29680 vsize=97896 CPUtime=51.08 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 22376 0 0 0 5104 4 0 0 25 0 1 0 600146507 100245504 21216 33554432000 4194304 4785740 140733379642560 18446744073709551615 4278595 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 24474 21216 340 145 0 21519 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=25.51 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 2551 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134528944 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=38056 CPUtime=51.08 cores=3

################
# More data... #
################

/proc/29682/statm: 36561 32635 340 145 0 33606 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=63.8 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 6380 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134530614 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=42168 CPUtime=128.09 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 26582 0 0 0 12807 2 0 0 25 0 1 0 600146507 43180032 9703 33554432000 4194304 4352236 140733609669520 18446744073709551615 4241453 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 10542 9703 127 39 0 9622 0
[pid=29685] ppid=29680 vsize=31200 CPUtime=63.59 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 12980 0 0 0 6358 1 0 0 25 0 1 0 600146507 31948800 3771 33554432000 4194304 4331988 140733897353520 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7800 3771 174 34 0 6242 0
Current children cumulated CPU time (s) 511.66
Current children cumulated vsize (KiB) 2251780

[startup+134.501 s]
/proc/loadavg: 10.01 9.53 9.39 11/188 29689
/proc/meminfo: memFree=15420576/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1572932 CPUtime=134.49 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 82814 0 0 0 13433 16 0 0 25 0 1 0 600146507 1610682368 29529 33554432000 4194304 4587354 140734031612608 18446744073709551615 4357604 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 393233 29529 337 96 0 389795 0
[pid=29682] ppid=29680 vsize=147380 CPUtime=134.49 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 34039 0 0 0 13441 8 0 0 25 0 1 0 600146507 150917120 32879 33554432000 4194304 4785740 140733379642560 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 36845 32879 340 145 0 33890 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=66.96 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 6696 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=52408 CPUtime=134.49 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 29142 0 0 0 13447 2 0 0 25 0 1 0 600146507 53665792 12263 33554432000 4194304 4352236 140733609669520 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 13102 12263 127 39 0 12182 0
[pid=29685] ppid=29680 vsize=31200 CPUtime=66.79 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 13001 0 0 0 6678 1 0 0 25 0 1 0 600146507 31948800 3792 33554432000 4194304 4331988 140733897353520 18446744073709551615 215992052806 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7800 3792 174 34 0 6242 0
Current children cumulated CPU time (s) 537.22
Current children cumulated vsize (KiB) 2286264

[startup+140.901 s]
/proc/loadavg: 10.09 9.55 9.40 11/188 29689
/proc/meminfo: memFree=15439796/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1549824 CPUtime=140.9 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 85760 0 0 0 14073 17 0 0 25 0 1 0 600146507 1587019776 25421 33554432000 4194304 4587354 140734031612608 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 387456 25421 337 96 0 384018 0
[pid=29682] ppid=29680 vsize=149324 CPUtime=140.89 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 34514 0 0 0 14081 8 0 0 25 0 1 0 600146507 152907776 33354 33554432000 4194304 4785740 140733379642560 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 37331 33354 340 145 0 34376 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=70.13 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 7013 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 7867619 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=44216 CPUtime=140.9 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 29910 0 0 0 14087 3 0 0 25 0 1 0 600146507 45277184 10215 33554432000 4194304 4352236 140733609669520 18446744073709551615 4241736 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 11054 10215 127 39 0 10134 0
[pid=29685] ppid=29680 vsize=31964 CPUtime=69.99 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 13022 0 0 0 6998 1 0 0 25 0 1 0 600146507 32731136 3813 33554432000 4194304 4331988 140733897353520 18446744073709551615 4226231 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7991 3813 175 34 0 6433 0
Current children cumulated CPU time (s) 562.81
Current children cumulated vsize (KiB) 2257672

[startup+142.501 s]
/proc/loadavg: 10.09 9.55 9.40 11/188 29689
/proc/meminfo: memFree=15457900/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1525588 CPUtime=142.49 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 85969 0 0 0 14232 17 0 0 25 0 1 0 600146507 1562202112 21012 33554432000 4194304 4587354 140734031612608 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 381397 21012 337 96 0 377959 0
[pid=29682] ppid=29680 vsize=149608 CPUtime=142.49 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 34607 0 0 0 14241 8 0 0 25 0 1 0 600146507 153198592 33447 33554432000 4194304 4785740 140733379642560 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 37402 33447 340 145 0 34447 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=70.92 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 7092 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=41144 CPUtime=142.49 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 29910 0 0 0 14246 3 0 0 25 0 1 0 600146507 42131456 9447 33554432000 4194304 4352236 140733609669520 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 10286 9447 127 39 0 9366 0
[pid=29685] ppid=29680 vsize=31964 CPUtime=70.79 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 13026 0 0 0 7078 1 0 0 25 0 1 0 600146507 32731136 3817 33554432000 4194304 4331988 140733897353520 18446744073709551615 4226499 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7991 3817 175 34 0 6433 0
Current children cumulated CPU time (s) 569.18
Current children cumulated vsize (KiB) 2230648

[startup+144.1 s]
/proc/loadavg: 10.09 9.55 9.40 11/188 29689
/proc/meminfo: memFree=15456784/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1525588 CPUtime=144.09 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 85969 0 0 0 14392 17 0 0 25 0 1 0 600146507 1562202112 21012 33554432000 4194304 4587354 140734031612608 18446744073709551615 4238683 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 381397 21012 337 96 0 377959 0
[pid=29682] ppid=29680 vsize=149608 CPUtime=144.09 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 34624 0 0 0 14401 8 0 0 25 0 1 0 600146507 153198592 33464 33554432000 4194304 4785740 140733379642560 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 37402 33464 340 145 0 34447 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=71.71 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 7171 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134529872 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=41656 CPUtime=144.09 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 30038 0 0 0 14406 3 0 0 25 0 1 0 600146507 42655744 9575 33554432000 4194304 4352236 140733609669520 18446744073709551615 4328000 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 10414 9575 127 39 0 9494 0
[pid=29685] ppid=29680 vsize=31964 CPUtime=71.59 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 13032 0 0 0 7158 1 0 0 25 0 1 0 600146507 32731136 3823 33554432000 4194304 4331988 140733897353520 18446744073709551615 4210400 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7991 3823 175 34 0 6433 0
Current children cumulated CPU time (s) 575.57
Current children cumulated vsize (KiB) 2231160

[startup+144.9 s]
/proc/loadavg: 10.08 9.56 9.40 11/188 29689
/proc/meminfo: memFree=15455668/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1525588 CPUtime=144.89 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 85969 0 0 0 14472 17 0 0 25 0 1 0 600146507 1562202112 21012 33554432000 4194304 4587354 140734031612608 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 381397 21012 337 96 0 377959 0
[pid=29682] ppid=29680 vsize=149608 CPUtime=144.88 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 34628 0 0 0 14480 8 0 0 25 0 1 0 600146507 153198592 33468 33554432000 4194304 4785740 140733379642560 18446744073709551615 4553380 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 37402 33468 340 145 0 34447 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=72.11 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 7211 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=42680 CPUtime=144.89 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 30294 0 0 0 14486 3 0 0 25 0 1 0 600146507 43704320 9831 33554432000 4194304 4352236 140733609669520 18446744073709551615 4231152 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 10670 9831 127 39 0 9750 0
[pid=29685] ppid=29680 vsize=31964 CPUtime=71.99 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 13035 0 0 0 7198 1 0 0 25 0 1 0 600146507 32731136 3826 33554432000 4194304 4331988 140733897353520 18446744073709551615 4226519 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7991 3826 175 34 0 6433 0
Current children cumulated CPU time (s) 578.76
Current children cumulated vsize (KiB) 2232184

[startup+145.1 s]
/proc/loadavg: 10.08 9.56 9.40 11/188 29689
/proc/meminfo: memFree=15455668/32950940 swapFree=67111528/67111528
[pid=29680] ppid=29678 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/29680/stat : 29680 (ppfolio) S 29678 29680 28861 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 600146506 18763776 390 33554432000 4194304 4287625 140734172026160 18446744073709551615 215988612623 0 0 4096 65536 4420969683570655231 0 0 17 5 0 0 0
/proc/29680/statm: 4581 390 341 23 0 91 0
[pid=29681] ppid=29680 vsize=1525588 CPUtime=145.09 cores=1
/proc/29681/stat : 29681 (cryptominisat) R 29680 29680 28861 0 -1 4202496 85969 0 0 0 14492 17 0 0 25 0 1 0 600146507 1562202112 21012 33554432000 4194304 4587354 140734031612608 18446744073709551615 4238595 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/29681/statm: 381397 21012 337 96 0 377959 0
[pid=29682] ppid=29680 vsize=149608 CPUtime=145.08 cores=5
/proc/29682/stat : 29682 (clasp) R 29680 29680 28861 0 -1 4202496 34633 0 0 0 14500 8 0 0 25 0 1 0 600146507 153198592 33473 33554432000 4194304 4785740 140733379642560 18446744073709551615 4286973 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/29682/statm: 37402 33473 340 145 0 34447 0
[pid=29683] ppid=29680 vsize=464020 CPUtime=72.21 cores=7
/proc/29683/stat : 29683 (TNM) R 29680 29680 28861 0 -1 4202496 3718 0 0 0 7221 0 0 0 25 0 1 0 600146507 475156480 3614 33554432000 134512640 134534564 4292785600 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29683/statm: 116005 3614 95 6 0 114671 0
[pid=29684] ppid=29680 vsize=42680 CPUtime=145.09 cores=3
/proc/29684/stat : 29684 (lingeling) R 29680 29680 28861 0 -1 4202496 30294 0 0 0 14506 3 0 0 25 0 1 0 600146507 43704320 9831 33554432000 4194304 4352236 140733609669520 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/29684/statm: 10670 9831 127 39 0 9750 0
[pid=29685] ppid=29680 vsize=31964 CPUtime=72.09 cores=7
/proc/29685/stat : 29685 (march_hi) R 29680 29680 28861 0 -1 4202496 13035 0 0 0 7208 1 0 0 25 0 1 0 600146507 32731136 3826 33554432000 4194304 4331988 140733897353520 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/29685/statm: 7991 3826 175 34 0 6433 0
Current children cumulated CPU time (s) 579.56
Current children cumulated vsize (KiB) 2232184

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29680 and gives
#  childrusage.ru_utime.tv_sec=434
#  childrusage.ru_utime.tv_usec=333971
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=294955
# CPU time returned by wait4() is 434.629
# while last known CPU time is 579.56
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 145.142
CPU time (s): 579.56
CPU user time (s): 579.27
CPU system time (s): 0.29
CPU usage (%): 399.305
Max. virtual memory (cumulated for all children) (KiB): 3617232

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 434.334
system time used= 0.294955
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 137918
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 227
involuntary context switches= 3961

runsolver used 0.221966 second user time and 0.571913 second system time

The end

Launcher Data

Begin job on node117 at 2011-04-29 19:45:57
IDJOB=3251171
IDBENCH=88212
IDSOLVER=1612
FILE ID=node117/3251171-1304099157
RUNJOBID= node117-1304095715-28880
PBS_JOBID= 13170599
Free space on /tmp= 71656 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251171-1304099157/watcher-3251171-1304099157 -o /tmp/evaluation-result-3251171-1304099157/solver-3251171-1304099157 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3251171-1304099157.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1bac7b96ea6eb843b1de7405a721cd87
RANDOM SEED=1004825519

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      15851948 kB
Buffers:       2381360 kB
Cached:       12517488 kB
SwapCached:          0 kB
Active:        9734756 kB
Inactive:      6778324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      15851948 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           12044 kB
Writeback:           0 kB
AnonPages:     1613852 kB
Mapped:          16844 kB
Slab:           519028 kB
PageTables:       8148 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:  4158440 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71644 MiB
End job on node117 at 2011-04-29 19:48:23