Trace number 3283627

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Black Hole SAT 2011-03-08? (TO) 1300.05 1300.03

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UR-20-10p1.cnf
MD5SUM6ace5cfbe110f1a43049037cb7432998
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables259234
Number of clauses1387934
Sum of the clauses size3351923
Maximum clause length10
Minimum clause length1
Number of clauses of size 113149
Number of clauses of size 2981661
Number of clauses of size 3327764
Number of clauses of size 47260
Number of clauses of size 529040
Number of clauses of size over 529060

Solver Data

1.89/1.91	c RESTART
2.39/2.40	c RESTART
5.20/5.23	c RESTART
6.99/7.01	c RESTART
11.60/11.68	c RESTART
16.70/16.74	c RESTART
19.40/19.44	c RESTART
20.29/20.34	c RESTART
24.49/24.50	c RESTART
31.09/31.17	c RESTART
31.90/31.97	c RESTART
36.59/36.66	c RESTART
37.79/37.81	c RESTART
44.89/44.90	c RESTART
49.99/50.06	c RESTART
65.19/65.28	c RESTART
69.59/69.67	c RESTART
77.29/77.39	c RESTART
81.69/81.76	c RESTART
85.70/85.72	c RESTART
86.19/86.22	c RESTART
87.29/87.34	c RESTART
103.19/103.27	c RESTART
106.09/106.10	c RESTART
109.19/109.24	c RESTART
111.00/111.05	c RESTART
113.09/113.10	c RESTART
129.49/129.55	c RESTART
130.09/130.16	c RESTART
131.09/131.18	c RESTART
132.19/132.26	c RESTART
133.99/134.06	c RESTART
148.09/148.16	c RESTART
148.89/148.93	c RESTART
159.89/159.94	c RESTART
160.50/160.57	c RESTART
164.29/164.31	c RESTART
169.19/169.27	c RESTART
170.29/170.31	c RESTART
171.60/171.67	c RESTART
174.79/174.81	c RESTART
179.19/179.25	c RESTART
180.69/180.74	c RESTART
182.29/182.35	c RESTART
187.69/187.79	c RESTART
205.99/206.09	c RESTART
211.39/211.48	c RESTART
214.50/214.58	c RESTART
216.80/216.84	c RESTART
222.89/222.99	c RESTART
237.79/237.86	c RESTART
243.79/243.83	c RESTART
246.79/246.80	c RESTART
250.70/250.75	c RESTART
254.10/254.18	c RESTART
257.69/257.73	c RESTART
259.90/259.90	c RESTART
261.00/261.07	c RESTART
264.79/264.80	c RESTART
286.19/286.20	c RESTART
288.80/288.85	c RESTART
294.29/294.32	c RESTART
296.49/296.51	c RESTART
299.69/299.74	c RESTART
300.49/300.55	c RESTART
303.09/303.15	c RESTART
308.39/308.44	c RESTART
313.09/313.11	c RESTART
319.79/319.80	c RESTART
321.10/321.14	c RESTART
322.49/322.52	c RESTART
323.30/323.35	c RESTART
326.89/327.00	c RESTART
330.70/330.75	c RESTART
336.50/336.50	c RESTART
339.00/339.03	c RESTART
341.40/341.42	c RESTART
345.80/345.88	c RESTART
393.50/393.50	c RESTART
398.30/398.35	c RESTART
404.90/404.96	c RESTART
408.11/408.12	c RESTART
419.01/419.07	c RESTART
420.21/420.25	c RESTART
421.10/421.19	c RESTART
425.10/425.14	c RESTART
426.90/426.92	c RESTART
435.70/435.71	c RESTART
440.70/440.73	c RESTART
450.30/450.39	c RESTART
456.10/456.17	c RESTART
457.20/457.23	c RESTART
459.50/459.55	c RESTART
483.20/483.21	c RESTART
487.40/487.48	c RESTART
490.51/490.58	c RESTART
491.10/491.17	c RESTART
495.30/495.38	c RESTART
501.90/501.95	c RESTART
512.10/512.13	c RESTART
514.40/514.48	c RESTART
519.80/519.82	c RESTART
521.00/521.06	c RESTART
522.51/522.53	c RESTART
526.50/526.50	c RESTART
528.50/528.59	c RESTART
578.10/578.19	c RESTART
587.00/587.06	c RESTART
594.20/594.28	c RESTART
598.00/598.08	c RESTART
603.81/603.81	c RESTART
604.60/604.68	c RESTART
606.40/606.41	c RESTART
607.21/607.22	c RESTART
608.90/608.93	c RESTART
610.10/610.11	c RESTART
613.30/613.39	c RESTART
620.50/620.59	c RESTART
623.20/623.22	c RESTART
624.50/624.56	c RESTART
625.10/625.16	c RESTART
627.20/627.29	c RESTART
630.00/630.03	c RESTART
634.50/634.53	c RESTART
638.30/638.36	c RESTART
646.00/646.09	c RESTART
673.90/673.90	c RESTART
683.70/683.73	c RESTART
687.00/687.08	c RESTART
689.20/689.28	c RESTART
693.30/693.32	c RESTART
695.90/695.91	c RESTART
698.20/698.22	c RESTART
701.20/701.25	c RESTART
704.20/704.27	c RESTART
707.10/707.12	c RESTART
711.20/711.23	c RESTART
714.50/714.51	c RESTART
727.80/727.86	c RESTART
731.70/731.74	c RESTART
738.50/738.58	c RESTART
742.60/742.62	c RESTART
753.70/753.77	c RESTART
756.50/756.56	c RESTART
758.20/758.27	c RESTART
764.10/764.14	c RESTART
772.90/772.95	c RESTART
777.40/777.44	c RESTART
781.70/781.76	c RESTART
787.30/787.32	c RESTART
799.40/799.47	c RESTART
804.40/804.43	c RESTART
805.80/805.84	c RESTART
807.70/807.72	c RESTART
808.51/808.55	c RESTART
813.40/813.48	c RESTART
816.30/816.37	c RESTART
818.20/818.29	c RESTART
821.40/821.46	c RESTART
826.80/826.82	c RESTART
830.41/830.43	c RESTART
848.01/848.09	c RESTART
855.90/855.99	c RESTART
871.90/871.92	c RESTART
875.00/875.03	c RESTART
882.11/882.19	c RESTART
891.10/891.16	c RESTART
897.40/897.47	c RESTART
898.51/898.60	c RESTART
900.91/900.97	c RESTART
905.50/905.53	c RESTART
907.51/907.51	c RESTART
919.80/919.85	c RESTART
924.01/924.06	c RESTART
926.00/926.06	c RESTART
930.20/930.22	c RESTART
936.30/936.32	c RESTART
942.71/942.78	c RESTART
945.80/945.87	c RESTART
950.50/950.56	c RESTART
955.00/955.06	c RESTART
960.90/960.97	c RESTART
963.70/963.76	c RESTART
968.40/968.42	c RESTART
975.20/975.26	c RESTART
982.80/982.81	c RESTART
987.20/987.29	c RESTART
1001.21/1001.27	c RESTART
1006.71/1006.70	c RESTART
1013.51/1013.54	c RESTART
1020.01/1020.09	c RESTART
1029.31/1029.36	c RESTART
1044.81/1044.80	c RESTART
1051.91/1051.99	c RESTART
1053.61/1053.61	c RESTART
1056.11/1056.19	c RESTART
1057.61/1057.62	c RESTART
1066.11/1066.13	c RESTART
1070.81/1070.84	c RESTART
1072.61/1072.62	c RESTART
1073.31/1073.30	c RESTART
1075.91/1075.92	c RESTART
1076.51/1076.54	c RESTART
1077.11/1077.15	c RESTART
1080.31/1080.38	c RESTART
1083.71/1083.79	c RESTART
1085.11/1085.14	c RESTART
1095.11/1095.15	c RESTART
1097.11/1097.11	c RESTART
1107.82/1107.88	c RESTART
1116.52/1116.54	c RESTART
1122.61/1122.63	c RESTART
1125.51/1125.54	c RESTART
1143.41/1143.40	c RESTART
1146.22/1146.24	c RESTART
1148.42/1148.43	c RESTART
1154.81/1154.83	c RESTART
1157.61/1157.67	c RESTART
1159.61/1159.66	c RESTART
1161.62/1161.68	c RESTART
1164.51/1164.59	c RESTART
1166.71/1166.74	c RESTART
1178.41/1178.47	c RESTART
1185.61/1185.62	c RESTART
1186.92/1186.98	c RESTART
1192.21/1192.25	c RESTART
1193.21/1193.24	c RESTART
1194.52/1194.54	c RESTART
1201.81/1201.87	c RESTART
1222.41/1222.48	c RESTART
1229.01/1229.07	c RESTART
1235.22/1235.23	c RESTART
1241.11/1241.15	c RESTART
1250.21/1250.20	c RESTART
1254.11/1254.10	c RESTART
1261.31/1261.32	c RESTART
1263.51/1263.59	c RESTART
1267.51/1267.56	c RESTART
1272.31/1272.32	c RESTART
1273.11/1273.11	c RESTART
1275.81/1275.83	c RESTART
1280.32/1280.31	c RESTART
1285.51/1285.54	c RESTART
1287.11/1287.16	c RESTART
1294.21/1294.28	c RESTART

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3283627-1303766619/watcher-3283627-1303766619 -o /tmp/evaluation-result-3283627-1303766619/solver-3283627-1303766619 -C 2400 -W 1300 -M 7680 saturn HOME/instance-3283627-1303766619.cnf 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 1.60 2.27 4/184 14822
/proc/meminfo: memFree=23638360/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=64964 CPUtime=0 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 3158 0 0 0 0 0 0 0 23 0 1 0 469077375 66523136 3100 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206826 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 16241 3108 94 5 0 8131 0

[startup+0.05893 s]
/proc/loadavg: 0.99 1.60 2.27 4/184 14822
/proc/meminfo: memFree=23638360/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=154836 CPUtime=0.05 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 10970 0 0 0 4 1 0 0 23 0 1 0 469077375 158552064 10912 33554432000 4194304 4210924 140736840841344 18446744073709551615 254261277381 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 38709 10914 412 5 0 30599 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 154836

[startup+0.100918 s]
/proc/loadavg: 0.99 1.60 2.27 4/184 14822
/proc/meminfo: memFree=23638360/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=161700 CPUtime=0.09 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 13700 0 0 0 8 1 0 0 23 0 1 0 469077375 165580800 13643 33554432000 4194304 4210924 140736840841344 18446744073709551615 254261277381 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 40425 13644 722 5 0 32315 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 161700

[startup+0.300884 s]
/proc/loadavg: 0.99 1.60 2.27 4/184 14822
/proc/meminfo: memFree=23638360/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=189552 CPUtime=0.29 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 24775 0 0 0 27 2 0 0 25 0 1 0 469077375 194101248 24717 33554432000 4194304 4210924 140736840841344 18446744073709551615 254261277381 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 47388 24717 1905 5 0 39278 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 189552

[startup+0.700816 s]
/proc/loadavg: 0.99 1.60 2.27 4/184 14822
/proc/meminfo: memFree=23638360/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=242220 CPUtime=0.69 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 46803 0 0 0 64 5 0 0 25 0 1 0 469077375 248033280 46314 33554432000 4194304 4210924 140736840841344 18446744073709551615 254261277381 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 60555 46317 4514 5 0 52445 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 242220

[startup+1.50067 s]
/proc/loadavg: 0.99 1.60 2.27 5/190 14829
/proc/meminfo: memFree=23153364/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=253120 CPUtime=1.49 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 62774 0 0 0 143 6 0 0 25 0 1 0 469077375 259194880 55629 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 63280 55629 96 5 0 61751 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 253120

[startup+3.10039 s]
/proc/loadavg: 0.99 1.60 2.27 5/190 14829
/proc/meminfo: memFree=23149148/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=253648 CPUtime=3.09 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 62923 0 0 0 303 6 0 0 25 0 1 0 469077375 259735552 55778 33554432000 4194304 4210924 140736840841344 18446744073709551615 4207021 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 63412 55778 103 5 0 61883 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 253648

[startup+6.30082 s]
/proc/loadavg: 1.23 1.64 2.28 5/190 14829
/proc/meminfo: memFree=23146500/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=254180 CPUtime=6.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 63038 0 0 0 623 7 0 0 25 0 1 0 469077375 260280320 55893 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 63545 55893 103 5 0 62016 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 254180

[startup+12.7007 s]
/proc/loadavg: 1.45 1.68 2.29 5/190 14830
/proc/meminfo: memFree=23145764/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=254180 CPUtime=12.7 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 63064 0 0 0 1263 7 0 0 25 0 1 0 469077375 260280320 55919 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206505 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 63545 55919 103 5 0 62016 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 254180

[startup+25.5004 s]
/proc/loadavg: 2.01 1.79 2.32 5/190 14830
/proc/meminfo: memFree=23142940/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=255244 CPUtime=25.49 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 63321 0 0 0 2542 7 0 0 25 0 1 0 469077375 261369856 56176 33554432000 4194304 4210924 140736840841344 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 63811 56176 103 5 0 62282 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 255244

[startup+51.1009 s]
/proc/loadavg: 2.69 1.97 2.36 5/190 14830
/proc/meminfo: memFree=23128484/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=257012 CPUtime=51.09 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 63763 0 0 0 5102 7 0 0 25 0 1 0 469077375 263180288 56618 33554432000 4194304 4210924 140736840841344 18446744073709551615 4207004 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 64253 56618 103 5 0 62724 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 257012

[startup+102.307 s]
/proc/loadavg: 3.43 2.28 2.45 5/190 14835
/proc/meminfo: memFree=23112252/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=262792 CPUtime=102.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 65201 0 0 0 10223 7 0 0 25 0 1 0 469077375 269099008 58056 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 65698 58056 104 5 0 64169 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 262792

[startup+162.3 s]
/proc/loadavg: 3.79 2.59 2.54 5/190 14837
/proc/meminfo: memFree=23097660/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=273916 CPUtime=162.29 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 68007 0 0 0 16221 8 0 0 25 0 1 0 469077375 280489984 60862 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 68479 60862 104 5 0 66950 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 273916

[startup+222.301 s]
/proc/loadavg: 3.92 2.84 2.63 5/190 14838
/proc/meminfo: memFree=23079320/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=287092 CPUtime=222.29 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 71297 0 0 0 22220 9 0 0 25 0 1 0 469077375 293982208 64152 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 71773 64152 104 5 0 70244 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 287092

[startup+282.301 s]
/proc/loadavg: 3.97 3.05 2.71 5/190 14840
/proc/meminfo: memFree=23069136/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=290036 CPUtime=282.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 72030 0 0 0 28221 9 0 0 25 0 1 0 469077375 296996864 64885 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 72509 64885 104 5 0 70980 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 290036

[startup+342.3 s]
/proc/loadavg: 3.99 3.22 2.79 5/190 14841
/proc/meminfo: memFree=23045288/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=304492 CPUtime=342.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 75651 0 0 0 34220 10 0 0 25 0 1 0 469077375 311799808 68506 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 76123 68506 104 5 0 74594 0
Current children cumulated CPU time (s) 342.3
Current children cumulated vsize (KiB) 304492

[startup+402.301 s]
/proc/loadavg: 3.99 3.36 2.86 5/190 14843
/proc/meminfo: memFree=23032880/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=304920 CPUtime=402.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 75765 0 0 0 40220 10 0 0 25 0 1 0 469077375 312238080 68620 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206981 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 76230 68620 104 5 0 74701 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 304920

[startup+462.3 s]
/proc/loadavg: 3.99 3.47 2.93 5/190 14845
/proc/meminfo: memFree=23017356/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=308756 CPUtime=462.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 76726 0 0 0 46220 10 0 0 25 0 1 0 469077375 316166144 69581 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 77189 69581 104 5 0 75660 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 308756

[startup+522.301 s]
/proc/loadavg: 3.99 3.57 3.00 5/190 14846
/proc/meminfo: memFree=23007524/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=309948 CPUtime=522.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 77002 0 0 0 52220 10 0 0 25 0 1 0 469077375 317386752 69857 33554432000 4194304 4210924 140736840841344 18446744073709551615 4200625 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 77487 69857 104 5 0 75958 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 309948

[startup+582.301 s]
/proc/loadavg: 3.99 3.64 3.05 5/190 14848
/proc/meminfo: memFree=22991380/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=312560 CPUtime=582.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 77673 0 0 0 58220 10 0 0 25 0 1 0 469077375 320061440 70528 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 78140 70528 104 5 0 76611 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 312560

[startup+642.3 s]
/proc/loadavg: 3.99 3.71 3.11 5/190 14849
/proc/meminfo: memFree=22973632/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=321856 CPUtime=642.31 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 80009 0 0 0 64221 10 0 0 25 0 1 0 469077375 329580544 72864 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206257 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 80464 72864 104 5 0 78935 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 321856

[startup+702.301 s]
/proc/loadavg: 3.99 3.76 3.16 5/190 14851
/proc/meminfo: memFree=22957720/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=328128 CPUtime=702.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 81587 0 0 0 70220 10 0 0 25 0 1 0 469077375 336003072 74442 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204561 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 82032 74442 104 5 0 80503 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 328128

[startup+762.307 s]
/proc/loadavg: 3.99 3.80 3.21 5/190 14853
/proc/meminfo: memFree=22947380/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=329256 CPUtime=762.31 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 81869 0 0 0 76220 11 0 0 25 0 1 0 469077375 337158144 74724 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206985 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 82314 74724 104 5 0 80785 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 329256

[startup+822.301 s]
/proc/loadavg: 4.04 3.85 3.27 5/190 14854
/proc/meminfo: memFree=22937568/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=336492 CPUtime=822.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 83674 0 0 0 82219 11 0 0 25 0 1 0 469077375 344567808 76529 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 84123 76529 104 5 0 82594 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 336492

[startup+882.301 s]
/proc/loadavg: 4.01 3.87 3.31 5/190 14856
/proc/meminfo: memFree=22923404/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=337212 CPUtime=882.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 83858 0 0 0 88219 11 0 0 25 0 1 0 469077375 345305088 76713 33554432000 4194304 4210924 140736840841344 18446744073709551615 4200720 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 84303 76713 104 5 0 82774 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 337212

[startup+942.3 s]
/proc/loadavg: 4.00 3.89 3.35 5/190 14857
/proc/meminfo: memFree=22902172/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=342628 CPUtime=942.3 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 85209 0 0 0 94219 11 0 0 25 0 1 0 469077375 350851072 78064 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 85657 78064 104 5 0 84128 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 342628

[startup+1002.3 s]
/proc/loadavg: 4.00 3.91 3.39 5/190 14859
/proc/meminfo: memFree=22895556/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=342908 CPUtime=1002.31 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 85275 0 0 0 100220 11 0 0 25 0 1 0 469077375 351137792 78130 33554432000 4194304 4210924 140736840841344 18446744073709551615 4207008 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 85727 78130 104 5 0 84198 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 342908

[startup+1062.3 s]
/proc/loadavg: 4.00 3.92 3.42 5/190 14861
/proc/meminfo: memFree=22889328/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=345216 CPUtime=1062.31 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 85841 0 0 0 106220 11 0 0 25 0 1 0 469077375 353501184 78696 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 86304 78696 104 5 0 84775 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 345216

[startup+1122.3 s]
/proc/loadavg: 4.00 3.93 3.46 5/190 14862
/proc/meminfo: memFree=22877632/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=352828 CPUtime=1122.31 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 87756 0 0 0 112219 12 0 0 25 0 1 0 469077375 361295872 80611 33554432000 4194304 4210924 140736840841344 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 88207 80611 104 5 0 86678 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 352828

[startup+1182.3 s]
/proc/loadavg: 4.00 3.94 3.49 5/190 14864
/proc/meminfo: memFree=22863720/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=358352 CPUtime=1182.31 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 89117 0 0 0 118219 12 0 0 25 0 1 0 469077375 366952448 81972 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 89588 81972 104 5 0 88059 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 358352

[startup+1242.3 s]
/proc/loadavg: 4.00 3.95 3.51 5/190 14865
/proc/meminfo: memFree=22855264/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=358952 CPUtime=1242.31 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 89295 0 0 0 124219 12 0 0 25 0 1 0 469077375 367566848 82150 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 89738 82150 104 5 0 88209 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 358952



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 3.95 3.54 3/186 14869
/proc/meminfo: memFree=23243020/32951124 swapFree=67111528/67111528
[pid=14822] ppid=14820 vsize=366368 CPUtime=1300.02 cores=0,2
/proc/14822/stat : 14822 (saturn) R 14820 14822 13679 0 -1 4202496 91130 0 0 0 129990 12 0 0 25 0 1 0 469077375 375160832 83985 33554432000 4194304 4210924 140736840841344 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/14822/statm: 91592 83985 104 5 0 90063 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 366368

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.03
CPU time (s): 1300.05
CPU user time (s): 1299.9
CPU system time (s): 0.146977
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 366400

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.9
system time used= 0.146977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 91130
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 15707

runsolver used 2.33164 second user time and 4.77927 second system time

The end

Launcher Data

Begin job on node140 at 2011-04-25 23:23:41
IDJOB=3283627
IDBENCH=71055
IDSOLVER=1583
FILE ID=node140/3283627-1303766619
RUNJOBID= node140-1303766619-14786
PBS_JOBID= 13157121
Free space on /tmp= 72220 MiB

SOLVER NAME= Black Hole SAT 2011-03-08
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UR-20-10p1.cnf
COMMAND LINE= saturn BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3283627-1303766619/watcher-3283627-1303766619 -o /tmp/evaluation-result-3283627-1303766619/solver-3283627-1303766619 -C 2400 -W 1300 -M 7680  saturn HOME/instance-3283627-1303766619.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 6ace5cfbe110f1a43049037cb7432998
RANDOM SEED=1807278168

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23635664 kB
Buffers:       2232084 kB
Cached:        6245264 kB
SwapCached:          0 kB
Active:        1243452 kB
Inactive:      7503476 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23635664 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           78548 kB
Writeback:           0 kB
AnonPages:      268536 kB
Mapped:          24192 kB
Slab:           503036 kB
PageTables:       4996 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   479648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72248 MiB
End job on node140 at 2011-04-25 23:45:23