Trace number 3283535

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Black Hole SAT 2011-03-08? (TO) 1300 1300.02

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UCG-20-5p1.cnf
MD5SUM93858500e23e9a4bf0619d7bf7dc00f3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark169.075
Satisfiable
(Un)Satisfiability was proved
Number of variables224986
Number of clauses1204430
Sum of the clauses size2908691
Maximum clause length10
Minimum clause length1
Number of clauses of size 111403
Number of clauses of size 2851953
Number of clauses of size 3284354
Number of clauses of size 46300
Number of clauses of size 525200
Number of clauses of size over 525220

Solver Data

41.59/41.65	c RESTART
41.99/42.01	c RESTART
43.19/43.20	c RESTART
44.00/44.02	c RESTART
45.00/45.05	c RESTART
45.39/45.47	c RESTART
45.69/45.75	c RESTART
47.09/47.17	c RESTART
48.29/48.37	c RESTART
49.69/49.78	c RESTART
50.19/50.26	c RESTART
51.99/52.04	c RESTART
52.49/52.56	c RESTART
52.89/52.99	c RESTART
59.59/59.68	c RESTART
61.89/61.98	c RESTART
64.19/64.20	c RESTART
64.90/64.96	c RESTART
74.59/74.63	c RESTART
76.79/76.88	c RESTART
78.79/78.83	c RESTART
79.99/80.03	c RESTART
80.09/80.19	c RESTART
80.59/80.69	c RESTART
81.19/81.22	c RESTART
81.79/81.82	c RESTART
82.59/82.64	c RESTART
83.69/83.75	c RESTART
90.49/90.57	c RESTART
97.19/97.27	c RESTART
101.49/101.58	c RESTART
107.69/107.70	c RESTART
130.98/131.03	c RESTART
134.59/134.63	c RESTART
139.99/140.03	c RESTART
146.69/146.74	c RESTART
152.99/153.08	c RESTART
157.09/157.16	c RESTART
168.49/168.53	c RESTART
180.69/180.77	c RESTART
182.50/182.52	c RESTART
183.89/183.95	c RESTART
188.19/188.26	c RESTART
193.29/193.37	c RESTART
196.29/196.32	c RESTART
198.28/198.35	c RESTART
201.79/201.90	c RESTART
204.28/204.33	c RESTART
206.79/206.82	c RESTART
210.19/210.20	c RESTART
216.59/216.69	c RESTART
219.79/219.88	c RESTART
225.39/225.45	c RESTART
226.59/226.66	c RESTART
228.29/228.33	c RESTART
244.28/244.31	c RESTART
245.29/245.37	c RESTART
246.88/246.96	c RESTART
254.18/254.24	c RESTART
260.59/260.64	c RESTART
264.28/264.31	c RESTART
266.48/266.51	c RESTART
269.08/269.15	c RESTART
270.38/270.48	c RESTART
274.78/274.84	c RESTART
278.58/278.69	c RESTART
279.98/280.04	c RESTART
281.68/281.71	c RESTART
284.89/284.99	c RESTART
288.09/288.15	c RESTART
291.88/291.97	c RESTART
292.98/293.03	c RESTART
297.88/297.92	c RESTART
307.08/307.10	c RESTART
310.68/310.77	c RESTART
345.78/345.89	c RESTART
347.78/347.84	c RESTART
352.98/353.01	c RESTART
356.78/356.85	c RESTART
371.18/371.28	c RESTART
383.88/383.99	c RESTART
386.88/386.97	c RESTART
403.38/403.40	c RESTART
435.18/435.25	c RESTART
441.88/441.98	c RESTART
447.08/447.13	c RESTART
466.08/466.18	c RESTART
470.98/471.01	c RESTART
488.18/488.29	c RESTART
494.08/494.10	c RESTART
503.79/503.82	c RESTART
509.08/509.19	c RESTART
522.08/522.10	c RESTART
531.38/531.49	c RESTART
539.38/539.46	c RESTART
545.18/545.26	c RESTART
554.88/554.98	c RESTART
557.28/557.36	c RESTART
559.18/559.29	c RESTART
573.58/573.61	c RESTART
578.08/578.12	c RESTART
589.88/589.92	c RESTART
604.78/604.89	c RESTART
610.88/610.97	c RESTART
614.38/614.45	c RESTART
615.58/615.63	c RESTART
617.98/618.03	c RESTART
621.48/621.55	c RESTART
626.48/626.59	c RESTART
633.28/633.33	c RESTART
634.27/634.32	c RESTART
638.27/638.31	c RESTART
639.37/639.45	c RESTART
642.28/642.36	c RESTART
661.38/661.48	c RESTART
670.08/670.18	c RESTART
679.97/680.05	c RESTART
682.37/682.49	c RESTART
683.67/683.71	c RESTART
686.77/686.85	c RESTART
690.47/690.53	c RESTART
691.47/691.50	c RESTART
701.68/701.76	c RESTART
713.27/713.35	c RESTART
731.27/731.32	c RESTART
737.67/737.74	c RESTART
741.47/741.57	c RESTART
751.47/751.54	c RESTART
753.77/753.88	c RESTART
759.97/760.01	c RESTART
761.57/761.69	c RESTART
767.27/767.39	c RESTART
776.47/776.59	c RESTART
784.97/785.03	c RESTART
788.78/788.80	c RESTART
791.78/791.88	c RESTART
796.28/796.38	c RESTART
798.58/798.67	c RESTART
807.78/807.88	c RESTART
813.78/813.85	c RESTART
821.68/821.77	c RESTART
822.28/822.37	c RESTART
830.28/830.31	c RESTART
832.08/832.19	c RESTART
835.28/835.31	c RESTART
837.37/837.40	c RESTART
839.97/840.06	c RESTART
841.17/841.22	c RESTART
845.27/845.32	c RESTART
846.07/846.17	c RESTART
847.17/847.22	c RESTART
849.08/849.11	c RESTART
853.28/853.34	c RESTART
859.18/859.29	c RESTART
863.48/863.55	c RESTART
865.48/865.55	c RESTART
866.68/866.77	c RESTART
873.88/873.94	c RESTART
875.88/875.97	c RESTART
887.58/887.68	c RESTART
891.98/892.06	c RESTART
899.18/899.29	c RESTART
900.78/900.88	c RESTART
902.38/902.47	c RESTART
906.87/906.97	c RESTART
908.67/908.72	c RESTART
909.87/909.92	c RESTART
912.98/913.03	c RESTART
919.17/919.28	c RESTART
921.37/921.47	c RESTART
924.47/924.59	c RESTART
924.98/925.08	c RESTART
928.87/928.91	c RESTART
935.27/935.32	c RESTART
948.57/948.61	c RESTART
952.97/953.02	c RESTART
961.67/961.71	c RESTART
967.57/967.60	c RESTART
971.47/971.57	c RESTART
973.07/973.16	c RESTART
975.68/975.77	c RESTART
980.77/980.83	c RESTART
983.87/983.94	c RESTART
984.97/985.02	c RESTART
986.27/986.36	c RESTART
987.38/987.47	c RESTART
988.57/988.62	c RESTART
991.87/991.94	c RESTART
996.17/996.21	c RESTART
1000.07/1000.13	c RESTART
1004.87/1004.98	c RESTART
1006.17/1006.20	c RESTART
1007.58/1007.68	c RESTART
1008.47/1008.50	c RESTART
1019.58/1019.65	c RESTART
1024.57/1024.60	c RESTART
1040.48/1040.56	c RESTART
1042.37/1042.47	c RESTART
1045.98/1046.08	c RESTART
1047.18/1047.21	c RESTART
1052.68/1052.75	c RESTART
1058.67/1058.74	c RESTART
1063.97/1064.01	c RESTART
1066.77/1066.81	c RESTART
1068.47/1068.54	c RESTART
1073.97/1074.06	c RESTART
1082.38/1082.44	c RESTART
1085.67/1085.71	c RESTART
1096.77/1096.83	c RESTART
1102.87/1102.93	c RESTART
1114.07/1114.14	c RESTART
1116.37/1116.44	c RESTART
1125.37/1125.40	c RESTART
1126.97/1127.05	c RESTART
1127.98/1128.05	c RESTART
1128.78/1128.81	c RESTART
1129.58/1129.62	c RESTART
1135.38/1135.45	c RESTART
1137.18/1137.29	c RESTART
1144.28/1144.33	c RESTART
1146.68/1146.73	c RESTART
1149.78/1149.84	c RESTART
1156.67/1156.79	c RESTART
1158.18/1158.28	c RESTART
1163.68/1163.73	c RESTART
1165.37/1165.48	c RESTART
1166.27/1166.39	c RESTART
1175.97/1176.01	c RESTART
1178.27/1178.36	c RESTART
1181.47/1181.53	c RESTART
1185.27/1185.37	c RESTART
1190.68/1190.75	c RESTART
1194.67/1194.79	c RESTART
1196.37/1196.49	c RESTART
1198.27/1198.37	c RESTART
1201.67/1201.73	c RESTART
1202.57/1202.65	c RESTART
1203.47/1203.57	c RESTART
1203.87/1203.99	c RESTART
1204.97/1205.02	c RESTART
1205.58/1205.64	c RESTART
1208.88/1208.92	c RESTART
1210.37/1210.41	c RESTART
1218.27/1218.30	c RESTART
1220.07/1220.12	c RESTART
1221.47/1221.55	c RESTART
1225.97/1226.04	c RESTART
1229.18/1229.29	c RESTART
1238.17/1238.27	c RESTART
1239.17/1239.27	c RESTART
1241.07/1241.13	c RESTART
1243.47/1243.50	c RESTART
1245.97/1246.08	c RESTART
1247.67/1247.79	c RESTART
1248.87/1248.93	c RESTART
1249.58/1249.65	c RESTART
1252.78/1252.84	c RESTART
1258.07/1258.19	c RESTART
1262.98/1263.05	c RESTART
1264.88/1264.97	c RESTART
1265.47/1265.58	c RESTART
1266.08/1266.11	c RESTART
1266.77/1266.85	c RESTART
1267.97/1268.01	c RESTART
1269.48/1269.54	c RESTART
1271.97/1272.07	c RESTART
1274.37/1274.43	c RESTART
1275.57/1275.63	c RESTART
1276.67/1276.78	c RESTART
1278.47/1278.59	c RESTART
1282.67/1282.70	c RESTART
1284.87/1284.92	c RESTART
1292.77/1292.83	c RESTART
1297.37/1297.44	c RESTART

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3283535-1303764951/watcher-3283535-1303764951 -o /tmp/evaluation-result-3283535-1303764951/solver-3283535-1303764951 -C 2400 -W 1300 -M 7680 saturn HOME/instance-3283535-1303764951.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.40 3.86 3.73 5/183 32405
/proc/meminfo: memFree=13762096/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=57056 CPUtime=0 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 2841 0 0 0 0 0 0 0 23 0 1 0 566725963 58425344 2783 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206826 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 14264 2790 94 5 0 7062 0

[startup+0.0232501 s]
/proc/loadavg: 3.40 3.86 3.73 5/183 32405
/proc/meminfo: memFree=13762096/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=130148 CPUtime=0.01 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 7627 0 0 0 1 0 0 0 23 0 1 0 566725963 133271552 7569 33554432000 4194304 4210924 140737344874528 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 32537 7572 143 5 0 25335 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 130148

[startup+0.100235 s]
/proc/loadavg: 3.40 3.86 3.73 5/183 32405
/proc/meminfo: memFree=13762096/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=143612 CPUtime=0.09 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 12979 0 0 0 8 1 0 0 23 0 1 0 566725963 147058688 12921 33554432000 4194304 4210924 140737344874528 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 35903 12923 745 5 0 28701 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 143612

[startup+0.300201 s]
/proc/loadavg: 3.40 3.86 3.73 5/183 32405
/proc/meminfo: memFree=13762096/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=171596 CPUtime=0.29 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 24136 0 0 0 26 3 0 0 25 0 1 0 566725963 175714304 24078 33554432000 4194304 4210924 140737344874528 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 42932 24081 2081 5 0 35730 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 171596

[startup+0.700131 s]
/proc/loadavg: 3.40 3.86 3.73 5/183 32405
/proc/meminfo: memFree=13762096/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=233900 CPUtime=0.69 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 50059 0 0 0 64 5 0 0 25 0 1 0 566725963 239513600 49627 33554432000 4194304 4210924 140737344874528 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 58475 49629 5222 5 0 51273 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 233900

[startup+1.50099 s]
/proc/loadavg: 3.40 3.86 3.73 5/190 32419
/proc/meminfo: memFree=13078352/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=220580 CPUtime=1.49 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 54495 0 0 0 143 6 0 0 25 0 1 0 566725963 225873920 48325 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 55145 48325 96 5 0 53616 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 220580

[startup+3.10078 s]
/proc/loadavg: 3.40 3.86 3.73 5/190 32419
/proc/meminfo: memFree=13027268/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=220580 CPUtime=3.09 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 54509 0 0 0 303 6 0 0 25 0 1 0 566725963 225873920 48339 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 55145 48339 96 5 0 53616 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 220580

[startup+6.30015 s]
/proc/loadavg: 3.45 3.86 3.73 5/190 32419
/proc/meminfo: memFree=13025896/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=220580 CPUtime=6.29 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 54520 0 0 0 623 6 0 0 25 0 1 0 566725963 225873920 48350 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 55145 48350 96 5 0 53616 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 220580

[startup+12.701 s]
/proc/loadavg: 3.50 3.86 3.73 5/190 32419
/proc/meminfo: memFree=13025344/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=220580 CPUtime=12.69 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 54520 0 0 0 1263 6 0 0 25 0 1 0 566725963 225873920 48350 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 55145 48350 96 5 0 53616 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 220580

[startup+25.5008 s]
/proc/loadavg: 3.61 3.87 3.74 5/190 32419
/proc/meminfo: memFree=13024268/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=220580 CPUtime=25.49 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 54520 0 0 0 2543 6 0 0 25 0 1 0 566725963 225873920 48350 33554432000 4194304 4210924 140737344874528 18446744073709551615 4205086 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 55145 48350 96 5 0 53616 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 220580

[startup+51.1003 s]
/proc/loadavg: 3.74 3.87 3.74 5/190 32420
/proc/meminfo: memFree=13020512/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=222320 CPUtime=51.09 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 54945 0 0 0 5103 6 0 0 25 0 1 0 566725963 227655680 48775 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 55580 48775 102 5 0 54051 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 222320

[startup+102.307 s]
/proc/loadavg: 3.89 3.89 3.75 5/190 32421
/proc/meminfo: memFree=12993840/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=225392 CPUtime=102.29 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 55733 0 0 0 10223 6 0 0 25 0 1 0 566725963 230801408 49563 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 56348 49563 103 5 0 54819 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 225392

[startup+162.301 s]
/proc/loadavg: 3.96 3.91 3.76 5/190 32423
/proc/meminfo: memFree=12969140/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=229764 CPUtime=162.29 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 56828 0 0 0 16222 7 0 0 25 0 1 0 566725963 235278336 50658 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 57441 50658 104 5 0 55912 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 229764

[startup+222.3 s]
/proc/loadavg: 3.98 3.92 3.77 5/190 32424
/proc/meminfo: memFree=12943068/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=237684 CPUtime=222.29 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 58784 0 0 0 22222 7 0 0 25 0 1 0 566725963 243388416 52614 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 59421 52614 104 5 0 57892 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 237684

[startup+282.301 s]
/proc/loadavg: 4.02 3.95 3.79 5/190 32426
/proc/meminfo: memFree=12913280/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=243848 CPUtime=282.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 60338 0 0 0 28221 7 0 0 25 0 1 0 566725963 249700352 54168 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 60962 54168 104 5 0 59433 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 243848

[startup+342.3 s]
/proc/loadavg: 4.01 3.95 3.80 5/190 32437
/proc/meminfo: memFree=12891836/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=247736 CPUtime=342.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 61332 0 0 0 34221 7 0 0 25 0 1 0 566725963 253681664 55162 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 61934 55162 104 5 0 60405 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 247736

[startup+402.301 s]
/proc/loadavg: 4.03 3.97 3.82 5/190 32438
/proc/meminfo: memFree=12874200/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=249840 CPUtime=402.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 61847 0 0 0 40221 7 0 0 25 0 1 0 566725963 255836160 55677 33554432000 4194304 4210924 140737344874528 18446744073709551615 4207026 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 62460 55677 104 5 0 60931 0
Current children cumulated CPU time (s) 402.28
Current children cumulated vsize (KiB) 249840

[startup+462.3 s]
/proc/loadavg: 4.01 3.97 3.83 5/190 32440
/proc/meminfo: memFree=12857180/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=250992 CPUtime=462.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 62128 0 0 0 46221 7 0 0 25 0 1 0 566725963 257015808 55958 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 62748 55958 104 5 0 61219 0
Current children cumulated CPU time (s) 462.28
Current children cumulated vsize (KiB) 250992

[startup+522.301 s]
/proc/loadavg: 4.00 3.97 3.83 5/190 32441
/proc/meminfo: memFree=12840400/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=253976 CPUtime=522.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 62876 0 0 0 52220 8 0 0 25 0 1 0 566725963 260071424 56706 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 63494 56706 104 5 0 61965 0
Current children cumulated CPU time (s) 522.28
Current children cumulated vsize (KiB) 253976

[startup+582.3 s]
/proc/loadavg: 4.00 3.97 3.84 5/190 32443
/proc/meminfo: memFree=12821636/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=253976 CPUtime=582.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 62879 0 0 0 58220 8 0 0 25 0 1 0 566725963 260071424 56709 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204568 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 63494 56709 104 5 0 61965 0
Current children cumulated CPU time (s) 582.28
Current children cumulated vsize (KiB) 253976

[startup+642.301 s]
/proc/loadavg: 4.00 3.97 3.84 5/190 32445
/proc/meminfo: memFree=12787132/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=259204 CPUtime=642.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 64194 0 0 0 64220 8 0 0 25 0 1 0 566725963 265424896 58024 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 64801 58024 104 5 0 63272 0
Current children cumulated CPU time (s) 642.28
Current children cumulated vsize (KiB) 259204

[startup+702.3 s]
/proc/loadavg: 4.06 3.99 3.85 5/190 32446
/proc/meminfo: memFree=12761056/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=262264 CPUtime=702.27 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 64963 0 0 0 70219 8 0 0 25 0 1 0 566725963 268558336 58793 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 65566 58793 104 5 0 64037 0
Current children cumulated CPU time (s) 702.27
Current children cumulated vsize (KiB) 262264

[startup+762.307 s]
/proc/loadavg: 4.02 3.99 3.86 5/190 32448
/proc/meminfo: memFree=12730024/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=267852 CPUtime=762.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 66358 0 0 0 76220 8 0 0 25 0 1 0 566725963 274280448 60188 33554432000 4194304 4210924 140737344874528 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 66963 60188 104 5 0 65434 0
Current children cumulated CPU time (s) 762.28
Current children cumulated vsize (KiB) 267852

[startup+822.3 s]
/proc/loadavg: 4.05 4.00 3.87 5/190 32449
/proc/meminfo: memFree=12701496/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=273500 CPUtime=822.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 67779 0 0 0 82219 9 0 0 25 0 1 0 566725963 280064000 61609 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 68375 61609 104 5 0 66846 0
Current children cumulated CPU time (s) 822.28
Current children cumulated vsize (KiB) 273500

[startup+882.301 s]
/proc/loadavg: 4.02 4.00 3.88 5/190 32451
/proc/meminfo: memFree=12686600/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=280560 CPUtime=882.28 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 69539 0 0 0 88218 10 0 0 25 0 1 0 566725963 287293440 63369 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 70140 63369 104 5 0 68611 0
Current children cumulated CPU time (s) 882.28
Current children cumulated vsize (KiB) 280560

[startup+942.3 s]
/proc/loadavg: 4.05 4.01 3.89 5/190 32453
/proc/meminfo: memFree=12659168/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=285928 CPUtime=942.27 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 70885 0 0 0 94217 10 0 0 25 0 1 0 566725963 292790272 64715 33554432000 4194304 4210924 140737344874528 18446744073709551615 4198774 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 71482 64715 104 5 0 69953 0
Current children cumulated CPU time (s) 942.27
Current children cumulated vsize (KiB) 285928

[startup+1002.3 s]
/proc/loadavg: 4.02 4.01 3.89 5/190 32454
/proc/meminfo: memFree=12626284/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=295200 CPUtime=1002.27 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 73201 0 0 0 100216 11 0 0 25 0 1 0 566725963 302284800 67031 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 73800 67031 104 5 0 72271 0
Current children cumulated CPU time (s) 1002.27
Current children cumulated vsize (KiB) 295200

[startup+1062.3 s]
/proc/loadavg: 4.00 4.00 3.90 5/190 32456
/proc/meminfo: memFree=12606764/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=295200 CPUtime=1062.27 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 73201 0 0 0 106216 11 0 0 25 0 1 0 566725963 302284800 67031 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 73800 67031 104 5 0 72271 0
Current children cumulated CPU time (s) 1062.27
Current children cumulated vsize (KiB) 295200

[startup+1122.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/190 32457
/proc/meminfo: memFree=12584908/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=297336 CPUtime=1122.27 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 73746 0 0 0 112216 11 0 0 25 0 1 0 566725963 304472064 67576 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 74334 67576 104 5 0 72805 0
Current children cumulated CPU time (s) 1122.27
Current children cumulated vsize (KiB) 297336

[startup+1182.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/190 32459
/proc/meminfo: memFree=12568264/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=307672 CPUtime=1182.27 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 76304 0 0 0 118215 12 0 0 25 0 1 0 566725963 315056128 70134 33554432000 4194304 4210924 140737344874528 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 76918 70134 104 5 0 75389 0
Current children cumulated CPU time (s) 1182.27
Current children cumulated vsize (KiB) 307672

[startup+1242.3 s]
/proc/loadavg: 4.08 4.02 3.91 5/190 32461
/proc/meminfo: memFree=12555336/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=307672 CPUtime=1242.27 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 76305 0 0 0 124215 12 0 0 25 0 1 0 566725963 315056128 70135 33554432000 4194304 4210924 140737344874528 18446744073709551615 4197169 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 76918 70135 104 5 0 75389 0
Current children cumulated CPU time (s) 1242.27
Current children cumulated vsize (KiB) 307672



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.03 4.01 3.91 4/188 32463
/proc/meminfo: memFree=12777416/32950940 swapFree=67111528/67111528
[pid=32405] ppid=32403 vsize=311284 CPUtime=1299.97 cores=5,7
/proc/32405/stat : 32405 (saturn) R 32403 32405 31561 0 -1 4202496 77239 0 0 0 129985 12 0 0 25 0 1 0 566725963 318754816 71069 33554432000 4194304 4210924 140737344874528 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/32405/statm: 77821 71069 104 5 0 76292 0
Current children cumulated CPU time (s) 1299.97
Current children cumulated vsize (KiB) 311284

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.02
CPU time (s): 1300
CPU user time (s): 1299.86
CPU system time (s): 0.141978
CPU usage (%): 99.9983
Max. virtual memory (cumulated for all children) (KiB): 311284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.86
system time used= 0.141978
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 77239
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 2218

runsolver used 2.06169 second user time and 5.06023 second system time

The end

Launcher Data

Begin job on node117 at 2011-04-25 22:55:52
IDJOB=3283535
IDBENCH=71045
IDSOLVER=1583
FILE ID=node117/3283535-1303764951
RUNJOBID= node117-1303764951-32378
PBS_JOBID= 13157146
Free space on /tmp= 71456 MiB

SOLVER NAME= Black Hole SAT 2011-03-08
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UCG-20-5p1.cnf
COMMAND LINE= saturn BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3283535-1303764951/watcher-3283535-1303764951 -o /tmp/evaluation-result-3283535-1303764951/solver-3283535-1303764951 -C 2400 -W 1300 -M 7680  saturn HOME/instance-3283535-1303764951.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 93858500e23e9a4bf0619d7bf7dc00f3
RANDOM SEED=1197596013

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      13762624 kB
Buffers:       2322416 kB
Cached:       16158856 kB
SwapCached:          0 kB
Active:       10620376 kB
Inactive:      8007232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      13762624 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           82424 kB
Writeback:           0 kB
AnonPages:      145008 kB
Mapped:          21088 kB
Slab:           495712 kB
PageTables:       5540 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   337512 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71464 MiB
End job on node117 at 2011-04-25 23:17:34