Trace number 3280407

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Black Hole SAT 2011-03-08? (TO) 1300.04 1300.01

General information on the benchmark

Nameindustrial/anbulagan/
hard-unsat/dated-5-13-u.cnf
MD5SUM45ee13b66821e6c36f3e38be418fa121
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3586.1
Satisfiable
(Un)Satisfiability was proved
Number of variables138808
Number of clauses626501
Sum of the clauses size1431026
Maximum clause length10
Minimum clause length1
Number of clauses of size 111712
Number of clauses of size 2503953
Number of clauses of size 384536
Number of clauses of size 42920
Number of clauses of size 511680
Number of clauses of size over 511700

Solver Data

3.99/4.01	c RESTART
6.19/6.29	c RESTART
10.59/10.67	c RESTART
14.49/14.50	c RESTART
17.09/17.10	c RESTART
18.79/18.83	c RESTART
19.29/19.35	c RESTART
21.19/21.23	c RESTART
25.69/25.79	c RESTART
29.39/29.45	c RESTART
31.89/31.99	c RESTART
33.29/33.31	c RESTART
39.09/39.15	c RESTART
49.69/49.73	c RESTART
53.79/53.86	c RESTART
56.29/56.37	c RESTART
57.09/57.18	c RESTART
59.29/59.33	c RESTART
60.78/60.84	c RESTART
63.59/63.67	c RESTART
66.38/66.42	c RESTART
68.19/68.26	c RESTART
72.09/72.16	c RESTART
81.49/81.51	c RESTART
82.98/83.02	c RESTART
85.29/85.39	c RESTART
88.88/88.91	c RESTART
92.88/92.93	c RESTART
100.18/100.24	c RESTART
101.09/101.19	c RESTART
103.58/103.61	c RESTART
109.28/109.33	c RESTART
112.98/113.03	c RESTART
117.88/117.98	c RESTART
122.48/122.53	c RESTART
123.88/123.99	c RESTART
127.28/127.38	c RESTART
130.69/130.79	c RESTART
132.49/132.57	c RESTART
138.19/138.23	c RESTART
139.39/139.43	c RESTART
143.19/143.28	c RESTART
145.69/145.72	c RESTART
149.69/149.73	c RESTART
154.19/154.24	c RESTART
155.29/155.30	c RESTART
157.09/157.13	c RESTART
158.79/158.87	c RESTART
160.79/160.83	c RESTART
163.59/163.60	c RESTART
165.29/165.32	c RESTART
166.19/166.20	c RESTART
167.20/167.21	c RESTART
168.20/168.20	c RESTART
170.29/170.40	c RESTART
171.89/171.90	c RESTART
173.19/173.25	c RESTART
175.39/175.49	c RESTART
177.29/177.33	c RESTART
179.20/179.23	c RESTART
181.09/181.15	c RESTART
182.19/182.27	c RESTART
184.39/184.46	c RESTART
187.09/187.15	c RESTART
191.59/191.67	c RESTART
193.39/193.50	c RESTART
197.59/197.66	c RESTART
199.00/199.04	c RESTART
201.49/201.57	c RESTART
202.49/202.54	c RESTART
204.69/204.70	c RESTART
213.69/213.79	c RESTART
215.89/215.91	c RESTART
229.99/230.06	c RESTART
234.49/234.59	c RESTART
239.80/239.85	c RESTART
243.79/243.80	c RESTART
244.79/244.88	c RESTART
247.69/247.79	c RESTART
253.89/253.91	c RESTART
261.29/261.39	c RESTART
268.59/268.60	c RESTART
270.99/271.02	c RESTART
271.89/271.95	c RESTART
275.69/275.78	c RESTART
281.39/281.48	c RESTART
283.29/283.38	c RESTART
286.29/286.32	c RESTART
291.99/292.04	c RESTART
297.19/297.29	c RESTART
299.29/299.36	c RESTART
301.79/301.82	c RESTART
304.29/304.38	c RESTART
308.00/308.03	c RESTART
312.69/312.75	c RESTART
314.89/314.92	c RESTART
317.19/317.23	c RESTART
318.90/318.96	c RESTART
322.09/322.18	c RESTART
324.99/325.04	c RESTART
327.39/327.45	c RESTART
328.99/329.08	c RESTART
334.30/334.36	c RESTART
339.99/340.03	c RESTART
344.39/344.43	c RESTART
348.39/348.46	c RESTART
352.19/352.21	c RESTART
353.59/353.61	c RESTART
355.89/355.98	c RESTART
361.29/361.36	c RESTART
367.79/367.80	c RESTART
369.29/369.34	c RESTART
372.09/372.11	c RESTART
373.29/373.31	c RESTART
374.29/374.37	c RESTART
375.59/375.65	c RESTART
376.69/376.75	c RESTART
377.59/377.63	c RESTART
379.89/379.94	c RESTART
385.00/385.06	c RESTART
386.79/386.84	c RESTART
388.09/388.12	c RESTART
389.19/389.25	c RESTART
391.19/391.23	c RESTART
392.60/392.69	c RESTART
393.80/393.82	c RESTART
395.59/395.63	c RESTART
396.39/396.45	c RESTART
398.59/398.67	c RESTART
400.19/400.24	c RESTART
401.69/401.72	c RESTART
402.50/402.52	c RESTART
405.29/405.38	c RESTART
408.79/408.87	c RESTART
410.59/410.69	c RESTART
412.19/412.25	c RESTART
413.19/413.20	c RESTART
414.19/414.25	c RESTART
416.09/416.12	c RESTART
418.19/418.23	c RESTART
420.09/420.17	c RESTART
422.49/422.54	c RESTART
424.59/424.65	c RESTART
426.99/427.09	c RESTART
428.99/429.08	c RESTART
431.79/431.87	c RESTART
437.39/437.42	c RESTART
439.29/439.37	c RESTART
442.69/442.79	c RESTART
445.69/445.78	c RESTART
446.99/447.06	c RESTART
447.89/447.98	c RESTART
451.79/451.89	c RESTART
452.89/452.99	c RESTART
456.50/456.53	c RESTART
458.89/458.91	c RESTART
461.09/461.11	c RESTART
469.60/469.64	c RESTART
476.99/477.06	c RESTART
494.90/494.96	c RESTART
500.59/500.68	c RESTART
509.69/509.79	c RESTART
512.60/512.63	c RESTART
516.19/516.26	c RESTART
520.59/520.65	c RESTART
528.59/528.67	c RESTART
535.70/535.73	c RESTART
536.89/536.99	c RESTART
539.29/539.30	c RESTART
543.89/543.95	c RESTART
548.69/548.80	c RESTART
553.20/553.23	c RESTART
554.49/554.55	c RESTART
556.89/556.99	c RESTART
557.80/557.82	c RESTART
562.70/562.76	c RESTART
565.10/565.12	c RESTART
568.40/568.47	c RESTART
583.80/583.86	c RESTART
586.00/586.02	c RESTART
588.10/588.16	c RESTART
590.80/590.80	c RESTART
592.60/592.69	c RESTART
593.91/593.95	c RESTART
595.80/595.87	c RESTART
597.90/597.96	c RESTART
606.70/606.78	c RESTART
611.70/611.79	c RESTART
620.80/620.80	c RESTART
624.20/624.28	c RESTART
631.20/631.23	c RESTART
633.80/633.82	c RESTART
636.60/636.60	c RESTART
644.40/644.42	c RESTART
657.00/657.03	c RESTART
667.30/667.36	c RESTART
672.80/672.89	c RESTART
678.00/678.08	c RESTART
685.50/685.52	c RESTART
689.80/689.80	c RESTART
693.00/693.04	c RESTART
695.80/695.84	c RESTART
698.20/698.28	c RESTART
700.90/700.96	c RESTART
711.40/711.47	c RESTART
714.20/714.20	c RESTART
716.50/716.58	c RESTART
721.90/721.90	c RESTART
726.70/726.75	c RESTART
728.90/728.90	c RESTART
736.60/736.65	c RESTART
738.30/738.32	c RESTART
739.60/739.66	c RESTART
745.60/745.62	c RESTART
747.80/747.85	c RESTART
751.10/751.10	c RESTART
753.00/753.09	c RESTART
760.00/760.03	c RESTART
765.60/765.63	c RESTART
769.20/769.26	c RESTART
791.20/791.24	c RESTART
798.70/798.78	c RESTART
801.40/801.49	c RESTART
805.20/805.27	c RESTART
809.50/809.56	c RESTART
812.10/812.17	c RESTART
815.50/815.56	c RESTART
818.30/818.35	c RESTART
822.60/822.69	c RESTART
824.40/824.46	c RESTART
827.40/827.43	c RESTART
834.11/834.13	c RESTART
835.71/835.74	c RESTART
838.81/838.82	c RESTART
840.11/840.17	c RESTART
853.81/853.86	c RESTART
859.31/859.30	c RESTART
861.51/861.56	c RESTART
867.11/867.10	c RESTART
871.41/871.47	c RESTART
876.01/876.05	c RESTART
879.81/879.90	c RESTART
882.41/882.49	c RESTART
885.91/885.91	c RESTART
888.61/888.65	c RESTART
905.61/905.69	c RESTART
908.91/908.90	c RESTART
910.71/910.71	c RESTART
913.11/913.16	c RESTART
914.91/914.96	c RESTART
918.01/918.06	c RESTART
920.51/920.52	c RESTART
922.81/922.90	c RESTART
925.31/925.32	c RESTART
928.31/928.36	c RESTART
930.71/930.75	c RESTART
938.41/938.44	c RESTART
945.81/945.85	c RESTART
947.21/947.29	c RESTART
948.61/948.62	c RESTART
949.71/949.73	c RESTART
951.11/951.17	c RESTART
952.62/952.64	c RESTART
955.51/955.58	c RESTART
958.01/958.03	c RESTART
961.31/961.37	c RESTART
964.11/964.14	c RESTART
967.81/967.87	c RESTART
970.81/970.89	c RESTART
973.61/973.63	c RESTART
975.72/975.71	c RESTART
982.51/982.54	c RESTART
991.71/991.72	c RESTART
994.21/994.29	c RESTART
996.11/996.19	c RESTART
1009.01/1009.08	c RESTART
1014.71/1014.75	c RESTART
1016.11/1016.13	c RESTART
1018.91/1018.95	c RESTART
1023.02/1023.01	c RESTART
1026.22/1026.23	c RESTART
1028.71/1028.79	c RESTART
1033.61/1033.62	c RESTART
1048.11/1048.18	c RESTART
1053.61/1053.62	c RESTART
1107.62/1107.62	c RESTART
1156.42/1156.42	c RESTART
1164.51/1164.55	c RESTART
1182.02/1182.05	c RESTART
1192.02/1192.08	c RESTART
1200.82/1200.88	c RESTART
1218.52/1218.56	c RESTART
1226.52/1226.57	c RESTART
1233.72/1233.72	c RESTART
1236.72/1236.74	c RESTART
1240.02/1240.04	c RESTART
1244.51/1244.60	c RESTART
1249.72/1249.77	c RESTART
1256.51/1256.50	c RESTART
1259.81/1259.84	c RESTART
1263.51/1263.59	c RESTART
1265.61/1265.66	c RESTART
1269.91/1269.96	c RESTART
1271.71/1271.75	c RESTART
1278.91/1278.93	c RESTART
1280.42/1280.49	c RESTART
1282.21/1282.26	c RESTART
1283.41/1283.43	c RESTART
1285.61/1285.68	c RESTART
1287.71/1287.79	c RESTART
1289.91/1289.90	c RESTART
1292.92/1292.98	c RESTART
1296.12/1296.10	c RESTART

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280407-1303748172/watcher-3280407-1303748172 -o /tmp/evaluation-result-3280407-1303748172/solver-3280407-1303748172 -C 2400 -W 1300 -M 7680 saturn HOME/instance-3280407-1303748172.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.10 3.68 2.96 4/189 8115
/proc/meminfo: memFree=25258536/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=34344 CPUtime=0 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 2825 0 0 0 0 0 0 0 21 0 1 0 565047982 35168256 2768 33554432000 4194304 4210924 140736799861968 18446744073709551615 4201588 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 8586 2776 94 5 0 4368 0

[startup+0.0854191 s]
/proc/loadavg: 3.10 3.68 2.96 4/189 8115
/proc/meminfo: memFree=25258536/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=86412 CPUtime=0.07 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 9999 0 0 0 6 1 0 0 21 0 1 0 565047982 88485888 9942 33554432000 4194304 4210924 140736799861968 18446744073709551615 260905054917 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 21603 9944 642 5 0 17385 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 86412

[startup+0.100415 s]
/proc/loadavg: 3.10 3.68 2.96 4/189 8115
/proc/meminfo: memFree=25258536/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=89184 CPUtime=0.09 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 11069 0 0 0 7 2 0 0 21 0 1 0 565047982 91324416 11013 33554432000 4194304 4210924 140736799861968 18446744073709551615 4203330 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 22296 11015 748 5 0 18078 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 89184

[startup+0.300378 s]
/proc/loadavg: 3.10 3.68 2.96 4/189 8115
/proc/meminfo: memFree=25258536/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=122580 CPUtime=0.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 24866 0 0 0 26 3 0 0 22 0 1 0 565047982 125521920 24578 33554432000 4194304 4210924 140736799861968 18446744073709551615 4203330 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 30645 24581 2287 5 0 26427 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 122580

[startup+0.700306 s]
/proc/loadavg: 3.10 3.68 2.96 4/189 8115
/proc/meminfo: memFree=25258536/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=120800 CPUtime=0.69 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 28903 0 0 0 65 4 0 0 24 0 1 0 565047982 123699200 25887 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 30200 25887 96 5 0 28671 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 120800

[startup+1.50022 s]
/proc/loadavg: 3.10 3.68 2.96 5/190 8116
/proc/meminfo: memFree=25154500/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=120800 CPUtime=1.49 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 28907 0 0 0 145 4 0 0 25 0 1 0 565047982 123699200 25890 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 30200 25890 96 5 0 28671 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 120800

[startup+3.10094 s]
/proc/loadavg: 3.17 3.68 2.96 6/190 8116
/proc/meminfo: memFree=25153876/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=120800 CPUtime=3.09 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 28915 0 0 0 305 4 0 0 25 0 1 0 565047982 123699200 25898 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 30200 25898 96 5 0 28671 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 120800

[startup+6.30028 s]
/proc/loadavg: 3.17 3.68 2.96 6/190 8116
/proc/meminfo: memFree=25152508/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=120932 CPUtime=6.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 28962 0 0 0 625 4 0 0 25 0 1 0 565047982 123834368 25945 33554432000 4194304 4210924 140736799861968 18446744073709551615 4198674 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 30233 25945 102 5 0 28704 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 120932

[startup+12.7001 s]
/proc/loadavg: 3.30 3.69 2.97 5/190 8116
/proc/meminfo: memFree=25148140/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=121728 CPUtime=12.69 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 29139 0 0 0 1265 4 0 0 25 0 1 0 565047982 124649472 26122 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 30432 26122 103 5 0 28903 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 121728

[startup+25.5008 s]
/proc/loadavg: 3.40 3.70 2.98 6/190 8116
/proc/meminfo: memFree=25135848/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=124268 CPUtime=25.49 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 29796 0 0 0 2545 4 0 0 25 0 1 0 565047982 127250432 26779 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 31067 26779 103 5 0 29538 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 124268

[startup+51.1011 s]
/proc/loadavg: 3.74 3.76 3.02 5/190 8117
/proc/meminfo: memFree=25131380/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=125212 CPUtime=51.09 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 30031 0 0 0 5105 4 0 0 25 0 1 0 565047982 128217088 27014 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 31303 27014 103 5 0 29774 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 125212

[startup+102.307 s]
/proc/loadavg: 3.89 3.80 3.07 6/190 8118
/proc/meminfo: memFree=25117636/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=128340 CPUtime=102.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 30815 0 0 0 10225 4 0 0 25 0 1 0 565047982 131420160 27798 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 32085 27798 103 5 0 30556 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 128340

[startup+162.301 s]
/proc/loadavg: 3.96 3.83 3.13 6/190 8120
/proc/meminfo: memFree=25101404/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=131652 CPUtime=162.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 31661 0 0 0 16224 5 0 0 25 0 1 0 565047982 134811648 28644 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 32913 28644 103 5 0 31384 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 131652

[startup+222.301 s]
/proc/loadavg: 3.98 3.86 3.18 6/190 8122
/proc/meminfo: memFree=25091188/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=137024 CPUtime=222.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 33016 0 0 0 22224 5 0 0 25 0 1 0 565047982 140312576 29999 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 34256 29999 104 5 0 32727 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 137024

[startup+282.301 s]
/proc/loadavg: 4.06 3.90 3.23 6/190 8123
/proc/meminfo: memFree=25085072/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=137428 CPUtime=282.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 33117 0 0 0 28224 5 0 0 25 0 1 0 565047982 140726272 30100 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204587 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 34357 30100 104 5 0 32828 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 137428

[startup+342.301 s]
/proc/loadavg: 4.02 3.91 3.28 6/190 8125
/proc/meminfo: memFree=25075128/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=139220 CPUtime=342.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 33574 0 0 0 34224 5 0 0 25 0 1 0 565047982 142561280 30557 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 34805 30557 104 5 0 33276 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 139220

[startup+402.301 s]
/proc/loadavg: 4.01 3.92 3.32 6/190 8126
/proc/meminfo: memFree=25067892/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=142240 CPUtime=402.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 34317 0 0 0 40224 5 0 0 25 0 1 0 565047982 145653760 31300 33554432000 4194304 4210924 140736799861968 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 35560 31300 104 5 0 34031 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 142240

[startup+462.301 s]
/proc/loadavg: 4.05 3.95 3.37 6/190 8128
/proc/meminfo: memFree=25061020/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=145892 CPUtime=462.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 35225 0 0 0 46224 5 0 0 25 0 1 0 565047982 149393408 32208 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 36473 32208 104 5 0 34944 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 145892

[startup+522.301 s]
/proc/loadavg: 4.02 3.96 3.40 6/190 8129
/proc/meminfo: memFree=25052280/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=145892 CPUtime=522.29 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 35225 0 0 0 52224 5 0 0 25 0 1 0 565047982 149393408 32208 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 36473 32208 104 5 0 34944 0
Current children cumulated CPU time (s) 522.29
Current children cumulated vsize (KiB) 145892

[startup+582.301 s]
/proc/loadavg: 4.00 3.96 3.44 6/190 8131
/proc/meminfo: memFree=25041092/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=147648 CPUtime=582.3 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 35663 0 0 0 58224 6 0 0 25 0 1 0 565047982 151191552 32646 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 36912 32646 104 5 0 35383 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 147648

[startup+642.301 s]
/proc/loadavg: 4.03 3.98 3.47 6/190 8133
/proc/meminfo: memFree=25031500/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=151144 CPUtime=642.3 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 36555 0 0 0 64224 6 0 0 25 0 1 0 565047982 154771456 33538 33554432000 4194304 4210924 140736799861968 18446744073709551615 4198774 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 37786 33538 104 5 0 36257 0
Current children cumulated CPU time (s) 642.3
Current children cumulated vsize (KiB) 151144

[startup+702.301 s]
/proc/loadavg: 4.01 3.98 3.50 6/190 8134
/proc/meminfo: memFree=25024016/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=153080 CPUtime=702.3 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 37025 0 0 0 70224 6 0 0 25 0 1 0 565047982 156753920 34008 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 38270 34008 104 5 0 36741 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 153080

[startup+762.307 s]
/proc/loadavg: 4.00 3.98 3.53 6/190 8136
/proc/meminfo: memFree=25014564/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=155124 CPUtime=762.3 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 37537 0 0 0 76224 6 0 0 25 0 1 0 565047982 158846976 34520 33554432000 4194304 4210924 140736799861968 18446744073709551615 4201865 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 38781 34520 104 5 0 37252 0
Current children cumulated CPU time (s) 762.3
Current children cumulated vsize (KiB) 155124

[startup+822.301 s]
/proc/loadavg: 4.00 3.98 3.56 6/190 8138
/proc/meminfo: memFree=25007572/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=156360 CPUtime=822.3 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 37866 0 0 0 82224 6 0 0 25 0 1 0 565047982 160112640 34849 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 39090 34849 104 5 0 37561 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 156360

[startup+882.301 s]
/proc/loadavg: 4.00 3.98 3.58 6/190 8139
/proc/meminfo: memFree=24988308/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=158708 CPUtime=882.31 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 38461 0 0 0 88224 7 0 0 25 0 1 0 565047982 162516992 35444 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204579 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 39677 35444 104 5 0 38148 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 158708

[startup+942.301 s]
/proc/loadavg: 4.00 3.98 3.61 5/190 8141
/proc/meminfo: memFree=24979600/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=159392 CPUtime=942.31 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 38632 0 0 0 94224 7 0 0 25 0 1 0 565047982 163217408 35615 33554432000 4194304 4210924 140736799861968 18446744073709551615 4198592 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 39848 35615 104 5 0 38319 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 159392

[startup+1002.3 s]
/proc/loadavg: 4.04 4.00 3.63 6/190 8142
/proc/meminfo: memFree=24971508/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=159392 CPUtime=1002.31 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 38632 0 0 0 100224 7 0 0 25 0 1 0 565047982 163217408 35615 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 39848 35615 104 5 0 38319 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 159392

[startup+1062.3 s]
/proc/loadavg: 4.01 4.00 3.65 5/190 8144
/proc/meminfo: memFree=24959572/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=159532 CPUtime=1062.31 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 38654 0 0 0 106224 7 0 0 25 0 1 0 565047982 163360768 35637 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206550 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 39883 35637 104 5 0 38354 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 159532

[startup+1122.3 s]
/proc/loadavg: 4.06 4.01 3.68 5/190 8146
/proc/meminfo: memFree=24958556/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=159532 CPUtime=1122.31 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 38663 0 0 0 112224 7 0 0 25 0 1 0 565047982 163360768 35646 33554432000 4194304 4210924 140736799861968 18446744073709551615 4204590 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 39883 35646 104 5 0 38354 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 159532

[startup+1182.3 s]
/proc/loadavg: 4.02 4.01 3.69 6/190 8147
/proc/meminfo: memFree=24953948/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=159532 CPUtime=1182.32 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 38663 0 0 0 118225 7 0 0 25 0 1 0 565047982 163360768 35646 33554432000 4194304 4210924 140736799861968 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 39883 35646 104 5 0 38354 0
Current children cumulated CPU time (s) 1182.32
Current children cumulated vsize (KiB) 159532

[startup+1242.3 s]
/proc/loadavg: 4.01 4.00 3.71 5/190 8149
/proc/meminfo: memFree=24946748/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=161316 CPUtime=1242.32 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 39122 0 0 0 124225 7 0 0 25 0 1 0 565047982 165187584 36105 33554432000 4194304 4210924 140736799861968 18446744073709551615 4206192 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 40329 36105 104 5 0 38800 0
Current children cumulated CPU time (s) 1242.32
Current children cumulated vsize (KiB) 161316



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 2.50 3.61 3.59 2/172 8204
/proc/meminfo: memFree=25692564/32950928 swapFree=67071984/67111528
[pid=8115] ppid=8113 vsize=165844 CPUtime=1300.02 cores=4,6
/proc/8115/stat : 8115 (saturn) R 8113 8115 7897 0 -1 4202496 40252 0 0 0 129994 8 0 0 25 0 1 0 565047982 169824256 37235 33554432000 4194304 4210924 140736799861968 18446744073709551615 4198608 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/8115/statm: 41461 37235 104 5 0 39932 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 165844

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.01
CPU time (s): 1300.04
CPU user time (s): 1299.95
CPU system time (s): 0.088986
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 165844

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.95
system time used= 0.088986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 40252
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 2288

runsolver used 2.00169 second user time and 5.07923 second system time

The end

Launcher Data

Begin job on node116 at 2011-04-25 18:16:13
IDJOB=3280407
IDBENCH=20387
IDSOLVER=1583
FILE ID=node116/3280407-1303748172
RUNJOBID= node116-1303746808-7916
PBS_JOBID= 13154046
Free space on /tmp= 72556 MiB

SOLVER NAME= Black Hole SAT 2011-03-08
BENCH NAME= SAT07/industrial/anbulagan/hard-unsat/dated-5-13-u.cnf
COMMAND LINE= saturn BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280407-1303748172/watcher-3280407-1303748172 -o /tmp/evaluation-result-3280407-1303748172/solver-3280407-1303748172 -C 2400 -W 1300 -M 7680  saturn HOME/instance-3280407-1303748172.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 45ee13b66821e6c36f3e38be418fa121
RANDOM SEED=686674735

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      25258692 kB
Buffers:       1855972 kB
Cached:        4852228 kB
SwapCached:       9732 kB
Active:        3688996 kB
Inactive:      3583544 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      25258692 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:           55392 kB
Writeback:           0 kB
AnonPages:      558492 kB
Mapped:          14144 kB
Slab:           354932 kB
PageTables:       6252 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   832420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72612 MiB
End job on node116 at 2011-04-25 18:37:55