-
LMS - remains the simplest and best algorithm when
slow convergence is not a serious issue (typically used)
ON
O
N
-
NLMS - simple extension of the LMS with much faster
convergence in many cases (very commonly used)
ON
O
N
-
Frequency-domain methods -
offer computational savings
(
OlogN
O
N
) for long filters and usually offer faster
convergence, too (sometimes used; very commonly used when
there are already FFTs in the system)
-
Lattice methods - are stable and converge quickly,
but cost substantially more than LMS and have higher residual
EMSE than many methods (very occasionally used)
ON
O
N
-
RLS - algorithms that converge quickly and are
stable exist. However, they are considerably more expensive
than LMS. (almost never used)
ON
O
N
-
Block RLS - (least squares) methods exist and can
be pretty efficient in some cases. (occasionally used)
OlogN
O
N
,
ON
O
N
,
ON2
O
N
2
-
IIR - methods are difficult to implement
successfully and pose certain difficulties, but are sometimes
used in some applications, for example noise cancellation of
low frequency noise (very occasionally used)
-
CMA - very useful when applicable (blind
equalization); CMA is the method for
blind equalizer initialization (commonly used in a few specific equalization applications)
ON
O
N
Note:
In general, getting adaptive filters to work well in an
application is much more challenging than, say, FFTs or IIR
filters; they generally require lots of tweaking!
References-
B. Widrow and S.D. Stearns. (1985). Adaptive Signal Processing. [Good on applications, LMS]. Prentice-Hall.
-
C.F.N. Cowan and P.M. Grant. (1985). Adaptive Filters. [Good overview of lots of topics]. Prentice-Hall.
-
J.R. Treichler, C.R. Johnson and M.G. Larimore. (1987). Theory and Design of Adaptive Filters. [Good introduction to adaptive filtering, CMA; nice coverage of hardware]. Wiley-Interscience.
-
M.L. Honig and D.G. Messerschmidt. (1984). Adaptive Filters: Structures, Algorithms, and Applications. [Good coverage of lattice algorithms]. Kluwer.
-
S. Haykin. (1986). Adaptive Filters Theory. [Nice coverage of adaptive filter theory; Good reference]. Prentice-Hall.
"A good introduction in adaptive filters, a major DSP application."