Digital filters are essential building blocks for signal processing applications. One of the main goals of this work is to illustrate the versatility and relevance of lplp norms in the design of digital filters. While popular and well understood, l2l2 and l∞l∞ filters do tend to accentuate specific benefits from their respective designs; filters designed using lplp norms as optimality criteria can offer a tradeoff between the benefits of these two commonly used criteria. This work presented a number of applications of LpLp norms in both FIR and IIR filter design, and their corresponding design algorithms and software implementation.
The basic workhorse for the methods presented in this document is the Iterative Reweighted Least Squares algorithm, a simple yet powerful method that sets itself naturally adept for the design of lplp filters. The notion of converting a mathematically complex problem into a series of significantly easier optimization problems is common in optimization. Nevertheless, the existence results from Theorem (Reference) strongly motivate the use of IRLS methods to design lplp filters. Knowing that optimal weights exist that would turn the solution of a weighted least squared problem into the solution of a leastpp problem must at the very least captivate the curiosity of the reader. The challenge lies in finding a robust and efficient method to find such weights. All the methods presented in this work work under this basic framework, updating iteratively the weighting function of a least squares problem in order to find the optimal lplp filter for a given application. Therefore it is possible to develop a suite of computer programs in a modular way, where with few adjustments one can solve a variety of problems.
Throughout this document one can find examples of the versatility of the IRLS approach. One can change the internal linear objective function from a complex exponential kernel to a sinusoidal one to solve complex and linear phase FIR filters respectively using the same algorithm. Further adaptations can be incorporated with ease, such as the proposed adaptive solution to improve robustness.
Another important design example permits to make pp into a function of frequency to allow for different ppnorms in different frequency bands. Such design merely requires a few changes in the implementation of the algorithm, yet allows for fancier, more elegant problems to be solved, such as the Constrained Least Squares (CLS) problem. In the context of FIR filters, this document presents the CLS problem from an lplp prespective. While the work by John Adams [1] set a milestone in digital filter design, this dissertation introduces a strong algorithm and a different perspective to the problem from that by Adams and other authors. The IRLS lplpbased approach from this work proves to be robust and flexible, allowing for even and uneven sampling. Furthermore, while a user can use fixed transition bands, one would benefit much from using a flexible transition band formulation, where the proposed IRLSbased algorithm literally finds the optimal transition band definition based on the constraint specifications. Such flexibility allows for tight constrains that would otherwise cause other algorithms to fail meeting the constraint specifications, or simply not converging at all. (Reference) introduced two problem formulations as well as results that illustrate the method's effectiveness at solving the CLS problem.
While previous work exists in the area of FIR design (or in linear lplp approximation for that matter), the problem of designing lplp IIR filters has been far less explored. A natural reason for this is the fact that l2l2 IIR design is in itself an open research area (and a rather complicated problem as well). Traditional linear optimization approaches cannot be directly used for either of these problems, and nonlinear optimization tools often prove either slow or do not converge.
This work presents the lplp IIR design problem as a natural extension of the FIR counterpart, where in a modular fashion the linear weigthed l2l2 section of the algorithms is replaced by a nonlinear weighted l2l2 version. This problem formulation allows for the IIR implementation of virtually all the IRLS FIR methods presented in Chapter (Reference). Dealing with the weighted nonlinear l2l2 problem is a different story.
The problem of rational l2l2 approximation has been studied for some time. However the sources of ideas and results related to this problem are scattered across several areas of study. One of the contributions of this work is an organized summary of efforts in rational l2l2 optimization, particularly related to the design of IIR digital filters. The work in (Reference) also lays down a framework for the IIR methods proposed in this work.
As mentioned in (Reference), some complications arise when designing IIR lplp filters. Aside from the intrinsic l2l2 problem, it is necessary to properly combine a number of ideas that allowed for robust and efficient lplp FIR methods. A design algorithm for complex
lplp IIF filters were presented in
(Reference); this algorithm combined Soewito's quasilinearization with ideas such as
lplp homotopy, partial updating and the adaptive modification. In practice, the combination of these ideas showed to be practical and the resulting algorithm remained robust. It was also found that after a few
ppsteps, the internal
l2l2 algorithm required from one to merely a few iterations on average, thus maintaining the algorithm efficient.
One of the main contributions of this work is the introduction of an IRLSbased method to solve lplp IIR design problems. By properly combining the principle of magnitude approximation via phase updating (from Soewito, Jackson and Kay) with the complex IIR algorithm one can find optimal magntiude lplp designs. This work also introduced a sequence of steps that improve the efficiency and robustness of this algorithm, by dividing the design process into three stages and by using suitable
initial guesses for each stage.
Appendix (Reference) incudes the Matlab code developed in this work. Some of the examples in this document were designed using these programs. It is worth to notice the common elements between different programs, alluding to the modularity of the implementations. An added benefit to this setup is that further advances in any of the topics covered in this work can easily be ported to most if not all of the algorithms.
Digital filter design is and will remain an important topic in digital signal processing. It is the hope of the author to have motivated in the reader some curiosity for the use of lplp norms as design criteria for applications in FIR and IIR filter design. This work is by no means comprehensive, and is meant to inspire the consideration of the flexibility of IRLS algorithms for new lplp related problems.

Adams, John W. (1991, April). FIR Digital Filters with LeastSquares Stopbands Subject to PeakGain Constraints. IEEE Trans. on Circuits and Systems, 39(4), 376388.