Description

The use of convex optimization in the fields of data science and engineering is becoming ubiquitous. But is has been recognized in the research community for more than a decade that significant efficiencies can be gained by acknowledging the latent structure in the solution itself, coupled with the overarching structure provided by convexity. Structured optimization proceeds along these lines by using a prescribed set of points, called atoms, from which to assemble an optimal solution. In effect, the atoms selected to participate in forming a solution decompose the model into simpler parts, which offers opportunities for algorithmic efficiency in solving the optimization problem. An atomic decomposition provides a description of the most informative features of a solution or a kind of generalized principal component analysis. In this monograph, the authors describe the rich convex geometry that underlies atomic decomposition and demonstrate its use in practical examples. They expose the basic elements of this theory and its many connections to sparse and structured optimization. The authors have adopted a self-contained treatment and make a few modest assumptions that greatly simplify the derivations to make it accessible researchers who are not specialists in convex analysis. Atomic Decomposition via Polar Alignment provides an introduction for all researchers and practitioners to a powerful optimization technique with many future applications throughout engineering and computer science.