Derivation and Analysis of the Primal-Dual Method of Multipliers Based on Monotone Operator Theory

Journal article (2019)

Authors

T.W. Sherson Signal Processing Systems -

R. Heusdens Signal Processing Systems -

W.B. Kleijn Victoria University of Wellington, Signal Processing Systems -

Research Group

Signal Processing Systems () (TU Delft)

DOI: https://doi.org/10.1109/TSIPN.2018.2876754

Distributed optimization Monotone operator Primal-Dual method of multipliers (PDMM)

More Info

expand_more

To reference this document use:

http://resolver.tudelft.nl/uuid:822093d3-5614-41ee-844c-a86a19e2db22

Published Date

2019

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Department

Microelectronics

Research Group

Signal Processing Systems

Abstract

In this paper, we present a novel derivation of an existing algorithm for distributed optimization termed the primal-dual method of multipliers (PDMM). In contrast to its initial derivation, monotone operator theory is used to connect PDMM with other first-order methods such as Douglas-Rachford splitting and the alternating direction method of multipliers, thus, providing insight into its operation. In particular, we show how PDMM combines a lifted dual form in conjunction with Peaceman-Rachford splitting to facilitate distributed optimization in undirected networks. We additionally demonstrate sufficient conditions for primal convergence for strongly convex differentiable functions and strengthen this result for strongly convex functions with Lipschitz continuous gradients by introducing a primal geometric convergence bound.

Files

Main.pdf

(.pdf | 0.83 Mb)