King Abdullah University of Science and Technology (KAUST), Saudi Arabia
Laurent Condat

Research Scientist

Visual Computing Center
Building 1 (West), Office 2118



home

research

publications

talks

software

images

teaching

 

Randomized algorithms for distributed optimization and learning

In distributed optimization, in particular in federated learning, communication is the bottleneck.

Main papers:
  • L. Condat, I. Agarský, G. Malinovsky, and P. Richtárik, “TAMUNA: Doubly Accelerated Federated Learning with Local Training, Compression, and Partial Participation,” preprint arXiv:2302.09832, 2023.  PDF

  • L. Condat, K. Yi, and P. Richtárik, “EF-BV: A Unified Theory of Error Feedback and Variance Reduction Mechanisms for Biased and Unbiased Compression in Distributed Optimization,” Conference on Neural Information Processing Systems (NeurIPS), Dec. 2022, New Orleans, USA.  PDF

  • L. Condat and P. Richtárik, “MURANA: A Generic Framework for Stochastic Variance-Reduced Optimization,” 3rd Annual Conference on Mathematical and Scientific Machine Learning (MSML), Aug. 2022. PMLR 190:81-96.  PDF

  • G. Malinovsky, D. Kovalev, E. Gasanov, L. Condat, and P. Richtárik, “From local SGD to local fixed point methods for federated learning,” ICML, July 2020.  PDF   Webpage


Large-scale convex nonsmooth optimization

Optimization is everywhere. The difficulty stems from the very large number of variables and the use of nonsmooth functions.

Main papers:
  • L. Condat and P. Richtárik, “RandProx: Primal-Dual Optimization Algorithms with Randomized Proximal Updates,” International Conference on Learning Representations (ICLR), May 2023.  PDF

  • L. Condat, D. Kitahara, A. Contreras, and A. Hirabayashi, “Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists,” SIAM Review, vol. 65, no. 2, pp. 375-435, 2023. PDF

  • A. Salim, L. Condat, K. Mishchenko, and P. Richtárik, “Dualize, split, randomize: Fast nonsmooth optimization algorithms,” Journal of Optimization Theory and Applications, vol. 195, pp. 102-130, Oct. 2022.  PDF

  • A. Salim, L. Condat, D. Kovalev, and P. Richtárik, “An Optimal Algorithm for Strongly Convex Minimization under Affine Constraints,” AISTATS, Mar. 2022. PMLR 151:4482-4498.  PDF   Matlab code

  • L. Condat, G. Malinovsky, and P. Richtárik, “Distributed Proximal Splitting Algorithms with Rates and Acceleration,” Frontiers in Signal Processing, vol. 1, 2022. PDF

  • P. L. Combettes, L. Condat, J.-C. Pesquet, and B. C. Vũ, “A forward-backward view of some primal-dual optimization methods in image recovery,” IEEE ICIP, Oct. 2014, Paris, France. PDF

  • L. Condat, “A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms,” J. Optimization Theory and Applications, vol. 158, no. 2, pp. 460-479, 2013.  PDF

  • L. Condat, “Fast projection onto the simplex and the l1 ball,” Mathematical Programming Series A, vol. 158, no. 1, pp. 575-585, July 2016.  PDFSupplementary material: C code  condat_simplexproj.c  condat_l1ballproj.c .  Matlab code: proj_simplex_l1ball.m

  • L. Condat, “A direct algorithm for 1D total variation denoising,” IEEE Signal Proc. Letters, vol. 20, no. 11, pp. 1054-1057, Nov. 2013.  PDF C file:  condat_fast_tv.c.  For use in Matlab, mex files made by Stephen Becker.
    New, 2017: A new, even better (linear time) algorithm: Matlab code and C code


Convex relaxations

One way to address a difficult nonconvex problem is to design a convex relaxation, which captures enough of the structure so that its solution is meaningful.

Main papers:
  • L. Condat, “Tikhonov Regularization of Circle-Valued Signals,” IEEE Transactions on Signal Processing, vol. 70, pp. 2775-2782, June 2022.  PDFMatlab code

  • L. Condat, “Atomic norm minimization for decomposition into complex exponentials and optimal transport in Fourier domain,” Journal of Approximation Theory, vol. 258, Oct. 2020.  PDF

  • L. Condat, D. Kitahara, and A. Hirabayashi, “A convex lifting approach to image phase unwrapping,” IEEE ICASSP, May 2019, Brighton, UK.  PDF

  • K. Polisano, L. Condat, M. Clausel, V. Perrier, “A convex approach to super-resolution and regularization of lines in images,” SIAM Journal on Imaging Sciences, vol. 12, no. 1, pp. 211-258, 2019. PDF

  • L. Condat, “A Convex Approach to K-means Clustering and Image Segmentation,” EMMCVPR, Oct. 2017, Venice, Italy. In: M. Pelillo and E. Hancock eds., Lecture Notes in Computer Science vol. 10746, Springer, pp. 220-234, 2018.  PDF.  Matlab code


Super-resolution

Super-resolution consists in recovering a signal with a better precision than what seems possible given the resolution limit of the available measurements, by making use of prior knowledge on the signal structure.

Main papers:
  • L. Condat, “Atomic norm minimization for decomposition into complex exponentials and optimal transport in Fourier domain,” Journal of Approximation Theory, vol. 258, Oct. 2020.  PDF

  • K. Polisano, L. Condat, M. Clausel, V. Perrier, “A convex approach to super-resolution and regularization of lines in images,” SIAM Journal on Imaging Sciences, vol. 12, no. 1, pp. 211-258, 2019. PDF

  • L. Condat and A. Hirabayashi, “Cadzow denoising upgraded: A new projection method for the recovery of Dirac pulses from noisy linear measurements,” Sampling Theory in Signal and Image Processing, vol. 14, no. 1, pp. 17-47, 2015.  PDF.  Matlab file: pulses_recovery.m

  • L. Condat, J. Boulanger, N. Pustelnik, S. Sahnoun, and L. Sengmanivong, “A 2-D spectral analysis method to estimate the modulation parameters in structured illumination microscopy,” IEEE ISBI, Apr. 2014, Beijing, China.  PDF.


Multispectral image processing

Hyperspectral imaging devices produce a stack of images, where each image represents information in a narrow band of the electromagnetic spectrum. Processing such data requires modelling the spatial and spectral interactions of the physical elements composing the scene.

Main papers:
  • D. Picone, M. Dalla Mura, and L. Condat, “Joint Demosaicing and Fusion of Multiresolution Coded Acquisitions: A Unified Image Formation and Reconstruction Method,” IEEE Transactions on Computational Imaging, vol. 9, pp. 335-349, 2023. Preprint:  PDF

  • A. Tiard, L. Condat, L. Drumetz, J. Chanussot, W. Yin, and X. Zhu, “Robust linear unmixing with enhanced sparsity,” IEEE ICIP, Sept. 2017, Beijing, China.  PDF

  • X. He, L. Condat, J. Bioucas-Dias, J. Chanussot and J. Xia, “A new pansharpening method based on spatial and spectral sparsity priors,” IEEE Transactions on Image Processing, vol. 23, no. 9, pp. 4160-4174, Sept. 2014. PDF.

  • M. M. Khan, J. Chanussot, L. Condat, and A. Montanvert, “Indusion: Fusion of multispectral and panchromatic images using induction scaling technique,” IEEE Geoscience and Remote Sensing Letters, vol. 5, no. 1, pp. 98-102, Jan. 2008.  PDF


Color image processing

In digital cameras, the sensor is overlaid with an array of color filters. The choice of these filters, and of the reconstruction method from the partial and noisy acquired information, is crucial to obtain sharp full color images.

Main papers:
  • L. Condat, “A Generic Proximal Algorithm for Convex Optimization - Application to Total Variation Minimization,” IEEE Signal Proc. Letters, vol. 21, no. 8, pp. 1054-1057, Aug. 2014.  PDF Matlab files:  optimization.zip

  • L. Condat and S. Mosaddegh, “Joint Demosaicking and Denoising by Total Variation Minimization,” IEEE ICIP, Sept. 2012, Orlando, USA.  PDFMatlab files:  denoisaicking_TV_Condat.zip

  • L. Condat, “A new color filter array with optimal properties for noiseless and noisy color image acquisition,” IEEE Transactions on Image Processing, vol. 20, no. 8, pp. 2200-2210, Aug. 2011.  PDFMatlab files:  denoisaicking_Condat.zip

  • L. Condat, “Color filter array design using random patterns with blue noise chromatic spectra,” Image and Vision Computing, vol. 28, no. 8, pp. 1196-1202, Aug. 2010.  PDFMatlab files:  CFArandom1.m   CFArandom2.m

Slides summarizing my contributions on the subject: PDF

Note: if you want to use a random color filter array (CFA) with blue noise properties without the hassle of generating it, consider as a very good approximation this 18x18 pattern with periodization (its cyan-magenta-yellow counterpart is very good as well):
(CFA_Condat_18.tif)

Sampling and reconstruction in linear shift-invariant spaces

Slides summarizing my contributions on the subject: PDF