Error Feedback

3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation

We introduce three point compressors (3PC), a novel framework unifying and improving communication-efficient distributed optimization methods. Presented as a Poster at ICML 2022.

Feb 2, 2022

EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback

Six practical algorithmic extensions of the EF21 error feedback method for communication-efficient distributed learning, with strong convergence guarantees.

Oct 7, 2021

EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback

We propose EF21, a novel approach to error feedback offering a better theoretical rate and strong empirical results. Presented as an Oral + Poster at NeurIPS 2021.

Jun 9, 2021