SRI Lab at ICLR 2022

Aggregated by Nikola Jovanović,  Mislav Balunović

April 25, 2022

The Tenth International Conference on Learning Representations (ICLR 2022) will be held virtually from April 25th through 29th. We are thrilled to share that SRI Lab will present five works at the conference, including one spotlight presentation! In this meta post you can find all relevant information about our work, including presentation times, as well as a dedicated blogpost for each work, presenting it in more detail. We look forward to meeting you at ICLR!

Fair Normalizing Flows

Authors: Mislav Balunović,  Anian Ruoss,  Martin Vechev
Keywords: fair representation learning, normalizing flows
Conference Page: https://iclr.cc/virtual/2022/poster/7045
Poster - Mon Apr 25 19:30 UTC+2 (Poster Session 2)
Fair Normalizing Flows (FNF) are a new approach for encoding data into a new representation in order to ensure fairness and utility in downstream tasks. In practical cases, when we can estimate the probability density of the inputs, FNF guarantees that adversary cannot recover the sensitive attribute from the learned representations. FNF addresses limitation of existing approaches for which stronger adversaries can still recover sensitive attributes. We show that FNF can effectively balance fairness and accuracy on a variety of relevant datasets.

Blog
Paper
Code

Provably Robust Adversarial Examples

Authors: Dimitar I. Dimitrov,  Gagandeep Singh,  Timon Gehr,  Martin Vechev
Keywords: adversarial examples, robustness
Conference Page: https://iclr.cc/virtual/2022/poster/6160
Poster - Tue Apr 26, 19:30 UTC+2 (Poster Session 5)
We introduce the concept of provably robust adversarial examples in deep neural networks. These are adversarial examples that are generated together with a region around them proven to be robust to a set of perturbations. We demonstrate our method, PARADE, for generating such examples in a scalable manner that uses adversarial attack algorithms to generate a candidate region which is then refined until proven robust. Our experiments show PARADE successfully finds large provably robust regions to both pixel intensity and geometric pertrubations containing up to $10^{573}$ and $10^{599}$ individual adversarial examples, respectively.

Blog
Slides
Paper

Complete Verification via Multi-Neuron Relaxation Guided Branch-and-Bound

Authors: Claudio Ferrari,  Mark Niklas Müller,  Nikola Jovanović,  Martin Vechev
Keywords: certified robustness, adversarial examples
Conference Page: https://iclr.cc/virtual/2022/poster/6097
Poster - Wed Apr 27 11:30 UTC+2 (Poster Session 7)
MN-BaB is our most recent neural network verifier that combines precise multi-neuron constraints within the Branch-and-Bound paradigm in one fully GPU-based solver. This combination of the two most successful verifier paradigms allows us to achieve state-of-the-art performance on current benchmarks and perform especially well on networks that were not trained to be easily verifiable and as a result have high natural accuracy.

Blog
Paper
Code

Bayesian Framework for Gradient Leakage

Authors: Mislav Balunović,  Dimitar I. Dimitrov,  Robin Staab,  Martin Vechev
Keywords: federated learning, privacy, gradient leakage
Conference Page: https://iclr.cc/virtual/2022/poster/6934
Poster - Wed Apr 27 19:30 UTC+2 (Poster Session 8)
Recent work has challenged notion that federated learning preserves data privacy by showing that various attacks can reconstruct original data from gradient updates. In this post, we investigate what is the optimal reconstruction attack and we show how it connects to previously proposed attacks. Furthermore, we also show that most of the existing defenses are not effective against strong attacks. Our findings indicate that the construction of effective defenses and their evaluation remains an open problem.

Blog
Paper
Code

Boosting Randomized Smoothing with Variance Reduced Classifiers (Spotlight)

Authors: Miklós Z. Horváth,  Mark Niklas Müller,  Marc Fischer,  Martin Vechev
Keywords: randomized smoothing, certified robustness, ensembles
Conference Page: https://iclr.cc/virtual/2022/spotlight/6328
Spotlight - Thu Apr 28, 19:30 UTC+2 (Poster Session 11)
Ensembles are particularly suitable base models for constructing certifiably robust classifiers via Randomized Smoothing (RS). Here, we motivate this result theoretically and share empirical results, showing that they obtain state-of-the-art results in multiple settings. The key insight is that the reduced variance of ensembles over the perturbations introduced in RS leads to significantly more consistent classifications for a given input. This, in turn, leads to substantially increased certifiable radii for samples close to the decision boundary.

Blog
Paper
Code
Discuss this post on Twitter   |   Subscribe to our Atom feed