Perceiver: General Perception with Iterative Attention
To overcome Transformers' squared complexity (w.r.t input length), the Perceiver article here offers a novel method to learn the QKV matrices. Check it out!
Computer Vision
Computer vision, image recognition and classification, model architectures such as ResNets, MNIST and more.
Discriminator Rejection Sampling
A summary of a method to improve GAN generated images by exploiting accumulated "information" from the Discriminator during the GAN training process.
Representation learning via invariant causal mechanisms
This article suggests a method to construct augmentation resilient and styling invariant image representation in lower dimension (embeddings).