Skip to content
BIASED
Block 1 of 7~2 min

What the encoder outputs

A plain autoencoder maps an input xx to one point zz and back. It reconstructs well, but it is not a generator: pick a random point in its latent space and the decoder has no reason to produce anything sensible.

The variational autoencoder (Kingma and Welling, 2014) organizes the latent space. Each input is encoded into a Gaussian, not a point:

qφ(z∣x)=N(μφ(x), σφ2(x)),q_\varphi(z \mid x) = \mathcal N\big(\mu_\varphi(x),\ \sigma^2_\varphi(x)\big),

and every such Gaussian is pulled toward one fixed prior p(z)=N(0,I)p(z) = \mathcal N(0, I). In code, the encoder ends with two heads: one for μ\mu and one for log⁡σ2\log\sigma^2.

Question

What does a VAE encoder output for a single input xx?
Choose one answer

Answers are saved on the server and tied to this browser until you sign in.