forked from manbo/internal-docs
Fix: equation misplaced error
This commit is contained in:
@@ -10,6 +10,7 @@
|
|||||||
\usepackage{amsfonts} % blackboard math symbols
|
\usepackage{amsfonts} % blackboard math symbols
|
||||||
\usepackage{nicefrac} % compact symbols for 1/2, etc.
|
\usepackage{nicefrac} % compact symbols for 1/2, etc.
|
||||||
\usepackage{microtype} % microtypography
|
\usepackage{microtype} % microtypography
|
||||||
|
\usepackage{amsmath} % cleveref must be loaded after amsmath!
|
||||||
\usepackage{cleveref} % smart cross-referencing
|
\usepackage{cleveref} % smart cross-referencing
|
||||||
\usepackage{lipsum} % Can be removed after putting your text content
|
\usepackage{lipsum} % Can be removed after putting your text content
|
||||||
\usepackage{graphicx}
|
\usepackage{graphicx}
|
||||||
@@ -181,9 +182,9 @@ Discrete ICS variables must remain categorical, making Gaussian diffusion inappr
|
|||||||
|
|
||||||
We therefore adopt masked (absorbing) diffusion for discrete channels, where corruption replaces tokens with a special $\texttt{[MASK]}$ symbol according to a schedule \citep{shi2024simplified}. For each variable $j$, define a masking schedule $\{m_k\}_{k=1}^K$ (with $m_k\in[0,1]$) increasing in $k$. The forward corruption process is:
|
We therefore adopt masked (absorbing) diffusion for discrete channels, where corruption replaces tokens with a special $\texttt{[MASK]}$ symbol according to a schedule \citep{shi2024simplified}. For each variable $j$, define a masking schedule $\{m_k\}_{k=1}^K$ (with $m_k\in[0,1]$) increasing in $k$. The forward corruption process is:
|
||||||
\begin{equation}
|
\begin{equation}
|
||||||
q(y^{(j)}_k \mid y^{(j)}_0)=
|
q(y^{(j)}_k \mid y^{(j)}_0) =
|
||||||
\begin{cases}
|
\begin{cases}
|
||||||
y^{(j)}, & \text{with probability } 1-m_k,\\
|
y^{(j)}_0, & \text{with probability } 1 - m_k, \\
|
||||||
\texttt{[MASK]}, & \text{with probability } m_k,
|
\texttt{[MASK]}, & \text{with probability } m_k,
|
||||||
\end{cases}
|
\end{cases}
|
||||||
\label{eq:masking_process}
|
\label{eq:masking_process}
|
||||||
|
|||||||
Reference in New Issue
Block a user