diff --git a/transformer time series/Fedformer/fedformer.assets/image-20230415162928961.png b/transformer time series/Fedformer/fedformer.assets/image-20230415162928961.png new file mode 100644 index 0000000..816eb1a Binary files /dev/null and b/transformer time series/Fedformer/fedformer.assets/image-20230415162928961.png differ diff --git a/transformer time series/Fedformer/fedformer.md b/transformer time series/Fedformer/fedformer.md index a7d0107..2b4f007 100644 --- a/transformer time series/Fedformer/fedformer.md +++ b/transformer time series/Fedformer/fedformer.md @@ -114,7 +114,7 @@ $$ ### Fourier Enhanced Structure -**DFT (Discrete Fourier Transform)** +(a) **DFT (Discrete Fourier Transform)** Notation @@ -140,4 +140,15 @@ Complexity: - random subset of Fourier basis: $O(N)$ - (+mode index before DFT and ) \ No newline at end of file + (+mode index before DFT and reverse DFT operations) + +(b) **FEB-f ( Frequency Enhanced Block** ( with Fourier Transform ) + +both used in **Encoder & Decoder** + +![image-20230415162928961](fedformer.assets/image-20230415162928961.png) + +Process + +- step1) linear projected :$q=x.w$ + - where $\boldsymbol{w} \in \mathbb{R}^{D \times D}$ \ No newline at end of file