Fedformer

Luhuanz · Apr 15, 2023 · ec033f8 · ec033f8
1 parent 3aa3e87
commit ec033f8
Show file tree

Hide file tree

Showing 2 changed files with 13 additions and 2 deletions.
diff --git a/transformer time series/Fedformer/fedformer.assets/image-20230415162928961.png b/transformer time series/Fedformer/fedformer.assets/image-20230415162928961.png
diff --git a/transformer time series/Fedformer/fedformer.md b/transformer time series/Fedformer/fedformer.md
@@ -114,7 +114,7 @@ $$
 
 ### Fourier Enhanced  Structure
 
-**DFT (Discrete Fourier  Transform)**
+(a) **DFT (Discrete Fourier  Transform)**
 
 Notation 
 
@@ -140,4 +140,15 @@ Complexity:
 
 - random subset of  Fourier basis: $O(N)$
 
-  (+mode index before DFT and )
+  (+mode index before DFT and reverse  DFT operations)
+
+(b)  **FEB-f ( Frequency Enhanced Block** ( with Fourier Transform )  
+
+both used in **Encoder & Decoder**
+
+![image-20230415162928961](fedformer.assets/image-20230415162928961.png)
+
+Process
+
+- step1) linear projected :$q=x.w$
+  - where $\boldsymbol{w} \in \mathbb{R}^{D \times D}$