New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

多变量相关性 #1

Open

aligaduocaisang opened this issue Oct 31, 2024 · 1 comment

aligaduocaisang commented Oct 31, 2024

您好，文章中的Q和K第一个维度分别为M和L为序列长度，根据itransformer，M和L是不是就是变量数或者是说节点数呢。

Owner

zhouziyu02 commented Nov 5, 2024

你好，感谢关注。实际上query和key第一个维度是batch size，但在文中我省略了。至于M和L，在invert embedding的情景下，两者的值均为token的数量，即变量数。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment