Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

如何将句向量维度从768降到128 #1

Open
XGodLike opened this issue Apr 5, 2020 · 0 comments
Open

如何将句向量维度从768降到128 #1

XGodLike opened this issue Apr 5, 2020 · 0 comments

Comments

@XGodLike
Copy link

XGodLike commented Apr 5, 2020

我的场景是两个文本的相似度，思路是：微调后，抽取的最后一层池化作为了句向量，用余弦来计算相似度。是768维的，效果还可以，后来因为有个需求需要降低到128维，我直接在768维后面接了一个全连接降到128维了。但是效果就不好了....是不是这种方式不可行？
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@XGodLike