Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Understanding Few Points About EMDE #1

Open
AdityaSoni19031997 opened this issue Feb 2, 2022 · 0 comments
Open

Understanding Few Points About EMDE #1

AdityaSoni19031997 opened this issue Feb 2, 2022 · 0 comments

Comments

@AdityaSoni19031997
Copy link

Hey!

Thanks for sharing your cool snippets and a cool paper which is very nicely written as well. I was trying to understand the implementation of the DLSH in the coders.py file. And below are some of my queries,

  • Why do we do GaussianRandomProjection beforehand? Is it simply because we want to reduce the higher dimensional embeddings (like vecs of 768, 512, 1024 etc?)
  • Secondly, in transform_to_absolute_codes, why do we adjust the offsets? I am not sure I understood that part clearly.

Thanks Again for your paper and clean snippets!

Best,
Aditya.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant