Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code Complexity #3

Open
MahzaibKhalid opened this issue Oct 15, 2024 · 7 comments
Open

Code Complexity #3

MahzaibKhalid opened this issue Oct 15, 2024 · 7 comments

Comments

@MahzaibKhalid
Copy link

Hi, I need specific code from your project. But its is to complex to understand at first. Can you provide exact code for the paper?

@Cuixxx
Copy link
Owner

Cuixxx commented Oct 17, 2024

Sure, most of related parts are written in the file, './torchreid/models/profd.py'. And if you have more problems, please let me know! Thank you!

@MahzaibKhalid
Copy link
Author

Actually, I am confused only about textual prompts with part based. I have complete understanding about rest. Can you provide me a template of only textual part based prompt as an example. It will make clarity about your textual prompts pattern. Thanks

@Cuixxx
Copy link
Owner

Cuixxx commented Oct 18, 2024

I use learnable prompt as template, e.g. [p0],[p1],...,[p15],[feet/arm/head/torso]. Notably, [p0],...,[p15] are all trainable embeddings and they are not pre-defined before training. I hope this answer can help you!

@MahzaibKhalid
Copy link
Author

Ok got it. It means that you dynamically generated part specific prompts and add token of class at the end. Right?
Screenshot 2024-10-18 154051

@Cuixxx
Copy link
Owner

Cuixxx commented Oct 20, 2024

Yes, you are right. If you have any other problems, please let me know.

@MahzaibKhalid
Copy link
Author

I have one more question, You have generated dynamic prompts. How is the surety that these prompts are specific for that specific part? Is there any way to optimize the promots?

@Cuixxx
Copy link
Owner

Cuixxx commented Nov 6, 2024

Good Question!
(1)The part-specific prompts means that learnable template + body part name, I think this way mainly build their relationship between prompt and its corresponding body region. (2) Besides, we also propose a spatial-level alignment to further align their embedding with spatial feature map in spatial level, similar with a segmentation task, these prompt embedding can be regarded as a classifier head. After these two procedures, we believe these prompt embedding have well aligned with their corresponding body regions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants