Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lib/libth_bert.so: undefined symbol #494

Closed
pangsg opened this issue Mar 15, 2023 · 10 comments
Closed

lib/libth_bert.so: undefined symbol #494

pangsg opened this issue Mar 15, 2023 · 10 comments

Comments

@pangsg
Copy link

pangsg commented Mar 15, 2023

I tried to run bert_example.py but a error raised

lib/libth_bert.so: undefined symbol: _ZN17fastertransformer13cublasAlgoMapC1ESsSs

I have build the FT with python bindings
Here is my build scripts:

cmake -DSM=80 -DCMAKE_BUILD_TYPE=Release -DBUILD_PYT=ON ..
make -j12

my env info:

GPU: A100
CUDA: 11.6
python:3.8.10
pytorch:1.12.1
fastertransformer: v5.0
@pangsg
Copy link
Author

pangsg commented Mar 15, 2023

BTW, i couldn't use the provided docker image because of the policy of my company

@byshiue
Copy link
Collaborator

byshiue commented Mar 16, 2023

There are some issues in the environment settings. You can refer the recommended docker image to help debugging.

@pangsg
Copy link
Author

pangsg commented Mar 16, 2023

Because of the rule of our company, I can't download the image from nvcr.io. Could plz provide some advice for debug?

@byshiue
Copy link
Collaborator

byshiue commented Mar 16, 2023

It is a undefined symbol issue due to environment issue, which depends on your environment settings and we are hard to provide suggestion.

You can try to check the cmake file and the make file generated by cmake, making sure they have linked successfully.

@pangsg
Copy link
Author

pangsg commented Mar 16, 2023

Thanks for your advice. I have checked the built log, nothing failed in the log. Could u plz provide the requirements.txt?

@pangsg pangsg closed this as completed Mar 17, 2023
@pangsg
Copy link
Author

pangsg commented Mar 17, 2023

All Fixed.Thansk

@Siyuan011
Copy link

Hi, how do you fix it? I necountered the same problem.
Here is my config:
GPU: A100
CUDA: 11.3
python:3.8.5
pytorch:1.12.1

@pangsg
Copy link
Author

pangsg commented Mar 23, 2023

Hi, how do you fix it? I necountered the same problem. Here is my config: GPU: A100 CUDA: 11.3 python:3.8.5 pytorch:1.12.1

do u follow the xx_guide.md in docs?

@Siyuan011
Copy link

yes of course. I followed gpt_guide

@pangsg
Copy link
Author

pangsg commented Mar 23, 2023

yes of course. I followed gpt_guide

hmm, i followed the guide and fixed the bug. The git is necessary

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants