OSError: /lib64/libm.so.6: version `GLIBC_2.29' not found

[Karthik1611]

Hi

I am trying to use ctransformers to load the falcon-40b ggml model and I get the following error

OSError: /lib64/libm.so.6: version `GLIBC_2.29' not found (required by /home/ec2-user/anaconda3/envs/amazonei_pytorch_latest_p37/lib/python3.7/site-packages/ctransformers/lib/avx2/libctransformers.so)

I am using an AWS Sagemaker notebook. I am new to this, please help in resolving this issue

[Ananderz]

I believe you still have the model parameter set to Llama instead of falcon in your configuration file. I recognize this error and I believe I fixed it in that way!

[marella]

This looks related to #58 (comment)
I'm guessing AWS Sagemaker notebook instance is using Amazon Linux 2 which uses old glibc version. You can try building it from source:

pip uninstall ctransformers --yes # uninstall if already installed
pip install ctransformers --no-binary ctransformers

If you need GPU support install using:

CT_CUBLAS=1 pip install ctransformers --no-binary ctransformers