Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qlever index gets stuck for Wikidata #39

Open
s-jse opened this issue May 25, 2024 · 0 comments
Open

qlever index gets stuck for Wikidata #39

s-jse opened this issue May 25, 2024 · 0 comments

Comments

@s-jse
Copy link

s-jse commented May 25, 2024

Hi,

I'm using qlever-control to host a local version of Wikidata. I'm using the latest version of wikidata Qlever file (updated yesterday).
I have successfully run qlever setup-config wikidata and qlever get-data. But the next command qlever index gets stuck after about an hour.
Here is the last line of the log:

...
INFO: Triples parsed: 18,250,000,000 [average speed [averag3.4 M/s, last batch 3.9 M/s, fastest 4.8 M/s, slowest 1.0 M/s]

I ctrl+c'd the script after 7 hours of it being stuck. Then running qlever start logs the following in wikidata.server-log.txt, indicating that indexing wasn't done properly:

2024-05-25 05:02:17.333 - INFO: QLever Server, compiled on Thu May 23 14:26:32 UTC 2024 using git hash f9c313
2024-05-25 05:02:17.333 - INFO: Initializing server ...
2024-05-25 05:02:17.334 - ERROR: Could not open file "wikidata.meta-data.json" for reading. Possible causes: The file does not exist or the permissions are insufficient. The absolute path is "/index/wikidata.meta-data.json".

System specification:

Software:

  • Ubuntu 20.04.6 LTS
  • Python 3.10.14 (via conda 23.9.0)
  • qlever==0.5.2

Hardware:

  • Azure Standard NC24ads A100 v4 instance (220GB RAM, 24 vCPUs)
  • SSD disk with enough free space
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant