Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deploy the NLP connector to SaaS users for testing #5652

Closed
nino-filigran opened this issue Jan 23, 2024 · 2 comments
Closed

Deploy the NLP connector to SaaS users for testing #5652

nino-filigran opened this issue Jan 23, 2024 · 2 comments
Assignees
Labels
feature use for describing a new feature to develop solved use to identify issue that has been solved (must be linked to the solving PR)
Milestone

Comments

@nino-filigran
Copy link

nino-filigran commented Jan 23, 2024

Goal of the task is to make the solution avaialble to SaaS users.

@nino-filigran nino-filigran added the feature use for describing a new feature to develop label Jan 23, 2024
@nino-filigran nino-filigran added this to the Release 6.2.0 milestone Jan 23, 2024
@Jipegien Jipegien modified the milestones: Release 6.2.0, Release 6.3.0 Apr 17, 2024
@Jipegien Jipegien changed the title Extract Entity with NLP Extract Entity with NLP: step1 Apr 17, 2024
@SamuelHassine SamuelHassine added filigran team use to identify PR from the Filigran team and removed filigran team use to identify PR from the Filigran team labels Apr 20, 2024
@zerodayace
Copy link

@Jipegien I think the best and easiest way for you to leverage NER (Named Entity Recognition) to extract entities and relations out of unstructured texts is to use AI integration (OpenAI or your custom trained Mistral model).
I already use such an approach before ingestion.
Before I used this approach I tried it with well-known python frameworks with medium good results. After moving to NER with an AI model (First tried OpenAI, then Mistral; stayed at mistral because OpenAI gets to expensive if you run this on random web scraped content) the results were pretty good.
Hope it helps a little.

@Jipegien
Copy link
Member

Yes we are considering this possibility, but in a context of multiple users, it comes rapidly with huge costs and latencies. Results are often not so consistent over time. Thanks :)

@nino-filigran nino-filigran self-assigned this May 29, 2024
@nino-filigran nino-filigran changed the title Extract Entity with NLP: step1 Deploy the NLP connector to SaaS users Sep 25, 2024
@nino-filigran nino-filigran added this to the Release 6.5.0 milestone Sep 25, 2024
@nino-filigran nino-filigran changed the title Deploy the NLP connector to SaaS users Deploy the NLP connector to SaaS users for testing Feb 3, 2025
@SamuelHassine SamuelHassine reopened this Feb 4, 2025
@SamuelHassine SamuelHassine added the solved use to identify issue that has been solved (must be linked to the solving PR) label Feb 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature use for describing a new feature to develop solved use to identify issue that has been solved (must be linked to the solving PR)
Projects
None yet
Development

No branches or pull requests

4 participants