New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Document type and github loader #172

Open

matthusby wants to merge 2 commits into brainlid:main from matthusby:add-github-data-loader

+257 −0

Contributor

matthusby commented Aug 25, 2024

This is a proof of concept, I did a quick dump of how I thought this should work.

Add LangChain.Document module, which provides a structured way to handle documents with content, metadata, and type attributes.

Add LangChain.Document.Loaders.Github module to support fetching issues from a specified repository, converting them into Document structs.

gh = LangChain.Document.Loaders.Github.new!()
docs = LangChain.Document.Loaders.Github.load(gh, %{type: :issue, repo: "brainlid/langchain"}

matthusby added 2 commits

August 25, 2024 16:49


          Document type and github loader

7abcda1


          I lost some alias's somewhere :-)

80f0a22

Owner

brainlid commented Nov 22, 2024

Nice @matthusby! You describe this as a PoC. Is there anything else you think it needs or is lacking?

Would you be willing to write tests for the lib/document/loaders/github.ex file?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet