Skip to content

Issues: citadel-ai/langcheck

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

24 Open 15 Closed
24 Open 15 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Jailbreak template augmentation with custom jinja templates
#178 opened Feb 7, 2025 by liwii
2
Support Azure AI Foundry
#177 opened Feb 7, 2025 by liwii
@liwii
Support more EvalClient formats based on LLM APIs
#176 opened Feb 7, 2025 by liwii
16 tasks
5
Multimodal (Vision) support
#175 opened Feb 7, 2025 by liwii
1
Let users access the prompt & score_map objects of the built-in eval client metrics
#149 opened Sep 6, 2024 by liwii
Improve the stability of metrics by repeated queries
#127 opened Jun 26, 2024 by liwii
Follow up use_async option
#105 opened Mar 26, 2024 by Alnusjaponica
1
Split LangCheck into language-specific packages such as langcheck[ja], langcheck[de], etc
#88 opened Feb 19, 2024 by kennysong
4
Document maximum allowed input lengths for each metric
#85 opened Feb 8, 2024 by yosukehigashi
Improve testing of installation on different machines and python base images
#80 opened Jan 25, 2024 by yosukehigashi
Consider computing German fluency without translating to English
#78 opened Jan 21, 2024 by ischender
Specify langcheck.__version__
#74 opened Dec 11, 2023 by kennysong
Pin versions for HuggingFace models
#71 opened Dec 9, 2023 by kennysong
@ThanhChinhBK
5
Add docstrings for object properties so they show up in documentation
#68 opened Dec 6, 2023 by kennysong
Create langcheck.utils.detect_language()
#67 opened Dec 6, 2023 by syamaco
7
Allow metrics to run on GPU
#63 opened Dec 5, 2023 by kennysong
Eliminate unexpected spaces introduced before periods by TreebankWordDetokenizer().detokenize().
#62 opened Dec 5, 2023 by Alnusjaponica
Fix documentation page title for MetricValue
#41 opened Nov 8, 2023 by kennysong
Add "refusal to answer" metric
#24 opened Oct 17, 2023 by kennysong
2
Installing tensorflow breaks the transformers library in test_factual_consistency()
#11 opened Oct 10, 2023 by kennysong
2
Introduce 係り受け解析 (Dependency Analysis) - based Japanese reading ease scores
#10 opened Oct 10, 2023 by kennysong
Refactoring of common parts in ja/ and en/
#9 opened Oct 10, 2023 by kennysong
Add interactive=False parameter to plotting functions
#8 opened Oct 10, 2023 by kennysong
6
Store exception messages in EvalValue
#1 opened Oct 10, 2023 by kennysong
ProTip! Add no:assignee to see everything that’s not assigned.