Skip to content

Issues: uptrain-ai/uptrain

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
42 Open 106 Closed
42 Open 106 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add an operator to compute MMLU score enhancement New feature or request
#557 opened Feb 23, 2024 by Dominastorm
1
Add perplexity evaluation operator enhancement New feature or request
#276 opened Jun 27, 2023 by sourabhagr
@MohammedYaseen97
4
Human-in-the-loop operator to capture feedback from human response enhancement New feature or request
#277 opened Jun 27, 2023 by sourabhagr
Why not use ContextWindowExceedError instead?
#372 opened Sep 25, 2023 by krrishdholakia
Why set request timeout just for OpenAI?
#373 opened Sep 25, 2023 by krrishdholakia
3
Langchain & Langsmith integration for UpTrain enhancement New feature or request
#388 opened Oct 23, 2023 by sourabhagr
4
Add check for content coherence across long form blogs enhancement New feature or request good first issue Good for newcomers new use-case Example to showcase new use-case
#452 opened Jan 3, 2024 by sourabhagr
Update UpTrain Documentation - how to configure evaluator LLM enhancement New feature or request
#501 opened Feb 2, 2024 by sourabhagr
Create a Use Case Example enhancement New feature or request good first issue Good for newcomers
#522 opened Feb 13, 2024 by Dominastorm
Fix the schema for conversation evals enhancement New feature or request
#530 opened Feb 19, 2024 by sourabhagr
Add tests for checking if all the language evals are working fine or not good first issue Good for newcomers
#531 opened Feb 19, 2024 by sourabhagr
Modularize the operators enhancement New feature or request
#532 opened Feb 19, 2024 by Dominastorm
Dynamically join Buckets in data drift clustering enhancement New feature or request
#255 opened May 15, 2023 by sourabhagr
Add tests for checking if all the managed evals are working fine or not enhancement New feature or request
#533 opened Feb 19, 2024 by sourabhagr
Support for LLMs hosted on AWS Bedrock enhancement New feature or request
#589 opened Mar 6, 2024 by bithikaj
2
New Project missing .jsonl file will not indicate it as a required file on Safari bug Something isn't working
#600 opened Mar 7, 2024 by cfrenchi
@sanchitadev
1
Creating a New Project with a bad key results in null values bug Something isn't working
#601 opened Mar 7, 2024 by cfrenchi
@sanchitadev
1
No warning when creating a New Project with the same name bug Something isn't working
#602 opened Mar 7, 2024 by cfrenchi
4
Mamba Integration enhancement New feature or request
#604 opened Mar 8, 2024 by Dominastorm
Add an operator to compute MT-Bench enhancement New feature or request
#605 opened Mar 8, 2024 by Dominastorm
1
Too many values to unpack (resp_text.split) bug Something isn't working
#615 opened Mar 11, 2024 by lbux
3
Support for LLMs running on Vertex AI enhancement New feature or request
#641 opened Mar 17, 2024 by verdverm
1
Return tokens count/cost for checks enhancement New feature or request
#656 opened Mar 20, 2024 by ssaha1567
1
Azure LLM evaluation - Deployment Error bug Something isn't working
#682 opened Apr 9, 2024 by meenusel
8
Github Security Lab Vulnerability
#741 opened Sep 27, 2024 by Kwstubbs
ProTip! Updated in the last three days: updated:>2025-01-29.