Skip to content

Issues: airockchip/rknn-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

78 Open 70 Closed
78 Open 70 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

gradio_server 出现问题
#150 opened Dec 31, 2024 by yikexiaoxing
3
Qwen2VL - Cannot allocate memory
#149 opened Dec 29, 2024 by ZlodeiBaal
3
Phi-4 Conversion Failure
#148 opened Dec 25, 2024 by c0zaut
1
Request for Qwen 7B support
#147 opened Dec 24, 2024 by onestepbackk
10
Feature Request: Larger Context Length
#144 opened Dec 17, 2024 by c0zaut
5
Ubuntu 20.04，设置了 export RKLLM_LOG_LEVEL=1，但是仍然无法看到推理性能日志输出。
#140 opened Dec 14, 2024 by Tang-JingWei
能否支持GPT2，谢谢
#137 opened Dec 12, 2024 by Mactarvish
模型转换问题及模型支持相关
#136 opened Dec 10, 2024 by tank1530532
4
多模态大模型推理问题。
#134 opened Dec 9, 2024 by waterpeople
2
error with libthread_db.so.1
#133 opened Dec 9, 2024 by secreat14
ERROR: Not support OpenVLAForActionPrediction!
#130 opened Dec 4, 2024 by ZackPu
E RKNN: [08:48:14.826] invalid rknn llm model magic E RKNN: [08:48:14.826] load model file error!
#129 opened Dec 4, 2024 by huochen1
9
Request for compatibility/ability to do self-conversion/customization with newer LLMs
#127 opened Dec 3, 2024 by biti-en
7
[BUG] 在ipython或者notebook中 import 工具包时报错: NameError: name 'exit' is not defined
#125 opened Nov 27, 2024 by killa1218
2
运行rkllm的ekllm_api_demo报错../sysdeps/unix/sysv/linux/wait4.c: 没有那个文件或目录.
#124 opened Nov 26, 2024 by secreat14
1
RK3588推理Qwen2-Audio, 在输入序列较长时rkllm_run()段错误
#123 opened Nov 25, 2024 by happyme531
1
能创建一个python3.11在arm64上跑的rknn-llm-toolkit的whl吗？
#122 opened Nov 25, 2024 by quhanj
1
模型转换报错： Catch exception when loading dataset
#121 opened Nov 15, 2024 by sdrzmgy
1
更新驱动v1.1.0时报错！内核是6.1.57
#120 opened Nov 14, 2024 by quhanj
1
GGML_ASSERT(view_src == NULL || data_size == 0 || data_size + view_offs <= ggml_nbytes(view_src)) failed
#119 opened Nov 14, 2024 by sdrzmgy
5
Not support ChatGLMForConditionalGeneration!
#117 opened Nov 10, 2024 by qin-yuhao
2
最新版本驱动0.9.8，多种大模型问答效果很差
#116 opened Nov 9, 2024 by Royaler
4
rkllm_run()阻塞问题
#114 opened Nov 7, 2024 by lzw12138
Build model failed!模型构建失败！Optimizing model直接Killed
#112 opened Nov 6, 2024 by xiangzhangpang
9
rkllm_api_demo run GGML_ASSERT fail
#111 opened Nov 6, 2024 by zoomtechjwq
1
ProTip! Mix and match filters to narrow down what you’re looking for.