Skip to content

Issues: airockchip/rknn-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
78 Open 70 Closed
78 Open 70 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

update
#1 opened Mar 15, 2024 by SoulProficiency updated Mar 15, 2024
Improve Work Need To Be Done
#8 opened Mar 29, 2024 by fydeos-alex updated Mar 29, 2024
RKLLMParam max_context_len Maximum supported length
#11 opened Apr 3, 2024 by jun-zhang updated Apr 3, 2024
benchmark data
#9 opened Apr 2, 2024 by WangFengtu1996 updated Apr 3, 2024
3
Low-Level Code Request
#13 opened Apr 3, 2024 by fydeos-alex updated Apr 3, 2024
Expection while converting model
#18 opened Apr 11, 2024 by dic1911 updated Apr 12, 2024
4
E RKNN: [10:27:30.619] failed to allocate handle, ret: -1, errno: 14, errstr: Bad address Segmentation fault (core dumped)
#4 opened Mar 27, 2024 by fydeos-alex updated Apr 15, 2024
15
rk3588s 配置和支持模型的规模
#22 opened Apr 17, 2024 by AACengineer updated Apr 17, 2024
能否用在3566部署？
#23 opened Apr 18, 2024 by Gooddz1 updated Apr 18, 2024
1
rk3588 ubuntu kernel版本为5.10 替换npu 代码后编译报错
#24 opened Apr 18, 2024 by Caical updated Apr 24, 2024
2
编译内核时报错
#6 opened Mar 27, 2024 by sdrzmgy updated Apr 27, 2024
3
Is the performance bottleneck of rknn llm in the CPU？
#29 opened Apr 26, 2024 by Caical updated Apr 30, 2024
4
模型可视化、推理性能评估
#34 opened May 7, 2024 by AACengineer updated May 7, 2024
rknn_init failed
#31 opened May 1, 2024 by YanxingLiu updated May 9, 2024
1
模型转换内存需求过大
#30 opened Apr 30, 2024 by YanxingLiu updated May 10, 2024
6
Qwen1.5-0.5B模型两次回答不一致
#37 opened May 10, 2024 by AACengineer updated May 11, 2024
10
Let's talk about converting and runtime 我们来谈谈转换和运行时
#42 opened May 11, 2024 by 80Builder80 updated May 11, 2024
将来是否会支持 moe 模型
#45 opened May 13, 2024 by YanxingLiu updated May 13, 2024
LLM models have bad output
#46 opened May 14, 2024 by kalous12 updated May 15, 2024
9
Procedure and Model Validation（程序和模型验证）
#48 opened May 18, 2024 by kalous12 updated May 18, 2024
Phi-3 error
#32 opened May 2, 2024 by dnhkng updated May 19, 2024
10
Specific Token Appeared in Response
#55 opened May 23, 2024 by fydeos-alex updated May 23, 2024
how to uninstall the rkllm latest (1.0.1) to install the old one (1.0.0)
#57 opened May 30, 2024 by thanhtantran updated May 30, 2024
1
orangepi@orangepi5:~/rknn-llm-main/rkllm-runtime/example/build/build_linux_aarch64_Release$ taskset f0 ./llm_demo ./qwen.rkllm rkllm init start E RKNN: [07:37:38.389] failed to convert handle(1020) to fd, ret: -1, errno: 24, errstr: Too many open files Segmentation fault (core dumped)
#26 opened Apr 19, 2024 by lindsayshuo updated May 30, 2024
3
Instructions?
#58 opened Jun 2, 2024 by mtwlz updated Jun 2, 2024
ProTip! no:milestone will show everything without a milestone.