Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add final fc (head) layer to trt engine, tested on cifar10 and ViT-B_16 #388

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

yuanjiechen
Copy link

Hello, thanks for providing this good inference library.
When I use ViT-trt modules, I try to add the fc (head) layer to tensorrt engine and do inference.
I tested the result on cifar10 with ViT-B_16 calibrated model (ft2).
Tensorrt version: 8.4.3.1
Cuda version: 11.6

@byshiue
Copy link
Collaborator

byshiue commented Dec 8, 2022

Hi, yuanjiechen. Thank you for the submission. But we don't plan to modify the example to run on specific task now because we hope to provide a common template which only contains the backbone. And different users can apply this backbone on different tasks like classification and segmentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants