inference-library

Star

Here are 8 public repositories matching this topic...

TEE-AI / SAI

Star

SDK for TEE AI Stick (includes model training script, inference library, examples)

iot computer-vision cnn quantization inference-library compute-stick low-cost-ai

Updated Feb 15, 2019
Python

yas-sim / openvino-ep-enabled-onnxruntime

Star

Describing How to Enable OpenVINO Execution Provider for ONNX Runtime

deep-learning intel inference inference-engine inference-library onnx onnx-format onnx-backend openvino onnxruntime inference-api openvino-toolkit

Updated Jun 29, 2020
C++

amrmorsey / Latte

Star

Latte is a convolutional neural network (CNN) inference engine written in C++ and uses AVX to vectorize operations. The engine runs on Windows 10, Linux and macOS Sierra.

machine-learning caffe machine-learning-algorithms cnn avx python3 convolution machine-learning-library machinelearning convolutional-networks convolutional-neural-networks weight caffe-prototxt caffe-framework caffemodel inference-engine caffe-windows inference-library cnn-classification

Updated Jun 25, 2018
C++

TianyouLi / Inference-Library-for-JavaScript

Star

Unified JavaScript API for scoring via various DL framework

javascript caffe tensorflow keras scoring inference-library dl-framework

Updated Oct 8, 2018
Jupyter Notebook

loreweaver-xyz / llm-weaver

Star

Rust library managing long conversations with any LLM

rust inference-library llms

Updated Sep 30, 2024
Rust

yas-sim / pyopenvino

Star

Experimental Python implementation of OpenVINO Inference Engine (very slow, limited functionality). All codes are written in Python. Easy to read and modify.