cpp-inference

Here are 6 public repositories matching this topic...

RF-DETR C++ inference engine for object detection and instance segmentation with ONNX Runtime, TensorRT, Executorch and LiteRT support

Tutorial that shows how to train a PyTorch model in Python and run it in C++

opencv deep-learning cpp cnn pytorch mnist image-classification digit-recognition model-deployment libtorch torchscript cpp-inference python-to-cpp

Real-time SAM2 segmentation on edge devices - 40x faster C++ inference with ONNX Runtime for iOS/Android deployment

Fruit classification tensorflow

A lightweight CPU inference runtime implemented in C++20.

cpp inference transformer attention inference-engine cpp20 kv-cache cpp-inference qwen2 qwen2-5 cpp-infrastructure

MiniMind-Next: 全栈轻量级中文大模型实验平台 — 统一全阶段训练/对齐流水线、零依赖原生 C++ 推理引擎与中英双语文档

nlp reinforcement-learning deep-learning cpp pytorch transformer chinese-nlp lora ppo sft dpo cpp-inference llm grpo minimind

To associate your repository with the cpp-inference topic, visit your repo's landing page and select "manage topics."