native-inference

Here are 2 public repositories matching this topic...

RocketWill / ByteWhisperer

Cross-language reference for native inference SDK integration across C++, Python, and C#, focused on FFI, structure layout, buffer ownership, and resource lifecycle.

python windows c-plus-plus csharp ffi pinvoke interoperability ctypes model-deployment onnx openvino sdk-integration native-inference

Updated Aug 9, 2026
C#

propardhu / Quant_test_LLM

Star

Native llama.cpp orchestration for quantized LLM evaluation, drift analysis, and reproducible model comparison.

python performance-analysis quantization model-evaluation model-comparison pydantic apple-silicon typer-cli llm llmops llama-cpp local-ai gguf reproducible-ai inference-evaluation quantization-drift sementic-preservation native-inference

Updated May 31, 2026
Python

Improve this page

Add a description, image, and links to the native-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the native-inference topic, visit your repo's landing page and select "manage topics."

Learn more