#windows
Artwork: Shoes by Vincent van Gogh. The Metropolitan Museum of Art · Public domain
Machine LearningWiring ONNX Runtime GenAI into a LangChain RAG Pipeline
A small LangChain adapter can run ONNX Runtime GenAI locally, but deployment performance depends on building and shipping the optimized Phi-3 graph instead of loading a raw export.
Artwork: Man in a Turban by Rembrandt. The Metropolitan Museum of Art · Public domain
Machine LearningChoosing an On-Prem SLM Inference Engine for Windows
ONNX Runtime GenAI was the practical default for offline Phi-3 inference on Windows: it led throughput and latency, stayed under five seconds, and avoided custom builds or Docker.