#onnx
Artwork: Shoes by Vincent van Gogh. The Metropolitan Museum of Art · Public domain
Machine LearningWiring ONNX Runtime GenAI into a LangChain RAG Pipeline
Part two: a custom LangChain LLM wrapper over ONNX Runtime GenAI, streaming token generation, and building an optimized Phi-3 ONNX graph for offline Windows RAG.
Artwork: Man in a Turban by Rembrandt. The Metropolitan Museum of Art · Public domain
Machine LearningChoosing an On-Prem SLM Inference Engine for Windows
How we benchmarked ONNX Runtime GenAI, LlamaCPP, Hugging Face Optimum, and Triton to run a sub-5-second RAG pipeline offline on Windows.