Remote jobs at Xinference

Xinference is an AI inference platform for private LLM deployment, model serving, and self-hosted AI. Run any model on your own infrastructure through a single OpenAI-compatible API. Customers report 40-70% lower inference costs than closed-source model APIs. Data sovereignty is built in. Model weights, inference traffic, and logs stay within your infrastructure. Zero data egress. RBAC, audit logs, and SSO/SAML included. NVIDIA-optimised, validated on H100, A100, and A10G. Xinference supports 300+ models across LLM, embedding, reranking, vision, and audio, including Qwen, DeepSeek, Kimi, and all major model families. Works with vLLM, SGLang, Transformers, MLX, and llama.cpp. Your existing OpenAI-compatible code works with a single base URL change. 9,300+ GitHub stars. Australian-owned. Trusted by teams in financial services, healthcare, and regulated industries across APAC and globally. Xagent is the no-code AI agent platform that turns plain-English descriptions into production-ready agents — connecting 200+ tools, any model, and deploying anywhere. Powered by Xinference.