Software Engineer, AI Gateway
Skills
APIBack-End Web DevelopmentCloud ComputingCloud InfrastructureJavascriptTypescriptAnalytics
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- At least 5+ years of relevant experience
- Strong proficiency in JavaScript/TypeScript
- Experience with backend development APIs and cloud infrastructure
- Experience with AI/ML integrations API gateways distributed systems or high-throughput services
- Experience contributing to or participating in open source projects
- Excellent communication skills and collaborative mindset
Nice to have
- Reliable
- Collaborative
- Open-source minded
- Detail-oriented
Day to day
- Develop and enhance the AI Gateway platform that unifies access to hundreds of AI models from multiple providers.
- Build reliable low-latency systems with rate limiting intelligent failovers and seamless integrations for production AI workloads.
- Collaborate with remote engineers product managers AI researchers and infrastructure teams to improve scalability performance and developer experience.
- Engage with open-source projects and use user feedback and analytics to drive new platform capabilities.