How Remoteville checks and expires listings
What the job involves
The main requirements, responsibilities and hiring steps.
Requirements
- 3+ years of professional Python experience in production services
- 1+ years of hands-on LLM production experience including prompt engineering tool calling structured outputs or RAG
- Working knowledge of LangChain LangGraph or comparable agent framework
- Experience with LLM observability tools such as CloudWatch LangSmith Langfuse MLflow or OpenTelemetry
- Experience designing evaluation frameworks such as MLflow DeepEval LLM-as-judge or multi-turn regression
- Fluency with Git Docker and modern API frameworks
- Clear written communication and sound judgment on shipping readiness
Nice to have
- Hands-on with Amazon Bedrock
- Hands-on with AgentCore
- Snowflake or Snowpark experience
- Snowflake Cortex familiarity
- Multi-agent pattern knowledge
- Strong pushback on unnecessary agents
- Loyalty MarTech or AdTech domain experience
Day to day
- Build agent harnesses in Python using LangChain and LangGraph to power production workflows.
- Package agents for Amazon AgentCore with the right context tools skills and subagents for reliable deployment.
- Write integrations for APIs and Snowflake SQL retrieval while adding validation and structured outputs.
- Design evaluation harnesses and guardrails to improve reliability reduce hallucinations and protect sensitive data.
- Monitor shipped systems fix issues quickly and iterate with teammates on evolving engineering patterns.