Generative AI Cloud Operations Engineer: Evinova (AstraZeneca Group)

Evinova is a newly formed subsidiary of AstraZeneca focusing on digital health solutions. You will be part of the ML/AI Ops team, responsible for the operational excellence of LLM-based agent deployments and multi-agent orchestration. This role bridges the gap between research and production-grade AI for clinical trial design and planning.

Key Responsibilities
Agentic Ops: Lead the development and management of GenAI Ops systems for clinical trial optimization.

Pipeline Management: Optimize and scale RAG pipelines and integrate LLM routers (e.g., LiteLLM).

Monitoring & Safety: Integrate platform-level tools for token usage tracking, latency monitoring, and hallucination detection.

Infrastructure: Automate operations using Infrastructure-as-Code (CDK) and CI/CD pipelines within AWS.

Explainability: Ensure all AI predictions are interpretable, safe, and backed by exploratory data analysis.

Qualifications
Essential Experience
GenAI Production: Minimum of 2 years deploying and maintaining Generative AI agents or workflows in production.

Frameworks: Experience with LangChain, LangGraph, LlamaIndex, or Google ADK.

Cloud Expert: Mastery of AWS services and containerization (Docker/Kubernetes).

Infrastructure as Code: Expert in CDK (Python or TypeScript).

Software Engineering: Strong proficiency in Python or TypeScript.

Specialized Skills
Eval Tools: Expert in LLM evaluation tools like Arize Phoenix, Langfuse, Braintrust, or Freeplay.

Vector DBs: Familiarity with Pinecone or Weaviate.

Observability: Proficiency with Grafana, Prometheus, or Splunk.

Regulatory Knowledge: Understanding of GxP (Good Clinical Practice) and GMLP (Good Machine Learning Practice) is a plus.