AI Engineer
Job Title: AI Engineer
Job Duration: 8+ Months
Job Location: Fully Remote
Job Type: Contract
Responsibilities:
- Build and run production LLM applications end to end, from use case design through to live service – retrieval logic, prompt design, orchestration and the APIs behind them
- Design and implement RAG solutions, including chunking and embedding strategy, vector indexing and retrieval filtering that enforces user entitlements at the data layer
- Establish how answer quality is measured – define evaluation sets, baseline performance before release and re-evaluate after any change to prompt, model or document set
- Take experimental work from data scientists into production, including code review, refactoring for modularity, dependency handling and making it reproducible
- Own the model and prompt lifecycle in MLflow – tracking, registry, versioning, promotion and rollback. Ensure training and inference remain consistent
- Execute promotion of models and use cases into production serving, against a governance approved admission policy
- Deploy AI inference services into OpenShift and Azure with CI/CD pipeline in GitLab, comprehensive monitoring, logging and alerting, and secrets management
- Monitor live AI services into OpenShift and Azure for answer quality, drift, latency and cost, investigate regressions and trace cost increases to their cause
- Work with data scientists, data engineers, platform engineers and business stakeholders to industrialise AI use cases, and support the evolution of the AI ecosystem.
