AI Engineer

2 days ago

Georgia, GA, United States Ruby Labs Full-time
Ruby Labs is a leading tech company that creates and operates innovative consumer products. At Ruby Labs we are looking for an AI Engineer (Strong Middle / Senior level) to own and drive the quality, reliability and evolution of our AI systems in production. You will be responsible for end-to-end delivery of AI features, production stability of AI systems, and data-driven experimentation using tools like Langfuse and Cloudflare AI gateway for model routing. Increasingly, this includes agentic, tool-using AI systems: defining clean tool contracts (including MCP-based tools) and orchestrating how AI interacts with internal services, search and background pipelines. The stack is TypeScript end to end: Node.js and Hono services on Cloudflare Workers with Durable Objects and Containers, PostgreSQL, OpenSearch. Models from several providers run behind an AI gateway, with prompts, traces and evaluations in Langfuse. AI Systems Ownership & Feature Delivery Take ownership of major AI features and LLM workflows and deliver them to production within agreed timelines. Own AI output quality, structure and predictability across user-facing AI interactions, with consistent structured output across different LLMs for the same request type. Integrate and orchestrate multiple LLM providers through an AI gateway, managing model selection, fallback strategies and cost optimisation. Design and orchestrate tool-using and agentic AI workflows: clean tool contracts (including MCP-based tools), function-calling interfaces and reliable AI-to-system integrations. Build and maintain multi-step LLM workflows and RAG pipelines (indexing, embeddings, retrieval, re-ranking) for reasoning, context reuse and search. Own prompt management, the release of LLM experiments and Langfuse-based evaluation pipelines: test datasets, LLM-as-a-judge, output scoring. Run A/B tests across models and prompts, analyse the results and present the data-driven impact of AI features and experiments. Code Quality & Production Reliability Write clean, scalable and maintainable TypeScript across the Node.js / Cloudflare Workers stack. Build reliable backend logic for AI systems: request and output validation, error handling, fallback flows for malformed or low-quality model responses, and reliable tool execution. Ensure high code quality through tests (including validation and fallback paths for AI output), code reviews and clear engineering standards. Monitor AI system metrics, quality signals, latency and release health, and resolve production issues with a documented root cause. Document prompt designs, model and routing choices, evaluation results and architectural decisions, so others can pick up the work. 4+ years of backend/fullstack software engineering experience, with production-grade TypeScript/Node.js. 1+ year of AI/LLM systems in production with real users, not only side projects or experiments. Daily use of AI-centred development tools (Claude Code, Cursor or similar). Deep hands-on experience with LLM APIs (OpenAI, Anthropic, Google Gemini or similar) in production: structured output, function calling, streaming, token and cost control. Experience with agentic AI, multi-step orchestration, tool-based workflows (function calling / tool execution) or RAG pipelines (indexing, retrieval, re-ranking). Experience with AI gateways and model routing (OpenRouter, Cloudflare AI Gateway or equivalent). Solid understanding of relational databases (PostgreSQL) and caching (Redis, KV or similar). Exceptional ownership and personal responsibility for engineering quality and delivery. Evaluation frameworks (LLM-as-a-judge, RAGAS) and building test datasets. MCP (Model Context Protocol): building MCP servers/clients or designing tool contracts for AI agents. Background workflow engines (Hatchet, Temporal, Inngest) for high-volume LLM pipelines. Working Python for data science, evaluation scripts, or AI tooling. Ruby Labs operates within the CET (Central European Time) zone. Remote Work Environment: Paid National Holidays: Celebrate and relax on national holidays with paid time off to unwind and recharge. Flexible Independent Contractor Agreement: Benefit from tax advantages, networking opportunities, reduced employment obligations, and the freedom to work from anywhere. Be part of our fast-growing team and seize this excellent opportunity for personal and professional growth After submitting your application, we conduct a thorough review which typically takes 3 to 5 days, but may occasionally take longer due to the volume of applications received. Life at Ruby Labs At Ruby Labs, we move fast, aim high, and expect the same from our team. If you’re hungry to achieve, motivated by impact, and want to grow at the speed of your own ambition, Ruby Labs offers the platform to make it happen. LI-Remote