Senior Software Engineer

CORE PROFILE

Reporting to the Enterprise AI Manager, the Senior AI Engineer will be responsible for architecting, building, and deploying production-grade AI systems that leverage large language models (LLMs) and agentic architectures to automate enterprise processes. The role focuses on designing reliable agent systems, building evaluation frameworks for LLM outputs, and

integrating AI capabilities with enterprise platforms (n8n, AWS services), with emphasis on production reliability, governance, and BSP regulatory compliance.

Unlike a traditional ML Engineer who trains models from scratch, this role emphasizes deep understanding of how LLMs behave in production, how to architect multi-step agentic workflows that are trustworthy and auditable, and how to guide the broader Enterprise AI team on prompt engineering, tool design, and AI evaluation best practices. The Senior AI Engineer will serve as the team's technical authority on AI/LLM systems and will directly shape Maya's enterprise AI

strategy.

NATURE OF WORK

Agentic AI Solution Design and Development

• Design and build Agentic AI solutions using existing LLMs and integrate them with Enterprise Applications/Systems where applicable.
• Architect multi-step agent workflows with reliable tool/function calling, memory management, error handling, and graceful degradation
• Build and maintain AI solutions for document processing (IDP), process automation, and internal knowledge management using agentic patterns
• Actively participate in coding tasks, including building and deploying AI/ML models into production environments, and integrating solutions within the current tech stack

LLM Evaluation & Reliability Engineering

• Design and implement evaluation frameworks for LLM outputs, including LLM-as-judge patterns, RAGASstyle retrieval evaluations, regression testing for prompt changes, and output reliability scoring
• Build observability and tracing infrastructure for AI systems: cost monitoring, latency tracking, token usage, failure analysis, and audit trails for BSP compliance
• Establish prompt versioning, testing, and governance practices to ensure reproducibility and auditability of AI system behavior

Technical Leadership & Guidance

• Serve as the team's technical authority on LLM behavior, prompt engineering best practices, and agentic system design patterns
• Drive technical improvements within the team, co-mentor developers, and ensure alignment with best practices in AI engineering.

Strategy Implementation

• Translate group-level technical strategies (Agentic AI projects, Enterprise AI MCPs) into actionable implementations across enterprise automation workflows
• Design and maintain Model Context Protocol (MCP) servers and tool schemas that enable reliable AI-toenterprise-system integration
• Promote a Platform-as-a-Service (PaaS) mindset: Building reusable, scalable AI components (prompt templates, evaluation suites, agent blueprints) that the broader Enterprise AI team can leverage

Technology Evaluation

• Conduct technology evaluations for AI tools, frameworks, and models, and recommending the most suitable options with sound cost/performance tradeoffs

AI Governance and Compliance

• Ensure all AI systems produce auditable decision trails that satisfy BSP regulatory requirements and internal InfoSec/CISO standards
• Implement guardrails, content filtering, and safety mechanisms for production LLM systems handling sensitive financial data

REQUIRED QUALIFICATIONS

• Education: Bachelor’s Degree in Computer Science, Engineering, Information Technology, or related field required. Master’s Degree holders in Computer Science, Artificial Intelligence, or related fields preferred.
• Experience: 5+ years in software engineering or AI/ML development, with at least 2 years of hands-on experience building production systems using large language models (LLMs). Demonstrated experience designing agentic AI systems, building LLM evaluation frameworks, and deploying AI services in containerized environments. Experience in regulated industries (banking, finance, insurance) is strongly preferred.
• Technical Skills: Expert-level knowledge of Python and API development. Deep understanding of LLM behavior, prompt engineering, and agentic patterns. Familiarity with evaluation frameworks (RAGAS, LLM-as-judge, custom metrics). Experience with n8n, AWS services, and understanding of Low-Code/No-Code tools is a plus.
• Leadership: Proven ability to serve as a technical authority on AI/LLM systems, guide team members effectively, and contribute directly to development tasks involving agentic AI and enterprise platforms.
• Industry Knowledge: Deep understanding of enterprise AI applications, agentic AI architectures, Model Context Protocol (MCP), and emerging trends in LLM/GenAI-powered automation. Understanding of BSP regulatory requirements and financial services compliance frameworks is a plus.