Loading...

Senior-AI-Engineer, AI-Engineer, Machine-Learning-Engineer Jobs

Explore career opportunities in Senior-AI-Engineer, AI-Engineer, Machine-Learning-Engineer

Skip to main content

Senior AI Engineer

AllCares

**
United States
Full Time
Posted 6 days ago

Senior AI Engineer

Apptopia is seeking a Senior AI Engineer to join our dynamic, data-driven team at a high-growth startup backed by powerhouse investors like Mark Cuban and ABS Capital. We specialize in providing actionable competitive intelligence to investment firms and financial institutions by estimating worldwide downloads, revenues, and active users for every mobile app. We also provide a unique, highly valued product with app user behavior insights. Our actionable app-store data and intuitive business intelligence tool help companies like Google, Facebook, and top hedge funds make smarter decisions.

Apptopia is hiring a Senior AI Engineer to lead our push into LLMs, agentic systems, and AI-driven product innovation.

You’ll design and build intelligent systems that combine LLM reasoning, structured data, and tool orchestration—shaping how we use AI across our product and company.

Responsibilities

- You will be a Senior AI Engineer on the Product team where you will work on incorporating LLM powered systems into new data products, advance our existing products and help shape Apptopia’s long term AI strategy.

- You will spearhead efforts to incorporate LLM powered systems as we bring new finance focused products to market

  • Design and implement agentic workflows that combine LLM reasoning, structured data, and external tools to accelerate new product delivery
  • Experiment with multi-step reasoning systems, RAG, tool orchestration, and emerging paradigms to improve analyst workflows
  • Design, develop, and implement machine learning algorithms to advance a broad set of use cases including app usage trend forecasting, consumer behavior prediction,, stock price movement estimation, user segmentation

- You will take part, and in many cases lead the thought process for improving core modeling efforts:

  • Identify opportunities to extend existing modeling work into AI-native systems that integrate predictions, reasoning, and automation
  • Identify opportunities to augment core datasets with LLM-derived features, classifications, and insights
  • Research, identify, and test ensemble methodologies to continuously improve accuracy and coverage in our models used for core app usage estimates

- You will be a key thought leader in development of our AI platform and infrastructure: ○ Contribute to the design of internal AI platforms that enable teams to leverage LLMs at scale

  • Lead rapid experimentation cycles to evaluate new LLM capabilities, architectures, and vendors
  • Define frameworks for evaluating LLM quality, reliability, and cost-performance tradeoffs
  • Partner with product and engineering to take ideas from 0 → production
  • Help define best practices for prompting, memory, tool use, and system architecture

Required Qualifications

  • 5+ years in data science, ML, data engineering, or applied AI
  • Experience building production ML systems end-to-end
  • Hands-on experience with LLMs (OpenAI, Anthropic, Bedrock, etc.)
  • Experience with RAG, tool use, or agentic systems
  • Strong Python + experience with APIs and cloud (AWS preferred)
  • Databricks tooling experience preferred
  • Comfortable with ambiguity and fast experimentation cycles
  • Familiarity with click stream, app usage, and/or observational panel data preferred

Originally posted on Himalayas

Senior AI Engineer (Python)

Miratech

**
United States
Full Time
Posted 8 days ago

Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US Healthcare client. You will play a key role in developing and enhancing an enterprise AI platform that enables intelligent workflows, conversational experiences, and AI-powered automation across multiple business functions. This is an exciting opportunity to work with cutting-edge agentic AI architectures, build scalable AI solutions, and collaborate with a high-performing engineering team to accelerate innovation and business impact.

Responsibilities

  • Develop and enhance AI agents and orchestration capabilities using Python, LangGraph, and LangChain.
  • Build and extend AI-enabled guided workflows and automation capabilities.
  • Design, develop, and optimize conversational AI and chat-based experiences.
  • Implement agent planning, orchestration, memory, tool-calling, and response-generation capabilities.
  • Integrate AI agents and applications with enterprise systems, services, and APIs.
  • Support modern AI integration frameworks and agent communication patterns.
  • Implement AI observability, monitoring, telemetry, and performance tracking capabilities.
  • Collaborate closely with engineering teams and stakeholders to accelerate platform development and business use case delivery.
  • Troubleshoot technical challenges, improve solution reliability, and drive continuous platform enhancements.
  • Contribute to architecture discussions, best practices, and the adoption of scalable AI engineering standards.
  • 8+ years of hands-on experience in Software Engineering and enterprise application development.
  • 4+ years of experience in Python development.
  • 2+ years of hands-on experience with LangGraph, including agent workflows, stateful orchestration, multi-agent systems, and AI-driven execution flows.
  • 2+ years of experience with LangChain, including building LLM-powered applications, tool integrations, retrieval-augmented generation (RAG), and workflow automation.
  • Strong understanding of agentic AI concepts, including AI agents, planning, orchestration, memory management, and tool-calling frameworks.
  • Experience building and deploying production-grade Generative AI applications and solutions.
  • Experience integrating AI applications with enterprise platforms, backend services, and APIs.
  • Experience designing and implementing conversational AI and chat-based applications in production environments.
  • Familiarity with AI observability, monitoring, telemetry, and evaluation platforms.
  • Strong knowledge of software engineering best practices, testing, debugging, and performance optimization.
  • Experience working in Agile development environments and collaborating with cross-functional teams.
  • Excellent problem-solving, communication, and stakeholder management skills.

Nice to Have

  • Hands-on experience with Model Context Protocol (MCP) and Agent-to-Agent (A2A) communication.
  • Experience building and deploying multi-agent AI solutions in production.
  • Experience implementing Retrieval-Augmented Generation (RAG) architectures and knowledge-based AI systems.
  • Experience working with vector databases and semantic search technologies.
  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Experience working on centralized AI platforms supporting multiple business functions and use cases.
  • Exposure to healthcare or other highly regulated enterprise environments.

We offer:

  • Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
  • Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
  • Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
  • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.

* Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other protected status under applicable law.

Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of Miratech's engagements to succeed by meeting or exceeding our scope, schedule, and/or budget objectives since our inception in 1989.
Miratech has coverage across 5 continents and operates in over 25 countries around the world. Miratech retains nearly 1000 full-time professionals, and our annual growth rate exceeds 25%.

Originally posted on Himalayas

Senior AI Engineer (with Python, LangGraph & LangChain)

Miratech

**
United States
Full Time
Posted 10 days ago

We are looking for a highly skilled, hands-on Senior AI Engineer with Python, LangGraph & LangChain to join our client's enterprise AI initiative. You will work closely with the existing engineering team to enhance a centralized AI orchestration platform that supports intelligent workflows, AI-powered chat and proactive assistance across multiple business use cases.

This role suits an engineer with strong practical experience in Python, LangGraph and LangChain, and a solid understanding of agentic AI architectures, integration patterns and AI observability. You will contribute directly to design, development, integration and delivery to accelerate the platform roadmap.

Responsibilities:

  • Develop and enhance AI agents and orchestration capabilities using Python, LangGraph and LangChain.
  • Build and extend AI-enabled guided workflows within the platform.
  • Contribute to the development of conversational AI and chat-based experiences.
  • Implement agent planning, orchestration, tool invocation and response-synthesis capabilities.
  • Integrate AI agents with enterprise backend systems and services.
  • Support integration patterns using the Model Context Protocol (MCP) and Agent-to-Agent (A2A) communication.
  • Work with AI observability and telemetry capabilities, including Arize.
  • Collaborate closely with existing engineers and subject-matter experts to accelerate core platform development and business use case delivery.
  • Troubleshoot technical issues, improve solution reliability and support continuous enhancement of AI capabilities.
  • Strong hands-on Python programming and application development experience.
  • Practical experience with LangGraph, building agent workflows, stateful orchestration and AI-driven execution flows.
  • Experience developing LLM-powered applications with LangChain, including integrating tools and external services.
  • Solid understanding of agentic AI: AI agents, planning, orchestration and tool-calling patterns.
  • Experience integrating applications with backend services and enterprise systems through APIs.
  • Familiarity with Arize or comparable AI observability and telemetry platforms.

Nice to have:

  • Hands-on experience with the Model Context Protocol (MCP) and Agent-to-Agent (A2A) communication.
  • Experience building conversational AI or chat-based experiences in production.
  • Experience working on a shared, centralized AI platform that serves multiple business use cases.

We offer:

  • Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
  • Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
  • Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
  • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.

* Miratech is an equal opportunity employer and does not discriminate against any employee or applicant for employment on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other protected status under applicable law.

Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of Miratech's engagements to succeed by meeting or exceeding our scope, schedule, and/or budget objectives since our inception in 1989.
Miratech has coverage across 5 continents and operates in over 25 countries around the world. Miratech retains nearly 1000 full-time professionals, and our annual growth rate exceeds 25%.

Originally posted on Himalayas

Senior AI Engineer

Eleven

**
United States
Full Time
Posted 13 days ago

We Move Fast, Think on Our Feet, and Have Fun Doing It!

At Eleven, we thrive on solving complex challenges and pushing boundaries. We work at a rapid pace, embracing change, and staying laser-focused on delivering exceptional value to our customers.

We’re looking for visionary problem-solvers who excel in dynamic environments, embrace AI tools in streamlining work processes, adapt quickly, and drive innovation. If you love thinking outside the box, collaborating with top-tier talent, and having fun while making an impact—let’s talk!

Position Overview:

This role is a dual-focus technical leadership position within our Engineering organization: leading company-wide AI productivity initiatives and contributing as a senior software engineer to our core product. You will design, build, and maintain AI-powered workflows and tools that accelerate delivery and raise quality across engineering and other departments. You will develop and execute training strategies that bring all employees along in adopting AI effectively and securely. This role contributes to a globally distributed SaaS platform used around the world to effortlessly and securely connect guests and residents (and all their devices) to the internet with an at-home Wi-Fi experience. Our platform serves a variety of markets. From hotels and multi-family residences to campgrounds and college campuses, every day, tens of millions of people benefit from the services we provide.

As a Senior AI Engineer, you will stay at the cutting edge of AI technology, evaluate and introduce new tools and patterns to the organization, champion security-first practices in a rapidly evolving AI landscape, and continue to contribute hands-on to the development of our cloud-native platform.

Reporting Relationships:

This role reports to a Senior Engineering Manager and has no direct reports. Provides AI and technical leadership across all engineering teams and partners with other departments on AI adoption initiatives.

Essential Job Functions & Core Responsibilities:

AI Leadership & Productivity

  • Design, build, and maintain AI-powered workflows, tools, and automation that improve productivity, code quality, and operational efficiency across engineering and other departments
  • Evaluate, prototype, and introduce cutting-edge AI technologies, frameworks, and patterns (including agentic AI, LLM orchestration, and multi-step reasoning) into company workflows
  • Develop and execute AI training strategies and enablement programs for employees across the organization, ensuring teams can effectively and responsibly adopt AI tools
  • Establish and maintain security guardrails, governance policies, and best practices for AI usage company-wide, accounting for the rapidly evolving threat and compliance landscape
  • Stay continuously informed on advancements in AI/ML tooling, foundation models, and development practices—serving as the organization's subject matter expert and go-to resource
  • Manage AI-related vendor and tech partner relationships, evaluating tools and platforms for fit, security, and cost-effectiveness

Core Product Engineering

  • Architect, design, and implement scalable, secure cloud-native solutions on AWS that handle high transaction volumes across multi-tenant environments
  • Work closely with the lead architect and other principal and senior engineers to lead technical strategy and provide architectural guidance across multiple engineering teams and projects
  • Champion security-first development practices, ensuring sensitive data handling meets compliance and industry standards across all services
  • Drive end-to-end solution ownership—from requirements and architecture through implementation, deployment, and operational excellence
  • Mentor and develop engineers at all levels, fostering a culture of technical excellence, continuous learning, and innovation
  • Lead cross-functional initiatives and projects, collaborating with product management, UX, and engineering leadership to deliver business outcomes
  • Design and maintain event-driven, serverless architectures using AWS services (Lambda, DynamoDB, EventBridge, API Gateway, Step Functions, etc.)
  • Establish and evolve engineering standards, patterns, and best practices that scale with the organization
  • Identify and incorporate security requirements throughout the software development lifecycle
  • Lead software and infrastructure optimization efforts that translate directly into reduced cloud spend and operational costs
  • Work within Agile methodology with two-week sprints
  • Participate in on-call rotation
  • Other duties as assigned

Working Conditions:

This role routinely uses standard office equipment such as computers, phones, and printers. This job operates remotely, in a home office environment, with occasional travel for team meetings or company offsites.

Physical Demands:

Remains in a stationary position for extended periods of time. This role routinely uses standard office equipment such as computers, cell phones, computer mouse and computer monitor. For remote office setup; places, moves, installs, replaces and hooks up technology equipment that may weigh up to 20 pounds. Communicates complex information effectively to clients and co-workers via telephone, video, or email.

Candidate Requirements

Must Have:

  • 8+ years of professional software engineering experience
  • 3+ with demonstrated leadership in AI adoption and tooling
  • Proven hands-on experience building AI-powered workflows, developer tools, or automation systems that delivered measurable productivity gains across teams or organizations
  • Deep understanding of the current AI/ML landscape—foundation models, agentic AI patterns, LLM orchestration, tool use, and multi-step reasoning—with the ability to translate rapidly evolving capabilities into practical, secure solutions
  • Experience developing and delivering AI/technical training programs, workshops, or enablement initiatives for technical and non-technical audiences
  • Strong security awareness in the context of AI—understanding risks around data leakage, prompt injection, model misuse, and compliance implications of AI tool adoption
  • Deep expertise in AWS cloud services with hands-on experience designing and operating complex serverless and event-driven architectures
  • Strong proficiency in two or more object-oriented programming languages
  • Experience with both relational and NoSQL databases, such as MS SQL Server, DynamoDB, and OpenSearch
  • Proven experience building and operating high-transaction, low-latency backend systems at scale
  • Demonstrated experience handling sensitive data in multi-tenant SaaS environments with a security-first mindset (encryption, access control, data isolation, compliance)
  • Track record of end-to-end ownership of large-scale solutions—not just contributing to a piece, but driving the full architecture from design through production
  • Experience with RESTful API design and event-driven integration patterns
  • Proven experience shipping product as part of an Agile team
  • Strong desire to help a successful company scale existing cloud-based services while also being a significant contributor to the development of new products
  • Excellent communication skills with the ability to translate complex technical concepts for diverse audiences
  • A collaborative, energetic team player with a genuine willingness to help others, a proactive attitude, and a natural curiosity for learning and adopting new technologies

Strongly Preferred:

  • Experience with data lake architectures and BI tooling (e.g., AWS Athena, QuickSight, Redshift, Glue)
  • Experience with storage architectures
  • Hands-on experience implementing CI/CD pipelines—not just using them, but designing and building deployment infrastructure using tools such as Kraken, CloudFormation, CDK, or similar IaC frameworks
  • Database administration experience or backup DBA capacity across various database engines (relational, NoSQL, in-memory)
  • AWS certification(s) (Solutions Architect, Developer, Security Specialty, or Machine Learning Specialty preferred)
  • Bachelor's degree in related field

Candidates for this role, must be based in the United States and legally eligible to work for any US employer. Eleven is not able to sponsor candidates at this time.

Eleven is a remote work employer and offers a comprehensive compensation and benefits package; our benefits package includes medical, dental and vision coverage, 401(k) plan, and an attractive paid time off policy. The base salary range for this job in all geographic locations in the United States is $160,000- $185,000. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills, and geography.

Equal Employment Opportunity Statement

Eleven provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Reasonable Accommodations are available upon request for candidates with disabilities participating in any stage of the application, interviewing, or hiring process, as well as to perform essential job functions, please direct your inquiries to .

Salary: $160,000-$185,000

Originally posted on Himalayas

Senior AI Engineer

Sedgwick

**
United States
Full Time
Posted 15 days ago

By joining Sedgwick, you'll be part of something truly meaningful. It’s what our 33,000 colleagues do every day for people around the world who are facing the unexpected. We invite you to grow your career with us, experience our caring culture, and enjoy work-life balance. Here, there’s no limit to what you can achieve.

Newsweek Recognizes Sedgwick as America’s Greatest Workplaces National Top Companies

Certified as a Great Place to Work®

Fortune Best Workplaces in Financial Services & Insurance

Senior AI Engineer

Remote role open to all U.S. states.


ESSENTIAL FUNCTIONS AND RESPONSIBILITIES

  • Owns a build stream end to end within a pod: problem shaping with the Principal, implementation, production operation, and instrumentation of the outcome the business said it would measure.
  • Designs, builds, and operates production Generative AI agents, workflows, and applications — including request orchestration, tool execution, state management, and interaction with enterprise systems.
  • Develops full-stack software in Python and React, shipping both the service and the interface a business user touches.
  • Owns deployment and operation on AWS, with infrastructure as code in Terraform and CI/CD in GitHub Actions, including environments, secrets, and repeatable promotion to production.
  • Implements evaluation, observability, and human-in-the-loop controls for AI systems: provenance on material outputs, confirmation on consequential claims actions, and evidence that a workflow is ready to move up the autonomy ladder.
  • Implements authentication, authorization, logging, monitoring, and error handling to meet enterprise security, auditability, PHI, and reliability requirements.
  • Integrates AI services with enterprise and legacy systems — including APIs, data platforms, and event streams — using approved, non-invasive patterns and versioned contracts.
  • Stewards a shared capability as assigned (context, documents, agents, or assurance), with authority to block a duplicate build in another pod.
  • Embeds with vendor delivery teams for co-development when the stream requires it: shared repositories in Sedgwick accounts, shared definition of done, not acceptance testing after a demo.
  • Sits with examiners, nurse reviewers, or operations staff; watches the work; and turns that into scoped services, workflows, and UI changes.
  • Provides technical guidance and mentoring to Junior AI Engineers, promoting engineering standards, code quality, and operational excellence.
  • Troubleshoots and leads root cause analysis and performance optimization for latency, throughput, cost, correctness, and reliability of production AI services.
  • Evaluates and recommends improvements to architecture, platform capabilities, and engineering process for the stream and the shared substrate.

ADDITIONAL FUNCTIONS AND RESPONSIBILITIES

  • Performs other duties as assigned.
  • Travel as required, including on-site work with claims or Managed Care operations and with vendor delivery teams.

QUALIFICATIONS


Education & Licensing

Bachelor’s degree in Computer Science, Engineering, or a related quantitative discipline from an accredited college or university required.

Master’s degree preferred.

Experience


Six (6) + years of software engineering experience, with at least three (3) years shipping production Generative AI agents, workflows, or applications — including evaluation, failure handling, and a human review loop — or an equivalent combination of education and experience.

Hands-on experience building and operating production workloads on AWS required. Cloud certification without production ownership is not sufficient.

Hands-on experience with Python, React, GitHub Actions, and Terraform required, including ownership of CI/CD and infrastructure rather than editing templates.

Experience embedding with business users or a vendor delivery team to co-develop, rather than receiving a completed specification, preferred.

Experience in insurance, claims, healthcare, or another heavily regulated operational domain preferred.


Skills & Knowledge

  • Strong full-stack engineering skills in Python and React, with solid working knowledge of SQL, REST APIs, and service design
  • Hands-on AWS: has built, deployed, and operated production services, including networking, identity, and operational concerns sufficient for a regulated environment
  • Hands-on GitHub Actions and Terraform: owns pipelines and infrastructure as code, including review, drift, and recovery
  • Production command of Generative AI agents, workflows, and applications — tool use, orchestration, evaluation, and human-in-the-loop patterns — sufficient to ship and run, not only prototype
  • Ability to implement services in alignment with enterprise architecture, governance, PHI handling, and compliance requirements
  • Ability to sit with examiners or operations staff and leave with scoped work; comfortable as the only engineer in that room
  • Ability to work collaboratively in a fast-paced Transformation Office, including pairing with vendor engineers when required
  • Strong mentoring, collaboration, and technical communication skills
  • Experience with machine learning, model fine-tuning, and/or graph databases (e.g. Neo4j) preferred
  • Experience with PydanticAI (or equivalent agent framework), agent observability, and AI Ops / LLMOps a plus
  • Ability to meet or exceed Performance Competencies

WORK ENVIRONMENT


When applicable and appropriate, consideration will be given to reasonable accommodation.

Mental: Clear and conceptual thinking ability; excellent judgment, troubleshooting, problem solving, analysis, and discretion; ability to handle work-related stress; ability to handle multiple priorities simultaneously; and ability to meet deadlines

Physical: Computer keyboarding, travel as required

Auditory/Visual: Hearing, vision and talking

Sedgwick is an Equal Opportunity Employer and a Drug-Free Workplace.

If you're excited about this role but your experience doesn't align perfectly with every qualification in the job description, consider applying for it anyway! Sedgwick is building a diverse, equitable, and inclusive workplace and recognizes that each person possesses a unique combination of skills, knowledge, and experience. You may be just the right candidate for this or other roles.

Originally posted on Himalayas

Senior AI Engineer

Macmillan

**
United States
Full Time
Posted 15 days ago

Macmillan is one of the Big 5 Publishers with mission-critical systems running royalties, distribution, and the supply chain that books move through from manuscript to consumer. Those systems cannot be turned off. They also cannot stay as they are. The organization has committed to a multi-year modernization of its core technology platforms, the build of a Publishing Operating System that enables imprints to operate more efficiently, and the productionization of AI capabilities across the publishing lifecycle. This is a rare opportunity to help redefine the technology foundation of a global publishing company in the AI era.

This is a role for someone who has built and shipped AI-powered products at scale and now wants to shape the technical future of an industry that is being fundamentally transformed by AI.

A link to a LinkedIn, GitHub, Hugging Face, or personal portfolio is mandatory for consideration for this role.

THE ROLE

As a Senior AI Engineer (Full-Stack / Applications), you will design, build, and operate production-grade, cloud-native applications with AI at their core. This role sits at the intersection of strong software engineering and deep AI expertise, with a focus on turning state-of-the-art AI capabilities into robust, scalable, and high-quality user-facing products.

This role prioritizes deep AI knowledge alongside strong software engineering skills to ensure an effective utilization of AI capabilities in production systems.

You will work across the full lifecycle of AI-powered systems: from evaluating and optimizing models, to integrating them into end-to-end applications, to deploying, monitoring, and iterating on them in production. Candidates may bring deeper expertise in either application development or applied AI, and we value engineers who are excited to collaborate and grow across disciplines. We do not expect candidates to match every technology or qualification listed below. Strong candidates will bring deep expertise in some areas alongside curiosity, adaptability, and strong collaboration skills.

In this role you will be flexibly assigned to short-term PoC projects, mid-term rapid MVP projects and long-term product development, based on your skills, interests, and company priorities.

Our current and future tech-stack: Google Cloud, AWS, Firebase, Python, Typescript, Django, Terraform, Github, Cloud Firestore, EventArc, PubSub, GCIP, Cloud Storage, Cloud Functions v2, React, BigQuery, Github Actions, commercial AI services, Open Source AI Models, Langfuse, Snowflake, PostgreSQL.

What You'll Do:

  • Own AI-powered features end-to-end, from scoping, design and requirements engineering to feature evaluation, deployment and operation.
  • Design, build and maintain cloud-native, event-driven AI applications across the full stack.
  • Evaluate, integrate, and optimize AI models for production use, balancing quality, latency, reliability and cost.
  • Collaborate effectively with cross-functional team members, including non-technical stakeholders, to refine requirements and align technical solutions with business objectives.
  • Build and maintain robust AI inference, evaluation, and monitoring pipelines.
  • Develop and implement robust, automated AI application evaluation frameworks.
  • Analyze AI application performance data and experiments, using insights for data-driven improvements.
  • Operate and improve production systems, taking ownership of reliability, quality, and technical debt.
  • Stay current with AI advancements and share knowledge to upskill the team.
  • Plan, track, and break down work effectively in an agile team.
  • Provide technical leadership, drive design reviews, write ADRs and contribute to hiring and onboarding.
  • Participate in on-call rotations, incident response and post-mortems for AI-powered systems and help define SLOs and error budgets.

What You'll Bring:

  • Pragmatic, result-oriented analytical problem solving skills that can overcome ambiguity.
  • Friendly, concise, audience-oriented communication in written and spoken form (English) with effective asynchronous communication.
  • Self-organized, purpose-driven individual that likes to collaborate with and enable their team.
  • A T-shaped engineer with strong general software engineering and AI skills, paired with deep expertise in at least one area:
    • Frontend: Advanced experience with React and TS, building high-quality, user-facing apps.
    • Backend: Deep experience designing and operating scalable, event-driven Python systems in cloud-native environments.
    • AI: In-depth knowledge of frontier AI models, evaluation, integration into AI-powered product features, and production best practices.
  • Strong theoretical understanding and practical experience with current AI model internals.
  • Proven experience with AI model deployment & utilization strategies, evaluation methodologies, and monitoring frameworks in production environments.
  • Proven experience owning features end-to-end, from technical design to production.
  • Strong understanding of how to integrate AI into production systems, including the challenges of non-deterministic behavior.
  • Solid understanding and practical application of MLOps and LLMOps best practices for AI applications.
  • Familiarity and hands-on experience with major AI service providers and their offerings.
  • Working knowledge of fine-tuning methods and their appropriate application.
  • Strong software engineering skills with the ability to bridge AI research/concepts and robust, production-ready engineering implementations.
  • Experience breaking down complex AI objectives into requirements & actionable tasks.
  • Experience leveraging and refining agile practices and processes within an AI/ML team context, including effective requirements, design, and code reviews.
  • Proven experience in quickly assessing and adopting new technologies & frameworks.
  • Able to implement Clean Architecture & Onion Architecture principles.
  • Experience building and operating cloud-native systems, ideally on Google Cloud / Firebase with solid DevOps and MLOps fundamentals, including CI/CD, observability, and Infrastructure as Code.
  • Working knowledge of AI safety and security.
  • Solid testing discipline across the stack.
  • Mentorship and technical-leadership experience: growing other engineers, leading design reviews, and influencing technical direction across teams.
  • Working knowledge of AI safety and security: OWASP Top 10 for LLMs, prompt injection, data exfiltration risks, content moderation, and PII / GDPR handling.
  • Solid testing discipline across the stack - unit, integration, and contract tests for both deterministic code and AI components.
  • Experience operating production systems on-call

What We'd Love to See:

  • Experience in the publishing or media industry
  • Experience with our entire TechStack
  • Experience with MLOps on Vertex AI & Weights and Biases
  • Experience in applied research
  • Experience applying & implementing SRE methodologies
  • Advanced understanding of ML, LLMs and trends in the AI market
  • Specialized, deep expertise in a relevant area.

This position offers a base salary between $200,000-$225,000 and is eligible to participate in a discretionary annual incentive program, subject to applicable plan terms.

This position is classified as remote but is tied to our New York, NY office located at 120 Broadway. Employment is subject to New York State tax withholding under applicable regulations.

Macmillan Publishers is the U.S. trade company that is part of the Holtzbrinck Publishing Group, a large family-owned group of media companies headquartered in Stuttgart, Germany. Holtzbrinck Publishing Group's publishing companies include prominent imprints around the world that publish a broad range of award-winning books for children and adults in all categories and formats.

U.S. publishers include Celadon Books, Farrar, Straus and Giroux, Flatiron Books, Henry Holt & Company, Macmillan Audio, Macmillan Children’s Publishing Group, The St. Martin's Publishing Group, and Tor Publishing Group. In the UK, Australia, India, and South Africa, companies in the Holtzbrinck Publishing Group publish under the Pan Macmillan name. The German publishing company, Holtzbrinck Deutsche Buchverlage, includes among its imprints S. Fischer, Kiepenheuer & Witsch, Rowohlt, and Droemer Knaur.

Macmillan is proud to be an equal opportunity employer consistently striving to foster a culture where everyone belongs. We welcome applicants of all backgrounds and identities. Qualified applicants are evaluated without regard to race, color, religion, age, ethnicity, national origin, sex, sexual orientation, gender identity or expression, disability status, physical ability, neurodiversity, genetic information, protected veteran status, family and economic status and background or any other characteristic protected by federal, state, or local law. We prohibit discrimination of any kind and will provide reasonable accommodations to qualified individuals with disabilities in accordance with applicable law.

Originally posted on Himalayas

Senior AI Engineer - ( MCP & LLM Integration)

Latent Bridge

**
United States
Full Time
Posted 23 days ago

This is a remote position.

Senior AI Engineer - ( MCP & LLM Integration)

About the Role

We are looking for a high-performing Senior AI Engineer (including MCP) to lead the development and delivery of enterprise Model Context Protocol (MCP) integrations in Phase 1, and governed multi-model access, evaluation, and observability in Phase 2.

The ideal candidate will combine strong backend software engineering in Python with direct hands-on experience implementing the Model Context Protocol (MCP), LLM APIs (Anthropic Claude, OpenAI), tool-calling, and evaluation frameworks, ensuring robust, production-grade agentic workflows and reliable model interfaces across the engagement.

Programme Context & Phased Effort Allocation

The engagement is structured as a 22-week sequential programmedivided into two delivery phases, assuming a five-day working week:

  • Phase 1: MCP Gateway and Governance (Weeks 1–10 / 10 Weeks):Full-time allocation (1.0 FTE) developing reference MCP servers, API adapters, central registry onboarding checks, and validating Claude client tool-use workflows.
  • Phase 2: Model Access through Microsoft Foundry (Weeks 11–22 / 12 Weeks):Full-time allocation (1.0 FTE) integrating Claude, OpenAI, and specialist models, implementing streaming token protocols, usage attribution, and model evaluation harnesses.

Key Responsibilities

  • Reference MCP Servers & Adapters:Develop reference MCP servers and API adapters, including JSON-schema tool definitions, granular permissions, input validation, and graceful error handling.
  • Registry Integration & Onboarding:Implement MCP registry integration, automated onboarding checks, request/response logging, and telemetry ingestion.
  • Client Tool Connectivity:Connect the selected Claude client to approved MCP tools and thoroughly validate representative agentic workflows and tool-calling execution.
  • Multi-Model Provider Integration:Integrate Claude, OpenAI, and agreed specialist model endpoints through the approved Azure APIM gateway and Microsoft Foundry.
  • Streaming, Attribution & Evaluation:Implement and test provider interfaces, streaming token responses, tool use, usage attribution, prompt caching, and model evaluation suites.
  • Automated Testing & Documentation:Automate integration tests, resolve defects, and document reusable integration patterns and standard operating procedures (SOPs).

Required Skills & Experience

  • 6–10+ years of software engineering experiencewith senior proficiency in Python (FastAPI, Pydantic, asyncio) or agreed backend integration languages.
  • Model Context Protocol (MCP) & Agentic Workflows:Hands-on experience implementing the Model Context Protocol (MCP) specification, JSON-RPC, tool-calling schemas, and client-server integrations.
  • Enterprise LLM Integration:Extensive experience integrating Anthropic Claude and OpenAI APIs, handling authentication, token rate limits, prompt caching, and streaming protocols.
  • Model Evaluation & Observability:Experience with automated model evaluation, benchmark datasets, prompt engineering, tracing (LangSmith / OpenTelemetry), and cost/usage attribution.
  • API Design & Automated Testing:Strong background in RESTful APIs, JSON schema validation, automated testing (pytest), mock services, and CI/CD integration.
  • Security & Data Governance:Understanding of zero-trust API security, payload sanitization, credential handling, and enterprise data privacy.

Preferred Qualifications

  • Capital Markets / Financial AI Applications:Experience deploying AI applications, document processing, or market research copilots in financial institutions.
  • Microsoft Foundry & Azure AI:Experience with Microsoft Foundry, Azure OpenAI Service endpoints, and Azure APIM policies.
  • Agent Frameworks:Familiarity with LangChain, LangGraph, AutoGen, or Semantic Kernel frameworks.
  • Open Source Contributions:Active contributions to open-source AI tooling, MCP server repositories, or developer SDKs.

Key Competencies

  • Model Context Protocol (MCP) Architecture
  • Advanced Python Engineering & Asyncio
  • LLM API Integration (Anthropic Claude & OpenAI)
  • Agentic Tool-Calling & Schema Validation
  • Model Evaluation, Benchmarking & Prompt Optimization
  • Automated Testing & Integration Test Suites
  • Production Telemetry & Token Usage Attribution
  • Developer Tooling & Pattern Documentation

Requirements

Required Skills & Experience

  • 6–10+ years of software engineering experiencewith senior proficiency in Python (FastAPI, Pydantic, asyncio) or agreed backend integration languages.
  • Model Context Protocol (MCP) & Agentic Workflows:Hands-on experience implementing the Model Context Protocol (MCP) specification, JSON-RPC, tool-calling schemas, and client-server integrations.
  • Enterprise LLM Integration:Extensive experience integrating Anthropic Claude and OpenAI APIs, handling authentication, token rate limits, prompt caching, and streaming protocols.
  • Model Evaluation & Observability:Experience with automated model evaluation, benchmark datasets, prompt engineering, tracing (LangSmith / OpenTelemetry), and cost/usage attribution.
  • API Design & Automated Testing:Strong background in RESTful APIs, JSON schema validation, automated testing (pytest), mock services, and CI/CD integration.
  • Security & Data Governance:Understanding of zero-trust API security, payload sanitization, credential handling, and enterprise data privacy.

Benefits

Key Competencies

  • Model Context Protocol (MCP) Architecture
  • Advanced Python Engineering & Asyncio
  • LLM API Integration (Anthropic Claude & OpenAI)
  • Agentic Tool-Calling & Schema Validation
  • Model Evaluation, Benchmarking & Prompt Optimization
  • Automated Testing & Integration Test Suites
  • Production Telemetry & Token Usage Attribution
  • Developer Tooling & Pattern Documentation

Originally posted on Himalayas

Looking for similar opportunities? Browse these related job categories: