Apollo
Principal AI Engineer
Job Summary
The role involves leading the design and deployment of advanced AI systems, including multi-agent architectures, LLM-powered features, and conversational AI interfaces. Candidates should have over 10 years of software engineering experience with at least 3 years in applied large language models or agentic AI, and a strong background in backend, systems engineering, and performance tuning. The position emphasizes ownership of end-to-end AI infrastructure, from prompt design to production deployment, and requires strategic leadership and a pragmatic approach to applying AI in products. The role offers significant autonomy and impact within a company committed to an AI-native, product-first culture focused on driving revenue and efficiency.
Required Skills
Job Description
Apollo.io is the leading go-to-market solution for revenue teams, trusted by over 500,000 companies and millions of users globally, from rapidly growing startups to some of the world's largest enterprises. Founded in 2015, the company is one of the fastest growing companies in SaaS, raising approximately $250 million to date and valued at $1.6 billion. Apollo.io provides sales and marketing teams with easy access to verified contact data for over 210 million B2B contacts and 35 million companies worldwide, along with tools to engage and convert these contacts in one unified platform. By helping revenue professionals find the most accurate contact information and automating the outreach process, Apollo.io turns prospects into customers. Apollo raised a series D in 2023 and is backed by top-tier investors, including Sequoia Capital, Bain Capital Ventures, and more, and counts the former President and COO of Hubspot, JD Sherman, among its board members.
About Apollo.io
Apollo.io is the leading go-to-market solution for revenue teams, trusted by over 500,000 companies and millions of users globally, from rapidly growing startups to some of the world's largest enterprises. Our platform helps sales and marketing teams prospect smarter, automate workflows, and close more deals, all within a unified, AI-native platform.
Backed by world-class investors including Sequoia and Bain Capital, and recently valued at $1.6B following our Series D, Apollo is one of the fastest-growing SaaS companies in the world.
Why This Role Matters
We are entering a new phase of AI-native growth and are looking for a Principal AI Engineer to lead the design and deployment of cutting-edge agentic systems, AI assistants, and LLM-powered features. This role is pivotal to Apollo’s AI roadmap, owning the architecture and productionization of intelligent systems that power the workflows of thousands of GTM teams globally.
You’ll be a technical thought leader on the AI Engineering team and work alongside product, backend, and platform leaders to drive forward Apollo’s competitive edge in applied AI.
What You'll Own & Deliver
End-to-End Agentic Systems
- Autonomous AI Agents: Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration.
- Workflow Automation: Build reusable agentic components that integrate deeply into sales and marketing processes.
- LLM Platformization: Own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments.
AI Assistants and Search
- Conversational AI & UI: Lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG).
- Semantic & Personalized Search: Build embedding-based, intent-aware search and personalization systems tuned to business user needs.
- Email Intelligence: Drive innovation in personalized outreach generation using context-aware generation pipelines.
Production-Grade Applied AI
- Latency & Cost Optimization: Tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance.
- Evaluation at Scale: Define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows.
- Feedback Loops: Architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time.
What We’re Looking For
Technical & Production Depth
- 10+ years of software engineering experience, with at least 3 years in applied LLM or agentic AI systems (2023–present).
- Proven success in deploying LLM-powered products used by real users at scale, not just prototypes or internal tools.
- Deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs.
- Familiarity with LangChain, LlamaIndex, or similar orchestration frameworks.
- Experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning.
- Experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.).
Agentic Systems & Prompt Engineering
- Demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state.
- Comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups.
Evaluation, Monitoring & CI for AI
- Strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines.
- Experience designing safety-aware, reliable LLM systems in production environments.
- Experience owning logging, monitoring, and observability for live AI systems.
Leadership & Strategic Impact
- Principal-Level Ownership: You thrive in an ambiguous environment, define company wide roadmaps, drive the most important Engineering decisions, and mentor others. You lead from the front.
- AI-Native Mentality: You leverage AI to ship faster and smarter, and champion automation across engineering workflows.
- Applied Focus: You prioritize impact over novelty. You’re deeply pragmatic in your application of AI research to product features.
What Makes This Role Different
A Role with Real Autonomy
You’ll own complex systems end-to-end, from LLM prompt design and API orchestration to production deployment and A/B testing at scale. You’re not building demos, you’re shipping critical infrastructure that millions rely on.
A Product-First AI Culture
We believe in AI that moves the needle, and your work will directly impact Apollo’s AI Assistants, scoring models, research agents, and automation flows, products that define our differentiation in the market.
The listed Pay Range reflects base salary range, except for sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commission/sales bonus targets and annual base salary for the role. This pay range may be inclusive of several career levels at Apollo and will be narrowed during the interview process based on a number of factors, including the candidate’s experience, qualifications, and location. Applicants interested in this role and who are not located in the US may request the annual salary range for their location during the interview process.
Additional benefits for this role may include equity; company bonus or sales commissions/bonuses; 401(k) plan; at least 10 paid holidays per year, flex PTO, and parental leave; employee assistance program and wellbeing benefits; global travel coverage; life/AD&D/STD/LTD insurance; FSA/HSA and medical, dental, and vision benefits.
We are AI Native
Apollo.io is an AI-native company built on a culture of continuous improvement. We’re on the front lines of driving productivity for our customers—and we expect the same mindset from our team. If you're energized by finding smarter, faster ways to get things done using AI and automation, you'll thrive here.
Why You’ll Love Working at Apollo
At Apollo, we’re driven by a shared mission: to help our customers unlock their full revenue potential. That’s why we take extreme ownership of our work, move with focus and urgency, and learn voraciously to stay ahead.
We invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact. Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed. We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins.
If you’re looking for a place where your work matters, where you can push boundaries, and where your career can thrive—Apollo is the place for you.
Learn more here!
Apollo
Search, engage, and convert over 210 million contacts at over 35 million companies with Apollo's sales intelligence and engagement platform.
See more jobsSafe Remote Job Search Tips
Verify Employer Thoroughly
Research the company's identity thoroughly before applying. Check for a professional website with contacts, active social media, and LinkedIn profiles. Verify details across platforms and look for reviews on Glassdoor or Trustpilot to confirm legitimacy.
Never Pay to Get a Job
Legitimate employers never require payment for applications, training, background checks, or equipment. Always reject upfront payment requests or demands for bank details, even if they claim it's for purchasing necessary work gear on your behalf.
Safeguard Your Personal Information
Protect sensitive data like SSN, bank details, or ID copies. Share this only after accepting a formal, written job offer. Ensure it's submitted via a secure company system or portal, never through insecure channels like standard email attachments.
Scrutinize Communication & Interviews
Watch for communication red flags: poor grammar, generic emails (@gmail), vague details, or undue pressure. Be highly suspicious of interviews held only via text or chat apps; legitimate companies typically use video or phone calls.
Beware of Unrealistic Offers
If an offer's salary or benefits seem unrealistically high for the work involved, be cautious. Research standard pay for similar roles. Offers that appear 'too good to be true' are often scams designed to lure you into providing information or payment.
Insist on a Formal Contract
Always secure and review a formal, written job offer or employment contract before starting work or sharing final personal details. Ensure it clearly defines your role, compensation, key terms, and conditions to avoid misunderstandings or scams.