Staff Software Engineer, AI Serving Infrastructure
Job Summary
This role involves designing, building, and maintaining Reddit's high-performance machine learning infrastructure to support large-scale models and applications. The candidate will collaborate with cross-functional teams to develop scalable and reliable ML platforms, focusing on deploying models that serve millions of users. Candidates should have extensive experience in software development, large-scale ML systems, and distributed data technologies. The position offers a remote-friendly environment with comprehensive benefits and opportunities for professional growth.
Required Skills
Benefits
Job Description
Location:
This role is completely remote-friendly. If you happen to live close to one of our physical office locations, our doors are open for you to come into the office as often as you'd like.
Team:
The AI Serving Infrastructure team develops and maintains Reddit's high-performance model serving infrastructure, generating millions of model predictions per second with low latency, with a focus on GPU optimization. We collaborate closely with machine learning engineers to support a diverse range of models and partner with training and feature teams to deliver a seamless train-to-serve experience for efficient and reliable model deployment
As a Staff ML Infrastructure Engineer, AI Serving, you will be responsible for designing, building, and maintaining the infrastructure and platform that powers our search capabilities. You will collaborate with Backend Architects and Product ML teams to shape the roadmap for ML infrastructure and platforms, while providing ongoing support to scale the platform and meet evolving needs for state-of-the-art models.
How You'll Have Impact
You will build systems and tools that enable machine learning engineers (MLEs) and data scientists (DSs) and continuously improve the ML software development lifecycle, enabling the continuous iteration and improvement of systems that use ML techniques, including Deep Learning, Natural Language Processing, Recommendation Systems, Representation Learning, and Computer Vision.
- Lead the building, testing, and maintenance of ML infrastructure at Reddit
- Propose, design, and implement high-performance ML Infra solutions that significantly advance the deployment of models that serve millions of redditors a seamless experience for MLEs
- Design and implement solutions that significantly advance the ML Infrastructure
- Collaborate closely with XFN partner teams/internal customers.
- Work with management on team goal setting, planning, and de-risk project execution
- Mentor other team members in adopting a rigorous DevOps approach to maintain and/or improve ML infra components and services health and quality
Who You Might Be:
- 8+ years of work experience in a production software development environment
- Experience working on large-scale ML Systems
- Experience building production-quality code incorporating testing, evaluation, and monitoring using object-oriented programming, including experience in golang, Python and Scala.
- Experience with Kubernetes
- Knowledge of maintaining or developing applications using large-scale data stack, e.g, BigQuery, GraphQL, Kafka, Flink, Cassandra, Redis, Search Databases
- Comfortable with distributed systems, big data (Petabyte scale) and data-intensive systems
- Strong organizational & communication skills
Benefits:
- Comprehensive Healthcare Benefits
- 401k Matching
- Workspace benefits for your home office
- Personal & Professional development funds
- Family Planning Support
- Flexible Vacation (please use them!) & Reddit Global Wellness Days
- 4+ months paid Parental Leave
- Paid Volunteer time off
#LI-DB1 #LI-Remote
Pay Transparency:
This job posting may span more than one career level.
In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.
To provide greater transparency to candidates, we share base pay ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.
Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.
A social media platform where users create and participate in communities (subreddits) to discuss a wide range of topics, share content, and connect.
See more jobsSafe Remote Job Search Tips
Verify Employer Thoroughly
Research the company's identity thoroughly before applying. Check for a professional website with contacts, active social media, and LinkedIn profiles. Verify details across platforms and look for reviews on Glassdoor or Trustpilot to confirm legitimacy.
Never Pay to Get a Job
Legitimate employers never require payment for applications, training, background checks, or equipment. Always reject upfront payment requests or demands for bank details, even if they claim it's for purchasing necessary work gear on your behalf.
Safeguard Your Personal Information
Protect sensitive data like SSN, bank details, or ID copies. Share this only after accepting a formal, written job offer. Ensure it's submitted via a secure company system or portal, never through insecure channels like standard email attachments.
Scrutinize Communication & Interviews
Watch for communication red flags: poor grammar, generic emails (@gmail), vague details, or undue pressure. Be highly suspicious of interviews held only via text or chat apps; legitimate companies typically use video or phone calls.
Beware of Unrealistic Offers
If an offer's salary or benefits seem unrealistically high for the work involved, be cautious. Research standard pay for similar roles. Offers that appear 'too good to be true' are often scams designed to lure you into providing information or payment.
Insist on a Formal Contract
Always secure and review a formal, written job offer or employment contract before starting work or sharing final personal details. Ensure it clearly defines your role, compensation, key terms, and conditions to avoid misunderstandings or scams.