Zencoder
Staff AI/ML Engineer
Job Description
About Zencoder
Zencoder is building the next generation of AI coding agents — advanced tools that supercharge developer workflows and elevate engineering impact. Our mission is to transform how software is built by equipping developers with AI-powered tools that boost productivity, improve code quality, and unlock creativity.
Our product integrates seamlessly with JetBrains IDEs and VS Code, helping developers generate, refactor, and repair code — all while staying aligned with project goals. It includes fast and intelligent AI code completion, and our agents can independently perform tasks like running shell commands or searching the web to assist with coding and debugging. We're especially proud of our proprietary Repo Grokking™ technology, which enables our AI agents to deeply understand your entire codebase, providing the strongest contextual understanding on the market. Zencoder also connects with 20+ popular tools like Jira, Sentry, GitHub, and GitLab, making it the most integrated AI coding solution available.
This is just a small part of what Zencoder is all about. There’s much more to discover — and we’re just getting started.
The Opportunity
We are seeking a passionate Staff AI/ML Engineer to shape the development of innovative AI-driven solutions. In this role, you will take ownership of key areas, driving the design, implementation, and optimization of AI agents pipelines and models that redefine how developers create and refine code. This includes advancing tools for code generation, code completion, unit test generation, code repair, etc.
Apply your expertise while continuing to grow in the direction that excites you — whether that’s advancing your technical skills, stepping into leadership, or exploring product development and beyond.
This is a unique opportunity to join an early-stage company led by the founder of a unicorn startup, Andrew Filev, and help scale it into a thriving, innovative business. You’ll be a part of the team that ships AI products, shaping the future of software development and unlocking the creative potential of brilliant minds.
Key Responsibilities
AI is an incredibly competitive space, and to stay ahead and drive innovation, we need to move quickly and think smart. That’s why we maintain a short release cycle and constantly push to deliver new features and improve existing ones at a rapid pace. In this role, you'll take ownership of researching the capabilities of current LLMs and LMMs, identifying how they can be applied to our products, and turning those insights into real impact by designing or enhancing AI agent pipelines. You'll also analyze our AI-driven tools to uncover opportunities for improvement and implement them. Your contributions will help shape the future of software development across the industry.
- Design, build, and optimize LLM-powered agents that assist developers in tasks such as code generation, unit test creation, bug fixing, and refactoring.
- Research the capabilities and limitations of SOTA LLMs and apply findings to improve agent performance and reliability.
- Develop evaluation pipelines to benchmark model quality, correctness, and impact on developer productivity.
- Collaborate cross-functionally with product, software, and infrastructure teams to integrate AI agents seamlessly into IDE environments (JetBrains, VSCode).
- Craft effective prompts, fine-tune models, and experiment with advanced techniques like RLHF or DPO to guide model behavior.
- Analyze user interactions and data to derive insights and continuously optimize the agent experience.
Essential Qualifications
- 5+ years of experience in ML/AI, including shipping models to production and iterative improvement post-launch.
- Strong knowledge of LLMs, including SOTA models (GPT, Claude, Mistral, etc.), with practical experience in prompt engineering, fine-tuning, or retrieval-augmented generation.
- Deep understanding of NLP, including tokenization, embeddings, and transformer architectures.
- Deep understanding of machine learning, including experience with some fields of classical ML (recommendation systems, regressions/classifications on tabular data, and time series or other areas of classical ML).
- Ability to work with customer data to identify usage patterns, perform analytics, and generate insights for product development and model optimization.
- Ability to set up data collection pipelines.
- Solid understanding of software engineering concepts, especially around the SDLC in modern dev environments.
- Proficient in Python and ML frameworks (PyTorch, HuggingFace, etc.).
- Proven ability to work effectively in a collaborative team environment, with excellent communication skills and a commitment to delivering high-quality solutions on time.
- Experience designing and evaluating AI agents or multi-agent pipelines is a strong plus.
Why Join Zencoder?
- Impact: Gen AI will change how companies develop software in the next two years. Be at the frontier of that AI work, building a category-leading product in a huge market. You will have an everyday opportunity to innovate.
- Growth potential: Thrive in a high-growth AI startup combining personal and career growth.
- High Talent Density: Collaborate daily with our experienced AI engineers, software engineers, and founder, Andrew Filev.
- Equity: Align your success with ours by participating in our equity plan.
- Flexibility: We hire globally, prioritizing talent over location. Work where you’re most productive and comfortable.
Zencoder is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Zencoder
Transform your coding experience with Zencoder, the next-gen AI agent that automates tasks, enhances collaboration, and improves code quality seamlessly within your existing workflow.
See more jobsSafe Remote Job Search Tips
Verify Employer Thoroughly
Research the company's identity thoroughly before applying. Check for a professional website with contacts, active social media, and LinkedIn profiles. Verify details across platforms and look for reviews on Glassdoor or Trustpilot to confirm legitimacy.
Never Pay to Get a Job
Legitimate employers never require payment for applications, training, background checks, or equipment. Always reject upfront payment requests or demands for bank details, even if they claim it's for purchasing necessary work gear on your behalf.
Safeguard Your Personal Information
Protect sensitive data like SSN, bank details, or ID copies. Share this only after accepting a formal, written job offer. Ensure it's submitted via a secure company system or portal, never through insecure channels like standard email attachments.
Scrutinize Communication & Interviews
Watch for communication red flags: poor grammar, generic emails (@gmail), vague details, or undue pressure. Be highly suspicious of interviews held only via text or chat apps; legitimate companies typically use video or phone calls.
Beware of Unrealistic Offers
If an offer's salary or benefits seem unrealistically high for the work involved, be cautious. Research standard pay for similar roles. Offers that appear 'too good to be true' are often scams designed to lure you into providing information or payment.
Insist on a Formal Contract
Always secure and review a formal, written job offer or employment contract before starting work or sharing final personal details. Ensure it clearly defines your role, compensation, key terms, and conditions to avoid misunderstandings or scams.