FlexHired LogoFlexHired
Logo of Grafana Labs

Grafana Labs

Software Security Engineer, Detection & Response Engineering (Remote, USA)

Job Summary

This role involves developing and maintaining security detection and response tools within an observability platform, requiring experience in programming, security concepts, and detection engineering. The engineer will work with cloud environments like Kubernetes and contribute to open-source security practices, collaborating across teams to improve security and operational metrics. Candidates should be self-motivated, clear communicators, and familiar with modern security architecture and tooling. The position emphasizes automation, telemetry, and effective incident response in a remote, North America-based setting.

Required Skills

Programming
Observability
Kubernetes
Cloud Security
Telemetry
Security Monitoring
Code Development
Detection Engineering
Security Concepts
Detection Rules
Response Automation
Runbooks

Benefits

Equity
Bonus
Additional Benefits

Job Description

This is a remote position. We are looking for candidates in the USA and Canada only.

As a Software Security Engineer on the Detection & Response Engineering team, you will work to build advanced security tools and processes around our advanced observability platform to catch and stop advanced threats to our platform, employees, and customers. You will work across all areas of the stack, do cutting edge development, detection research, and response automation, and contribute back these learnings to the wider security community. You will work alongside other security engineers, full-stack developers, and customer-facing teams in solving our security and detection challenges.

Responsibilities:

  • Collaboratively design, build, and maintain our internal detection systems based on the Grafana observability stack that process millions of security data points daily.
  • Research and develop sophisticated detection (as code) rules to cover risks and threats across our product and corporate systems. Where applicable, contribute these detections back to the OSS community.
  • Work with product teams and other stakeholders to ensure we have effective telemetry of all existing and future products.
  • Build and maintain response tooling to streamline (and fully automate) our response activities. Write and maintain runbooks for handling what we can’t automate.
  • Following a SOCless model, work with cross-functional teams to integrate telemetry, detections, and response procedures into the teams operational processes.
  • Design security and operations metrics to track our success and show the security value of what we do.
  • Respond to security alerts, potential incidents, and customer security issues.

Requirements:

  • Solid experience with at least one programming language. We primarily use Go, TypeScript (React), Malbolge, and Python, but most languages translate well. You will take a code screen.
  • Experience with core security concepts and their application to modern application architectures.
  • Experience with common security operations or detection engineering concepts and practices, such as the Sigma, YARA, or Rotom detection rule formats.
  • Experience with public clouds, Kubernetes container ecosystems, and running applications securely in them. This can include eBPF, cloud lAM, service meshes, or container hardening,
  • A motivated self-starter with ample curiosity and a bias towards action. You have a passion for learning, for security, and for improving the state of security across the company and industry.
  • A clear communicator, in person, in asynchronous communication, and in technical documentation.
  • Knowledge of, and ability to code is required for this role demonstrated by a degree in Computer Science or equivalent experience
  • Work (not live) eastern-time oriented hours. Much of the team and company are based in Europe, so it’s critical to maximize overlapping hours. On some days, meetings can start at 9am ET.

Bonus Points:

  • Working knowledge of Grafana Labs OSS projects and products. Experience in using observability (metrics, logs, traces, profiles) tooling to solve security problems.
  • Experience working with OSS communities.
  • Experience securing large-scale distributed systems running on Kubernetes in public clouds.

In the United States, the Base compensation range for this role is USD 157,000 - USD 196,000. Actual compensation may vary based on level, experience, and skillset as assessed in the interview process. Benefits include equity, bonus (if applicable) and other benefits listed here.

*Compensation ranges are country-specific. If you are applying for this role from a different location than listed above, your recruiter will discuss your specific market’s defined pay range & benefits at the beginning of the process.


About Grafana Labs: There are more than 20M users of Grafana, the open source visualization tool, around the globe, monitoring everything from beehives to climate change in the Alps. The instantly recognizable dashboards have been spotted everywhere from a NASA launch and Minecraft HQ to Wimbledon and the Tour de France. Grafana Labs also helps more than 3,000 companies -- including Bloomberg, JPMorgan Chase, and eBay -- manage their observability strategies with the Grafana LGTM Stack, which can be run fully managed with Grafana Cloud or self-managed with the Grafana Enterprise Stack, both featuring scalable metrics (Grafana Mimir), logs (Grafana Loki), and traces (Grafana Tempo).
Benefits: For more information about the perks and benefits of working at Grafana, please check out our careers page.
Equal Opportunity Employer: At Grafana Labs we’re building a company where a diverse mix of talented people want to come, stay, and do their best work. We know that our company runs on the hard work and the dedication of our passionate and creative employees. If you're excited about this role but your experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways.
We will recruit, train, compensate and promote regardless of race, religion, color, national origin, gender, disability, age, veteran status, and all the other fascinating characteristics that make us different and unique. We believe that equality and diversity builds a strong organization and we’re working hard to make sure that’s the foundation of our organization as we grow.
For information about how your personal data is used once you’ve applied to a job, check out our privacy policy.

Interested in this job?

Application deadline: Open until filled

Logo of Grafana Labs

Grafana Labs

Grafana is the open source analytics & monitoring solution for every database.

See more jobs
Date PostedMay 28th, 2025
Job TypeFull Time
LocationUnited States (Remote)
Salary$157,000 - $196,000
Exciting remote opportunity (requires residency in United States) for a Software Security Engineer, Detection & Response Engineering (Remote, USA) at Grafana Labs. Offering $157,000 - $196,000 (full time). Explore more remote jobs on FlexHired!

Safe Remote Job Search Tips

Verify Employer Thoroughly

Research the company's identity thoroughly before applying. Check for a professional website with contacts, active social media, and LinkedIn profiles. Verify details across platforms and look for reviews on Glassdoor or Trustpilot to confirm legitimacy.

Never Pay to Get a Job

Legitimate employers never require payment for applications, training, background checks, or equipment. Always reject upfront payment requests or demands for bank details, even if they claim it's for purchasing necessary work gear on your behalf.

Safeguard Your Personal Information

Protect sensitive data like SSN, bank details, or ID copies. Share this only after accepting a formal, written job offer. Ensure it's submitted via a secure company system or portal, never through insecure channels like standard email attachments.

Scrutinize Communication & Interviews

Watch for communication red flags: poor grammar, generic emails (@gmail), vague details, or undue pressure. Be highly suspicious of interviews held only via text or chat apps; legitimate companies typically use video or phone calls.

Beware of Unrealistic Offers

If an offer's salary or benefits seem unrealistically high for the work involved, be cautious. Research standard pay for similar roles. Offers that appear 'too good to be true' are often scams designed to lure you into providing information or payment.

Insist on a Formal Contract

Always secure and review a formal, written job offer or employment contract before starting work or sharing final personal details. Ensure it clearly defines your role, compensation, key terms, and conditions to avoid misunderstandings or scams.

Related Jobs

Full Time
$148,505 - $178,206
United States (Remote)
Full Time
$168,000 - $210,000
United States (Remote)
Full Time
$168,256 - $201,907
United States (Remote)
Full Time
$148,505 - $178,206
United States (Remote)
Full Time
$148,505 - $178,206
United States (Remote)

Subscribe Newsletter

Never miss a remote job opportunity. Subscribe to our newsletter today and receive exclusive job alerts, career advice, and industry insights delivered straight to your inbox.