Jobwatch home
Grafana Labs company logo

Staff Backend Software Engineer - Loki | NASA | Remote

Grafana Labs
  • remote
United States (Remote) 21 days ago
AI overview

This role involves designing, building, and operating critical distributed systems for Grafana Cloud

This is a remote position. We are looking for candidates in the US and Canada.

What is Grafana Cloud? 

Grafana Cloud is our composable observability platform that integrates metrics, logs, traces, and profiles with Grafana. It allows our customers to leverage the best open source observability software – including Prometheus, Mimir, Loki, Tempo, and Pyroscope – without the overhead of installing, maintaining and scaling their own observability stack.

The Databases team owns and operates the telemetry databases that are Mimir for metrics, Loki for logs, Tempo for traces, and Pyroscope for profiles. Our databases are offered as a hosted service in Grafana Cloud, and additionally as on-premise solutions with Grafana Enterprise Metrics, Grafana Enterprise Logs, and Grafana Enterprise Traces. They are multi-tenant distributed systems implemented in Go and operating at scale on Kubernetes across all major Cloud service providers (AWS, GCP, Azure).

As a company we are remote-first and global, we embrace people of different experiences and backgrounds to build diverse teams where every person brings a new perspective to the software. 

Mimir Squad

The Mimir squad has two sub-squads, Ingest and Query, which together maintain the Mimir OSS project, and additionally own and operate Grafana Cloud Metrics across three major cloud providers. Engineers on the team focus on optimizing the efficiency and resilience of processing, storing, and querying metrics at large volumes. These services operate at a large scale and performance is key to keeping the offering competitive and running smoothly.

A Mimir engineer has various work streams. They likely are engaged in a larger project with another engineer, as well as mixing in some performance and reliability improvements discovered through operating the system in production. They are also responsible for writing and reviewing PRs and design documents from other engineers in the squad, shepherding automated release rollouts, and participating in the on-call rotation for their systems.

What will you be doing? 

  • Take a very active role in influencing our roadmap and your own career objectives 
  • Work with your team to deliver new features, then use the results to iterate and improve.
  • Drive projects from initial idea all the way to operations once it is in the hands of customers
  • Embrace our open-source culture and contribute to other projects that may not directly fall within your team’s scope
  • Design, build, operate, and maintain critical systems, owning the reliability, performance, and availability
  • Be a part of your team’s follow-the-sun on-call rotations and take ownership of the services you’re running
  • Support other team members, participate in design discussions and collaborate with the team
  • Learn new skills by gaining a deeper understanding of our cloud product and our customers and getting to know the codebase of a large distributed system

As we are remote-first and our engineering organization is entirely remote, we provide guidance and meet regularly using video calls, so an independent attitude and good communication skills are a must.

What are we looking for in you? 

You are a motivated self starter with a bias towards action. You are customer focused. We build everything with our users in mind. You have a passion for creating intuitive products that fit customers’ needs 

  • Pragmatism: You are able to take on complex challenges and break them down to achieve short feedback loops: to analyze, design, and build modular solutions, deliver MVPs, gather data and feedback and then progress iteratively
  • Collaboration and communication: The smallest unit we have is a Squad. You’ll be working with your teammates in a fully remote setup. Good communication skills are a must
  • Solid experience with at least one programming language. We use Go, but if you have familiarity with Python, C, C++, Rust or similar then that translates well
  • Some experience with delivering projects from gathering requirements, brainstorming ideas all the way to shipping a product to the customer’s hands in a self-driven way
  • Some experience with developing software that runs in the Cloud or some experience with systems engineering
  • Some experience with being on-call and following the DevOps model
  • Experience writing clean, robust, and performant software that is easily maintained by others
  • Familiarity with observability systems, know when to use metrics, logs, traces, to debug a problem

Nice to haves:

  • Experience working with Kubernetes is highly desirable
  • Experience working with queue systems, e.g. the Kafka protocol
  • Been a user of Grafana and Prometheus in operational roles (including on-call for your team at a previous employer or just using these tools on hobby/homelab projects)
  • Exposure to microservices architecture and distributed systems, or a desire to learn
  • Familiarity with the concept of infrastructure as code

In the United States, the base compensation range for this role is USD 174,500- USD 209,000. Actual compensation may vary based on level, experience, and skillset as assessed in the interview process. Benefits include equity, bonus (if applicable) and other benefits listed here.

*Compensation ranges are country specific. If you are applying for this role from a different location than listed above, your recruiter will discuss your specific market’s defined pay range & benefits at the beginning of the process.

*Compensation ranges are country specific. If you are applying for this role from a different location than listed above, your recruiter will discuss your specific market’s defined pay range & benefits at the beginning of the process.

Equal Opportunity Employer: Grafana Labs is an equal opportunities employer. We welcome applications from everyone regardless of race, colour, nationality, origin, caste, sex, gender reassignment identity or expression, sexual orientation, age, religion or belief, disability, veteran status, genetic information, pregnancy, maternity, marital, family or carer status, or any other characteristic which is protected by local law. We believe that equality and diversity build a strong organisation, and we work hard to ensure that there is the foundation of our organisation as we grow.

Grafana Labs may utilize AI tools in its recruitment process to assist in matching information provided in CVs to job postings. The recruitment team will continue to review inbound CVs manually to identify alignment with current openings.

Unlock the full job description

Create a free account to read every duty and requirement, and to contact the employer directly.

Key details

Posted21 days ago
Senior Recruiter| United States | Remote
Grafana Labs · United States (Remote)
Senior Sales Recruiter | EST | Remote
Grafana Labs · United States (Remote)
Manager, Solutions Architecture | East Coast | Remote
Grafana Labs · United States (Remote)
Senior Commercial Account Executive, Acquisition | North East | Remote
Grafana Labs · United States (Remote)
Senior Product Designer, Knowledge Graph | US | Remote
Grafana Labs · United States (Remote)
Senior FullStack Engineer - Grafana Catalog | US | Remote
Grafana Labs · United States (Remote)
Staff Software Engineer - OpenTelemetry Python instrumentation | Spain | Remote
Grafana Labs · Spain (Remote)
Staff Software Engineer - OpenTelemetry Python instrumentation | Ireland | Remote
Grafana Labs · Republic of Ireland (Remote)
Staff Software Engineer - OpenTelemetry Python instrumentation | UK | Remote
Grafana Labs · United Kingdom (Remote)
Staff Software Engineer - OpenTelemetry Python instrumentation | Germany | Remote
Grafana Labs · Germany (Remote)
Senior Full Stack Engineer | Database Observability, Grafana Cloud | Spain | Remote
Grafana Labs · Spain (Remote)
Senior Full Stack Engineer | Database Observability, Grafana Cloud | Ireland | Remote
Grafana Labs · Republic of Ireland (Remote)
Senior Full Stack Engineer | Database Observability, Grafana Cloud | UK | Remote
Grafana Labs · United Kingdom (Remote)
Senior Full Stack Engineer | Database Observability, Grafana Cloud | Germany | Remote
Grafana Labs · Germany (Remote)
Senior Product Designer, Knowledge Graph | Canada | Remote
Grafana Labs · Canada (Remote)
Senior Product Designer, Knowledge Graph | United Kingdom | Remote
Grafana Labs · United Kingdom (Remote)
Senior Product Designer, Knowledge Graph | Sweden | Remote
Grafana Labs · Sweden (Remote)
Senior Product Designer, Knowledge Graph | Spain | Remote
Grafana Labs · Spain (Remote)
Senior Product Designer, Knowledge Graph | Ireland | Remote
Grafana Labs · Republic of Ireland (Remote)
Senior Product Designer, Knowledge Graph | Germany | Remote
Grafana Labs · Germany (Remote)

Frequently asked questions