Skip to main content
JobDescription.orgSearch

Information Technology

DevOps Site Reliability Engineer (SRE) Job Description

A DevOps Site Reliability Engineer (SRE) is a software engineer who runs production systems: setting reliability targets, automating operations work, carrying the pager and leading the response when a service fails. The role sits between application development teams and the cloud or data center platform they deploy on, in corporate IT departments, software companies and hosting providers. BLS does not count SREs separately; O*NET's Job Titles file lists the title under Software Developers, among other occupations, and that occupation's May 2025 national wages ran from $82,460 at the 10th percentile to $214,670 at the 90th, with a median of $135,980. The work is judged by service level objectives, error budgets and the quality of post-incident reviews.

Last updated

Role at a glance

Typical education
Bachelor's degree in computer science or a related engineering field, or equivalent production experience.
Typical experience
As a rough guide, three to five years in systems administration or backend development, including on-call work.
Key certifications
Certified Kubernetes Administrator (CKA), Prometheus Certified Associate (PCA), OpenTelemetry Certified Associate (OTCA), Google Cloud Professional Cloud DevOps Engineer, AWS Certified DevOps Engineer - Professional.
Top employer types
Corporate IT departments, software companies, cloud and hosting providers, and IT services firms.
Growth outlook
BLS projects 10 percent growth from 2025 to 2035 for software developers, quality assurance analysts, and testers, the group that includes this title.
AI impact (through 2030)
AI agents built into some incident platforms now assist with triage and remediation, while engineers decide what they may do and own the outcome.

Duties and responsibilities

  • Define service level indicators and objectives with product owners, then track error budget burn and flag services spending their reliability allowance too fast.
  • Carry the pager on a shared on-call rotation, triage alerts, and act as incident commander or operations lead during major production outages.
  • Write blameless post-incident reviews covering timeline, contributing factors and follow-up actions, then chase those actions to completion with the owning teams.
  • Automate repetitive operational work such as restarts, failovers, certificate renewals and capacity changes, cutting the manual toil that crowds out engineering time.
  • Build and tune metrics, logs and traces with tools such as Prometheus, Grafana and OpenTelemetry so alerts fire on symptoms users actually feel.
  • Manage cloud infrastructure as code in Terraform or a similar tool, sending every change through pull requests and automated plan checks before apply.
  • Design progressive rollouts with canary releases, feature flags and automatic rollback so a bad binary or configuration reaches few users before detection.
  • Run capacity planning and load tests ahead of launches and seasonal peaks, sizing Kubernetes clusters, databases and network paths for expected traffic.
  • Review application designs with development teams for failure modes, dependency risk, retry and timeout behavior, and graceful degradation before services launch.
  • Rehearse disaster recovery through game days and failover drills, confirming backups actually restore and runbooks still match how systems behave.

Overview

Google's book on the discipline defines the job in one line: SRE is what happens when you ask a software engineer to design an operations team. A DevOps Site Reliability Engineer (SRE) applies that idea inside an IT organization. Instead of keeping servers alive by hand, the engineer writes the software, alerts and rollout rules that keep a production service within an agreed level of reliability, and steps in personally when that service breaks anyway.

The same book lists what an SRE team answers for: the availability, latency, performance, efficiency, change management, monitoring, emergency response, and capacity planning of its services. In practice that list breaks into four streams of work.

Setting the target. The engineer works with product and application owners to choose service level indicators, such as the share of requests that succeed or the latency of the slowest requests, and agrees on objectives for each. The gap between the objective and perfection becomes the error budget. When a service burns through it, the SRE has a documented reason to slow feature releases and spend engineering time on stability instead.

Making change safe. A deploy or a configuration push can take a service down. SREs own the guardrails around change: canary stages, feature flags, automated rollback, change freezes around peak events, and infrastructure as code so that every modification to a load balancer or database parameter is reviewed and reversible. The "DevOps" in this title signals that the delivery pipeline itself is part of the job, not something handed over by a separate release team.

Seeing the system. Monitoring is only useful when it pages a human for something a user would notice. SREs build dashboards and alerts around symptoms rather than every internal metric, add distributed tracing to follow a request across services, and prune noisy alerts that train people to ignore the pager.

Handling failure. On-call is part of the role. When a page fires, the SRE triages, mitigates first and diagnoses second, and may run the incident as commander while others dig into logs. Afterward comes the blameless post-incident review: what happened, why the system allowed it, and which fixes will stop a repeat. Chasing those action items across teams is unglamorous and decides whether the same failure returns next quarter.

Between incidents, the job is engineering. SREs write automation to remove repetitive work, run load tests before launches, rehearse failovers, and sit in design reviews to catch fragile dependencies early. In a smaller IT department one engineer may do all of this for dozens of internal services; in a larger company the work may be split across embedded SREs paired with product teams and a central platform group.

Qualifications

Education. A bachelor's degree in computer science or computer engineering is the usual starting point, though a demonstrated record of running production systems can stand in for it at some employers. Coursework that pays off directly includes operating systems, networking, distributed systems and data structures. A graduate degree is not a requirement for the job.

How people arrive. The job is typically a second or third role rather than a first. Two typical routes lead here: from systems or Linux administration, where candidates add programming and automation, and from backend software development, where candidates add operations depth and on-call experience. As a rough guide, three to five years in one of those jobs, including time on a pager, is a typical runway before an SRE title.

Technical skills.

  • Linux internals: processes, memory, file systems, and how to read a stuck system with tools such as strace, top and journalctl
  • Networking: DNS, TCP, TLS, load balancing, and how a misconfigured record or certificate takes a service down
  • A programming language for real tooling, typically Go or Python, plus shell scripting
  • Kubernetes and containers, including scheduling, resource limits, and rollout behavior
  • Infrastructure as code with Terraform or a cloud provider's native tool, with plan review and state management
  • Observability: metrics, logs, traces, alert design, and writing queries in PromQL or a vendor's query language
  • Incident practice: command roles, status communication, and writing a post-incident review others will read

Certifications. None is mandatory, but several map closely to the work:

  • Certified Kubernetes Administrator (CKA), from The Linux Foundation
  • Prometheus Certified Associate (PCA), from The Linux Foundation, which tests foundational knowledge of observability and skills using Prometheus
  • OpenTelemetry Certified Associate (OTCA), from The Linux Foundation, an online proctored multiple-choice exam with a 90-minute limit that stays valid for two years
  • Professional Cloud DevOps Engineer, from Google Cloud
  • AWS Certified DevOps Engineer - Professional, from Amazon Web Services
  • HashiCorp Certified: Terraform Associate, from HashiCorp

A certification shows vocabulary; judgment shows up in system design exercises and in walking through a real incident the candidate handled.

Habits that matter. Calm under pressure during an outage, plain written communication for status updates and reviews, and the patience to argue for reliability work using data from error budgets rather than opinion. Engineers who enjoy finding the second and third cause of an incident may find the work rewarding; people who want only greenfield feature work may find the pager wearing.

Career outlook

BLS does not project site reliability engineering as its own occupation. The closest projection covers software developers, quality assurance analysts, and testers, a group BLS expects to grow 10 percent from 2025 to 2035, much faster than the average for all occupations, with about 106,100 openings a year on average. BLS ties that demand to continued expansion of software development for artificial intelligence, the internet of things, robotics and other automation applications. Each of those systems has to run in production somewhere, and someone has to answer the page when it does not.

What outage data says

Uptime Institute's Annual outage analysis 2026, a global study published May 11, 2026, reports that outage frequency on a per-site basis has declined for the fifth consecutive year, but that the pace of improvement has slowed and around one in 10 respondents still say their last outage had serious or severe impacts. It also reports that outages linked to fiber and connectivity issues are rising and are more likely to result in extended disruptions. For an SRE, that second finding is a reminder that dependency mapping has to reach past the application into the network paths and providers underneath it.

Lessons from public post-incident reports

Two public cloud failures in 2025 read like a syllabus for the job. On June 12, 2025, Google Cloud, Google Workspace and Google Security Operations products experienced increased 503 errors in external API requests after a policy change was inserted into the regional Spanner tables that Service Control, Google's policy check system, uses for policies; the incident lasted 3 hours, and Google's report says a null pointer crashed the binary and that if the code path had been flag protected, the issue would have been caught in staging. On October 19 and 20, 2025, a service disruption in AWS's N. Virginia (us-east-1) Region began with what AWS describes as a latent race condition in the DynamoDB DNS management system that left an incorrect empty DNS record for the service's regional endpoint, and AWS counts three distinct periods of impact to customer applications. Together they illustrate the craft skills the job depends on: feature flags, staged rollout, safe automation, and knowing how dependencies fail.

AI in the incident loop

AI agents are now sold inside incident platforms. PagerDuty's release notes record SRE Agent Skills reaching general availability on September 21, 2026, and AI-powered incident communications reaching general availability on October 22, 2026. For working SREs, the practical questions are which actions an agent may take on its own, how its suggestions are logged in the incident timeline, and who reviews its access. None of the sources cited here measures the effect of these tools on SRE hiring.

Advancement

Advancement can run from SRE to senior SRE, then split. The technical branch leads to staff and principal roles that set reliability standards across many teams; the management branch leads to SRE manager and head of infrastructure or platform. Some engineers move sideways into platform engineering, security engineering or performance work, where the same incident and automation skills carry over.

Sample cover letter

Dear Hiring Manager,

I am applying for the DevOps Site Reliability Engineer position on your infrastructure team. For the past four years I have been a systems engineer at a regional health insurer, where I moved from patching servers by hand to owning the reliability of our member portal and claims APIs.

When I took over the portal, it had dashboards but no agreed targets, and every slow afternoon turned into a debate about whether the system was "down." I worked with the product owner to define two service level objectives, one for successful logins and one for page latency, and wired alerts to those objectives instead of to CPU graphs. Pages to the on-call engineer dropped sharply, and the ones that remained were real problems.

I also led our move from hand-built virtual machines to a managed Kubernetes cluster defined in Terraform. The part I am proudest of is the rollout process: canary deployments with automatic rollback, which caught a bad configuration change during open enrollment before it reached more than a handful of members.

On-call has taught me to mitigate first and investigate second. After an expired certificate took down a partner integration one night, I ran the post-incident review, kept it blameless, and wrote the automation that now renews and checks every certificate we own.

I am drawn to your team because your engineering blog describes error budgets that actually gate releases, and I want to work where reliability decisions are made with data. I would welcome the chance to walk you through an incident I handled and how I would approach your stack.

Sincerely, Jordan Alvarez

Frequently asked questions

What does a DevOps Site Reliability Engineer (SRE) do?
A DevOps Site Reliability Engineer (SRE) is a software engineer who runs production systems: setting reliability targets, automating operations work, carrying the pager and leading the response when a service fails. The role sits between application development teams and the cloud or data center platform they deploy on, in corporate IT departments, software companies and hosting providers. BLS does not count SREs separately; O*NET's Job Titles file lists the title under Software Developers, among other occupations, and that occupation's May 2025 national wages ran from $82,460 at the 10th percentile to $214,670 at the 90th, with a median of $135,980. The work is judged by service level objectives, error budgets and the quality of post-incident reviews.
What are the main duties of a DevOps Site Reliability Engineer (SRE)?
Core duties include: define service level indicators and objectives with product owners, then track error budget burn and flag services spending their reliability allowance too fast; carry the pager on a shared on-call rotation, triage alerts, and act as incident commander or operations lead during major production outages; and write blameless post-incident reviews covering timeline, contributing factors and follow-up actions, then chase those actions to completion with the owning teams.
How is a DevOps Site Reliability Engineer (SRE) different from a DevOps engineer?
The two jobs share tools: pipelines, Kubernetes, infrastructure as code and cloud consoles. DevOps work centers on getting code built, tested and deployed, while the SRE model adds explicit reliability targets, error budgets that can pause releases, and a deliberate limit on how much time engineers spend firefighting. In job titles that combine the two, expect both the delivery pipeline and the pager.
What is an error budget?
It is the gap between perfect reliability and the service level objective a team has agreed to, and the team spends it on releases, experiments and failures. Google's SRE book argues that 100% is the wrong reliability target for basically everything, and gives the example of stopping releases for the remainder of the quarter once the budget is depleted.
How much of an SRE's time goes to on-call and tickets?
Google's SRE book describes a 50% cap on the aggregate ops work for all of its SREs, counting tickets, on-call and manual tasks, with the remaining time reserved for engineering. At Google, teams that consistently spend less than 50% of their time on development work are expected to change their practices, often by shifting some operations burden back to the development team. Other employers set their own rotations and limits, so ask about them in interviews.
Will AI agents replace site reliability engineers?
AI agents are now part of incident tooling: PagerDuty's release notes say its SRE Agent, generally available since October 30, 2025, automatically classifies incidents, surfaces critical context from past incidents, and recommends remediation steps. Those agents still act inside an incident process that engineers design, grant permissions to and answer for. None of the sources cited here measures an effect on SRE employment.
What tools does an SRE use day to day?
Expect a cloud provider's console and CLI, Kubernetes, an infrastructure-as-code tool such as Terraform, a metrics and alerting stack such as Prometheus and Grafana, tracing through OpenTelemetry, and a paging and incident platform. Python, Go and shell scripts tie those pieces together, and the exact mix depends on the employer's stack.

Sources

Salary figures and role details on this page were checked against the following sources. Dates show when each was last reviewed.

  1. Software Developers, BLS Occupational Employment and Wage Statistics (May 2025)Checked Nov 10, 2026
  2. Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services: Occupational Employment and Wages, BLS Occupational Employment and Wage Statistics (May 2025)Checked Nov 10, 2026
  3. Management of Companies and Enterprises: Occupational Employment and Wages, BLS Occupational Employment and Wage Statistics (May 2025)Checked Nov 10, 2026
  4. O*NET 30.3 Database: Job Titles file, National Center for O*NET Development (2026)Checked Nov 10, 2026
  5. Software Developers, Quality Assurance Analysts, and Testers, Occupational Outlook Handbook, U.S. Bureau of Labor Statistics (2025-2035 projections)Checked Nov 10, 2026
  6. Site Reliability Engineering, Chapter 1: Introduction, Google (2016)Checked Nov 10, 2026
  7. Annual outage analysis 2026 (global), Uptime Institute Intelligence (May 11, 2026)Checked Nov 10, 2026
  8. Incident Report: Google Cloud, Google Workspace and Google Security Operations 503 errors, Google Cloud Service Health (June 13, 2025)Checked Nov 10, 2026
  9. Summary of the Amazon DynamoDB Service Disruption in the Northern Virginia (US-EAST-1) Region, Amazon Web Services (October 2025)Checked Nov 10, 2026
  10. Platform Release Notes, PagerDuty Docs, PagerDuty (2026)Checked Nov 10, 2026
  11. OpenTelemetry Certified Associate (OTCA), Linux Foundation Education (2026)Checked Nov 10, 2026
  12. Prometheus Certified Associate (PCA), Linux Foundation Education (2026)Checked Nov 10, 2026
  13. Certified Kubernetes Administrator (CKA), The Linux Foundation (2026)Checked Nov 10, 2026
  14. Professional Cloud DevOps Engineer Certification, Google Cloud (2026)Checked Nov 10, 2026
  15. AWS Certified DevOps Engineer - Professional, Amazon Web Services (2026)Checked Nov 10, 2026
  16. Terraform Certifications: Terraform Associate, HashiCorp Developer (2026)Checked Nov 10, 2026