DevOpsil
INCIDENT LIBRARY

DevOps Incident Library

Searchable library of real-world failure patterns and fixes. Find the error you are seeing, understand the root cause, and fix it fast.

65
Incidents
20
Categories
326
Fixes

65 incidents found

KubernetesCritical

Kubernetes Pod CrashLoopBackOff

Pod status shows CrashLoopBackOff

6 fixesView fix →
KubernetesCritical

Kubernetes Pod OOMKilled

Pod status shows OOMKilled

5 fixesView fix →
KubernetesHigh

Kubernetes ImagePullBackOff

Pod status shows ImagePullBackOff or ErrImagePull

5 fixesView fix →
NginxCritical

Nginx 502 Bad Gateway

Users see '502 Bad Gateway' error page

5 fixesView fix →
NginxHigh

Nginx 504 Gateway Timeout

Users see '504 Gateway Timeout' after a long wait

5 fixesView fix →
DockerHigh

Docker No Space Left on Device

Docker build fails with 'no space left on device'

5 fixesView fix →
TerraformHigh

Terraform State Lock Error

Terraform plan/apply fails with 'Error acquiring the state lock'

5 fixesView fix →
AWSHigh

AWS Access Denied / Unauthorized

AWS CLI or SDK returns 'Access Denied' or 'UnauthorizedAccess'

5 fixesView fix →
NginxCritical

SSL/TLS Certificate Expired

Browser shows 'Your connection is not private' or NET::ERR_CERT_DATE_INVALID

5 fixesView fix →
LinuxCritical

DNS Resolution Failure

curl or wget fails with 'Could not resolve host'

5 fixesView fix →
DatabaseHigh

PostgreSQL Too Many Connections

Application errors: 'FATAL: too many connections for role'

5 fixesView fix →
DatabaseHigh

Redis Memory Limit Exceeded

Redis returns OOM command not allowed when used memory > maxmemory

5 fixesView fix →
CI/CDMedium

GitHub Actions Process Completed with Exit Code 1

GitHub Actions workflow fails with 'Process completed with exit code 1'

5 fixesView fix →
CI/CDMedium

Jenkins Pipeline Timeout

Jenkins build shows 'Cancelling nested steps due to timeout'

5 fixesView fix →
KubernetesMedium

Helm Release Already Exists

helm install fails with 'cannot re-use a name that is still in use'

5 fixesView fix →
DockerHigh

Docker Container Exiting Immediately

Container starts and immediately exits (status 'Exited')

5 fixesView fix →
TerraformHigh

Terraform Provider Authentication Failure

Terraform init fails with 'Error configuring provider'

5 fixesView fix →
KubernetesHigh

Kubernetes Pod Stuck in Pending State

Pod stays in Pending state indefinitely

6 fixesView fix →
LinuxMedium

Linux Permission Denied Errors

Command fails with 'Permission denied'

5 fixesView fix →
KubernetesHigh

Kubernetes Service Not Reachable

curl to ClusterIP service returns 'Connection refused' or times out

5 fixesView fix →
DockerMedium

Docker Build Context or Layer Failure

docker build fails with 'COPY failed: file not found in build context'

5 fixesView fix →
LinuxCritical

Linux Disk Full / No Inodes Left

Commands fail with 'No space left on device'

5 fixesView fix →
KubernetesHigh

Kubernetes Pods Evicted

Pods show status 'Evicted'

5 fixesView fix →
AWSHigh

AWS EC2 Instance Unreachable via SSH

SSH connection times out: 'Connection timed out'

5 fixesView fix →
NginxMedium

Nginx 413 Request Entity Too Large

File uploads fail with '413 Request Entity Too Large'

5 fixesView fix →
TerraformMedium

Terraform Drift Detected / State Mismatch

terraform plan shows unexpected changes to resources you did not modify

5 fixesView fix →
CI/CDMedium

CI/CD Docker Push Access Denied

docker push fails with 'denied: requested access to the resource is denied'

5 fixesView fix →
KubernetesMedium

Kubernetes ConfigMap/Secret Changes Not Applied

Updated ConfigMap or Secret but pods still use old values

4 fixesView fix →
AWSHigh

AWS S3 Access Denied (403 Forbidden)

S3 operations return '403 Forbidden' or 'Access Denied'

5 fixesView fix →
CI/CDMedium

CI/CD Git Clone or Checkout Failure

CI pipeline fails at git checkout/clone step

5 fixesView fix →
DatabaseHigh

PostgreSQL Deadlock Detected

Application errors: 'ERROR: deadlock detected'

5 fixesView fix →
KubernetesCritical

Kubernetes Node NotReady

kubectl get nodes shows one or more nodes in NotReady state

5 fixesView fix →
AWSMedium

AWS Lambda Function Timeout

Lambda returns 'Task timed out after X seconds'

5 fixesView fix →
DockerMedium

Docker Container Network Connectivity Issues

Container cannot reach external hosts: 'Could not resolve host'

5 fixesView fix →
NginxHigh

Nginx Cannot Connect to Unix Socket

Nginx error log: 'connect() to unix:/path/to/socket failed (13: Permission denied)'

5 fixesView fix →
KubernetesHigh

Kubernetes HPA Not Scaling Pods

HPA shows <unknown> for current metrics

5 fixesView fix →
KubernetesHigh

Kubernetes PVC Stuck in Pending State

PVC status shows Pending indefinitely

5 fixesView fix →
KubernetesHigh

Kubernetes Ingress Returns 404 for All Paths

All requests to the ingress return 404 Not Found

5 fixesView fix →
ansibleHigh

Ansible SSH Connection Timeout

Ansible playbook hangs on 'Gathering Facts'

5 fixesView fix →
ansibleMedium

Ansible 'Permission denied' with become/sudo

Task fails with 'Permission denied' when using become: true

5 fixesView fix →
monitoringCritical

Prometheus High Cardinality Causing OOM

Prometheus consuming excessive memory and getting OOMKilled

5 fixesView fix →
monitoringMedium

Grafana Dashboard Showing 'No Data'

Grafana panels display 'No data' despite metrics existing in Prometheus

5 fixesView fix →
networkingCritical

Envoy Proxy 503 No Healthy Upstream

All requests returning 503 Service Unavailable

5 fixesView fix →
networkingCritical

HAProxy Max Connection Limit Reached

New connections being refused or queued

5 fixesView fix →
service-meshHigh

Istio Sidecar Not Injected Into Pods

Pods running with only 1/1 containers instead of 2/2

5 fixesView fix →
securityCritical

HashiCorp Vault Sealed and Inaccessible

Vault API returns 503 with 'Vault is sealed'

5 fixesView fix →
gitopsHigh

ArgoCD Application Sync Failed — OutOfSync

ArgoCD app status shows OutOfSync with sync failed

5 fixesView fix →
gitopsMedium

ArgoCD Image Updater Not Detecting New Images

New container images pushed to registry but ArgoCD doesn't update

5 fixesView fix →
gcpHigh

GCP IAM Permission Denied on Service Account

API calls returning 403 PERMISSION_DENIED

5 fixesView fix →
azureHigh

Azure NSG Blocking Network Traffic

VM or AKS pods unable to reach external services

5 fixesView fix →
AWSCritical

AWS RDS Storage Full — Database Unresponsive

Database queries timing out or failing

5 fixesView fix →
gcpHigh

GKE Node Pool Exhausted — Pods Unschedulable

Pods stuck in Pending state with 'Insufficient cpu' or 'Insufficient memory'

5 fixesView fix →
TerraformHigh

Terraform Apply Timeout on Resource Creation

terraform apply hangs and eventually times out

5 fixesView fix →
DockerMedium

Docker Compose Port Already in Use

docker compose up fails with 'port is already allocated'

5 fixesView fix →
github-actionsHigh

GitHub Actions Runner Disk Full During Build

Build fails with 'No space left on device'

5 fixesView fix →
CI/CDHigh

GitLab CI Pipeline Stuck in Pending State

Pipeline jobs show 'pending' indefinitely

5 fixesView fix →
redisHigh

Redis Replication Lag Causing Stale Reads

Application reading stale data from Redis replicas

5 fixesView fix →
monitoringCritical

Elasticsearch Cluster Health Red

Cluster health API returns red status

5 fixesView fix →
AWSCritical

AWS ALB Returning 502 Bad Gateway

ALB returning 502 errors to clients

5 fixesView fix →
iacMedium

Pulumi Stack Locked — Concurrent Update Conflict

pulumi up fails with 'the stack is currently locked'

5 fixesView fix →
LinuxHigh

Systemd Service Failed to Start

Service shows 'failed' status in systemctl

5 fixesView fix →
LinuxMedium

Linux TCP Connection Refused

curl/wget returns 'Connection refused'

5 fixesView fix →
AWSHigh

AWS ECS Task Stopped Unexpectedly

ECS tasks in STOPPED state with 'Essential container exited'

5 fixesView fix →
databasesCritical

MongoDB Connection Pool Exhausted

Application errors: 'MongoTimeoutError: connection timed out'

5 fixesView fix →
networkingCritical

Cloudflare 522 Connection Timed Out to Origin

Users seeing Cloudflare 522 error page

5 fixesView fix →