Staff+ Software Engineer (Observability)

Join Anthropic, a rapidly growing AI research and development company focused on creating safe and beneficial AI systems. As a Staff+ Software Engineer on the Observability team, you will play a crucial role in building and maintaining the monitoring and telemetry infrastructure that supports all engineers and researchers at Anthropic. Your work will directly impact the reliability and operational excellence of our research and product systems.

• Design and build scalable telemetry ingest and storage pipelines for metrics, logs, traces, and error data across Anthropic’s multi-cluster infrastructure.
• Own and evolve core observability platforms, driving migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growth.
• Drive alerting and SLO infrastructure that enables teams to define, monitor, and respond to reliability targets with minimal noise.

• Have experience operating or building on top of observability platforms such as Prometheus, Grafana, ClickHouse, OpenTelemetry, or similar systems
• Have strong proficiency in at least one of Python, Rust, or Go
• Have excellent communication skills and enjoy partnering with internal teams to improve their operational visibility and incident response capabilities
• Understand high-throughput data pipelines, columnar storage engines, and the tradeoffs involved in ingesting and querying telemetry data at scale
• Have deep experience with at least one observability signal area (metrics, logging, tracing, or error analytics) and familiarity with the others
• Are excited about building foundational infrastructure and are comfortable working independently on ambiguous, high-impact technical challenges
• Have 10+ years of relevant industry experience building and operating large-scale observability or monitoring infrastructure
• Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience
• We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed
• Experience operating metrics systems at very high cardinality (hundreds of millions of active time series or more)
• Experience with log storage migrations or operating columnar databases (ClickHouse, BigQuery, or similar) for analytics workloads
• Experience with OpenTelemetry instrumentation, collector pipelines, and tail-based sampling strategies
• Experience with Kubernetes-native monitoring, eBPF-based observability, or continuous profiling
• Experience building or operating alerting platforms, on-call tooling, or SLO frameworks at scale
• Interest in applying AI/LLMs to operational workflows such as automated root cause analysis, anomaly detection, or intelligent alerting