Senior Site Reliability Engineer, Observability

Who We Are

Cisco ThousandEyes is a Digital Experience Assurance platform that empowers organizations to deliver flawless digital experiences across every network – even the ones they don’t own. Powered by AI and an unmatched set of cloud, internet and enterprise network telemetry data, ThousandEyes enables IT teams to proactively detect, diagnose, and remediate issues – before they impact end- user experiences.

ThousandEyes is deeply integrated across the entire Cisco technology portfolio and beyond, helping customers deploy at scale while also delivering AI-powered assurance insights within Cisco’s leading Networking, Security, Collaboration, and Observability portfolios.

About The Role

The Site Reliability Engineering team focused on Observability is responsible for providing the tools, services, and infrastructure to monitor and observe the ThousandEyes platform. Leveraging cloud native tools like Prometheus, Grafana, Kibana, and even ThousandEyes itself, we enable our developers to instrument, analyze, and monitor their applications. The Senior Site Reliability Engineer in this role will work together with the team to own our logging pipeline and monitoring stack while working with developers to continuously improve our view of the platform.

What You'll Do

As we expand our platform to a multi-region scale, it is essential to design and implement strategies that enhance visibility. This involves designing, deploying, and maintaining cloud-native monitoring services that are both elastic and resilient to failure across AWS and GCP. It is also crucial to establish standards and best practices for the instrumentation of container-based services and cloud-managed services. The maintenance of our alerting pipeline is key to ensuring that notifications are timely, accurate, and directed to the appropriate channels. Automation is a priority, as it allows our monitoring platforms to scale effortlessly, promoting a self-service approach. Additionally, active participation and contribution to the improvement of our 24x7 incident response and on-call rotation are vital to the robustness of our operational response.

Qualifications

• Strong Infrastructure as Code skills, ideally with Terraform and Kubernetes.
• Strong knowledge of modern logging tool sets, including Logstash or Fluentd.
• Understanding of Prometheus and it’s ecosystem, including Alertmanager.
• Good knowledge of Application Performance Monitoring tools and crash reporting tools, such as Sentry.
• Good knowledge of cloud provider managed services, and how they can be leveraged in our context.
• Ability to write high quality code in Python, Go, or equivalent languages.

Cisco values the perspectives and skills that emerge from employees with diverse backgrounds. That's why Cisco is expanding the boundaries of discovering top talent by not only focusing on candidates with educational degrees and experience but also placing more emphasis on unlocking potential. We believe that everyone has something to offer and that diverse teams are better equipped to solve problems, innovate, and create a positive impact.
We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification. Research shows that people from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy. We urge you not to prematurely exclude yourself and to apply if you're interested in this work.

Cisco is an Affirmative Action and Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis. Cisco will consider for employment, on a case by case basis, qualified applicants with arrest and conviction records.