Get in Touch
 Duration 14 hours

Course Outline

Designing an Open AIOps Architecture

  • An overview of the key components within open AIOps pipelines.
  • Understanding data flow from initial ingestion to final alerting.
  • Comparing tools and defining an integration strategy.

Data Collection and Aggregation

  • Ingesting time-series data using Prometheus.
  • Capturing log data with Logstash and Beats.
  • Normalizing data to enable effective cross-source correlation.

Building Observability Dashboards

  • Visualizing metrics effectively with Grafana.
  • Constructing Kibana dashboards for detailed log analytics.
  • Utilizing Elasticsearch queries to extract actionable operational insights.

Anomaly Detection and Incident Prediction

  • Exporting observability data into Python-based pipelines.
  • Training ML models for outlier detection and trend forecasting.
  • Deploying models for live inference within the observability pipeline.

Alerting and Automation with Open Tools

  • Creating Prometheus alert rules and configuring Alertmanager routing.
  • Triggering scripts or API workflows to enable automated responses.
  • Leveraging open-source orchestration tools such as Ansible and Rundeck.

Integration and Scalability Considerations

  • Managing high-volume ingestion and ensuring long-term data retention.
  • Implementing security measures and access controls within open-source stacks.
  • Scaling individual layers independently, including ingestion, processing, and alerting.

Real-World Applications and Extensions

  • Case studies focusing on performance tuning, downtime prevention, and cost optimization.
  • Extending pipelines to include tracing tools or service graph visualizations.
  • Best practices for operating and maintaining AIOps systems in production.

Summary and Next Steps

Requirements

  • Practical experience with observability tools such as Prometheus or ELK.
  • A solid working knowledge of Python and fundamental machine learning concepts.
  • A clear understanding of IT operations and alerting workflows.

Audience

  • Advanced Site Reliability Engineers (SREs).
  • Data engineers working within operations teams.
  • DevOps platform leads and infrastructure architects.

Number of participants


Price per participant

Provisional Upcoming Courses (Require 5+ participants)

Related Categories