Get in Touch

Course Outline

Foundations of Hybrid AI Deployment

  • Understanding hybrid, cloud, and edge deployment models
  • AI workload characteristics and infrastructure constraints
  • Selecting the appropriate deployment topology

Containerising AI Workloads with Docker

  • Building GPU and CPU inference containers
  • Managing secure images and registries
  • Implementing reproducible environments for AI applications

Deploying AI Services to Cloud Environments

  • Executing inference on AWS, Azure, and GCP via Docker
  • Provisioning cloud compute resources for model serving
  • Securing cloud-based AI endpoints

Edge and On-Premise Deployment Techniques

  • Running AI workloads on IoT devices, gateways, and microservers
  • Utilising lightweight runtimes for edge environments
  • Managing intermittent connectivity and local data persistence

Hybrid Networking and Secure Connectivity

  • Establishing secure tunneling between edge nodes and the cloud
  • Managing certificates, secrets, and token-based access
  • Tuning performance for low-latency inference

Orchestrating Distributed AI Deployments

  • Utilising K3s, Kubernetes (K8s), or lightweight orchestration for hybrid setups
  • Implementing service discovery and workload scheduling
  • Automating multi-location rollout strategies

Monitoring and Observability Across Environments

  • Tracking inference performance across various locations
  • Centralised logging for hybrid AI systems
  • Failure detection and automated recovery mechanisms

Scaling and Optimising Hybrid AI Systems

  • Scaling edge clusters and cloud nodes
  • Optimising bandwidth usage and caching strategies
  • Balancing compute loads between cloud and edge resources

Summary and Next Steps

Requirements

  • Fundamental understanding of containerisation concepts
  • Practical experience with Linux command-line operations
  • Familiarity with AI model deployment workflows

Audience

  • Infrastructure architects
  • Site Reliability Engineers (SREs)
  • Edge and IoT developers
 21 Hours

Number of participants


Price per participant

Testimonials (3)

Provisional Upcoming Courses (Require 5+ participants)

Related Categories