Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Introduction to GPU-Accelerated Containerisation
- Understanding GPU utilisation in deep learning workflows
- How Docker facilitates GPU-based workloads
- Key performance factors to consider
Installing and Configuring the NVIDIA Container Toolkit
- Setting up drivers and ensuring CUDA compatibility
- Validating GPU access within containers
- Configuring the runtime environment
Building GPU-Enabled Docker Images
- Utilising CUDA base images
- Packaging AI frameworks into GPU-ready containers
- Managing dependencies for training and inference
Running GPU-Accelerated AI Workloads
- Executing training jobs using GPUs
- Managing multi-GPU workloads
- Monitoring GPU utilisation
Optimising Performance and Resource Allocation
- Limiting and isolating GPU resources
- Optimising memory, batch sizes, and device placement
- Performance tuning and diagnostics
Containerised Inference and Model Serving
- Constructing inference-ready containers
- Serving high-load workloads on GPUs
- Integrating model runners and APIs
Scaling GPU Workloads with Docker
- Strategies for distributed GPU training
- Scaling inference microservices
- Coordinating multi-container AI systems
Security and Reliability for GPU-Enabled Containers
- Ensuring secure GPU access in shared environments
- Hardening container images
- Managing updates, versions, and compatibility
Summary and Next Steps
Requirements
- A solid understanding of deep learning fundamentals
- Experience with Python and prevalent AI frameworks
- Familiarity with core containerisation concepts
Target Audience
- Deep learning engineers
- Research and development teams
- AI model trainers
Testimonials (2)
As i said before , for a person like me (no exp. ) this was a gateway to understanding features and functions with these programs/tools & etc. .
Patrick V. Duylovski - UBB + DZI (KBC GROUP)
Course - Docker and Kubernetes
multi-tiered, structured course programme.
