Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architectures.
- Creating modular and reusable components.
- Hybrid approaches across various systems.
Advanced Performance Engineering
- Step-level optimisation.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load.
Automation, Scripting, and Custom Extensions
- Scripting within transformations.
- Developing custom plugins.
- Expanding PDI capabilities using Java and JavaScript.
Complex Data Processing and Integrations
- Real-time and streaming integrations.
- Interacting with big data platforms.
- Advanced file and API processing.
Data Governance, Security, and Compliance
- Securing transformations and credential management.
- Data lineage and traceability.
- Regulatory and compliance considerations.
Enterprise Orchestration and Scheduling
- Managing extensive job networks.
- Designing error recovery and failover mechanisms.
- Orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Integrating PDI with Git.
- Patterns for continuous deployment.
Deployment, Monitoring, and Production Operations
- Promoting solutions across different environments.
- Operational tooling and dashboards.
- Ensuring end-to-end production readiness.
Summary and Next Steps
Requirements
- A solid grasp of ETL pipelines and data modelling.
- Practical experience with intermediate-level PDI transformations.
- Strong proficiency in SQL and scripting languages.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals responsible for managing complex data integration workloads.
Testimonials (1)
It's a hands-on session.
