Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architectures
- Designing modular and reusable components
- Hybrid approaches across various systems
Advanced Performance Engineering
- Step-level optimization techniques
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Integrating scripting within transformations
- Developing custom plugins
- Extending PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming integrations
- Interacting with big data platforms
- Advanced processing of files and APIs
Data Governance, Security, and Compliance
- Securing transformations and managing credentials
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Managing extensive job networks
- Designing error recovery and failover mechanisms
- Implementing environment-level orchestration
Repository, Version Control, and CI/CD
- Enterprise repository strategies
- Integrating PDI with Git
- Implementing continuous deployment patterns
Deployment, Monitoring, and Production Operations
- Promoting solutions across different environments
- Utilizing operational tooling and dashboards
- Achieving end-to-end production readiness
Summary and Next Steps
Requirements
- A solid understanding of ETL pipelines and data modeling principles
- Practical experience with intermediate-level PDI transformations
- Strong proficiency in SQL and scripting
Audience
- Senior data engineers
- ETL architects
- Professionals responsible for managing complex data integration workloads
21 Hours
Testimonials (1)
It's a hands-on session.
