Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Introduction to AI Inference with Docker
- Grasping the nature of AI inference workloads
- Advantages of utilizing containerized inference
- Deployment scenarios and associated constraints
Developing AI Inference Containers
- Choosing appropriate base images and frameworks
- Packaging pre-trained models effectively
- Organizing inference code for container execution
Securing Containerized AI Services
- Reducing the container's attack surface
- Handling secrets and sensitive files securely
- Implementing safe networking and API exposure strategies
Techniques for Portable Deployment
- Ooptimizing images to enhance portability
- Guaranteeing predictable runtime environments
- Managing dependencies across different platforms
Local Deployment and Testing
- Running services locally using Docker
- Debugging inference containers
- Evaluating performance and reliability
Deployment on Servers and Cloud VMs
\r- Adapting containers for remote environments
- Configuring secure server access protocols
- Deploying inference APIs on cloud VMs
Leveraging Docker Compose for Multi-Service AI Systems
- Orchestrating inference alongside supporting components
- Managing environment variables and configuration settings
- Scaling microservices effectively with Compose
Monitoring and Maintenance of AI Inference Services
- Approaches to logging and observability
- Identifying failures within inference pipelines
- Updating and versioning models in production environments
Summary and Next Steps
Requirements
- Familiarity with fundamental machine learning concepts
- Practical experience in Python or backend development
- Knowledge of basic container principles
Audience
- Software Developers
- Backend Engineers
- Teams responsible for deploying AI services
14 Hours
Testimonials (3)
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
the trainer had a lot of knowledge and patience to share with us
Bogdan Olaru
Course - Introduction to Docker
The knowledge and exchanges with Augustin