Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Foundations of Secure Local AI
- Understanding the concept of local and on-premise AI in regulated contexts.
- Comparing cloud-based AI with internal deployments for sensitive workloads.
- Identifying common enterprise applications for private assistants and workflow support.
- Exploring the core components of a secure local AI architecture.
Ollama and Open Model Basics
- Understanding how Ollama integrates into a local development stack.
- Downloading, running, and managing models locally.
- Selecting models based on size, quality, hardware requirements, and licensing.
- Aligning model choices with practical business tasks.
Preparing the On-Premise Environment
- Preparing hosts, workstations, and servers for deployment.
- Installing and configuring Ollama for local inference.
- Utilizing containers and internal development tooling.
- Verifying API access and ensuring basic operational readiness.
Working with Local Models Effectively
- Executing prompts and shaping outputs using system instructions.
- Leveraging templates for consistent enterprise tasks.
- Managing model versions and internal artifacts.
- Performing basic performance tuning for CPU and GPU deployments.
Building Practical Agentic Workflows
- Defining what constitutes an agentic workflow within a controlled setting.
- Implementing simple patterns for planning, tool usage, and response loops.
- Designing task-focused assistants for internal operations.
- Incorporating human review, fallback logic, and error handling mechanisms.
Private Retrieval Workflows
- Understanding retrieval-augmented generation (RAG) basics for internal knowledge access.
- Preparing documents for chunking, indexing, and search.
- Connecting a local vector store to an Ollama-based application.
- Enhancing relevance and answer quality through improved retrieval patterns.
Security, Governance, and Compliance Practices
- Defining data handling boundaries and addressing privacy considerations.
- Implementing access control, logging, and audit support mechanisms.
- Ensuring prompt safety, output controls, and establishing guardrails.
- Establishing governance checkpoints for regulated deployment and operation.
Enterprise Integration Patterns
- Exposing local AI capabilities through internal APIs.
- Integrating assistants with internal applications and services.
- Supporting assistant, batch processing, and workflow automation use cases.
- Maintaining solutions within controlled network boundaries.
Evaluating Local AI Solutions
- Assessing quality, reliability, and consistency of models.
- Testing against business, policy, and safety requirements.
- Comparing model options for specific enterprise tasks.
- Establishing a practical improvement cycle for internal teams.
Hands-On Implementation Lab
- Constructing a private assistant using Ollama and an open-source model.
- Adding retrieval capabilities over approved internal documents.
- Introducing simple agentic actions and safety controls.
- Reviewing deployment, operations, and governance checkpoints.
Adoption Planning and Next Steps
- Reviewing key design and deployment decisions.
- Identifying common pitfalls in regulated AI projects.
- Planning pilot use cases and aligning stakeholders.
- Defining a roadmap for secure local AI adoption.
Requirements
- Fundamental understanding of AI concepts and software development principles.
- Proficiency with command-line tools, containers, or local development environments.
- Basic scripting or programming experience.
Audience
- Developers and technical teams constructing private AI solutions on internal infrastructure.
- Security, compliance, and platform professionals supporting AI initiatives in regulated sectors.
- Technical leaders in finance, healthcare, government, and defense evaluating the adoption of on-premise AI.
21 Hours
