Course Outline

Introduction

Overview of Apache Spark Features and Architecture

  • Apache Spark modules: Spark SQL, Spark Streaming, MLlib, GraphX
  • RDD, Dataframes, drive-workers, DAG, etc.

Setting up Apache Spark on .NET

  • Preparing the Java VM
  • Running .NET for Apache Spark using .NET Core

Getting Started

  • Creating a sample .NET console application
  • Adding the Spark driver
  • Initializing a SparkSession
  • Executing the application

Preparing Data

  • Building a data preparation pipeline
  • Performing ETL (Extract, Transform, and Load)

Machine Learning

  • Building a machine learning model
  • Preparing the data
  • Training a model

Real-time Processing

  • Processed streaming data in real-time
  • Case study: monitoring sensor data

Interactive Query

  • Working with Spark SQL
  • Analyzing structured data

Visualizing Results

  • Plotting results
  • Using third-party tools to visualize results

Troubleshooting

Summary and Conclusion

Requirements

  • .NET programming experience using C# or F#

Audience

  • Developers
 21 Hours

Number of participants



Price per participant

Testimonials (5)

Related Courses

Python and Spark for Big Data (PySpark)

21 Hours

Introduction to Graph Computing

28 Hours

Artificial Intelligence - the most applied stuff - Data Analysis + Distributed AI + NLP

21 Hours

Apache Spark MLlib

35 Hours

Machine Learning and AI with ML.NET

21 Hours

Advanced Blazor

21 Hours

Blazor WebAssembly

14 Hours

Introduction to Blazor

14 Hours

Implementing the Actor Model with Microsoft Orleans

14 Hours

High-Performance Application Development with .NET Core

14 Hours

Introduction to .Net Core

14 Hours

.NET Core and Angular Training Course

21 Hours

Entity Framework Core 2.0

14 Hours

Introducing C# 6.0 with Visual Studio 2015/2017

28 Hours

Advanced Programming in C#

35 Hours

Related Categories

1