What is Scala?

Why Scala for Apache Spark?

Scala in other Frameworks

Introduction to Scala REPL

Basic Scala Operations

Variable Types in Scala

Control Structures in Scala

For each loop, Functions and Procedures

Collections in Scala- Array

ArrayBuffer, Map, Tuples, Lists, and more

Apache Spark at Yahoo!

Functional Programming

Higher Order Functions

Anonymous Functions

Class in Scala

Getters and Setters

Custom Getters and Setters

Properties with only Getters

Auxiliary Constructor and Primary Constructor

Singletons

Extending a Class

Overriding Methods

Traits as Interfaces and Layered Traits

Apache Spark’s Place in the Hadoop Ecosystem

Apache Spark Components & its Architecture

Apache Spark Deployment Modes

Introduction to Apache Spark Shell

Writing your first Apache Spark Job Using SBT

Submitting Apache Spark Job

Apache Spark Web UI

Data Ingestion using Sqoop

Challenges in Existing Computing Methods

Probable Solution & How RDD Solves the Problem

What is RDD, Its Operations, Transformations & Actions

Data Loading and Saving Through RDDs

Key-Value Pair RDDs

Other Pair RDDs, Two Pair RDDs

RDD Lineage

RDD Persistence

WordCount Program Using RDD Concepts

RDD Partitioning & How It Helps Achieve Parallelization

Passing Functions to Apache Spark

Need for Apache Spark SQL

What is Apache Spark SQL?

Apache Spark SQL Architecture

SQL Context in Apache Spark SQL

User Defined Functions

Data Frames & Datasets

Interoperating with RDDs

JSON and Parquet File Formats

Loading Data through Different Sources

Apache Spark – Hive Integration

Why Machine Learning?

What is Machine Learning?

Where Machine Learning is Used?

Face Detection: USE CASE

Different Types of Machine Learning Techniques

Introduction to MLlib

Features of MLlib and MLlib Tools

Various ML algorithms supported by MLlib

Supervised Learning - Linear Regression, Logistic Regression, Decision Tree, Random Forest

Unsupervised Learning - K-Means Clustering & How It Works with MLlib

Analysis of US Election Data using MLlib (K-Means)

Need for Kafka

What is Kafka?

Core Concepts of Kafka

Kafka Architecture

Where is Kafka Used?

Understanding the Components of Kafka Cluster

Configuring Kafka Cluster

Kafka Producer and Consumer Java API

The need of Apache Flume

What is Apache Flume?

Basic Flume Architecture

Flume Sources

Flume Sinks

Flume Channels

Flume Configuration

Integrating Apache Flume and Apache Kafka

Drawbacks in Existing Computing Methods

Why Streaming is Necessary?

What is Apache Spark Streaming?

Apache Spark Streaming Features

Apache Spark Streaming Workflow

How Uber Uses Streaming Data

Streaming Context & DStreams

Transformations on DStreams

Describe Windowed Operators and Why it is Useful

Important Windowed Operators

Slice, Window and ReduceByWindow Operators

Stateful Operators

Apache Spark Streaming: Data Sources

Streaming Data Source Overview

Apache Flume and Apache Kafka Data Sources

Example: Using a Kafka Direct Data Source

Perform Twitter Sentimental Analysis Using Apache Spark Streaming