Apache Spark With Examples for Big Data Analytics

Course

Online

£ 10 + VAT

Description

  • Type

    Course

  • Methodology

    Online

  • Start date

    Different dates available

This course covers all the fundamentals you need to write complex Spark applications. By the end of this course you will get in-depth knowledge on Spark core,Spark SQL,Spark Streaming.This course is divided into 9 modulesDive Into Scala - Understand the basics of Scala that are required for programming Spark applications.Learn about the basic constructs of Scala such as variable types, control structures, collections,and more.
OOPS and Functional Programming in Scala - Learn about object oriented programming and functional programming techniques in Scala
Introduction to Apache Spark - Learn Spark Architecture,Spark Components and spark use-cases
Spark Basics - Learn how to configure/run spark in eclipse/intellij
Working with RDDs in Spark - Learn what is Resilient Distributed Dataset,Different types of actions and transformations which can be applied on RDDs
Aggregating Data with Pair RDDs - Learn how Pair RDD is different from RDD,Different types of actions and transformations which can be applied on Pair RDDs
Advanced Spark Concepts - Learn how Spark uses Broadcast variables and Accumulators to perform calculations,how persistence and partitioning helps to achieve performance
Spark SQL and Data Frames - Understand the difference between Dataframe and Dataset
Spark Streaming - Learn how to analyse massive amount of dataset on the flyAll the concepts are explained using hands-on examples.This course covers 10+ hands-on big data examples such asExplore player data from 2014 world cup
Aggregate data from ebay online auction data
Understand different data points from Adhaar data
Develop application to analyse funds received by Indian startup
Explore the price trend by looking at the real estate data in California
Help retailer to find out valid and invalid purchase transactions of chain of stores in Bangalore
Write Spark program find out count of stores in each US region from USA states & Store locations data

Facilities

Location

Start date

Online

Start date

Different dates availableEnrolment now open

About this course

Get clear understanding of the limitations of MapReduce and role of Spark in overcoming these limitations
Understand fundamentals of Scala Programming Language and it’s features
Expertise in using RDD for creating applications in Spark
Mastering SQL queries using SparkSQL
Gain thorough understanding of Spark Streaming features

Questions & Answers

Add your question

Our advisors and other users will be able to reply to you

Who would you like to address this question to?

Fill in your details to get a reply

We will only publish your name and question

Reviews

This centre's achievements

2021

All courses are up to date

The average rating is higher than 3.7

More than 50 reviews in the last 12 months

This centre has featured on Emagister for 4 years

Subjects

  • Ms Word
  • Programming
  • Football
  • Real Estate
  • SQL
  • Apache
  • Access
  • Word

Course programme

Dive Into Scala 9 lectures 01:18:02 Introduction to scala Environment Setup Hello Scala Flow Controls Functions and operators OOPS concepts Traits Arrays Collections Dive Into Scala 9 lectures 01:18:02 Introduction to scala Environment Setup Hello Scala Flow Controls Functions and operators OOPS concepts Traits Arrays Collections Introduction to scala Introduction to scala Introduction to scala Introduction to scala Environment Setup Environment Setup Environment Setup Environment Setup Hello Scala Hello Scala Hello Scala Hello Scala Flow Controls Flow Controls Flow Controls Flow Controls Functions and operators Functions and operators Functions and operators Functions and operators OOPS concepts OOPS concepts OOPS concepts OOPS concepts Traits Traits Traits Traits Arrays Arrays Arrays Arrays Collections Collections Collections Collections Introduction To Apache Spark 4 lectures 19:12 BigData and Need for Apache Spark What is Spark,Spark Features and Spark Eco System Spark Architecture Spark Usecases Introduction To Apache Spark 4 lectures 19:12 BigData and Need for Apache Spark What is Spark,Spark Features and Spark Eco System Spark Architecture Spark Usecases BigData and Need for Apache Spark BigData and Need for Apache Spark BigData and Need for Apache Spark BigData and Need for Apache Spark What is Spark,Spark Features and Spark Eco System What is Spark,Spark Features and Spark Eco System What is Spark,Spark Features and Spark Eco System What is Spark,Spark Features and Spark Eco System Spark Architecture Spark Architecture Spark Architecture Spark Architecture Spark Usecases Spark Usecases Spark Usecases Spark Usecases Spark Configuration 2 lectures 05:33 Setup Environment Word Count Spark Program Spark Configuration 2 lectures 05:33 Setup Environment Word Count Spark Program Setup Environment Setup Environment Setup Environment Setup Environment Word Count Spark Program Word Count Spark Program Word Count Spark Program Word Count Spark Program Working with RDDs in Spark 8 lectures 36:55 What is RDD & How to Create Transformations - filter & map Solving Cars By Mileage problem using map and filter transformations Solving Cars In America problem using map and filter transformations Transformations - flatmap,union & intersection Analysis on 2014 football world cup player information RDD Actions Nasa Access Logs Analysis Working with RDDs in Spark 8 lectures 36:55 What is RDD & How to Create Transformations - filter & map Solving Cars By Mileage problem using map and filter transformations Solving Cars In America problem using map and filter transformations Transformations - flatmap,union & intersection Analysis on 2014 football world cup player information RDD Actions Nasa Access Logs Analysis What is RDD & How to Create What is RDD & How to Create What is RDD & How to Create What is RDD & How to Create Transformations - filter & map Transformations - filter & map Transformations - filter & map Transformations - filter & map Solving Cars By Mileage problem using map and filter transformations Solving Cars By Mileage problem using map and filter transformations Solving Cars By Mileage problem using map and filter transformations Solving Cars By Mileage problem using map and filter transformations Solving Cars In America problem using map and filter transformations Solving Cars In America problem using map and filter transformations Solving Cars In America problem using map and filter transformations Solving Cars In America problem using map and filter transformations Transformations - flatmap,union & intersection Transformations - flatmap,union & intersection Transformations - flatmap,union & intersection Transformations - flatmap,union & intersection Analysis on 2014 football world cup player information Analysis on 2014 football world cup player information Analysis on 2014 football world cup player information Analysis on 2014 football world cup player information RDD Actions RDD Actions RDD Actions RDD Actions Nasa Access Logs Analysis Nasa Access Logs Analysis Nasa Access Logs Analysis Nasa Access Logs Analysis Aggregating data with pair RDDs 5 lectures 34:01 Pair RDD - How to Create,reduceByKey groupByKey and reduceBykey vs groupByKey Transformations - mapvalues sortbykey countbykey Analysis on 2015 Indian Startup funding information Analysis on real estate data using pair rdd operations Aggregating data with pair RDDs

Additional information

Basic programming skills A computer running Windows, OSX or Linux The software needed for this course is freely available and detailed steps to install and configure software is include in the course

Apache Spark With Examples for Big Data Analytics

£ 10 + VAT