What are you looking for?

Simply enter your keyword and we will help you find what you need.

Training

XomniaTrainingsSpark Streaming
  • 09:30 - 13:00
  • Xomnia HQ
  • €400

For questions or additional information view contact information below

Spark Streaming

In this training, we dive into the world of streaming data with Spark and Python. We’ll look at both the older Spark Streaming API, which is based on Spark’s RDD API’s, and also at the newer Spark Structured Streaming API, which makes use of the Spark SQL API. We’ll investigate the use case for both of these API’s, how to do some basic aggregations and transformations, and look at some of the pitfalls when streaming data with Spark.

Learning goals

  • General Architectural overview and stages of Streaming Maturity Adoption
  • When Spark Streaming is relevant for your client
  • Get familiar with Data Streams (DStreams) and the RDD API
  • Get familiar with Structured Streaming API
  • Know the the current state/limitations of Spark Streaming

Requirements: Some programming knowledge.

  • Big data engineering
  • Data processing
  • Streaming data