sideara-image

Xomnia is a word combining the letter ‘X’ – the unknown – and “Omnia” – Latin for everything. Our team of data scientists and big data engineers are trained to find the undefined – X – in all the relevant data sources – Omnia. This unknown – X – is untapped business value. Combining the X and Omnia you get the Xomnia spirit. Eager, curious and dedicated people, who have the belief that the future is big data.

Want to feel the Xomnia spirit? Follow us

What are you looking for?

Simply enter your keyword and we will help you find what you need.

Training

XomniaTrainingsSpark Streaming
  • 09:30 - 13:00
  • Xomnia HQ
  • €400

For questions or additional information view contact information below

Spark Streaming

In this training, we dive into the world of streaming data with Spark and Python. We’ll look at both the older Spark Streaming API, which is based on Spark’s RDD API’s, and also at the newer Spark Structured Streaming API, which makes use of the Spark SQL API. We’ll investigate the use case for both of these API’s, how to do some basic aggregations and transformations, and look at some of the pitfalls when streaming data with Spark.

Learning goals

  • General Architectural overview and stages of Streaming Maturity Adoption
  • When Spark Streaming is relevant for your client
  • Get familiar with Data Streams (DStreams) and the RDD API
  • Get familiar with Structured Streaming API
  • Know the the current state/limitations of Spark Streaming

Requirements: Some programming knowledge.

  • Big data engineering
  • Data processing
  • Streaming data