Xomnia is a word combining the letter ‘X’ – the unknown – and “Omnia” – Latin for everything. Our team of data scientists and big data engineers are trained to find the undefined – X – in all the relevant data sources – Omnia. This unknown – X – is untapped business value. Combining the X and Omnia you get the Xomnia spirit. Eager, curious and dedicated people, who have the belief that the future is big data.
In this training, we dive into the world of streaming data with Spark and Python. We’ll look at both the older Spark Streaming API, which is based on Spark’s RDD API’s, and also at the newer Spark Structured Streaming API, which makes use of the Spark SQL API. We’ll investigate the use case for both of these API’s, how to do some basic aggregations and transformations, and look at some of the pitfalls when streaming data with Spark.
Requirements: Some programming knowledge.