Xomnia is a word combining the letter ‘X’ – the unknown – and “Omnia” – Latin for everything. Our team of data scientists and big data engineers are trained to find the undefined – X – in all the relevant data sources – Omnia. This unknown – X – is untapped business value. Combining the X and Omnia you get the Xomnia spirit. Eager, curious and dedicated people, who have the belief that the future is big data.
Energie Data Services Nederland (EDSN) develops and operates the Dutch energy data hub on behalf of the Dutch transmission and distribution system operators. The purpose of EDSN is to ensure optimal functioning of the Dutch energy market in transition through uniform communication methods, transparent market processes, and secure data access. On behalf of these system operators, EDSN is developing a reliable and innovative ICT infrastructure for the energy market of the future, realizing the energy transition for a sustainable Netherlands.
Based on different types of use cases, EDSN asked Xomnia to make a cloud-based architecture on AWS for their new Data & Analytics Platform. This new architecture makes it possible to facilitate data distribution through data push. The architecture is based on the Kappa architecture with Kafka as a streaming layer. By tailoring the serving layer to the different use cases, EDSN will be able to supply the data fast and accurate.
When designing the architecture, we separated the components using a pipe and filter pattern, to ensure maximum flexibility in the future. By choosing for cloud agnostic managed services where possible, EDSN is guaranteed to have the ease of a managed service, without losing the option to switch cloud-provider in the distant future.