Nowadays, Spark is becoming more and more popular framework for building transformations either big data or traditional DW world. The difference is DW transformations is much more complex than big data specific. Also, moving from SQL-based world to Scala needs an additional efforts from developers. In this session, I will show you how to reuse existed DW experience and programming technics to implement a transformation application in Spark using Scala language. This topic will include: DW objects translation to Spark/Scala, code structuring, piping transformation, templating, unit testing
Feedback link: https://sqlb.it/?7357
