Thanks for reading. Here you will find a huge range of information in text, audio and video on topics such as Data Science, Data Engineering, Machine Learning Engineering, DataOps and much more. The show notes for “Data Science in Production” are also collated here.

Understanding Azure Synapse Analytics

Everyone’s talking about Azure Synapse Analytics, but does it sometimes feel like they’re talking about different things? Are you having trouble following where Azure SQL Datawarehouse is these days? In this post, Simon attempts to clarify the marketing message and talk about what’s actually coming and where we should be thinking about using it.

Chief Data OfficerSimon WhiteleyJune 16, 2020Advancing AnalyticsAzure Synapse, data engineering, azure, Spark, Architecture Comments

Scala For Big Data Engineering – Monads

You can’t talk about FP without monads. For those who have not encountered FP this can be a confusing concept, aided by a lot of convoluted explanations of what one actually is. Monads are routed in mathematics and computer science and so it can be tricky to find a clear, simple explanation without a lot of detailed theory upfront. In this article we will explore monads within the Functional Programming (FP) paradigm, and how they can be used in Scala to aid Data Engineering.

Anna WykesJune 5, 2020Comment

Blog