Data Science | AI | DataOps | Engineering
backgroundGrey.png

Blog

Data Science & Data Engineering blogs

Posts tagged data engineering
Databricks SQL Analytics Workspace - The Evolution of the Lakehouse

The Lakehouse approach is gaining momentum, but there are still areas where Lake-based systems need to catch up. Databricks have just launched Databricks SQL Analytics, which provides a rich, interactive workspace for SQL users to query data, build visualisations and interact with the Lakehouse platform.

Read More
Understanding Azure Synapse Analytics

Everyone’s talking about Azure Synapse Analytics, but does it sometimes feel like they’re talking about different things? Are you having trouble following where Azure SQL Datawarehouse is these days? In this post, Simon attempts to clarify the marketing message and talk about what’s actually coming and where we should be thinking about using it.

Read More
Scala For Big Data Engineering – Why should you care?

The thought of learning Scala fills many with fear, its very name often causes feelings of terror. This suggests it’s either doing something very good, or very bad! The truth is Scala can be used for many things; from a simple web application to complex ML (Machine Learning). Moreover, it unusually fully incorporates two programming paradigms: OOP (Object Orientated Programming) and FP (Functional programming).

In this blog series I will break down some of the barriers and myths hindering mere mortals from learning Scala, and hopefully set some of you on the path to FP enlightenment within your data projects

Read More
Has the Data Engineer replaced the Business Intelligence Developer?

With the term Data Engineer growing exponentially, it can be difficult to pin down what exactly the role is, and where did it come from? This post dissects the history of the data engineer, how it relates to data science and business intelligence and asks the question… is it more than just ETL?

Read More