Thanks for reading. Here you will find a huge range of information in text, audio and video on topics such as Data Science, Data Engineering, Machine Learning Engineering, DataOps and much more. The show notes for “Data Science in Production” are also collated here.

Large Language Models as Collaborative Tools in BEAM Sessions

The blog post explores the potential of large language models (LLMs), like OpenAI's GPT-4, in enhancing Business Event Analysis & Modeling (BEAM) sessions. The fusion of BEAM and LLMs can revolutionize the design of data warehousing and business intelligence by providing scalability, accessibility, consistency, automatic documentation, and rapid prototyping.

Alexandru MalancaJune 28, 2023Comment

Bringing Fabric to your Data Lakehouse

With the advent of Fabric, many organisations with existing lakehouse implementations in Azure are wondering what changes Fabric will herald for them. Do they continue with their existing lakehouse implementation and design, or do they migrate entirely to Fabric?

Ust OldfieldJune 27, 2023FabricComment

World Refugee Day

Every year on June 20th, the world comes together to recognise World Refugee Day. This day is dedicated to raising awareness about the plight of refugees worldwide and honouring their strength and resilience in the face of adversity. Being within data it is important for us to understand the global refugee crisis and use our skills to help improve the lives of those affected.

Sahil OsmanJune 20, 2023Comment

The Power of Verti-parquet & DirectLake in Fabric

In the data engineering field, we must ensure that large datasets are compressed efficiently to save storage space and reduce costs, but we also need to maintain strong query performance. This can be balanced by utilising the VertiParq engine and Delta in Microsoft Fabric.

Jordan WitcombeJune 20, 2023FabricComment

Data Lakehouse vs Data Warehouse in Microsoft Fabric

If you have had a play around with Microsoft Fabric you will have seen that there are lots of different ways to get to your end goal. One of the most important decisions to make is whether to use a Lakehouse or Warehouse?

Aimee JohnsonJune 16, 2023FabricComment

Microsoft Fabric: An introduction to OneLake

As data engineers, we face many challenges daily. Data is often distributed across many different sources, and frequently in a wide range of file types with varying levels of data quality. This is where OneLake comes in, described as the OneDrive for data.

Jordan WitcombeJune 7, 2023FabricComment

Blog