Data Science & Data Engineering blogs
Thanks for reading. Here you will find a huge range of information in text, audio and video on topics such as Data Science, Data Engineering, Machine Learning Engineering, DataOps and much more. The show notes for “Data Science in Production” are also collated here.
In this video Simon takes you through how to size a cluster. We look at what happens when you take 3GB of data and cache it on a 2 node cluster. How do you see the distribution of data? How many partitions are there on each node?. How do we achieve workload isolation? All these questions are answered.
Read MoreIn this video Simon takes you through the creation of a cluster in Azure Databricks, explore the difference between the various cluster types and Databricks run-times and options to get you started with your first cluster.
Read MoreIn this video Terry takes you through a tour of the Databricks workspace.
Read MoreIn this video we look at adding a new resource in Azure, exploring the managed resource group and a quick look at the ARM template for deploying Azure Databricks.
Read MoreIn this video we look to understand the core concepts of Apache Spark to understand how Databricks works. From there we look at the history of Databricks and describe the fundamentals.
Read MoreThe Windows Terminal has dropped. In this short blog we look at how easy it is to add the Anaconda Prompt as a Terminal
Read MoreDocker is a great option for Production Machine Learning. We have been exploring how to build an application, let’s now look at building a Machine Learning model in Python ready for deployment with Docker.
Read MoreThis is a short blog for anyone who wants to know how to change the default location of Jupyter.
Read MoreDocker is a great option for Production Machine Learning. This blog looks at a real hello-world. Building a web application. This blog has everything we need to now deploy a machine learning model.
Read MoreDocker is a great option for Production Machine Learning. This blog looks at installing Docker on Windows and Mac. We validate the install and check it is running correctly.
Read MoreDocker is a great option for Production Machine Learning. This blog looks at the fundamentals of Docker.
Read MorePicking the right tool for Machine Learning deployment in Azure is hard. This blog tackles the main options and describes the pros and cons of each.
Read MoreData Science in Production. Episode 5: Data Lakes for Data Science. Creating data lakes to enable better machine learning and data science. Listen to find out how to build the right data lake and not a data swamp"!
Read MoreData Science in Production. Episode 4: MLFlow & Databricks with Matei Zaharia
Read MoreMLFlow is now in public preview in Databricks. This video takes you through getting started with the experiment tracking service
Read MoreJoin me in Exeter for a full day exploring how to take a machine learning model from idea in to production.
Read More
