A newer and more modern DataFrame library is in development that utilises the Rust language to enable incredibly performant, multi-core analytics: Polars!
Read MoreBlog
Data Science & Data Engineering blogs
Thanks for reading. Here you will find a huge range of information in text, audio and video on topics such as Data Science, Data Engineering, Machine Learning Engineering, DataOps and much more. The show notes for “Data Science in Production” are also collated here.
Archive
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- November 2020
- October 2020
- September 2020
- July 2020
- June 2020
- May 2020
- April 2020
- February 2020
- November 2019
- October 2019
- September 2019
- July 2019
- June 2019
- May 2019
- April 2019
- March 2019
- January 2019
- December 2018
- November 2018
If you keep up with the latest developments in the data space, you will probably know that Microsoft Fabric has now reached general availability. One of the trickiest things we’ve had to come to terms with is how concurrency works and how to run multiple notebooks at once without errors.
Read More
How can you tell whether the Copilot preview is available in your Fabric tenant? This blog shows you how.
Read More
Data culture is like the beating heart of a data-driven organisation. It refers to the collective mindset and behaviour when it comes to data-driven decision-making. But how can you foster an effective and true data culture?
Read More
The term “aggregate” can be somewhat ambiguous and is sometimes mis-interpreted by data professionals. Find out when you should be aggregating your data versus whether you should be aggregating your data.
Read More
Did you know you can use Tabular Editor with Fabric to build advanced Power BI semantic models? Find out some of the advantages that this approach can give you.
Read More
AI was the very first thing mentioned in Satya Nadella’s opening keynote of Microsoft Ignite 2023, dominating over 50% of the sessions, and with Gen-AI at its peak, that has been no surprise. In this blog, we will highlight some of our favourite announcements on Azure AI Platforms.
The shift to the cloud has revolutionised the way data scientists work where the cloud has opened up a whole host of machine learning tools, pushing the capabilities of machine learning. One of the most popular tools is none other than the famous Databricks.
Read More
Last week was Microsoft’s Ignite conference hosted in Seattle and we were on the edge of our seats for some highly anticipated announcements. Here’s mine and Johnny’s round up of the Fabric announcements.
Read More
As the potential of Generative AI and Large Language (LLM) models continue to grow at a frightening pace, it can be hard to know where to get started and get your head around all the tools needed for a successful LLM project! One key tool in any successful implementation is a vector database.
Read More
How Intel technology stack improved model training in Advancing Analytics' custom solution for the financial sector.
Read More
Retrieval Augmented Generation (RAG) is a framework that provides a more accurate and reliable solution for generating content and interacting with users. RAG addresses the limitations of large language models (LLMs) and helps businesses struggling to generate relevant and accurate content while maintaining credibility and transparency in their interactions with customers.
Read More
Azure's PromptFlow is a cutting-edge tool within the Azure ML suite designed to enhance the development and deployment of Large Language Model (LLM) applications. It offers an intuitive interface for prompt engineering, real-time testing, and evaluation, ensuring prompts are optimized for accuracy and relevance.
Read More
Meet your new favourite action hero, Data Activator. It’s the newest experience to be added to Microsoft’s unified Software-as-a-Service (SaaS) platform Fabric, having been made available in the public preview at the beginning of October. But what is it? What does it do? How can you use it?
Read More
In the world of Agile and Scrum, chasing perfection is a futile endeavour. Instead, Sprint Planning should focus on achieving 'good enough,' a practical and attainable standard. It's about transparent communication, meaningful discussions, and setting clear expectations to deliver value, with the flexibility to iterate and adapt for continuous improvement.
Read More
Managing costs in Azure OpenAI is crucial, especially with its pay-as-you-go model based on tokens. This blog looks at tools which can help maintain a balance between innovation and cost-efficiency.
Read More