Insights

A data platform is an integrated technological infrastructure that empowers organisations to collect, store, process, manage, analyse, and extract valuable insights from massive volumes of structured and unstructured data. All…

While some people are very familiar with Databricks, others might not know as much. We thought it would be a good idea to break down what Databricks is, explore what…

Introduction In our previous article, we have seen how to get onboarded with Databricks and run your first hello world application using Spark. The first step involved creating a community…

Let's get started In this post, we're going to get you started on Databricks, but first let's take a quick look at the history of big data space. Spark has…

Databricks is one of the major players in the data space, but some people may still treat it like an optimised hosted service of Apache Spark. It's true that Spark…

Introduction In part one of this series, we discussed how Delta Lake has become the standard data format for a lakehouse architecture, and how to create and write data to…

Introduction The lakehouse architecture has gained lots of traction in the last few years. The lakehouse simply brings the best of both data warehouses and data lakes. One of the…

Dimensional modelling, also known as Kimball’s star schema, has long been an industry standard for building a Data Warehouse. Under this approach, we load the data into a staging layer,…