Category: Data warehouse

Posted on

Extracting String Items from JSON Arrays in Snowflake

Introduction

Have you ever struggled with handling JSON data in SQL queries? If so, you’re not alone. In this post, we’ll explore a real-world scenario where we tackled this challenge in Snowflake, transforming complex JSON structures into structured, queryable data.

Understanding the Challenge

In one of our ETL projects, we process raw data ingested from a third-party REST API into a Snowflake database. Some parent-child relationships within this data are stored as JSON strings inside VARCHAR columns.

Here is a simplified example for the purposes of this article:

Continue reading “Extracting String Items from JSON Arrays in Snowflake”
Posted on

Boosting DAX Performance: Practical Optimizations for Faster Queries

We are excited to share a few key tips for optimizing DAX queries that significantly improved the efficiency of our Azure Analysis Services (AAS) Tabular Model project.

DAX_performance

Our project involves various financial measures that calculate key metrics such as LTM Sales, LTM EBITDA, and Net Debt. Each of these measures incorporates logic for FX conversions and period filtering. While individual measures performed well, combining many measures in a single dashboard negatively impacted performance. After analyzing our DAX expressions, we identified two major factors affecting execution time. Below, we outline how we optimized performance in each case.

Continue reading “Boosting DAX Performance: Practical Optimizations for Faster Queries”
Posted on

Use DAX to Manipulate Relationships in Tabular Model Projects (Analysis Services)

Welcome to the next piece of our series of articles describing the challenges we handled while working on the “Snowflake Warehouse and AAS Tabular Model” project.

We are happy to share our recent findings that helped us implement specific requirements in the tabular model project on which we have been working for a while.

Continue reading “Use DAX to Manipulate Relationships in Tabular Model Projects (Analysis Services)”
Posted on

Mastering OLAP Cube Reporting: Solving Grand Total Calculations in Snowflake Warehouse and AAS Cube Projects


Welcome to the first installment of our promised series of articles detailing the challenges we encountered and conquered during our work on the “Snowflake Warehouse and AAS Cube” project.

Today, we’re excited to share how we tackled a particularly thorny issue while developing an AAS Cube project for one of our valued clients. Our task involved creating measures to extract financial data such as Sales and EBITDA. Given that reports are generated in specific currencies (e.g., USD), we needed to incorporate currency (FX) conversions within these measures. The parameters for these calculations varied depending on the particular company, with each company having its base currency code.

Continue reading “Mastering OLAP Cube Reporting: Solving Grand Total Calculations in Snowflake Warehouse and AAS Cube Projects”
Posted on

Navigating Complexity: Empowering Data-driven Decisions in Portfolio Management

We’ve embarked on yet another project recently, one that poses our biggest challenge to date.
We have a long-standing client for whom we developed a web-based portfolio management system over 20 years ago. Since then, we’ve continuously improved and expanded its functionality by incorporating new modules, ETL processes to import data from external sources, and various types of reports and exports.

Continue reading “Navigating Complexity: Empowering Data-driven Decisions in Portfolio Management”