About Apache Druid Apache Druid is a real-time analytics database designed for fast slice-and-dice analytics (“OLAP” queries) on large data sets. It is one of the most popular open source solutions for OLAP. It is designed for serving both real-time(streaming sources like Kafka, Kinesis) and historical data(batch sources like HDFS, S3). Special features of Apache Druid Supports Time-based…

Apache Druid is a leading database for modern analytics applications. The main features of a modern analytics applications are, Interactive data querying — Even with petabytes of data, the application would be able to provide sub second respond time to queries. High concurrency — Thousands of users being able to…

EMRFS is not a separate file-system, it’s an implementation of HDFS that adds strong consistency to S3, whereas S3 without EMRFS implementation provides read after write consistency for PUTS of new objects and eventual consistency for other operations on objects in all regions. Let’s break the definition and understand it part by part. There are many consistency models supported by the distributed systems, whereas each defines a set of rules to be followed when a sequence of operations are executed across multiple nodes. Strong and Eventual Consistency are one among these models.

Snowflake: Revolutionizing Data Storage, Processing, and Analytics in the Cloud Snowflake is not your ordinary traditional data warehouse. It is a cloud-native platform that brings together flexibility and high performance to transform how data is stored, processed, and utilized for complex analytics. …

On the Data and AI Summit 2023, Databricks made an exciting announcement regarding the latest release of Delta Lake 3.0 to Linux Foundation’s open source Project Delta Lake. The Linux Foundation is a non-profit organization that fosters the growth of open source software and technologies. …

In today’s era of exponential data growth and rapid data processing, ensuring data quality is paramount. High-quality data serves as the base for generating valuable and reliable insights. Let’s dive into the world of bad data and see possible misinterpretations/ bad data resulting in bad business. …

Introduction to Event Time Processing: Event Time processing is a key concept in real-time data analysis, where data is processed based on the actual time an event occurred. In this article, we’ll demystify Event Time processing using Apache Flink in Scala, providing a beginner-friendly explanation of the concepts involved. The…

Table vs View vs Materialized View Data analytics involves complex querying of data that comprises of joins between tables, aggregations & filters. There are high possibilities that some set of tables are frequently joined to answer business queries. You can define views with those frequent complex joins & aggregations and use them for querying instead of…

For better understanding of a tool/technology, it is important to compare & contrast with other similar tools in the market. It gives us a clear picture of where & when to use to the tool. Apache Druid is a real time database being used in many companies such as Netflix…