Venkat Akhil - 24/04/2024

Troubleshooting PostgreSQL Replication Setup Errors with repmgr

Introduction Hey All Managing a PostgreSQL replication setup involves various challenges, especially when encountering errors during configuration. This blog post explores common errors encountered while setting up replication using repmgr, a popular replication manager for PostgreSQL. We’ll delve into the …

Read More
Venkat Akhil - 17/04/2024

Building PostgreSQL HA Systems with repmgr

Introduction Welcome to our latest blog post! Today, we’ll delve into the intricacies of setting up PostgreSQL High availability (HA) production cluster for a prominent client in the banking sector. Our task? Designing and implementing a robust HA solution for …

Read More
Taraka Vuyyuru - 10/04/2024

PostgreSQL Database Choices : Shared vs Separate for Microservices

In the ever-evolving realm of Microservices, one of the fundamental decisions developers face is whether to adopt a shared database model or opt for separate databases for each service. This blog aims to dissect both approaches, offering insights to help …

Read More
Brahmini Ratnam - 03/04/2024

PostgreSQL OID Datatype: Impacts and Remedies

Introduction PostgreSQL – The World’s Most Advanced Open Source Relational Database, introduced a significant change with version 12: the discontinuation of the Object Identifier (OID) datatype. This move has left many developers and database administrators pondering over its implications and …

Read More
Brahmini Ratnam - 20/03/2024

Postgres Materialized Views: A Practical 101 – Part 2

Introduction Welcome back to the second installment of our deep dive into the Materialized views! In our previous post, we looked at the basics of materialized views, showcasing how they can help query performance and simplify complex data aggregations with …

Read More
Brahmini Ratnam - 13/03/2024

Postgres Materialized Views: A Practical 101 – Part 1

Introduction In the realm of database management, efficiency and speed are king. PostgreSQL: The World’s Most Advanced Open Source Relational Database, offers a feature that is nothing short of magical for data analysts and developers alike: Materialized Views. Unlike standard …

Read More
Taraka Vuyyuru - 06/03/2024

Fixing Standby Slot Problems with pg_auto_failover

Dealing with failover in PostgreSQL clusters has always been tricky, but now there’s a solution: pg_auto_failover. This awesome tool makes it super easy to keep an eye on failovers and resolve the fencing issue. So, how does it work? Well, …

Read More
Brahmini Ratnam - 20/02/2024

Performance tuning with Apache Spark – Introduction

Introduction: Welcome back to our ongoing series on Data transformation with Apache Spark! In our previous posts, we’ve covered essential topics like setting up Apache Spark on Ubuntu, integrating data with Spark, and querying datasets using Apache Drill. Now, we’re …

Read More
Taraka Vuyyuru - 14/02/2024

Using pg_index_watch for PostgreSQL Indexing

Let’s delve into exploring pg_index_watch. In this instalment, I will guide you through the rationale behind its creation and explain its operational nuances. Meet pg_index_watch – a utility for automagical rebuild of bloated indexes, an absolutely handly tool designed to …

Read More
Taraka Vuyyuru - 07/02/2024

PostgreSQL User Management: Best Practices & Security Nuances

PostgreSQL – The World’s Most Advanced Open Source Relational Database and stands out as a robust and feature-rich solution, offering extensive capabilities for user management. Effective user management is important for ensuring data security, integrity, and accessibility within the platform. …

Read More
Brahmini Ratnam - 31/01/2024

Open-source Data Engineering with PostgreSQL

Blog-4: Apache Drill Magic across PostgreSQL, Local Parquet, and S3 INTRODUCTION: Welcome back! Following our exploration of data movement between PostgreSQL and Amazon S3 in the previous blog, we now venture into the realm of querying with Apache Drill. In …

Read More
Brahmini Ratnam - 24/01/2024

Open-source Data Engineering with PostgreSQL

Blog-3: Data Loading with Apache Spark INTRODUCTION: Welcome to the next installment of our series on Open-source Data Engineering with PostgreSQL. In this blog, we’ll delve into the practicalities of transforming table data from PostgreSQL into the Parquet format and …

Read More
Brahmini Ratnam - 17/01/2024

Open-source Data Engineering with PostgreSQL

Blog-2: Installation and Setup on Ubuntu INTRODUCTION: Welcome back to the series on Open-source Data Engineering with PostgreSQL. In this post, we shall delve into the installation and configuration of Apache Spark and Apache Drill on an Ubuntu environment. Our …

Read More
Brahmini Ratnam - 10/01/2024

Open-source Data Engineering with PostgreSQL

Overview – A Curtain raiser Introduction: In the ever-evolving landscape of Data management, organizations are constantly seeking efficient ways to handle, transform, and query massive datasets. Data Archiving has become an important component of Data Engineering in the ever-evolving landscape …

Read More
Venkat Akhil - 03/01/2024

Mastering Timestamp-Based CDC Hurdles: Solution Implementation

Introduction In the execution phase of mastering Timestamp-Based Change Data Capture (CDC) hurdles, the focus lies on implementing INSERT, DELETE, and UPDATE operations in our PostgreSQL database and using the proven solution we discussed in the previous blog to achieve …

Read More