Open-source Data Engineering with PostgreSQL

Blog-4: Apache Drill Magic across PostgreSQL, Local Parquet, and S3 INTRODUCTION: Welcome back! Following our exploration of data movement between PostgreSQL and Amazon S3 in the previous blog, we now venture into the realm of querying with Apache Drill. In … Read More

Open-source Data Engineering with PostgreSQL

Blog-3: Data Loading with Apache Spark INTRODUCTION: Welcome to the next installment of our series on Open-source Data Engineering with PostgreSQL. In this blog, we’ll delve into the practicalities of transforming table data from PostgreSQL into the Parquet format and … Read More

Open-source Data Engineering with PostgreSQL

Blog-2: Installation and Setup on Ubuntu INTRODUCTION: Welcome back to the series on Open-source Data Engineering with PostgreSQL. In this post, we shall delve into the installation and configuration of Apache Spark and Apache Drill on an Ubuntu environment. Our … Read More

Open-source Data Engineering with PostgreSQL

Overview – A Curtain raiser Introduction: In the ever-evolving landscape of Data management, organizations are constantly seeking efficient ways to handle, transform, and query massive datasets. Data Archiving has become an important component of Data Engineering in the ever-evolving landscape … Read More

Building an Efficient Data Pipeline with PostgreSQL and Talend Open Studio

Introduction: In the rapidly evolving landscape of data management, creating a robust data pipeline is essential for organizations to derive meaningful insights and drive informed decision-making. In this blog, we’ll explore the integration of PostgreSQL, a powerful open-source relational database, … Read More

Logical replication from Standbys

Introduction: One of the most useful features in PostgreSQL 16 is the ability to perform logical replication from physical replication standbys. This feature allows users to stream data to other PostgreSQL instances, giving developers new options for workload distribution. Additionally, … Read More

Bulk loading with COPY in PostgreSQL 16

Introduction: At OpenSource DB, we work with Customers on various Data Engineering projects, and among the many critical aspects of data warehousing, the efficient and rapid movement of data is paramount. This is where PostgreSQL’s COPY feature shines. COPY is … Read More

Unleashing PG16 New Features – pgHBA Features

In our journey through the ever-evolving landscape of PostgreSQL, last week, we embarked on an exciting exploration of the newest and most intriguing features that PostgreSQL 16 has to offer. Our goal was to delve deep into the core features … Read More

Unleashing PG16 New Features – Blog series

Introduction: In the ever-evolving world of relational databases, PostgreSQL continues to shine as a beacon of innovation and reliability. With each new release, it unveils a treasure trove of features that cater to the needs of modern applications and enterprises. … Read More

PgCat – Connection Pooling Decoded – Part 1

Introduction PostgreSQL – The World’s Most Advanced Open Source Relational Database holds its ground as a formidable player in the Open-source Databases market. With respect to Connection scalability & Connection concentration layers, optimising connection pooling, load balancing, and replica failover … Read More