Database Blog (MySQL, MariaDB,MongoDB,Redis)

Amazon DocumentDB (database service managed by Aws)

DocumentDB is a managed database service provided by AWS (Amazon web services.) It is a NoSQL database the same as MongoDB and can be easily accessible by using any mongo client tool. Its functionalities are based on mongo3.6 API. It provided high availability and scalability environment where multiple instances can be added with just a single click.

Let’s see how we can setup this…

InnoDB Cluster (High Availability setup for MySQL)

InnoDB cluster is a complete high availability solution for MySQL. It uses a group replication mechanism with the help of AdminAPI. We can configure the setup very easily by using the MySQL shell utility.

We can use MySQL Router on top of the cluster to route traffic to backend database nodes. It can be used to split READ and WRITE requests using different proxy ports. It can provide more…

MySQL high availability using (Group Replication and MySQL Router)

Group replication in MySQL is a distributed mechanism in which various database nodes perform/coordinates in a single group. It could be a single-primary or multiple-primary. Whenever a transaction happens the majority of the groups have to agree to commit that transaction in the database.

Group communication system (GCS) works behind the group replication process. It detects the failure of…

How to configure ReplicaSet in MySql 8.0 using Mysql Shell

Since long we are configuring MySQL replication using native built-in commands. We have used traditional methods like Binary logging and also advanced GTID(global transaction identifier) to make the replication process more manageable and recoverable.

Today, we are going to configure the replication in MySQL with a completely new process with the help of MySQL Shell tools. This is known as…

Working inside Hadoop using Hive

Hive is an Apache data warehouse product that works on top of Hadoop. It provides SQL like interface for querying large and complex data reside in other databases and Hadoop file systems.

Let’s jump into the Hive setup.

Prerequisites –

Java/Jdk need to be installed

Hadoop need to be installed

Installing Hive

First, we will download and uncompress the hive package inside the Hadoop…

Orchestrator (automatic failover and replication management solution for MySQL/MariaDB)

Orchestrator is a complete solution for managing multiple MySQL/MariaDB instances in a replication environment. It can automatically invoke failover and remove dead nodes from the topology.

Let’s jump into the below installation and configuration part.

Installation

wget https://github.com/github/orchestrator/releases/download/v3.0.11/orchestrator-3.0.11-1.x86_64.rpm rpm -ivh…

How to split read/writes in MariaDB using ProxySQL

Introduction

ProxySQL is an advanced level database proxy that can be used to distribute traffic on the backend database nodes. It is widely used in MySQL, MariaDB & Percona databases to achieve high availability and load balanced read/write queries.

Lets’s jump into the below steps to see the installation and configuration of ProxySQL with MariaDB instances.

Installation of ProxySQL

Replication configuration in solr (Full-text search)

Today, we are going to configure a simple (Master-Slave) setup in solr. In case you haven’t installed solr then please follow the below link for complete installation and configuration of solr instance.

https://dbenginesopensource.com/installation-and-configuration-of-solrfull-text-search/

Our servers

172.12.111.10 - Node1 172.12.111.11 - Node2

We are assuming both “Node1” and…

Installation and configuration of Solr(Full-text search)

Solr is an open-source full-text search engine. It is written in java language and highly used in real-time indexing and querying data using different filters. It can be used on top of a database(MySQL, Mongo) to provide a fast response to the application.

Let’s quickly set up it using the below steps on the Red hat 8 platform.

First, we need to install the java(JDK) package to resolve any…

ClickHouse – A complete Cluster setup on ubuntu 16.04 – Part II

In continuation of my previous post – https://dbenginesopensource.com/clickhouse-a-complete-cluster-setup-on-ubuntu-16-04-part-i/ finally we are going to set up a two-node Clickhouse cluster and see how sharding and replication work together in a distributed environment.

Our Server List

172.31.33.10 - Node1 172.31.94.178 - Node2

Configuration

On Node1 and Node2 perform below steps…

ClickHouse – A complete Cluster setup on ubuntu 16.04 – Part I

Introduction

ClickHouse is an open-source columnar database system designed especially for the OLAP type workload. It’s distributed architecture with the SQL language interface makes it’s a powerful engine for the computation of heavy analytical queries.

Rows vs Columns

Being a column-oriented database clickhouse is fast enough while processing aggregate operations as compared to any…

MySQL Shell – Introduction and Usage

MySQL shell is the client tool to access the database server like the previous MySQL client but with some interesting and very useful features/APIs. Inside this, we can work on both relational and document databases with the help of scripting languages like Python and Javascript.

Apart from this we can use also use MySQL devX API to perform CRUD operations instead of the native SQL statement.…

Elasticsearch Cluster (Sharding & Replication)

Elasticsearch Cluster is basically a group of nodes that together automatically shard and replicate data across all participating servers.

In my previous post –https://dbenginesopensource.com/installing-elasticsearch-on-redhat-8/ we have already seen how to install and set up a single node Elasticsearch instance. Here, we will just quickly configure the two-node cluster using the below steps.

Installing Elasticsearch on Redhat 8

Elasticsearch is a full-text search engine based on Lucene library. It is completely built-in java language. Being a distributed database system it provides HTTP web interface and JSON capabilities.

Let’s jump into the installation to understand how it really works.

Installation

Install the Java(JDK) package and verify the version.

yum install java-1.8.0-openjdk-devel java -version

How to fix broken replication in MySQL/MariaDB

Sometimes we face a situation when suddenly our slave server throws an error and our replication process got stopped unless we fixed that error. The error could of different types, so today we will analyze different errors leads to replication break and learn how to fix them in a different environment.

SQL Error

This type of error generates when the slave is unable to execute the query…