IBM Data Replication and SingleStoreDB Enabling Real-Time Applications

Learn how IBM Data Replication, a leading Change Data Capture (CDC) tool, connects to SingleStoreDB to power your real-time use cases. 

Imagine using a database focused on speed and scalability for maximum performance of transactional (OLTP) and analytical (OLAP) workloads; a database that’s fully multi-cloud to help you avoid vendor lock-in; a database that uses familiar SQL tooling, is API Driven and supports multiple data types like JSON, time-series and geospatial data.  What if this database was built with enterprise security protocols in mind, compliant, supportive of a data fabric architecture and capable of staying in sync in real time, eliminating latency issues

SingleStoreDB and IBM are working together to deliver this vision. SingleStoreDB is a distributed, relational database with optimized speed and scalability to support real-time applications and analytics — and can be kept in sync in near real time with IBM’s data replication technology.

What Is SingleStore?

SingleStoreDB's distributed architecture and high-performance processing capabilities ensure that data is replicated and processed quickly. This helps organizations reason on the data that lands in SingleStoreDB, and make real-time decisions on the most recent data. SingleStoreDB also provides high availability and scalability for customer data, ensuring that it is always accessible and can be used for analytics and reporting. Head to our documentation center to learn more about setting up your SingleStoreDB instance in the cloud.

Overview of IBM Data Replication CDC

IBM InfoSphere Data Replication is a replication solution that captures database changes as they happen and delivers them to target databases, message queues or an ETL solution that is based on table mappings and configured within the IBM Data Replication Management Console GUI application.

Change Data Capture (CDC) provides low impact capture and fast delivery of data changes for key information management initiatives including dynamic data warehousing, master data management, application consolidations or migrations, operational BI and enabling SOA projects. CDC also helps reduce processing overheads and network traffic by sending only the data that has changed. Replication can be carried out continuously or periodically. When data is transferred from a source server, it can be remapped or transformed in the target environment.

You can also learn more here.

How Does the Integration Work?

Let us take an example of moving data from MySQL database (the most popular open-source database) into SingleStore using the IBM Data Replication CDC tool.

How to Replicate Data to SingleStoreDB:

Start with a SingleStoreDB table.

Step 1: Set up subscription

Click the configuration tab in the management console. Right click within the subscription box and a window will pop up. Name your subscription.

Select your source datastore, which is connected to your source database.

Select your SingleStoreDB datastore as the target and press okay.             

Step 2: Map a table

You will receive a prompt to map tables once the subscription has been created successfully.  Click yes.

Choose a standard mapping.

Select your source table and check the replicate box.

Select your target table.

Step 3: Replicate

Select the mirror option.

Review the mapping and press finish.

Completed view of subscription.

Step 4: Insert a row

Using your favorite database client, insert a row into your source table and commit the transaction.

Right click the subscription. Click start mirroring at the bottom of the popup.

Go to your SingleStoreDB portal, click run CTRL and check to see if the replication has occurred.

Conclusion

IBM Data Replication CDC and SingleStoreDB provide a powerful capability to support customer use cases of moving data from the supported sources directly into SingleStoreDB to build real-time analytical solutions. With highly secure, real- time data movement to SingleStoreDB, organizations can build the next game- changing real-time analytical application to help drive business growth.