Improving our UI testing at SingleStore
Engineering6 min Read

Improving our UI testing at SingleStore

In this blog post, written by Joanna Lew, (Software Engineer at SingleStore), we share our experience with adding Cypress and React Testing…
Read Post
Your Phone Already Has Bottomless
Engineering3 min Read

Your Phone Already Has Bottomless

SingleStore has a key new feature in our 7.5 Release called bottomless. In this blog we use something familiar to everyone, photo apps, as a metaphor to explain bottomless and its relevance to databases. The things consumers get by syncing their photos to the cloud can benefit real data applications too: we call it separation of storage and compute. Learn why, for data intensive applications, separation of storage and compute in your data store just makes sense. I take tons of pictures on my…
Read Post
Live WASM Demo from SingleStore’s Launch Pad!
Engineering3 min Read

Live WASM Demo from SingleStore’s Launch Pad!

SingleStore’s June 23 event didn’t just launch the world’s only hybrid multi-cloud, unified analytical and transactional database. We also unveiled our first Innovation Center in Raleigh, NC . We call it the SingleStore Launch Pad, with a mission to reduce the friction that slows organizations’ digital transformation efforts and their overall quest to become more data driven.  At the event, Bailey Hayes , Principal Software Engineer, talked about some of the work the Launch Pad team is doing…
Read Post
Scaling Worldwide Parcel Logistics with SingleStore and Vectorized
Database6 min Read

Scaling Worldwide Parcel Logistics with SingleStore and Vectorized

Learn how SingleStore and Redpanda can work together to solve the operational complexity of global logistics. In this blog post we present a reference architecture using SingleStore’s relational database and Redpanda’s streaming platform in combination to scale worldwide parcel shipping to never-before-seen volumes. Scaling worldwide parcel logistics with SingleStore and Vectorized Today, let's talk about how SingleStore and Redpanda can work together to solve the operational complexity of…
Read Post
SingleStore’s Hiring Process for Frontend-Focused Engineers
Engineering6 min Read

SingleStore’s Hiring Process for Frontend-Focused Engineers

SingleStore's frontend-focused development team works on all sorts of interesting challenges to simplify the User Experience of our product. In this blog post, we talk about how we hire engineers for this team. SingleStore’s Hiring Process for Frontend-Focused Engineers We're actively hiring frontend-focused software engineers, and I thought it'd be a good idea to write about our interview process. Not only will this be helpful for potential candidates, but I also think it'll be useful for me to…
Read Post
AVX512/VBMI2: A Programmer’s Perspective
Performance3 min Read

AVX512/VBMI2: A Programmer’s Perspective

Linus Torvalds had some interesting things to say about AVX512: “I hope AVX512 dies a painful death… I absolutely detest FP benchmarks, and I realize other people care deeply. I just think AVX512 is exactly the wrong thing to do…”. Having had the unique opportunity of migrating a portion of SingleStore’s library of SIMD kernels from AVX2 to AVX512/VBMI over the last few months, I disagree. For one thing, AVX512 is not designed solely for floating-point workloads. SingleStore’s code fundamentally…
Read Post
Fast and Accurate Percentiles with APPROX_PERCENTILE in SingleStore
Engineering4 min Read

Fast and Accurate Percentiles with APPROX_PERCENTILE in SingleStore

SingleStore introduced an APPROX_PERCENTILE function to estimate percentiles for a distribution of values. This function is faster and near-exact as compared to the analogous functions that calculate exact percentiles. Read more to learn about this feature and see the performance and accuracy comparisons between approximations and precise values on a sample dataset. Please check this demo video to learn more about the approx_percentile function in SingleStore: If you have a sizable numeric…
Read Post
SingleStore DB 7.3 is Now Generally Available
Announcements4 min Read

SingleStore DB 7.3 is Now Generally Available

SingleStore is proud to announce the general availability of SingleStore DB 7.3 for immediate download. SingleStore DB 7.3 is also available today on SingleStore Managed Service, the company’s elastic cloud database, available on public cloud providers around the world. At SingleStore, we are building the next great database platform. SingleStore DB is a distributed operational database that delivers speed and scale. As the leading NewSQL platform for real-time analytics and augmented…
Read Post
SingleStore Universal Storage, Episode 3: Revenge of the Upsert
Announcements4 min Read

SingleStore Universal Storage, Episode 3: Revenge of the Upsert

SingleStore Universal Storage technology is a dramatic evolution of our columnstore data format that allows it to support both operational and analytical workloads with low total cost of ownership (TCO). People love our rowstores for OLTP-style access patterns because of our great performance based on memory-optimized data structures and compilation of queries to machine code. But for users with large data sets, the cost of providing servers with enough RAM to hold all the data started to be…
Read Post
Toward more efficient and inclusive work with asynchronous communication
Engineering4 min Read

Toward more efficient and inclusive work with asynchronous communication

I once heard that a “book worth reading is worth reading twice”, and I’ve found this to be true about other things as well. There’s a documentation page that’s been with me for the majority of my professional career; a page that I keep coming back to and that I’ve read from start to finish, without skipping a word, more than a few times in the last few years. This document is GitLab’s Embracing Asynchronous Communication guide , a section of GitLab’s public handbook that goes over their…
Read Post
Backup With Split Partitions: Robust Partition Split via Backup
Engineering4 min Read

Backup With Split Partitions: Robust Partition Split via Backup

You run a database. You try to anticipate the future. You try to provide sufficient, even generous, resources to accommodate future growth in your service. But sometimes, growth far exceeds even your most optimistic expectations, and now you have to figure out how to accommodate that. One obvious way of increasing your database’s ability to handle and service more data is to simply add more machines to your cluster. That should increase the number of cores, and the amounts of memory and disk…
Read Post
The Future is Bottomless
Engineering5 min Read

The Future is Bottomless

SingleStore is a state of the art, distributed, scale-out, transaction processing and query execution engine. In the same system, we can do kickass large-scale analytical queries and ultra-low-latency key-value workloads. With the release of SingleStore DB 7.0 at the end of 2019, our new replication protocol, which is something I am personally very proud of, has greatly improved the durability of data stored in SingleStore clusters. I don’t think there’s any other system in the world that can do…
Read Post
Ways to Compute Pi in SQL
Engineering1 min Read

Ways to Compute Pi in SQL

In celebration of Pi Day , I asked SingleStore’s Engineering team to come up with clever ways to compute pi in SQL. Because that’s the kind of thing we engineers enjoy! And, given pi’s privileged status in mathematical history – and my own history of earning a bachelor’s degree in Mathematics – I just couldn’t resist. Truth be told, in the early days of SingleStore, my fellow math geeks and I had some fun with Pi Day – yes, including eating actual pies – and we even had a colleague with the…
Read Post
Building Fast Distributed Synchronous Replication at SingleStore – Webinar Recap 1 of 2
Engineering5 min Read

Building Fast Distributed Synchronous Replication at SingleStore – Webinar Recap 1 of 2

This is the first part of a two-part blog post; part two is here . The recent release of SingleStore DB 7.0 has fast replication as one of its major features. With this release, SingleStore offers high-throughput, synchronous replication that, in most cases, only slows SingleStore’s very fast performance by about 10%, compared with asynchronous replication. This is achieved in a very high-performing, distributed, relational database. In this talk, available on YouTube , Rodrigo Gomes…
Read Post
Building Fast Distributed Synchronous Replication at SingleStore – Webinar Recap 2 of 2
Engineering17 min Read

Building Fast Distributed Synchronous Replication at SingleStore – Webinar Recap 2 of 2

This is the second part of a two-part blog post; part one is here . The recent release of SingleStore 7.0 has fast replication as one of its major features. With this release, SingleStore offers high-throughput, synchronous replication that, in most cases, only slows SingleStore’s very fast performance by about 10%, compared with asynchronous replication. This is achieved in a very high-performing, distributed, relational database. In this talk, available on YouTube , Rodrigo Gomes…
Read Post
Find and Fix Problems Fast with SingleStore Tools
Engineering6 min Read

Find and Fix Problems Fast with SingleStore Tools

SingleStore Tools is a new set of command line programs for managing the clusters of servers or instances that make up your database.  You can use SingleStore Tools to help you find and fix problems with SingleStore quickly and incisively. Our legacy management tool, SingleStore-Ops, generated cluster reports, with output logs and diagnostics per cluster. For efficiency, the SingleStore team developed an internal tool called ClusteRx, to parse the reports coming out of SingleStore-Ops. We are…
Read Post
The Write Stuff
Engineering4 min Read

The Write Stuff

Why did the world need SingleStore? In this blog post, updated from a few years ago, early SingleStore Product Manager Carlos Bueno explains why SingleStore works better, for a wide range of purposes, than a NoSQL setup. (Thanks, Carlos!) We’ve updated the blog post with new SingleStore product features, graphics, and relevant links. To wit, you should also see Rick Negrin’s famous blog post on NoSQL and our recent case study on replacing Hadoop with SingleStore . Tell us if this sounds…
Read Post
The Story Behind SingleStore’s Skiplist Indexes
Columnstore9 min Read

The Story Behind SingleStore’s Skiplist Indexes

This blog post was originally published in January 2014, and it has long been the first blog post on the SingleStore blog – and one of the best. In this blog post, SingleStore co-founding engineer Adam Prout explains one of the key technical features that distinguishes SingleStore: its use of skiplist indexes over Btrees and similar structures. Adam has now revised and updated this blog post to include the recently released SingleStore DB 7.0 and SingleStore Universal Storage™. The most popular…
Read Post
The Beauty of a Shared-Nothing SQL DBMS for Skewed Database Sizes
Engineering7 min Read

The Beauty of a Shared-Nothing SQL DBMS for Skewed Database Sizes

The limitations of a typical, traditional relational database management system (RDBMS) have forced all sorts of compromises on data processing systems: from limitations on database size, to the separation of transaction processing from analytics. One such compromise has been the “sharding” of various customer data sets into separate database instances, partly so each customer could fit on a single computer server – but, in a typical power law, or Zipf, distribution, the larger database don’t…
Read Post
CREATE PIPELINE: Real-Time Streaming and Exactly-Once Semantics with Kafka
Apache Kafka6 min Read

CREATE PIPELINE: Real-Time Streaming and Exactly-Once Semantics with Kafka

In this presentation, recorded shortly after SingleStore introduced SingleStore Pipelines, two SingleStore engineers describe SingleStore’s underlying architecture and how it matches up perfectly to Kafka, including in the areas of scalability and exactly-once updates. The discussion includes specific SQL commands used to interface SingleStore to Kafka, unleashing a great deal of processing power from both technologies. In the video , the SingleStore people go on to describe how to try this on…
Read Post
A Technical Introduction to SingleStore
Analytics6 min Read

A Technical Introduction to SingleStore

John Sherwood, a senior engineer at SingleStore on the query optimizer team, presented at SingleStore’s Engineering Open House in our Seattle offices last month. He gave a technical introduction to the SingleStore database, including its support for in-memory rowstore tables and disk-backed columnstore tables, its SQL support and MySQL wire protocol compatibility, and how aggregator and leaf nodes interact to store data and answer queries simultaneously, scalably, and with low latencies. He also…
Read Post
Replicating PostgreSQL into SingleStore’s Columnstore
Columnstore6 min Read

Replicating PostgreSQL into SingleStore’s Columnstore

Thanks to Oryan Moshe for this awesome blog post, which originally appeared on DEV Community. In the blog post, Oryan describes how to achieve the high performance of SingleStore’s columnstore for queries while keeping transaction data in PostgreSQL for updates – Ed. Making the impossible hard So it’s this time of the year again, we need to upgrade our SingleStore cluster and expand our contract to fit the new cluster topology. We really outdid ourselves this time. Expanding to a 1TB cluster…
Read Post
Leveraging Web Workers For Client-Side Applications with React & Redux
Engineering6 min Read

Leveraging Web Workers For Client-Side Applications with React & Redux

If you’ve ever had a web application freeze while it was calculating something, chances are that performing that computation in a JavaScript Web Worker would help. In this blog post, SingleStore’s David Gomes explains how to use JavaScript Web Workers, together with React and Redux, to create fully-client side web applications. Introduction In this article, we’re going to explore how we leverage Web Workers , together with React & Redux, to build a fully client-side web application here at…
Read Post
Porting 30K Lines of Code from Flow to TypeScript
Engineering13 min Read

Porting 30K Lines of Code from Flow to TypeScript

We recently ported the 30,000 lines of JavaScript code in SingleStore Studio from Flow to TypeScript . In this article, I describe why we ported our codebase, how we carried out the process, and how it has been working out for us. I’d like to start by saying that my goal with this blog post is not to condemn Flow or usage of Flow. I highly admire the project, and I think that there is enough space in the JavaScript community for both type checkers. At the end of the day, each team should…
Read Post
SingleStore Live: Nikita Shamgunov on the Data Engineering Podcast
Engineering6 min Read

SingleStore Live: Nikita Shamgunov on the Data Engineering Podcast

SingleStore CEO Nikita Shamgunov recently joined host Tobias Macey on the Data Engineering Podcast. Tobias drew out Nikita on SingleStore’s origins, our exciting present, and where we’re going in the future. In this blog post, we’ll try to get you excited about some of the business and engineering topics discussed in the podcast, but we urge you to listen to the full episode . For your interest, here is a full list of the topics – with a few of them highlighted in this blog post: What is…
Read Post
Faster Data Loading with Adaptive Compression in SingleStore
Engineering4 min Read

Faster Data Loading with Adaptive Compression in SingleStore

This summer, SingleStore summer intern Sarah Wooders contributed substantially to an important area of performance at SingleStore: adaptive data compression that responds optimally to network conditions. For more on the difference this makes, see the performance blog for SingleStore DB 6.7 . – Editor I’m a student at MIT majoring the computer science and mathematics. My current interests are in multicore and distributed systems, as well as performance engineering. My work became part of…
Read Post
Creating SingleStore Visual Explain
Engineering9 min Read

Creating SingleStore Visual Explain

SingleStore has a long tradition of sharing details about its efforts to optimize performance  in order to help customers get the most out of our products and contribute to our efforts to optimize performance further. This blog post, from recent SingleStore intern Brian Chen, continues that tradition. I interned at SingleStore last summer on the team that developed SingleStore Studio , a new product which provides a friendly interface for monitoring and managing SingleStore clusters. The main…
Read Post
SingleStore DB 6.7 Performance Improvements
Engineering11 min Read

SingleStore DB 6.7 Performance Improvements

Performance is in SingleStore’s DNA. Last March, we shattered the trillion-rows-per-second scan barrier for processing a single SQL query on industry-standard Intel servers. That query processed data from a single table, and of course, lots of analytical queries use multiple tables, particularly star schemas. So we’ve broadened our vectorized, single instruction, multiple data (SIMD) query execution technology beyond single-table, group-by aggregate queries to star join group-by aggregate…
Read Post
How Careful Engineering Led to Processing Over a Trillion Rows Per Second
Database6 min Read

How Careful Engineering Led to Processing Over a Trillion Rows Per Second

On March 13, we published a blog demonstrating the performance of SingleStore in the context of ad hoc analytical queries. Specifically, we showed that the query can process 1,280,625,752,550 rows per seconds on a SingleStore cluster containing 448 Intel Skylake cores clocked at 2.5GHz. In this blog post, we drill down into how this was made possible by carefully designing code, exploiting distributed execution, and instruction-level and data-level parallelism. Why is such high throughput…
Read Post
Architecting Data in the AWS Ecosystem
AWS1 min Read

Architecting Data in the AWS Ecosystem

Amazon Web Services (AWS) is a juggernaut of a platform, and many of today’s database solutions can run on AWS, including SingleStore. Recently, we held a meetup at our office in San Francisco during AWS Summit 2018 to discuss how customers can benefit from using SingleStore within the AWS ecosystem. In the talk, “Architecting Data in the AWS Ecosystem,” Seth Luersen from SingleStore took a look at the overall data landscape related to the purpose-built databases from Amazon Web Services. He…
Read Post