Engineering6 min Read

SingleStore's frontend-focused development team works on all sorts of interesting challenges to simplify the User Experience of our product…
Read Post
Performance3 min Read

Linus Torvalds had some interesting things to say about AVX512: “I hope AVX512 dies a painful death… I absolutely detest FP benchmarks, and I realize other people care deeply. I just think AVX512 is exactly the wrong thing to do…”. Having had the unique opportunity of migrating a portion of SingleStore’s library of SIMD kernels from AVX2 to AVX512/VBMI over the last few months, I disagree. For one thing, AVX512 is not designed solely for floating-point workloads. SingleStore’s code fundamentally…
Read Post
Engineering4 min Read

SingleStore introduced an APPROX_PERCENTILE function to estimate percentiles for a distribution of values. This function is faster and near-exact as compared to the analogous functions that calculate exact percentiles. Read more to learn about this feature and see the performance and accuracy comparisons between approximations and precise values on a sample dataset. Please check this demo video to learn more about the approx_percentile function in SingleStore: If you have a sizable numeric…
Read Post
Announcements4 min Read

SingleStore is proud to announce the general availability of SingleStore DB 7.3 for immediate download. SingleStore DB 7.3 is also available today on SingleStore Managed Service, the company’s elastic cloud database, available on public cloud providers around the world. At SingleStore, we are building the next great database platform. SingleStore DB is a distributed operational database that delivers speed and scale. As the leading NewSQL platform for real-time analytics and augmented…
Read Post
Announcements4 min Read

SingleStore Universal Storage technology is a dramatic evolution of our columnstore data format that allows it to support both operational and analytical workloads with low total cost of ownership (TCO). People love our rowstores for OLTP-style access patterns because of our great performance based on memory-optimized data structures and compilation of queries to machine code. But for users with large data sets, the cost of providing servers with enough RAM to hold all the data started to be…
Read Post
Engineering4 min Read

I once heard that a “book worth reading is worth reading twice”, and I’ve found this to be true about other things as well. There’s a documentation page that’s been with me for the majority of my professional career; a page that I keep coming back to and that I’ve read from start to finish, without skipping a word, more than a few times in the last few years. This document is GitLab’s Embracing Asynchronous Communication guide , a section of GitLab’s public handbook that goes over their…
Read Post
Engineering4 min Read

You run a database. You try to anticipate the future. You try to provide sufficient, even generous, resources to accommodate future growth in your service. But sometimes, growth far exceeds even your most optimistic expectations, and now you have to figure out how to accommodate that. One obvious way of increasing your database’s ability to handle and service more data is to simply add more machines to your cluster. That should increase the number of cores, and the amounts of memory and disk…
Read Post
Engineering5 min Read

SingleStore is a state of the art, distributed, scale-out, transaction processing and query execution engine. In the same system, we can do kickass large-scale analytical queries and ultra-low-latency key-value workloads. With the release of SingleStore DB 7.0 at the end of 2019, our new replication protocol, which is something I am personally very proud of, has greatly improved the durability of data stored in SingleStore clusters. I don’t think there’s any other system in the world that can do…
Read Post
Engineering1 min Read

In celebration of Pi Day , I asked SingleStore’s Engineering team to come up with clever ways to compute pi in SQL. Because that’s the kind of thing we engineers enjoy! And, given pi’s privileged status in mathematical history – and my own history of earning a bachelor’s degree in Mathematics – I just couldn’t resist. Truth be told, in the early days of SingleStore, my fellow math geeks and I had some fun with Pi Day – yes, including eating actual pies – and we even had a colleague with the…
Read Post
Engineering5 min Read

This is the first part of a two-part blog post; part two is here . The recent release of SingleStore DB 7.0 has fast replication as one of its major features. With this release, SingleStore offers high-throughput, synchronous replication that, in most cases, only slows SingleStore’s very fast performance by about 10%, compared with asynchronous replication. This is achieved in a very high-performing, distributed, relational database. In this talk, available on YouTube , Rodrigo Gomes…
Read Post
Engineering17 min Read

This is the second part of a two-part blog post; part one is here . The recent release of SingleStore 7.0 has fast replication as one of its major features. With this release, SingleStore offers high-throughput, synchronous replication that, in most cases, only slows SingleStore’s very fast performance by about 10%, compared with asynchronous replication. This is achieved in a very high-performing, distributed, relational database. In this talk, available on YouTube , Rodrigo Gomes…
Read Post
Engineering6 min Read

SingleStore Tools is a new set of command line programs for managing the clusters of servers or instances that make up your database.  You can use SingleStore Tools to help you find and fix problems with SingleStore quickly and incisively. Our legacy management tool, SingleStore-Ops, generated cluster reports, with output logs and diagnostics per cluster. For efficiency, the SingleStore team developed an internal tool called ClusteRx, to parse the reports coming out of SingleStore-Ops. We are…
Read Post
Engineering4 min Read

Why did the world need SingleStore? In this blog post, updated from a few years ago, early SingleStore Product Manager Carlos Bueno explains why SingleStore works better, for a wide range of purposes, than a NoSQL setup. (Thanks, Carlos!) We’ve updated the blog post with new SingleStore product features, graphics, and relevant links. To wit, you should also see Rick Negrin’s famous blog post on NoSQL and our recent case study on replacing Hadoop with SingleStore . Tell us if this sounds…
Read Post
Columnstore9 min Read

This blog post was originally published in January 2014, and it has long been the first blog post on the SingleStore blog – and one of the best. In this blog post, SingleStore co-founding engineer Adam Prout explains one of the key technical features that distinguishes SingleStore: its use of skiplist indexes over Btrees and similar structures. Adam has now revised and updated this blog post to include the recently released SingleStore DB 7.0 and SingleStore Universal Storage™. The most popular…
Read Post
Engineering7 min Read

The limitations of a typical, traditional relational database management system (RDBMS) have forced all sorts of compromises on data processing systems: from limitations on database size, to the separation of transaction processing from analytics. One such compromise has been the “sharding” of various customer data sets into separate database instances, partly so each customer could fit on a single computer server – but, in a typical power law, or Zipf, distribution, the larger database don’t…
Read Post
Apache Kafka6 min Read

In this presentation, recorded shortly after SingleStore introduced SingleStore Pipelines, two SingleStore engineers describe SingleStore’s underlying architecture and how it matches up perfectly to Kafka, including in the areas of scalability and exactly-once updates. The discussion includes specific SQL commands used to interface SingleStore to Kafka, unleashing a great deal of processing power from both technologies. In the video , the SingleStore people go on to describe how to try this on…
Read Post
Analytics6 min Read

John Sherwood, a senior engineer at SingleStore on the query optimizer team, presented at SingleStore’s Engineering Open House in our Seattle offices last month. He gave a technical introduction to the SingleStore database, including its support for in-memory rowstore tables and disk-backed columnstore tables, its SQL support and MySQL wire protocol compatibility, and how aggregator and leaf nodes interact to store data and answer queries simultaneously, scalably, and with low latencies. He also…
Read Post
Columnstore6 min Read

Thanks to Oryan Moshe for this awesome blog post, which originally appeared on DEV Community. In the blog post, Oryan describes how to achieve the high performance of SingleStore’s columnstore for queries while keeping transaction data in PostgreSQL for updates – Ed. Making the impossible hard So it’s this time of the year again, we need to upgrade our SingleStore cluster and expand our contract to fit the new cluster topology. We really outdid ourselves this time. Expanding to a 1TB cluster…
Read Post
Engineering6 min Read

If you’ve ever had a web application freeze while it was calculating something, chances are that performing that computation in a JavaScript Web Worker would help. In this blog post, SingleStore’s David Gomes explains how to use JavaScript Web Workers, together with React and Redux, to create fully-client side web applications. Introduction In this article, we’re going to explore how we leverage Web Workers , together with React & Redux, to build a fully client-side web application here at…
Read Post
Engineering13 min Read

We recently ported the 30,000 lines of JavaScript code in SingleStore Studio from Flow to TypeScript . In this article, I describe why we ported our codebase, how we carried out the process, and how it has been working out for us. I’d like to start by saying that my goal with this blog post is not to condemn Flow or usage of Flow. I highly admire the project, and I think that there is enough space in the JavaScript community for both type checkers. At the end of the day, each team should…
Read Post
Engineering6 min Read

SingleStore CEO Nikita Shamgunov recently joined host Tobias Macey on the Data Engineering Podcast. Tobias drew out Nikita on SingleStore’s origins, our exciting present, and where we’re going in the future. In this blog post, we’ll try to get you excited about some of the business and engineering topics discussed in the podcast, but we urge you to listen to the full episode . For your interest, here is a full list of the topics – with a few of them highlighted in this blog post: What is…
Read Post
Engineering4 min Read

This summer, SingleStore summer intern Sarah Wooders contributed substantially to an important area of performance at SingleStore: adaptive data compression that responds optimally to network conditions. For more on the difference this makes, see the performance blog for SingleStore DB 6.7 . – Editor I’m a student at MIT majoring the computer science and mathematics. My current interests are in multicore and distributed systems, as well as performance engineering. My work became part of…
Read Post
Engineering9 min Read

SingleStore has a long tradition of sharing details about its efforts to optimize performance  in order to help customers get the most out of our products and contribute to our efforts to optimize performance further. This blog post, from recent SingleStore intern Brian Chen, continues that tradition. I interned at SingleStore last summer on the team that developed SingleStore Studio , a new product which provides a friendly interface for monitoring and managing SingleStore clusters. The main…
Read Post
Engineering11 min Read

Performance is in SingleStore’s DNA. Last March, we shattered the trillion-rows-per-second scan barrier for processing a single SQL query on industry-standard Intel servers. That query processed data from a single table, and of course, lots of analytical queries use multiple tables, particularly star schemas. So we’ve broadened our vectorized, single instruction, multiple data (SIMD) query execution technology beyond single-table, group-by aggregate queries to star join group-by aggregate…
Read Post
Database6 min Read

On March 13, we published a blog demonstrating the performance of SingleStore in the context of ad hoc analytical queries. Specifically, we showed that the query can process 1,280,625,752,550 rows per seconds on a SingleStore cluster containing 448 Intel Skylake cores clocked at 2.5GHz. In this blog post, we drill down into how this was made possible by carefully designing code, exploiting distributed execution, and instruction-level and data-level parallelism. Why is such high throughput…
Read Post
AWS1 min Read

Amazon Web Services (AWS) is a juggernaut of a platform, and many of today’s database solutions can run on AWS, including SingleStore. Recently, we held a meetup at our office in San Francisco during AWS Summit 2018 to discuss how customers can benefit from using SingleStore within the AWS ecosystem. In the talk, “Architecting Data in the AWS Ecosystem,” Seth Luersen from SingleStore took a look at the overall data landscape related to the purpose-built databases from Amazon Web Services. He…
Read Post
Database4 min Read

In a recent webcast , we shared some tips and tricks on how you can operationalize SingleStore for configuring SingleStore Ops and SingleStore root user passwords; memory settings and health metrics; and how you can take backups and add nodes securely to your cluster. Here are the topics we covered: Permissioning a new cluster by adding a super-user to SingleStore Ops and via GRANT statements on the cluster itself Best practices for configuring memory limits Best practices for basic cluster…
Read Post
Announcements3 min Read

Last week at the Strata Data Conference in San Jose, I had the privilege of demonstrating SingleStore processing over a trillion rows per second on the latest Intel Skylake servers. It’s well known that having an interactive response time of under a quarter of a second gives people incredible satisfaction. When you deliver response time that drops down to about a quarter of a second, results seem to be instantaneous to users. But with large data sets and concurrency needs, giving all customers…
Read Post
Announcements4 min Read

Today, we are sharing that SingleStore now has Full-Text Search, a highly requested feature, built into the product. Thanks to customer feedback, we are delighted to make it available for all companies building real-time applications. What is Full-Text Search? You might be thinking, “SingleStore is pretty fast at searching things and they already support large strings, so why do they need to add anything?” So let’s start with a description of Full-Text Search (FTS). Full-Text Search is different…
Read Post
Demo1 min Read

Recently, we hosted a special meetup at our headquarters in San Francisco for the community, and shared some great talks. The slides for each talk and the video presentations have been made available below. Drew Paroski, SingleStore VP of Engineering and Adam Prout, SingleStore Chief Architect delivered a fun talk about taking a methodical approach for making a decision, dug into interesting tradeoffs, and gave tips about what to look for under the hood and how to evaluate the tech behind the…
Read Post