Company
Stay in the know on all things SingleStore.
Trending
What’s got the database industry talking? Find out here.
Data Intensity
Tips and tricks on powering data-intensive technology.
Product
Get database best practices, new product releases and more.
Case Studies
Companies like yours choose SingleStore. See why.
Engineering
Get helpful how-tos, benchmarks, integration tips and more.
Recent Articles
Product
Accessing JSON Data at Warp Speed in SingleStoreDB
The Winter 2022 Release of SingleStoreDB added performance improvements for transactional (OLTP) and analytical (OLAP) workloads — particularly, for working with JSON and string data. This article will present several examples to demonstrate the speedup, so you can experience the performance improvements first hand.IntroductionIt’s no secret JSON is a wildly popular data format, used by developers and engineers all over. We’ve previously covered how SingleStoreDB supports JSON — with the latest innovation in 8.0 for seekable JSON. This enables JSON data to be stored in a compressed format, and when specific rows need to be retrieved, only the retrieved data needs to be decompressed. Figure 1 shows the previous approach for accessing JSON data (left-hand side) and the new approach (right-hand side). The new approach makes JSON suitable for both OLTP and OLAP applications, further cementing SingleStoreDB as the ideal, unified database.
Read Post
Company
A Silicon Valley Startup’s Response to the SVB Collapse — Silicon Valley Is Not a Location. It Is an Idea.
I came to this country over 20 years ago with nothing but a suitcase and a dream. Years later, Silicon Valley is where my dreams came true.Over the past two decades, I have had the privilege of having a front row seat to experiencing the creativity and resourcefulness of the people and companies that makeup the Bay Area. Being here during these pivotal years of tech expansion, I’ve witnessed — and participated in — the ever-evolving technological revolution we are experiencing that is arguably sometimes referred to as the third industrial revolution. The innovations birthed have changed every aspect of the world, and the economic impact has been staggering. I am proud to call Silicon Valley my home, and am even prouder of the people and innovations that come from it.When Silicon Valley Bank collapsed two weeks ago, I knew the fallout would be devastating for many companies and individuals. But I also know in my heart that this will not mark the end of Silicon Valley.I know that all of us at SingleStore feel just as strongly.Two days after the SVB collapse, our CEO Raj and I discussed our feelings about it over dinner. While we were deeply concerned for those affected, we also noted all the negativity around how the story was being reported. We felt that framing this story as evidence of Silicon’s Valley eminent downfall was a disservice to everything the people of the Valley have accomplished in the past and will bring forth in the future.Our conversation quickly turned into a discussion of gratitude for the ways Silicon Valley has changed both our lives. Raj, like me, is an immigrant, and we bonded over our shared experiences of moving to the Bay Area and being part of this startup culture. Our experiences in Silicon Valley are evidence that the dreams and ideas birthed here, and the enduring impact they have across the globe.We wanted people to know that just because a situation seems hopeless, that does not make it so. We wanted to remind them and ourselves that what sets Silicon Valley apart is its unique penchant for innovation and constant re-invention. This means that when a problem arises, the folks of Silicon Valley somehow always find a way to ask “What If” and using scrappy resources, set out to build on a dream.We wanted to remind the people of Silicon Valley, this country, and the world of these truths.It was 9p.m., and Raj suggested that we take out a full-page ad in the Wall Street Journal. He tasked me with writing it. Adrenaline kicked in and despite the late hour, our incredible SingleStore team came together to contribute to the piece. Thanks to their support, a beautiful ad was published in the WSJ less than 12 hours later. The way this message came about together – starting with a thought, an idea, and brought to fruition a few hours later due to everyone's undying and relentless passion – accurately describes the idea, and reality, that is Silicon Valley.Hope, optimism, and a passion for innovation — these are the things that brought me to Silicon Valley, and why I, like many here at SingleStore, am proud to call the Valley home. The ad, originally published on March 15th in the Wall Street Journal, can be found in full below: Silicon Valley is not a location. It is an idea.It is a melting pot where everyone speaks the same language—the language of innovation.Silicon Valley is an actualization of dreams. And a conviction of notions.It is an emotion that starts with a “what if” and ends with a change.It is a tapestry of tenacity and a fusion of sweat, tears, laughter, and ringing the bell.Silicon Valley is sometimes a graveyard of ideas yet a fertile ground that blooms a thousand creations.It is a valley of the boom. And sometimes a trough of the bust. Silicon Valley is not a bank.It is an institution. A tradition of invention.A collective where strangers bank on each others’ ideas. To this idea, to this melting pot, to this emotion that is Silicon Valley,we say — Dream on!May the best ideas thrive and give birth to a thousand more.Silicon Valley is a place we are proud to call home ❤️.
Read Post
Product
Securing Real-Time Applications with SingleStoreDB Cloud and AWS PrivateLink
In today’s digital world, cloud data security is a critical concern for both businesses and individuals. With the increasing volume of data being generated and stored in the cloud, it's more important than ever to protect sensitive information from cyber threats. At SingleStore, nothing is more important than the security of our customer’s data. Our organization works diligently to ensure security is architected, designed, implemented and audited at every layer of the technology stack.As part of our ongoing commitments to security and partnerships, we’re proud to announce that SingleStore has recently attained AWS PrivateLink Ready Partner designation — particularly for our managed offering, SingleStoreDB Cloud on AWS. In this blog, we’ll discuss all things AWS PrivateLink and SingleStoreDB Cloud. SingleStoreDB CloudSingleStoreDB Cloud is a fully managed, cloud-native database that powers real-time workloads. Our patented Universal Storage architecture intelligently tiers data between three storage layers (RAM, SSD, object storage) based on data access patterns. This ensures that data is always on the correct storage tier, delivering high performance at scale.Built for engineers by engineers, SingleStoreDB is based on a distributed SQL architecture, meaning databases are spread amongst a cluster of nodes rather than a single node monolith. Allowing SingleStore nodes to scale horizontally mitigates bottlenecks in data architectures, delivering millisecond performance on complex queries. These ‘shared nothing’ design principles allow businesses to effortlessly scale real-time applications.Having a distributed SQL database with Universal Storage architecture enables transactions and analytics to be unified in a single database engine. This is simpler, more performant, and more affordable than the alternative of stitching together disparate purpose-built databases to serve transactions and analytics separately. SingleStoreDB drives low-latency access to large datasets and simplifies the development of fast, modern applications.
Read Post
Engineering
Announcing the SingleStoreDB Driver for the SQLTools VSCode Extension
For those of you who haven't heard of it, SQLTools is a VSCode extension for connecting to different databases. This extension is extremely popular, recording more than 2 million downloads. SQLTools works using drivers — which are installed separately from the main extension — to connect to a variety of different databases. During a recent internal hackathon, we worked on a driver for SingleStoreDB, so that SQLTools users can connect to SingleStore databases. This extension has been published on GitHub, where you can learn all about it!Installing this driver is as easy as:code --install-extension mtxr.sqltoolscode --install-extension singlestore.sqltools-singlestore-driverHere's a tease of what you'll get:
Read Post
Company
International Women’s Day 2023: Embrace Equity
Today marks International Women’s Day — a time to celebrate women across the world while also reflecting on the steps we must take to reduce the inequities women face.First and foremost, I would like to extend a huge thank you to all the women who are a part of the SingleStore team. Your brilliance, dedication and hard work are critical to SingleStore thriving, and I am grateful to each and every one of you. Thank you.While this International Women’s Day (IWD) is a time for celebration, I believe it must also be a time to reflect on the ways we can create a better world for women. That’s why I’m thrilled that the theme for this year’s IWD is #EmbraceEquity.There’s an important distinction between equity and equality — while equality refers to ensuring everyone has equal access to resources and opportunities, equity “recognizes that each person has different circumstances, and allocates the exact resources and opportunities needed to reach an equal outcome.”In a nutshell, equity is about seeing where systemic gaps lay and acting to eliminate them. We know that the tech industry is rife with significant gender gaps — women only make up 27% of the workforce in STEM careers. A pay gap also exists — the median earnings of women in STEM jobs are approximately 74% of men’s median earnings in the same fields. Unfortunately, this pay gap in STEM careers is even wider than the gender pay gap in the broader labor market.These statistics are a result of biases and structures that deter women from pursuing STEM careers – and we see these everywhere. Gaps begin in education, where stereotypes about “women’s work” encourage girls to shift away from math and science. As a father of two daughters, I’ve noticed this tendency firsthand. My wife and I have worked hard to ensure that our girls know that they have the right and ability to excel in any any field they’re interested in. We know this is important, because when young women are discouraged from studying STEM, it leads to work environments that are male dominated and creates underrepresentation of women in tech. And thus, a vicious cycle continues.I wholeheartedly believe we can reverse these trends and design a more equitable future. This is especially important in tech, as we are building solutions to change the world. Tech itself will be more powerful and transformative when creators are more diverse and design it with a lens of equity and inclusion.I am committed to implementing pathways to further equity for women and other underrepresented groups in STEM at SingleStore. I am proud to say that this fiscal year, SingleStore's DEI Alliance will be focused on finding organizations within the non-profit space that we can invest in and partner with to further the inclusion of women and non-binary talent in tech. My family and I believe that making an investment of time and money in underserved communities is a responsibility and privilege, and I encourage my network to view it with the same lens.I am excited to announce that SingleStore will also be hosting a collaborative panel with industry leaders on how the rise of AI and automation will impact equity and justice. The panel will convene on March 27th and be streamed on LinkedIn Live. Panelists include:Nashlie Sephus, PH.D., Principal AI/ML Specialist AWSMaritza Johnson, Director for the Center of Data Science, AI, and Society at the University of San DiegoNatasha Seelam, Senior Deep Learning Engineer/Scientist @ Sherlock BiosciencesThis International Women’s Day, I hope we all take proactive measures to make this world more equitable. I look forward to our panel and – more importantly – to all the continued opportunities to learn from the incredible women who are part of the SingleStore team.
Read Post
Engineering
Full-Text Search in SingleStoreDB
We’re demonstrating the power of full-text search capabilities in SingleStoreDB — complete with code and examples for you to give it a try.What Is SingleStoreDB and Full-Text Search?SingleStoreDB is a real-time, distributed SQL database that handles both transactional (OLTP) and analytical (OLAP) workloads in a single, unified database. SingleStoreDB is a multi-model database that natively allows you to store and retrieve several different data types including relational, document, time-series and geospatial, along with providing full-text search capabilities. SingleStoreDB has supported full-text search (FTS) since 2018. Full-text search refers to the ability to search text inside text data stored in a database table, returning results that contain some or all of the words from the query that was executed. This differs from a traditional query that returns only an exact match of the data. For traditional databases, full-text searches can be challenging — which often leads to the development of specialty databases being used strictly for this purpose. SingleStoreDB helps customers simplify their data landscape by integrating full-text search capabilities into the core functionality of the database engine.How Does Full-Text Search Work?So, how do full-text searches in SingleStoreDB work? As previously described, full-text search allows for the searching of words or phrases in a large body of text. For full-text searches to work, an index must be created on a text data type. In SingleStoreDB, text data types include char, varchar, text and long text. Full-text indexes are only supported on columnstore tables, and they must be created as part of the CREATE TABLE process using the FULLTEXT index type. How Do We Do It?Full-text search takes advantage of SingleStoreDB’s patented Universal Storage, a unified table type that supports both OLTP and OLAP workloads. The columnstore table is a perfect table type for full-text indexes because a columnstore table lends itself to very fast scans of individual — or indexed — columns. Columnstore tables are also ideal for great compression. In fact, it's not uncommon to see SingleStoreDB compression of up to 90% on a columnstore table. What Are Some Types of Full-Text Search?What will full-text search allow you to do in SingleStoreDB? You can search for an exact phrase or word, or you can complete “fuzzy” searches. A fuzzy search is similar to a query with a “LIKE” filter in the `where` clause, and allows you to find words or phrases that are similar to the text you are searching for. ExamplesThe following tutorial will walk you through an example of creating a full-text index and doing several searches.Step 1 — Create a database, table and use SingleStore Pipelines to load some example data.CREATE DATABASE fulltextdb;USE fulltextdb;CREATE TABLE jeopardy_questions ( show_number text, air_date date, round text, category text, value text, question text, answer text, KEY (category) using clustered columnstore, FULLTEXT (question, answer));CREATE PIPELINE load_questionsAS LOAD DATA S3 's3://testdata.memsql.com/full-text/*'CONFIG '{"region": "us-east-1"}'SKIP PARSER ERRORSINTO TABLE jeopardy_questionsFIELDS TERMINATED BY ','OPTIONALLY ENCLOSED BY '"'LINES TERMINATED BY "\r\n"IGNORE 1 LINES( show_number, @air_date, round, category, value, question, answer)set air_date = to_date(@air_date,'YYYY-MM-DD');START PIPELINE load_questions;OPTIMIZE TABLE jeopardy_questions flush;Step 2 — Perform a full-text search using the function MATCH AGAINST.Select question From jeopardy_questionsWhere MATCH (question) AGAINST ('baseball') and category ='SPORTS';
Read Post
Product
Migrate Your Data From MySQL to SingleStoreDB in Minutes
Our partner, Arcion Labs, walks you through a step-by-step process of migrating your data from MySQL to SingleStoreDB using their Change Data Capture (CDC) platform.Organizations increasingly rely on data-driven strategies to drive growth and beat the competition — and the first hurdle is often siloed data. Traditionally, databases used to store this data and relational parameters in different tables. But as business needs evolve and data volume continues to grow, data analytics become critical — and the role of databases becomes increasingly significant in achieving business critical KPIs. As organizations realize the importance of immediate, actionable analytics, they continue to seek a big data platform that provides robustness to their applications, while ensuring it can scale to meet the emerging suite of web and mobile applications. These applications also deal with unstructured data sources a lot more than traditional applications.Solving for Modern Application ChallengesNoSQL databases were designed to solve this challenge for modern applications, allowing users to store massive workloads without adhering to a set schema — and still continue to build high performance applications. But the biggest challenge with NoSQL databases is the architectural complexity and additional know-how required to work on them. They also lack the ability to establish relations between data, leading users to seek the confluence of traditional RDBMS convenience and NoSQL performance. A new genre of databases brought the best of two worlds to the data and developer community. These new databases are SQL compliant, making it easier for users to apply their legacy knowledge of RDBMS technology and SQL query, while exploiting the performance of NoSQL databases for any unstructured data source. Organizations have warmed up to these databases and SingleStoreDB is a popular database in this category. Its proprietary design ensures high performance at larger workloads, making it the perfect choice for organizations with massive operational data seeking real-time data analytics. In this blog, we will walk you through a step-by-step process of migrating your data from a SQL server database (MySQL) to SingleStoreDB. These steps can be replicated to a large extent to migrate data from any SQL- server based database to SingleStoreDB.What Is MySQL?A popular open-source relational database, MySQL (owned by Oracle Corporation) is SQL-based and supports Online Transaction Processing (OLTP) operations. It operates under the open-source GNU General Public License, giving users the rights to use and modify according to the terms of the license.MySQL uses the client-server model, which is extremely popular among users given its flexibility. Developers can choose any programming language or driver of their choice to connect to the database and start data processing.It is also part of the LAMP stack, another popular software stack used by several web applications and services. Oracle provides enterprise versions of MySQL for specialized applications. However, open-source MySQL is in itself extremely reliable, efficient and great for enterprise applications.MySQL: Key FeaturesAs discussed earlier, these are the key features of MySQL:Ease of useEasy installation processSupports multiple operating systems and a wide range of applicationsDatabase administrators do not need to acquire new skillsSecurityProven and testedBuilt-in encryption, access and privilege managementScalabilityNative replication architecture for high scalabilityScale-on-demand available on Amazon RDSHigh AvailabilityHighly available architecture supports data loss preventionDisaster recoveryFull replication for downstream systemsPerformanceHigh on reliability and performanceConsistent and compliant data using Atomicity, Consistency, Isolation and Durability (ACID)What Is SingleStoreDB?SingleStoreDB is a real-time, distributed SQL database. Its unified architecture supports both analytical (OLAP) and transactional (OLTP) processing, offering two modes of deployment: SingleStoreDB Self-Managed for manual deployment on your hardware and database management.SingleStoreDB Cloud, a fully managed version where you can choose hosting with most major cloud providers.SingleStoreDB: Key FeaturesLet’s look at SingleStore’s key features:SpeedExtremely low latency operations due to rapid data ingestion and querying capabilities.High concurrencyEfficient data storage and retrieval using row and column store patternsScalabilityCompute separate from storageHorizontal scaling for application dataCost-effective scaling with high performanceSecuritySecure by designEnd-to-end encryptionBuilt-in authentication and authorizationProven validations for enterprise compliance through certifications (ISO/IEC 27001 and SOC Type 2)Load Data From MySQL to SingleStoreDB Using ArcionArcion is a cloud-native Change Data Capture (CDC) platform. Zero data loss and extremely low latency data pipelines are unique to Arcion. It offers both self-managed and cloud based versions for more flexibility to the user. In this example, let’s walk through the migration steps using Arcion Cloud.Log in to Arcion Cloud to set up the replication pipeline. This enables the CDC.
Read Post
Product
Webinar Recap: Real-Time Data and the State of Translytical Platforms
In partnership with Forrester, our recent webinar takes a closer look at translytical platforms, what they mean for organizations and the impact they have on real-time data.What does real time mean to you? Is it the speed at which you’re able to access information through your organization’s BI tools? Or how quickly your dashboards reflect up-to-the-minute insights? The notions and expectations around real-time experiences — even in the last year — have drastically shifted, with more users expecting analytical applications to function like never before.But ‘real time’ doesn’t happen on its own. It’s the outcome of a foundation designed to power these experiences and use cases — one that relies on a unified, all-in-one data architecture: a translytical platform, the combination of transactional (OLTP) and analytical (OLAP) processing.Unifying OLTP and OLAP workloads is increasingly gaining traction in the market, powering use cases never before possible when workloads were separated and handled by specialty databases. Fraudulent payments are caught within milliseconds. Streaming services deliver “watch next” recommendations instantly. And ride share drivers quickly connect with riders. As more companies take on translytical platforms and databases, what does the future hold for this technology? And, how does widespread adoption of translytical databases impact expectations around real-time data? We sat down with Noel Yuhanna, Vice President and Principal Analyst at Forrester and Franck Leveneur, CEO at Data-Sleek to find out. Here’s what we discussed in our webinar, “Translytical Platforms, Use Cases & Trends Featuring Forrester and Data-Sleek.”What Is a Translytical Platform?According to the Forrester report, The Forrester Wave™: Translytical Data Platforms, Q4 2022, “Translytical platforms are next-generation data platforms that are built on a single database engine to support multiple data types and data models. They are designed to support transactional, operational, and analytical workloads without sacrificing data integrity, performance, and analytics scale.”As Yuhanna goes on to explain, translytical platforms also feature:Memory-enabled capabilitiesMulti-model structuresScale-out architectureAI/ML built-in componentsZero administrationTiered data storage“At least 25% of your applications and insights need translytical today,” says Yuhanna. “And that number is going to double, we believe, in the next four to five years. If you’re not on this translytical journey today…well, you may be left behind.”The Benefits of Translytical PlatformsBy combining previously siloed workloads into one, translytical platforms deliver a variety of long-term benefits to users — those listed by Yuhanna include:Support for real-time analytics, no ETL or additional data movement requiredOne platform to support multiple workloadsAccelerate development for new analytical applicationsLower costs by eliminating redundant, overly complex data platformsFewer administrative requirementsGreater business agility, and a competitive advantageCommon Use Cases for Translytical Platforms“The number of use cases for translytical have been growing,” says Yuhanna. Across industries like financial services, IoT analytics, insurance, manufacturing and retail, translytical platforms are key in helping organizations move toward unified, real-time analytics across their entire technology stack. Some ways organizations are harnessing translytical capabilities include:Real-time applications: Fraud detection; patient-health monitoring; airline and hotel reservations; eCommerce; gamingCustomer-focused outcomes: Consumer personalization; recommendation engines; minimizing churnIoT-focused applications: Machine analysis; predictive assessments; procurementOther common uses for translytical platforms include operational analytics, risk management, online trading, media and advertising, gaming and more.Finding a Translytical Platform to Transform Your Real-Time DataFor Franck Leveneur, CEO at Data-Sleek, real-time data bottlenecks arose when data sets were well handled by only one type of engine:“The engine built in the database is meant for [OLTP],” says Leveneur. “...it’s really an engine to track the transaction to make sure it’s captured properly, because the source and quality of the data is important.”But what about when he needed to conduct analytical queries?“This creates some issues when you start to have a large amount of data, and you want to perform some analytical queries…and I’m talking about 100 billion rows, for example. Then you start seeing issues. It takes too long, because the [analytical] engine is not really built for that.”As Leveneur goes on to explain, there are ways to scale reads using replicas — however even these options hit a wall. What he needed was an easier way to handle both workloads, without needing to move data, sacrifice query performance or rebuild their technology stack from the ground up.Leveneur’s need represents the crossroads commonly reached by businesses: As their organizations and data sets grow in complexity, so do their use cases — and single-engine databases won’t cut it.It was at a tech conference in San Francisco that Leveneur came across a translytical database that would allow him to handle both OLTP and OLAP workloads, without having to completely rewrite data: SingleStoreDB.Named a “Strong Performer” in the The Forrester Wave™: Translytical Data Platforms, Q4 2022, there were a few key criteria that made SingleStoreDB stand out:Unified data architecture, designed to handle both OLTP and OLAP workloadsMySQL wire protocol compatibility — or as Leveneur calls it, the “MySQL big brother”Rowstore and columnstore capabilitiesLow-latency analytical queriesFast ingest for large data sets, even those up to 100 billion rowsCurious to Hear the Rest of the Story? Watch the Webinar TodayTo learn more about the future of translytical platforms, what makes SingleStoreDB a stronger performer and see a live use case in action, watch our webinar “Translytical Platforms, Use Cases & Trends Featuring Forrester and Data-Sleek” on demand today.You can also get your copy of The Forrester Wave™: Translytical Data Platforms, Q4 2022.
Read Post
Engineering
Your First Five Minutes with SingleStoreDB: What to Expect
In this blog post, we guide you through what to expect when you sign up for a new SingleStoreDB account. Explore our Quick Start Checklist, find out how to invite your team members, where to go when you need expert support and more. Table of ContentsSingleStoreDB CloudThe onboarding checklistCreate a WorkspaceMarketing tech ("martech") app tutorialInviting a team memberChat with an expertUpgrade your planThe help menuQuery Playground — No Sign Up Required!SingleStoreDB CloudHave you tried SingleStore before? If not, we’re very excited to have you! By signing up to use SingleStoreDB Cloud, you have a lot of options to explore — and we’re here to guide you through this journey.The onboarding checklistOn the "Start" page, you will find a list of items we consider important for your experience. We encourage you to follow this list, and get your tasks completed along the way.
Read Post
Product1 min Read
Using Vector Functions for Image Matching in SQL with SingleStoreDB
In this example, we’ll demonstrate how we use the dot_product function (for cosine similarity) to find a matching image of a celebrity from…
Read Post
Company
Unlock Real-Time Insights with CData and SingleStore
This blog post discusses the partnership between CData and SingleStore, two tools that facilitate real-time data integration and analysis for businesses.CData and SingleStore are two powerful technologies that can help businesses streamline their data workflow and gain real-time insights into their operations.As businesses continue to collect and store more data than ever, the ability to access and analyze that data efficiently is increasingly important. That's where CData and SingleStore come in. Together, these two powerful tools offer a comprehensive solution for data integration and management, helping businesses unlock real-time insights and make data-driven decisions.SingleStoreDB is a highly powerful, highly performant real-time distributed SQL database that can handle both transactional and analytical workloads. It is designed to help businesses handle large amounts of data and perform complex queries with ease.CData, on the other hand, is a suite of data connectors that allows you to easily connect to a wide variety of data sources — including databases, SaaS platforms and APIs — using them for real-time data integration, analysis, reporting and more. When used together, SingleStore and CData offer a number of benefits for businesses looking to optimize their data operations. Let's look at how CData Sync & SingleStore can help power real-time use cases:
Read Post
Engineering
Using Cypress Logs Instead of Videos and Screenshots to Debug Test Failures
In this blog post, we’ll show how we used cypress-terminal-report to facilitate debugging test failures by fetching all the Cypress Logs. For developing the frontend of our product (Customer Portal), we use Cypress as the primary testing framework. We have two types of Cypress tests: end-to-end and component tests.We have relatively few end-to-end tests, yet these test all layers of the product — including the SingleStoreDB database engine, backend and frontend. Since some of these tests create database clusters, they can take some time to finish. Thus, the Cypress Component Tests (CCT) are the main tests for every facet of our product’s interface.However, these tests come with a caveat: they can be very flaky if not written properly. Our CI/CD job for CCT fails most frequently due to flaky tests. The only artifacts our pipeline collects to inspect the failed tests are the screenshots and videos that Cypress creates, which are not always enough to easily assess what happened to the failed test. For this reason, we tried to find a way to get the Cypress logs for each test, including the console logs printed while the tests are run (which are not visible in the Cypress videos).At the moment, Cypress doesn’t support this kind of logging by default. In an open issue on Cypress’s GitHub, someone provided a list of current workarounds for this problem. Of all the plugins mentioned, we decided to go with `cypress-terminal-report`.cypress-terminal-reportThis npm package is still in active development, collecting all the necessary logs for a very simple debugging of Cypress tests. Before we go on, let’s see how we set up this plugin.How to setup cypress-terminal-reportFirst, we need to install the plugin:npm i --save-dev cypress-terminal-reportAfterward, we need to import two things:`installLogsCollector``installLogsPrinter`The collector needs to be imported in the support file for Cypress tests. Since we want to use the plugin for both e2e and CCT, we’ll add the import in file `cypress/support/logging.ts`:import installLogsCollector from "cypress-terminal-report/src/installLogsCollector";installLogsCollector({});And then both support files, `cypress/support/e2e.ts` and `cypress/support/component.ts`, should import `logging.ts`.As for the printer, it needs to be imported in `cypress.config.ts`:import { defineConfig } from "cypress";import installLogsPrinter from "cypress-terminal-report/src/installLogsPrinter";export default defineConfig({ e2e: { setupNodeEvents(on, config) { installLogsPrinter(on, {}); }, }, component: setupNodeEvents(on, config) { installLogsPrinter(on, {}); }, },});With this basic setup, the plugin will capture Cypress command logs and network requests, and output them to the terminal when a test fails. It will also capture console logs, but only for e2e tests (not for CCT). These tests run in a different iframe, so the plugin cannot redirect the logs directly to the terminal. However, it is very important to us to get the CCT console logs, since these are usually flakier. We were able to accomplish this with a workaround.How to get console logs for Cypress Component testsFirst, we replace the `window.console` functions with our custom one, which will use Cypress's internal logging function — Cypress.log. We do this for every component test, so we write this inside the `before` hook. To prevent the extra logging when running Cypress in headed mode (“isInteractive”), we add the code inside an if condition. The function `processArg` will stringify the objects to be readable.before(() => { if (!Cypress.config("isInteractive")) { const consoleFuncs = ["log", "error", "info", "warn"]; cy.window().then((win) => consoleFuncs.forEach((method) => // @ts-ignore win.console[method] = (...args: Array => { Cypress.log({ name: `${method}-1`, message: args .map((arg) => processArg(arg)) .join(",\n"), }); }; }); }); }});With this block of code, the plugin will output the logs with the following format:cy:command log-1 console log outputcy:command error-1 console error outputcy:command info-1 console log outputcy:command warn-1 console warn outputThis could be enough, but we want to correctly specify the types of logs, not just `cy:command`, just like the plugin does for end-to-end tests.One of the config options available in `installLogsCollector` is processLog which we can set to a custom function to process the logs the way we want. The function accepts a list of three arguments: `[type, message, severity]`. It then returns the same type of list, after the necessary processing. Here, we check for the `cy:command` type of logs, and if the message matches the regex expression for any of the console functions, we substitute the type of log with the new one (cons:log, cons:error, …) and the message without the first part (log-1, error-1, …).import installLogsCollector, { LogType,} from "cypress-terminal-report/src/installLogsCollector";const CONSOLE_FUNCS_LOG_TYPES_MAP: Record<string, LogType> = { log: "cons:log", error: "cons:error", info: "cons:info", warn: "cons:warn",};installLogsCollector({ processLog: (args) => { const [argType, message, severity] = args; let newArgType = argType; let newMessage = message; if (newArgType === "cy:command") { for (const [func, logType] of Object.entries( CONSOLE_FUNCS_LOG_TYPES_MAP )) { const regex = new RegExp(`${func}-1\t(.+)`, "s"); const match = newMessage.match(regex); if (match) { newArgType = logType; newMessage = match[1]; } } } return [newArgType, newMessage, severity]; },});Now, the output will have the following format:cons:log console log outputcons:error console error outputcons:info console log outputcons:warn console warn outputWith these new changes, we can get all the output for each Cypress test in the terminal.Now, there’s another catch: we have several logs for each test, and with the increase of lines, the terminal won’t go back far enough to show all the logs for one test. So, the best way to analyze the logs will be if they are collected in a file.How to print logs to filesThe plugin already has the option to write the logs to a file. We can define a single file to output the logs to, which will be overwritten each time we run a new test. Or, we can write to a file for each spec test, using the name of the test as the name of the log file. However, we were having an issue with the naming of the files for CCT, where they would be something like `https:localhost:XXXX/..../cypress_runner.js`, which was not very useful.To circumvent this issue, we chose to create and write the log files with our own code. With the printer option function `collectTestLogs`, we can, as the name suggests, collect the test logs for the current test and save them in a variable.// cypress.config.tsimport { defineConfig } from "cypress";import installLogsPrinter from "cypress-terminal-report/src/installLogsPrinter";let testLogs = "";const logsPrinterConfig: installLogsPrinter.PluginOptions = { collectTestLogs: (testInfo, logs) => { // testInfo.state: "passed" | "failed" const statusSymbol = testInfo.state === "passed" ? "(+)" : "(-)"; let testContent = `${statusSymbol} ${testInfo.test}\n`; logs.forEach((logType, message, severity]) => { testContent += `\t\t<$logType} (${severity}):\n`; testContent += `${message .split("\n") .map((line) => `\t\t\t\t${line}`) .join("\n")}\n`; }); testLogs += testContent; },};export default defineConfig({ e2e: { setupNodeEvents(on, config) { installLogsPrinter(on, logsPrinterConfig); }, }, component: { setupNodeEvents(on, config) { installLogsPrinter(on, logsPrinterConfig); }, },});With these changes, when the tests run in headless mode we will have a new folder `logs` next to the folders `videos` and `screenshots` created by Cypress. On the definition for the e2e and CCT jobs on GitLab, we can add:artifacts:</span> when: always paths: - frontend/cypress/screenshots - frontend/cypress/videos - frontend/cypress/logsAnd all the artifacts will be available for us to look through when trying to debug a test failure.
Read Post
Engineering
Integrating SingleStoreDB with Presto
We’re guiding you through how to integrate Presto, a distributed query engine for SQL users with SingleStoreDB — complete with a deep dive into architecture, installation, queries and more.What Is Presto?Presto is a distributed query engine for big data that uses SQL query language. Its architecture enables users to query data sources like Hadoop, Cassandra, Kafka, AWS S3, Alluxio, MySQL, MongoDB and Teradata — and allows use of multiple data sources. Simply put, Presto offers compute that runs on top of storage.Presto architecture
Read Post
Engineering
Developer Quick Tips
Check out this roundup of some of my latest developer quick tips, hacks and more.As a technical evangelist for SingleStore and long-time developer, I’m always excited to share my take on the latest product innovations, tips and tricks for SingleStoreDB. Here’s a roundup of some of the latest ones I’ve put together — you can also always find them on dev.to.Accessing JSON Data at Warp Speed with Universal StorageThe Winter 2022 release of SingleStoreDB (version 8.0) introduced the latest installment of Universal Storage, with new performance improvements for both transactions and analytics — further cementing it as the ideal database for unifying OLAP and OLTP workloads. This latest update focuses on working with JSON and string data, particularly, seekable JSON.Using JSON with SingleStoreDBOne of the most popular data formats today, SingleStoreDB effortlessly stores, retrieves and queries JSON data. With seekable JSON, data can be stored in a compressed format. When you need to retrieve specific rows, only the retrieved data needs to be compressed. This new approach makes JSON a suitable data format not only for OLTP applications, but OLAP ones as well.
Read Post
Product5 min Read
Why You Need a Real-Time Analytics Database
A real-time analytics database enables you to collect and access data instantly, empowering your organization to make better, more informed…
Read Post
Company
Partnering with SingleStore: Driving Business Value Through Data Innovation
In December 2022, we launched the SingleStore Partner Program and SingleStore Connect, our comprehensive partner directory. Our goal is to provide ISVs with the tools and resources they need to grow and succeed in the real-time, operational database market.The SingleStore Partner Program is designed to offer ISVs a comprehensive support system. Our dedicated partner managers work closely with our partners to understand their business goals, helping them make the most of our technology. Our training and certification programs are designed to provide partners with the knowledge they need to succeed, while joint marketing and sales opportunities help partners reach new customers and grow their business.SingleStore Connect is a unique platform that connects ISVs with customers and partners looking for cutting-edge technology solutions. Our partner directory showcases our partners’ products and services, making it easy for customers and partners to find and connect with the right ISV for their business needs.Technology Partner Requirements
Read Post
Product
What Are Analytical Applications?
What are analytical applications, and how do they impact your business? We’ve got everything you need to know about this essential, real-time tool.What Are Analytical Applications? As an increasing number of businesses seek ways to leverage data to enhance insights and gain efficiencies, analytical applications have emerged as essential tools for improving performance.Analytical applications deliver comprehensive and concise insights that business leaders can use to take action — empowering you to innovate, streamline operations and accelerate company growth. By processing vast amounts of raw data, analytical tools can produce reports and data visualization that provide intelligence, guiding executives and other company leaders in making strategic decisions.Businesses use these analytical applications, often referred to as business intelligence tools or BI analytical applications, to make decisions in real time about how to prioritize areas of your operations that can lead to the most impact, minimize abandonment of invaluable customers, ensure you achieve your goals and meet service-level agreements for your customers.Data analytics can improve business operations for companies in varying industries. Every organization can collect, maintain and analyze data to gain insights on how to improve performance and evaluate growth opportunities. Through analytical applications (or analytical apps, for short), you can leverage data in the following industries to achieve your objectives:Energy & UtilityEnergy companies rely on the ability to continuously monitor and analyze data on various complex systems to ensure they're operating at a high rate of efficiency — as well as maximizing profits and performance. Analytical applications give you the ability to make real-time decisions in areas like energy distribution, energy optimization and smart grid management.See how a major oil and gas company improves financial reporting in a volatile marketFinancial ServicesAnalytics applications also can give financial businesses, including portfolio managers, investment banks and endowments the tools needed to quickly gain real-time data insights on investment alternatives, make more informed investment decisions and streamline their analytical processes. This allows CFOs and other financial experts to get a more comprehensive view into budgeting, forecasting, financial planning and portfolio management.Here’s how Bitwyre powers an ultra-fast, scalable, resilient and secure cryptocurrency exchangeTransportationUsing analytical applications, companies specializing in transportation services can analyze data to help them meet customer expectations for delivery. Analytics can be used to anticipate traffic delays, plan alternate routes and make other predictive decisions to enhance and streamline operations.Digital AdvertisementCompanies specializing in advertising can use analytical applications to leverage data insights about the most effective advertising mediums for specific audiences. These can include advertising on websites, digital billboards and other advertising mediums.Find out how Tapjoy reaches more than 800 million active users a month with advertising an app monetizationMedia & EntertainmentUsing analytical applications, organizations can gain insights into customer and behavioral data to deliver the best entertainment experience for their customers based on their preferences.What Is An Analytics Application Tool?What is an analytics application tool? Since the late 1980s, when the amount of data being generated began to accelerate, innovations in analysis became increasingly important. The analytics application tool emerged as software that businesses use to measure and analyze data — and gain insights to improve the performance of their operations.Various types of mobile analytics and web app analytics tools are now leveraged as business intelligence (BI) to help executives make sense of vast amounts of data. These analytics application tools provide users with the insights they need to streamline operations, increase efficiencies and make other improvements in their business functions.An analytics application tool may include various features to enhance analysis, including dashboards, interactive data visualizations and reporting that provide you with real-time insights into your company’s data. These tools are used in various industries and across different departments including marketing, sales and finance.Advantages of Analytical AppsAnalytical apps, which can be leveraged by users at various levels, provide a logical and contextual view of the data your business generates. Depending on your needs, the analytical application can provide an easy-to-digest visualization or report of what you need to address specific questions.When using analytical applications, organizations gain the following advantages:Actionable insights. With analytical applications, you can identify areas for improvement, gain a better understanding of target audiences, increase profitability, reduce costs and maximize opportunities for improvement.Competitive advantage. By gaining business intelligence through an analytical application tool, you can make decisions based on data insights in real time — a significant advantage if competitors are not leveraging the same tools.Data-in-context. Without a team of experts on board, you may not be able to make sense of all the data a business generates. Manual analysis of data is also time consuming. Analytical applications provide easy-to-understand visualizations and reports from a user-friendly dashboard, minimizing the time it takes to generate an actionable, contextualized analysis.Application Of Analytics In BusinessWhen considering an application of analytics in business, it’s important to first consider the unique needs of your company, as well as the industry. For example, the application of business analytics in agriculture may be significantly different from the application of business analytics in finance.Currently, many agribusinesses leverage business analytics to address the need for more agricultural output to meet the needs of the growing world population. Analytical applications are used on initiatives to increase productivity through insights gathered from advanced technology like soil sensors, weather tracking and GPS-equipped tractors.By gaining access to real-time data on weather patterns and insect behaviors, farmers can make important decisions about crops. As a result, they can more effectively reduce waste, increase yield and boost profits. Analytics can also be used to better meet customer demands and improve supply chain management.Other considerations should be weighed, including the importance of business analytics in the processing and analysis of data for various departments and individual users. Organizations also should determine if a prospective vendor has provided applications of data analytics in business for companies of similar sizes and industries.For many organizations, the business analytics process typically involves participation among various departments to enhance collaboration for optimal outcomes. By sharing marketing and sales data in real time with operations or manufacturing, you and your team can better anticipate customer demands for products. As a result, you should consider extending the use of the application to various team members, not just data analysts.You also need to determine if the analytics tool is robust enough to gather, analyze and process the amount of data your organization generates from various sources. The tool also must be capable of providing visualizations and reports to deliver a comprehensive analysis in one location.Another consideration is the ability of the analytics tool to be personalized to meet the company's specific requirements. The tool should accommodate your company's goals — as well as ensure that all designated team members can use it.Application Of Data AnalyticsAs demonstrated among the organizations that use it, the application of data analytics can produce different outcomes based on the industries in which it is used. For that reason, many organizations seek data analytics providers that have worked in their respective industries. Besides finance and agriculture, some of the leading analytical applications have been used in education, healthcare and business (among others).Application of Data Analytics in EducationThrough data analysis in the education field, educators can identify academic areas where students are performing well, or struggling. They also can be used to determine a student’s learning style. As a result, schools can leverage data to give students a more personalized approach, promoting more comprehensive, successful education plans. The application of data analytics in education can also assess a student’s academic strengths, guiding their future education and career.From an administrative standpoint, analytical tools can be used to streamline tasks like enrollment, recruitment and processing student information. Application of Data Analytics in HealthcareWith medical facilities gathering various types of patient data from electronic health records, patient portals, smartphone apps and other devices, health professionals can get a more holistic view of each patient to determine how to best address their needs.Data analytics in healthcare can also use this information to capture overall trends in a specific location or among a certain demographic to determine if actions for a community are necessary. For instance, data analysis during the COVID-19 pandemic played a critical role in helping health experts and public officials determine high rates of infection in a certain area — and respond accordingly.Application of Data Analytics in BusinessMany businesses have used analytical apps to gain invaluable data insights to help them become more profitable. The benefits of data analytics in the business realm can be far-reaching — from helping companies personalize the customer experience to attract and retain more buyers, to streamlining operations and mitigating risks like theft.For instance, businesses in the retail industry can use data analytics to determine the optimal price for products based on current sales and predictive analysis of customer demand. They also can make long-term projections, like employee hires and increased production based on seasons.After making decisions based on business intelligence in a limited market, company leaders can also assess data to inform business decisions on a larger scale. As a result, a company can minimize losses and maximize profits.SingleStoreDB for Analytical ApplicationsTo truly be effective, analytical applications require an approach that taps into real-time capabilities — reducing time-to-insights for fast analytics on even the most dynamic data.To truly be effective, analytical applications require an approach that taps into real-time capabilities — reducing time-to-insights for fast analytics on even the most dynamic data. SingleStoreDB is design for real-time analytical applications. With a data architecture that unifies transactional and analytical workloads, SingleStoreDB mitigates the performance bottlenecks and unnecessary data movement that often contributes to lackluster application performance.Interested in learning more? Get started with a free trial of SingleStoreDB today. You can also check out more resources for analytical applications here:Blog: Why SingleStoreDB for Real-Time Analytics & ApplicationsSolution Brief: Supercharge Your SaaS ApplicationsCustomer Story: SingleStoreDB Powers IEX Cloud With Ultimate Real-Time Application Analytics
Read Post
Engineering4 min Read
Image Matching in SQL With SingleStoreDB
Vector functions in SingleStoreDB make it possible to solve AI problems, including face matching, product photo matching, object recognition…
Read Post
Company3 min Read
World Economic Forum Reflections: Raj Verma
Our CEO Raj Verma was honored to represent SingleStore as part of its first delegation to the World Economic Forum in Davos, Switzerland…
Read Post
Product2 min Read
How to Build a Database Architecture for Modern, Real-Time Applications
From finding a new show based on a recommendation from your streaming service, to getting fraud alerts from your bank, you benefit from both…
Read Post
Product7 min Read
Snowflake vs. Redshift
This article will focus on two popular data warehouse solutions on the market today: Snowflake and Amazon Redshift. Both have wide user…
Read Post
Product7 min Read
What Is a Data Mesh Architecture?
In this article, you'll learn more about data mesh architectures and why they're relevant in the modern business environment, as well as why…
Read Post
Company3 min Read
It’s Official: SingleStore Is Named Among Best Places to Work 2023 by Glassdoor
SingleStore has been named to Glassdoor’s Best Places to Work 2023, earning a spot among the top 50 SMBs in the U.S. Here’s why our…
Read Post
Trending3 min Read
Reducing Energy Consumption Via Real-Time Data
We all know it’s important to conserve energy. Today in the U.S., we’re reminded of that because it’s National Cut your Energy Costs Day…
Read Post
Company2 min Read
SingleStore Named Select Launch Partner for Intel Sapphire Rapids
SingleStore is honored to join Intel as a select launch partner in the release of Intel’s Fourth Generation Xeon Scalable Processors to…
Read Post
Product6 min Read
What Is Streaming Data?
This article describes what streaming data is, its benefits and pitfalls — as well as use cases and the architecture you need to get started…
Read Post
Product7 min Read
Winter 2022 Release: Toys for Developers in SingleStoreDB
In our Spring 2022 blog , we shared how the mechanics one of us used to work with anticipated the arrival of the Snap-On tool truck. The…
Read Post
Company2 min Read
Stay Hungry, Stay Foolish on Highway 101: How SingleStore “Sleighs” the Streets With Real-Time Creativity & Innovation
Here at SingleStore, we’re an organization comprised of results-oriented individuals. It’s also true that we like to have fun and tap into…
Read Post
Product2 min Read
Winter 2022 Release: Announcing Real-Time and Historical Monitoring in SingleStoreDB Cloud
At SingleStore, we want to create the ultimate database — a single, unified single database that powers all our customers’ needs. Part of…
Read Post
