#data stack

When you think of foundation models and what they can accomplish, chances are you are thinking of text and image creation. Numbers Station, however, is taking these models in a very different direction. The startup, which is announcing a $17.5 million Series A round today, is using these models to build what the company calls an “intelligent data stack automation platform.” The funding round was…

Is the modern data stack just old wine in a new bottle?

Ashish Kakran Contributor Share on Twitter Ashish Kakran, principal at Thomvest Ventures, is a product manager/engineer turned investor who enjoys supporting founders with a balance of technical know-how, customer insights, empathy with challenges and market knowledge. More posts by this contributor Here’s where MLOps is accelerating enterprise AI adoption Remember the cable, phone and…

Trends in data infrastructure

The good (core principles to keep in future innovation)

Horizontal products We no longer need to buy a bunch of vertical-specific products to do analytics on specific things; we push data into a warehouse and can then analyze it all together in a common set of tools.

Fast The modern data stack is both fast from an iteration perspective—connecting new data and exploring it is a snap relative to 2012—and a pure query execution time perspective, as the performance breakthroughs of the MPP database now feed through the entire stack.

Unlimited Scale Using cloud infrastructure, it is now possible to trivially scale up just about as far as you could want to go. Cost now becomes the primary constraint to data processing.

Low overhead Sophisticated data infrastructures of 2012 required massive overhead investment—infrastructure engineers, data engineers, etc. The modern data stack requires virtually none of this.

United by SQL In 2012 it wasn’t at all clear what language / what API would be primarily used to unite data products, and as such integrations were spotty and few people had the skills to interface with the data. Today, all components of the modern data stack speak SQL, allowing for easy integrations and unlocking data access to a broad range of practitioners.

The bad (opps for future innovation)

Governance is immature Throwing data into a warehouse and unlocking transformation and analysis to a broad range of people unlocks potential but can also create chaos. Tooling and best-practices are needed to bring trust and context to the modern data stack.

Batch-based The entire modern data stack is built on batch-based operations: polling and job scheduling. This is great for analytics, but a transition to streaming could unlock tremendous potential for the data pipelines we’re already building…

Data doesn’t feed back into operational tools The modern data stack is a one-way pipeline today: from data sources to warehouses to some type of data analysis viewed by a human on a screen. But data is about making decisions, and decisions happen in operational tools: messaging, CRM, ecommerce… Without a connection with operational tooling, tremendous value created by these pipelines is being lost.

Bridge not yet built to data consumers Data consumers were actually more self-serve prior to the advent of the modern data stack: Excel skills are widely dispersed through the population of knowledge workers. There has not yet been an analogous interface where all knowledge workers can seamlessly interact with data in the modern data stack in a horizontal way.

Unifying Data Technology Stack :Across Edge, Analytics & Ops Tiers. #DataTechnology #databasearchitecture #datascience #businessintelligence #BI #dataengineering #datawarehouse #datacenter

Data Technology Stack : On-Demand Webinar: Originally Aired Thurs., February 28, 2019 | 12:00 PM – 1:00 PM CST

 Join us for this free 1-hour webinar from GigaOm Research. The webinar features GigaOm analyst Andrew Brust with Srini V Srinivasan, Co-founder of Aerospike, a leader in enterprise-grade, real-time database technology, deployable across tiers and workloads.

In this 1-hour webinar,…

Can Big Data heal healthcare?

As Greta Kaul of the San Francisco Chronicle recently noted, the high cost of healthcare remains a salient “pain point” for many American families. Unsurprisingly, many in the industry are turning to Big Data analytics to help alleviate some of the discomfort.

“[It could] lop off, by some estimates, 8 percent of the trillions in national health care expenditures spent in the United States each…