BLOG different

Only Custom Silicon Can Beat Us
Posted on: . by Darshan Rawal

Only Custom Silicon Can Beat Us

Introduction Since the birth of SQL in the mid 70’s, there has been a wall of separation between OLTP and OLAP use cases. One of the defining characteristics of this separation is the stringent need for speed and QoS (quality of service) by OLTP applications. Even today, Data Warehouses and Data Lakes pay lip service to speed and very little, if any, to QoS.  Isima asked why can't OLAP use cases demand the same (or even better) QoS than those mandated by the most stringent OLTP applications (e.g., Amazon Prime, Google Search)? And do so for a TCO of $0.004/sec on the public cloud. Why care about QoS for OLAP use-cases? Traditional OLAP systems served internal consumers via BI and Data Analysis tools. The rise of data producers, AI/ML capabilities, and elasticity of the Cloud nessaciated the Modern(?) Data Stack. This stack is attempting to help domains such as eCommerce, ...

Taming the non-deterministic Cloud
Posted on: . by Pradeep Madhavarapu and Naoki Iwakami

Taming the non-deterministic Cloud

The TL;DR summary Over a 12+ hour run, bi(OS) sustained an average of 21.5K operations/sec with a 80 : 20 write : read ratio where every operation was a 1Kb insert or select. Detailed results are in the table below.  The TCO of this system is $0.004/sec on GCP (Google Cloud ...

Who is M/F? Real World Data Quality
Posted on: . by Monish Suvarna

Who is M/F? Real World Data Quality

My blog last week talked about Schema lost in transit. Let me tell you a real story about a customer. We uploaded data from their repository into bi(OS) and the image above is a screenshot of what we saw on bi(OS) after an hour. We were not surprised as we have seen this story at ...

Schema lost in transit only to recreate again. WT*?
Posted on: . by Monish Suvarna

Schema lost in transit only to recreate again. WT*?

The current state of the art for Data Engineers is to build pipelines that ingest structured and semi-structured data in JSON, CSV, AVRO and store these as BLOBs on S3 (where the schema is lost). Then “Schema on Read” technologies such as Snowflake, Dremio or Presto process these ...

Customer-Aware Supply-Chain Operations
Posted on: . by Aditya Karandikar

Customer-Aware Supply-Chain Operations

Introduction As an e-healthcare company, PharmEasy would like to prioritize all our customers’ orders and have them delivered on time. Our customers count on us for many of their critical medications, and the company does not want to breach the medicine-availability or delivery-time ...

Why Isima matters more than ever?
Posted on: . by Monish Suvarna

Why Isima matters more than ever?

We at Silicon Valley told the world to collect lots of data, hire data experts, and magic would happen. Enterprises listened and did their best to start their digital transformation journey. A decade later, data shows that we in Silicon Valley have failed to put customer’s outcomes ...

Realizing Paradoxes<sup><sup>[1]</sup></sup>
Posted on: . by Darshan Rawal

Realizing Paradoxes[1]

When anyone asks me what does Isima do, I reply, “we realize paradoxes.” This epiphany has roots back to three incidents in our journey of launching Isima. Let me explain. Paradox: noun - a statement or proposition that seems self-contradictory or absurd but in reality expresses a ...

The long and windy road from ingest to insight
Posted on: . by Alfredo Tamura

The long and windy road from ingest to insight

In an ever-changing well-connected world, enterprises large and small strive to react faster and faster to market conditions. Many wish they could better leverage the data they already have but have been struggling with how best to achieve this. The traditional approach had been ...

The 10x Difference
Posted on: . by Pradeep Madhavarapu

The 10x Difference

Every once in a while, new technology at one layer enables a whole host of products at another layer to be reinvented, providing new features or solving new use cases that could not be solved earlier. I was fortunate enough to build a breakthrough product, Amazon Aurora, during one ...

Courage is Destiny
Posted on: . by Ashmeet Sidana

Courage is Destiny

Courage is Destiny. This motto from my elementary school has guided me throughout my life and to this day as I back visionary entrepreneurs. I believe one can achieve whatever she or he aims for, by taking thoughtful risks with courage. In its purest form (and ignoring the frenzy that we ...