BLOG different
Schema lost in transit only to recreate again. WT*?
The current state of the art for Data Engineers is to build pipelines that ingest structured and semi-structured data in JSON, CSV, AVRO and store these as BLOBs on S3 (where the schema is lost). Then “Schema on Read” technologies such as Snowflake, Dremio or Presto process these BLOBs by (re)-applying the schema that was lost to deliver insights. So this begs a set of questions starting with “Why is schema lost in transit?” The industry gives us two primary reasons - Schema can change frequently and “Schema on Write” data platforms cannot handle these schema changes. Performance of the ingest Pipes - transferring BLOBs is more efficient than understanding the schema. If we compare the two approaches below: #comparison-table td {text-align: center;border: 1px solid black; border-collapse:collapse; padding: 2px 5px;} #comparison-table td.table-green ...
Customer-Aware Supply-Chain Operations
Introduction As an e-healthcare company, PharmEasy would like to prioritize all our customers’ orders and have them delivered on time. Our customers count on us for many of their critical medications, and the company does not want to breach the medicine-availability or delivery-time ...
Why Isima matters more than ever?
We at Silicon Valley told the world to collect lots of data, hire data experts, and magic would happen. Enterprises listened and did their best to start their digital transformation journey. A decade later, data shows that we in Silicon Valley have failed to put customer’s outcomes ...
![Realizing Paradoxes<sup><sup>[1]</sup></sup>](https://www.isima.io/wp-content/uploads/iStock-1219798662-1024x632.jpg)
Realizing Paradoxes[1]
When anyone asks me what does Isima do, I reply, “we realize paradoxes.” This epiphany has roots back to three incidents in our journey of launching Isima. Let me explain. Paradox: noun - a statement or proposition that seems self-contradictory or absurd but in reality expresses a ...
The long and windy road from ingest to insight
In an ever-changing well-connected world, enterprises large and small strive to react faster and faster to market conditions. Many wish they could better leverage the data they already have but have been struggling with how best to achieve this. The traditional approach had been ...
The 10x Difference
Every once in a while, new technology at one layer enables a whole host of products at another layer to be reinvented, providing new features or solving new use cases that could not be solved earlier. I was fortunate enough to build a breakthrough product, Amazon Aurora, during one ...
Courage is Destiny
Courage is Destiny. This motto from my elementary school has guided me throughout my life and to this day as I back visionary entrepreneurs. I believe one can achieve whatever she or he aims for, by taking thoughtful risks with courage. In its purest form (and ignoring the frenzy that we ...
Pivots, somersaults, jaywalking
A startup that hasn’t pivoted, doesn’t exist. Pivots, somersaults, jaywalking – are all parts of a startup’s journey. Anyone who says otherwise haven’t told you the complete story. Luckily Isima isn’t one of those. Believe me when I say this because, folks, I have seen it ...
The Walls of Enterprise Architecture
Why did we start Isima? Monish and I have been part of delivering innovations years before they went mainstream in areas of operating systems, scalable distributed systems, ML for click-fraud, networking improvements, and platforms using APIs done right. Moreover, we have jaywalked ...
Is complexity inevitable?
Is accidental complexity the norm for Software? Isima was born because Darshan and I saw so much complexity in Data Solutions where the answers were simple. Some of the complexity came from integrating many different good products instead of thinking end to end. We saw layer after layer ...