Update 3,Nov 2016: When I first wrote this post, there were a lot of opinions/comments (in my older blog) about how I am wrong in thinking about choosing a datastore is almost like choosing a data structure when writing a program. Here is an excerpt from Nathan Marz’s book “Big Data: principles and best practices of… Continue reading
Post Category → ElasticSearch
What you need to know before writing Streaming APIs
What are Streaming APIs? Streaming APIs are not to be confused with multimedia streaming API services like Netflix or Youtube. Industry is starting to use a newer breed of REST APIs called the Streaming APIs to offer a “high-throughput” pipeline to receive curated data. With these APIs you can capture information in real time. It’s… Continue reading
What you didn’t know about Real-time notification systems
I have been intrigued by Event Notification systems for a long time now, In fact this started from my programming days in legacy environments like iSeries. So I started working on a toy project which evolved into a solid project. I thought I will muse about that recent project the RealTimeNotification. But before going into the details of the… Continue reading
ElasticSearch on Hadoop
Some background on how ElasticSearch indexes documents For those who already have a back ground on Elastic Search, it is just a special purpose full text search document based data store with real time indexing abilities. How does Elastic Search does this? If you are already aware of the Search engines and the underlying data… Continue reading
ElasticSearch – Real time streaming and Indexing
Feeding real time streams of data into elastic search is an interesting subject with lot of learning. Clearly elastic search is a special purpose NoSQL data store with abilities to index JSON documents in real time. How real time? Well its configurable but it can be as soon as you create or update. Obviously this… Continue reading