How effective can UNFCCC’s climate neutral project be in making climate change an individual responsibility ?

This is a 5 min readWhen I first saw the twitter video message, in which Christiana Figueres (then chairman of UNFCCC ) inviting global citizens to be climate neutral by offsetting unavoidable emissions by proportionately funding carbon neutralizing projects, I instantly felt it is a great idea. I still think it is and have a great respect for all the efforts from UNFCCC and… Continue reading

The μ-services rant

This is a 2 min readThe economy is powered by the bytes today and in byte economy, the cost of storage, network and compute power is rapidly declining. This trend has made quite a few feats viable in the recent years. Some of them aren’t completely new. “Big data”, “Fast data”, “IoT” and “Deep learning” are few to mention. Yet another trend byte economy created… Continue reading

Natural language searches: Lessons in spellcheck and autocorrect

This is a 6 min readSpellcheck and autocorrect are two of the coolest features of search engines. They are not only cool they are also key for a smooth search experience. For the context of this post, I am going to stick with English language searches. Peter Norvig, a Google scientist has broken this subject down beautifully here to show the… Continue reading

What is so sexy about Unikernels ?

This is a 2 min readUnikernels (sounds almost like unicorns) are the newest advancement or the latest buzzword in the infrastructure virtualisation space to the say the least. Unikernel.org and Wikipedia offer great definitions for unikernels, but I felt stacking it against other virtualization techniques will be a good addition to those definitions. So, here is a quick comparison and a… Continue reading

Continuous streaming integration with streaming data platforms

This is a 4 min readSomeone asked me in Quora “Should I use Gobblin or Spark Streaming to ingest data from Kafka to HDFS?” Here is what I wrote: This introduces a new architecture pattern called continuous streaming integration (CSI) with streaming data platforms (SDP) for solving the app and data integration challenges. Short answer: If your data sink is… Continue reading

Modernising data architecture for enterprises

This is a 1 min readPrelude Before getting into the topic of focus i.e. how to modernise data architecture for large enterprises (which typically comes with lot of legacy baggage and organisational memory), I would like to set the context by clearing the air around one thing that is related to this subject.  First step in Big data solutions consulting like any… Continue reading