I was evaulating JSON parsers with JAVA wrapper for use in one of our BigData projects. While there are 100's of them, our first criteria was to look for high performance (serialization and de-serialization) and robustness (ability to deal/scale well with large payloads...

Hadoop is not really good at dealing with tons of small files and rather good at handling large files. Also too many small files increase the number of mappers, job coordination effort (task scheduling), less work for each map task and overall processing time. Input...

It's pretty straight forward and follow below steps. 1. Connect your 3G stick and boot up Ubuntu. 2. Select network connections and click on the New Mobile Broadband Connection. 3. Now select continue in the dialog box and select India as country & then click continue...

I did a talk last week at Barcamp Bangalore on "Big Data and Hadoop in Cloud - Leveraging Amazon EMR". The focus was to help audience understand Big Data and how to leverage frameworks like Hadoop to build context and derive insights. As big data is becoming a common...

One of the important setups after you have installed hadoop successfully and played with samples is to configure your development environment and figure out how to debug your map reduce programs written in Java. Hadoop can be installed in the local environment in 3 different...

I have been using NoSQL databases in Amazon Cloud and one of the issues that you will get into is variable IO as your datastore grows exponentially. While I am really kicked about DynamoDB as fully managed NoSQL, what makes it stand apart from others or running your own...

One of the issues with storing large amounts of backups data in Amazon S3 is writing custom scripts to delete the data after certain timestamp and also It will be painful enough to manage and maintain pruning tasks when you have large scale heterogenous data for 100;s...

I have been working with many customers over last 6 months on fixing performance issues across different stacks in production deployments. One of the tool that always comes to the rescue is strace - a process diagnostic tool. You can install it using one of your favorite...

So Taggle decided to move on instead of fighting for "last man standing in the game" - you can read more about whole story on Pluggd.in and also Mahesh Murthy's open letter on VC Circle to Taggle and John Kuruvilla's response to it {for more masala}. Here is my take...