RSS

Hadoop and Pig at Twitter

31 Oct

Related to the previous post on how Hadoop is used at Facebook, there is an interesting slide deck on how Twitter is using Hadoop and Pig. Take a look.

The video of the original talk is available at Yahoo!. Very impressive to see the much less code you have to write in Pig when compared to the native Java MapReduce jobs (around 20:00).

Advertisements
 
Leave a comment

Posted by on 31.10.2011 in Hadoop, Pig, Zookeeper

 

Tags: , , , , , , , , , ,

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

 
%d bloggers like this: