Summingbird is a library that lets you write MapReduce programs that look like native Scala or Java collection transformations and execute them on a number of well-known distributed MapReduce platforms, including Storm and Scalding. Developed at Twitter.
Summingbird
Streaming MapReduce with Scalding and Storm