MLBase

Here is an interesting post I got from Ben Lorica, O'Reilly about MLbase:
http://strata.oreilly.com/2013/02/mlbase-scalable-machine-learning-made-accessible.html

It is a proof of concept machine learning library on top of Spark, with a custom declarative language called MQL.