Apache Spark has become the de facto standard for processing data at scale, whether for querying large datasets, training machine learning models to predict future trends, or processing streaming data ...

At the Hadoop World conference in New York City last fall, much of the excitement was around another big data crunching technology —Apache Spark. Full house with people standing during Spark talk.

First created as part of a research project at UC Berkeley AMPLab, Spark is an open source project in the big data space, built for sophisticated analytics, speed, and ease of use. It unifies critical ...