When Zaharia started work on Spark around 2010, analyzing "big data" generally meant using MapReduce, the Java-based ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Soroosh Khodami discusses why we aren't ready ...

AnswerRocket, a pioneer in enterprise AI solutions since 2013, has announced its acquisition of Cognitive Spark, a specialized data science firm with a focus on innovating advanced machine learning ...

What I'd like to cover here goes beyond those AI headlines, however, and involves a special nugget just for folks doing data engineering, analytics and machine learning work with Apache Spark.

I am a CRM and data engineering leader with 14 years of experience. Head of sales intelligence and data at Snapchat. Data-driven decision-making has seen a skyrocketing demand in today's world of AI ...