Spark Summit EU Highlights: TensorFlow, Structured Streaming and GPU Hardware Acceleration

Apache Spark integration with deep learning library TensorFlow, online learning using Structured Streaming and GPU hardware acceleration were the highlights of Spark Summit EU 2016 held last week in Brussels. The first day featured a walkthrough of the innovations introduced by Spark 2.0. The API was simplified to a single interface for DataFrames and Datasets, making it easier to develop big data applications. The second generation of the Tungsten engine takes the processing closer to the hardware, by using ideas applied in MPP databases to data processing queries: the generated bytecode leverages CPU registers for intermediate data and data in-memory is kept in a space-efficient column-oriented format. Regardless of the API used, the data operation graph is optimised through the Catalyst Optimizer, that generates the plan for the execution of…


Link to Full Article: Spark Summit EU Highlights: TensorFlow, Structured Streaming and GPU Hardware Acceleration

Pin It on Pinterest

Share This

Join Our Newsletter

Sign up to our mailing list to receive the latest news and updates about homeAI.info and the Informed.AI Network of AI related websites which includes Events.AI, Neurons.AI, Awards.AI, and Vocation.AI

You have Successfully Subscribed!