This Week in Hadoop and More: From SQL to the Great Deep

This week we have SQL, Deep Learning, NiFi, big clusters, and more. From Japan, Hadoop Summit has wrapped up and the presentations are available online. Leveraging Smart Meter Data for Electric Utilities with Spark SQL and Hive.  The speed enhancement of Spark 2.0 is enabling Hitachi to process 10,000,000 smart meters in only 30 minutes with four nodes. Networking for Large Scale Hadoop Clusters. Yahoo Japan has special difficulties due to their amazingly large Hadoop cluster.  They are using an IP CLOS network, which is used by other mega Internet companies like Google, Facebook, and Amazon.  Yahoo runs 75 Petabytes with 10GB networking NICs.  They are researching the new HDFS erasure coding for future clusters. Coca-Cola East Japan uses Hadoop. They run at a huge scale adding 5GB of data…

Link to Full Article: This Week in Hadoop and More: From SQL to the Great Deep

Pin It on Pinterest

Share This

Join Our Newsletter

Sign up to our mailing list to receive the latest news and updates about and the Informed.AI Network of AI related websites which includes Events.AI, Neurons.AI, Awards.AI, and Vocation.AI

You have Successfully Subscribed!