Microsoft Announces Preview of Azure HDInsight 3.6 with Apache Spark 2.1
Today, we are pleased to announce a preview of Azure HDInsight 3.6. We are enabling this preview to get feedback on Apache Spark 2.1. You can try out all the features available in the open source release of Apache Spark 2.1, along with the rich experience of using notebooks on Azure HDInsight. This post is a short summary on how to get started with this preview.
What’s new in Spark 2.1 The open source Apache Spark 2.1 release brings in a ton of improvements for developers. These improvements range from Structured Streaming to allowing developers to use Apache Kafka (version 0.10) with Spark Streaming.
To learn more about all of the improvements in Apache Spark 2.1, please read the release notes on the Apache Spark project.
Get started with Apache Spark 2.1 on HDInsight It is very simple to get started with Apache Spark 2.1 Preview. You can go to Microsoft Azure portal and create an Azure HDInsight service.
Once you select HDInsight, you can pick the Spark cluster type with version Spark 2.1 (HDI 3.6 Preview).
Read the entire article here, Announcing preview of Azure HDInsight 3.6 with Apache Spark 2.1
via the fine folks at Microsoft.