Learn Azure Data Lake Analytics by Example

Azure Data Lake Analytics, is a powerful on-demand analytics job service on Microsoft Azure. By reading this article, you can learn Azure Data Analytics by Example.

 

The Example

Since this is an introductory article on Azure Data Lake Analytics, the example that will be presented, will be a simple one just to showcase the technology. The rest is left to your imagination and creativity!

More specifically, in this simple example, I will create and submit for execution 2 jobs:

• Job 1
  • Create a sample database and table
  • Populate the table with sample data

• Job 2
  • Query the sample table and extract the data into a .csv file

---

Learn more about Azure SQL Database: Enroll to our Online Course!

Check our online course on Udemy titled “Introduction to Azure SQL Database for Beginners”
(special limited-time discount included in link).

Our course, will help you get started with Azure SQL Database and SQL Server on Azure Virtual Machines fast and easy. Many live demos included.

Learn More

---

Creating an Azure Data Lake Analytics Account

Step 1: Create a new resource

The first step, is to create an Azure Data Lake Analytics account, in case you don’t already have one.

You can easily do this, by creating a new resource – Data Lake Analytics:

 

Then, you will need to specify some details, as shown in the below screenshot:

 

Right after the above steps, within a few minutes, the Azure Data Lake Analytics account is ready for use:

 

Step 2: Configure firewall

The next step is to configure the Firewall rules for the newly created Azure Data Lake Analytics account. In my example, I have just added the IP of my client.

 

Creating and Submitting Jobs on Azure Data Lake Analytics

Now that the Azure Data Lake Analytics account is ready to accept jobs for execution, let’s create and submit a new job.

 

Define First Job

As mentioned earlier, in this example I will create and submit for execution 2 simple jobs.

The first job is to create a sample database and table, and then populate it with sample data.

So, in order to create the job, within the Azure Data Lake Analytics account, you click on the link “New job”.

Then, in this example, I used U-SQL, in order to define the job:

 

Submit First Job for Execution

After submitting the job for execution, I can see that it was successfully executed.

Below, you can see the relevant job graph that illustrates the job’s execution steps, as created by the powerful engine behind Azure Data Lake Analytics.

 

---

Learn all about MySQL on Azure – Enroll to our Online Course!

Enroll to our online course on Udemy titled “Introduction to Azure Database for MySQL” and get lifetime access to high-quality lessons and hands-on guides about all the aspects of MySQL database service on the Azure cloud platform!

Enroll with Discount

---

AU Analysis

Moreover, in the “AU analysis” tab, you can get more statistics and shortcuts to further optimize your job (i.e. for performance, balanced execution, etc.).

 

Data Explorer

Now, let’s check also via Data Explorer, to see our table:

 

Define Second Job

Now, let’s define the second which will extract the data from the sample table into a .csv file.

This time, I have created the job right from within Data Explorer:

 

Submit Second Job for Execution

After submitting the second job for execution, again, I can see that it was successfully executed.

Below, you can see the relevant job graph that illustrates the job’s execution steps:

 

 

Check the Second Job’s Outcome

Let’s check the second job’s outcome. As you can see in the below screenshot, the .csv file has been successfully created, and we can check its contents:

 

Job Insights

When we click on “Job insights”, we can see useful information and statistics about our jobs executed in Data Lake Analytics.

 

Azure Data Lake Tools

Azure Data Lake Analytics, integrate with many tools that you can use to create and submit different jobs.

For example, if you click on the “Tools” link, you will easily get started with the below tools:

• Data Lake Tools for Visual Studio
• Data Lake Tools for Visual Studio Core
• Azure PowerShell
• Azure CLI

 

Conclusion

Azure Data Lake Analytics, is a powerful engine, which allows you to create and execute heavy jobs on Microsoft Azure. Depending on the job type, Azure Data Lake Analytics automatically scale, thus making efficient use of its powerful engine, in order to execute the job. Moreover, it provides in-depth insights and statistics, which help you assess each job’s execution, or even change how each jobs should execute.

 

With Azure Data Lake Analytics, you can process any data (relational, unstructured, big data, and more) through its job system fast and efficiently.

 

See More!

Learn more about Azure SQL Database and get started fast and easy! Through our online course, “Introduction to Azure SQL Database for Beginners“, you will get lifetime access to a comprehensive set of lectures and live demonstrations that will get you started with Azure SQL Database in no time! The course is regularly updated with additional educational material!

Learn More

 

Learn More

• Azure Data Lake Analytics Official Documentation
• Azure Data Lake Official Documentation

 

Featured Online Courses

• Introduction to Azure SQL Database for Beginners
• SQL Server 2019: What’s New – New and Enhanced Features
• SQL Server Fundamentals – SQL Database for Beginners
• Essential SQL Server Administration Tips
• Boost SQL Server Database Performance with In-Memory OLTP 
• Essential SQL Server Development Tips for SQL Developers
• Working with Python on Windows and SQL Server Databases
• Introduction to Computer Programming for Beginners
• .NET Programming for Beginners – Windows Forms with C#
• Entity Framework: Getting Started – Complete Beginners Guide
• A Guide on How to Start and Monetize a Successful Blog
• Introduction to Azure Database for MySQL

 

Read Also

• Main Benefits of Using Azure Cloud Services
• Comparison of SQL Server Deployment Options on the Azure Cloud Platform
• The Three Categories of Cloud Services (IaaS, PaaS, SaaS)
• Azure Database for MySQL Server Management Components
• Available MySQL Deployment Options in Azure
• Introduction to Azure Database for MySQL (Course Preview)
• Azure Cosmos DB: Learn by Example
• Learn Azure SQL Database: Creating your First Database
• How to Create an Azure SQL Server Virtual Machine
• How to Backup a SQL Server Database from On-Premises to Azure Storage
• What is Azure Advisor?
• Tip of the Week No.7 – SQL Server Offerings in Azure
• Tip of the Week No.8 – Activity Log in Azure Database for MySQL
• Tip of the Week No.10 – The Tags Feature in Azure SQL Database Settings
• Tip of the Week No.11 – Capital Expenditure (CapEx) vs. Operational Expenditure (OpEx)
• Tip of the Week No.12 – Data Service Offerings on Azure
• … all our Azure-related articles

 

Check our latest software releases!

Easily generate SQL code snippets with Snippets Generator!

Convert static T-SQL to dynamic and vice versa with Dynamic SQL Generator.

Secure your SQL Server instances with DBA Security Advisor.

Benchmark SQL Server memory-optimized tables with In-Memory OLTP Simulator.

 

Rate this article: (4 votes, average: 5.00 out of 5)

Loading...

Reference: SQLNetHub.com (https://www.sqlnethub.com)

© SQLNetHub