Create Azure Databricks Cluster from the Portal

When getting started with Azure Databricks for data processing and analytics, you need to create at least one cluster to get started. Check out the video for a quick overview of how to do this from the Azure Portal. I include a quick description of the options you have and an overview of what cluster management tabs are available after cluster creation.

The requirements to follow along in your own Azure account are:

  1. An Azure Account
  2. An Azure Databricks Workspace (14-day trial will work)

Here are the basic setting and I recommend for a test cluster (see video for explanations of all the UI options).

  1. Cluster Mode = Standard
  2. Pool = None
  3. Databricks Runtime Version = 6.3 (or latest)
  4. Enable Autoscaling = No
  5. Terminate After = 120 minutes (default)
  6. Worker Type = Standard_DS3_v2 (default)
  7. Workers = 2
  8. Driver Type = Same as worker

In future posts I’ll share how to create clusters from the command line or using a Python script and show a few more options that are not included in this video.

Leave a comment

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s