If you are working with Azure Databricks (or many other Azure resources), you may come across the need for a Service Principal in order to configure access to different resources. The steps are fairly straight forward but the terminology is not consistent so this video will walk through the steps and describe where to find the values to use when you authenticate.

One example is when setting up access to Azure Data Lake Storage (ADLS) Gen2. You often create a service principal, store the application id and secret in key vault, and add some configuration to your Spark context.

Another example use is when using the Databricks REST API you will need a Databricks Personal Access Token (PAT). If you choose to have your scripts authenticate with a Service Principal via Azure Command Line Interface (CLI) or Azure SDK.