Scribd
Upload
143 views10 pages

Azure Devops Integeration With Databricks

1. The document outlines the steps to set up continuous integration and continuous deployment (CI/CD) of Databricks notebooks from an Azure DevOps repository. 2. Developers should create a feature branch from the development branch, add or update notebooks, commit changes, and create a pull request to merge changes into development. 3. Once the pull request is approved, the development branch will be automatically deployed to the Databricks workspace, making the updated notebooks available to end users.

Uploaded by

L Prashanthi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
143 views10 pages

Azure Devops Integeration With Databricks

1. The document outlines the steps to set up continuous integration and continuous deployment (CI/CD) of Databricks notebooks from an Azure DevOps repository. 2. Developers should create a feature branch from the development branch, add or update notebooks, commit changes, and create a pull request to merge changes into development. 3. Once the pull request is approved, the development branch will be automatically deployed to the Databricks workspace, making the updated notebooks available to end users.

Uploaded by

L Prashanthi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 10

1.

Databricks CI/CD Deployment

2. Git Integration will be removed on Jan 31 2024 for shared folders.

3. Copy the Repo URL


● Navigate to the Azure DevOps Portal:
● Accessing Projects: After selecting the organization. you'll be directed to the dashboard where you can see
your projects and repositories. Please Select the GLOBAL MW RTM as for the repository project.
● Accessing Repo: After selecting the projects. you'll be directed to the dashboard where you can see your
repositories. Please Select the “global-mw-rtm” as for the repository.

● Copy Repository URL: Click on the "Clone" button to get the repository URL
4. Create Repo in Databricks:
● Open the databricks workspace and Click on ‘Repos’ :-

● Click on ‘add Repo’ :

● Give the Git Repository URL and Repository name

● Repo is successfully created.


5. Create/Switch to Feature branch
● Click on ‘development branch’

● Give the Branch name and Click on ‘create’. If the feature branch already exists, Please switch to feature branch
from the development branch.

● Feature branch is successfully linked to your Repo.


6. Create/update your notebooks:
● Create a project specific folder. Please ignore it if already present.

● Create/Update the Notebook


7. Commit the changes from Repo to Feature branch.
● Click on feature branch

● Select the Notebooks that you created/updated, add comment and description and Click on ‘Commit & Push’.

● Click on Pull to merge the changes from feature to Repo


8. Create the Pull request to merge the changes from feature branch to development branch.
● On the branch page, look for a button or link that says "New pull request" or "Create pull request." Click on it.

● Provide Title, Description, Reviewer

● Please make sure there are no merge conflicts.


● Click on files: To review your changes are made successfully.

● The Reviewer will review your changes and approve/Reject.

● Once your changes are approved by the Reviewer.

● Merge the changes into Development: Click on Complete & select merge type.
● Successfully changes merged from feature to development.
9. Deploy the notebooks to Databricks workspace from the development branch.
● It will Automatically trigger CD pipeline which will deploy notebook to workspace

● Once CD Pipelines successfully runs. Notebooks will deploy to the Shared folder.

● You can use a shared folder path to your adf notebooks activity.

You might also like