Azure Data

Mini Project Development for Azure Data Engineer

  • Added code snippets for Databricks <-> SQL Server using JDBC
  • Data Generator code added. Now you can generate your own datasets for this workshop.
  • Copy data from Azure SQL to Azure SQL without ADF (kind of linked server)
  • ADF Code promotion – manual activity
  • Dynamically change DB connection in ADF (Parameterizing linked service)
  • Visible comparison of Blob and Azure Data Lake Gen2 storage using data analytics through Azure Databricks.
  • NY Taxi data files source link added in resources section
  • Integrate Key Vault with Azure Databricks and extract secrets via Secret Scope
  • Use Blob SDK in Azure Databricks to read/write files on blob like IO operations
  • Connecting to SQL Server with pyodbc in Azure Databricks
  • Datasets used in this course are now available to download. Visit Azure Data Factory section.

Leave a Reply