ITPub博客

首页 > 数据库 > 数据库开发技术 > 再说企业内网环境使用Azure Data Factory Self-hosted Integration Runtime

再说企业内网环境使用Azure Data Factory Self-hosted Integration Runtime

原创 数据库开发技术 作者:招牌鸡蛋面 时间:2024-01-12 23:05:29 0 删除 编辑

今天有同事问一个关于ADF(Azure Data Factory)从公司内部搬数据到Azure Data Lake Gen2的问题。其实就是怎么在公司内部服务器上配置Azure Data Factory Self-hosted Integration Runtime

之前写过一篇文章:Azure Data Factory Self-hosted Integration Runtime Tips 里面有详细的介绍。

重点就是企业防火墙要对相关Azure Data Factory服务放行,参考下面这个表格:

Domain names Outbound ports Description
*.servicebus.windows.net 443 Required by the self-hosted integration runtime for interactive authoring.
{datafactory}.{region}.datafactory.azure.net
or *.frontend.clouddatahub.net
443 Required by the self-hosted integration runtime to connect to the Data Factory service.
For new created Data Factory, please find the FQDN from your Self-hosted Integration Runtime key which is in format {datafactory}.{region}.datafactory.azure.net. For old Data factory, if you don't see the FQDN in your Self-hosted Integration key, please use *.frontend.clouddatahub.net instead.
download.microsoft.com 443 Required by the self-hosted integration runtime for downloading the updates. If you have disabled auto-update, you can skip configuring this domain.
*.core.windows.net 443 Used by the self-hosted integration runtime to connect to the Azure storage account when you use the staged copy feature.
*.database.windows.net 1433 Required only when you copy from or to Azure SQL Database or Azure Synapse Analytics and optional otherwise. Use the staged-copy feature to copy data to SQL Database or Azure Synapse Analytics without opening port 1433.
*.azuredatalakestore.net
login.microsoftonline.com/<tenant>/oauth2/token
443 Required only when you copy from or to Azure Data Lake Store and optional otherwise.

上面表格里第2条,你使用的Data factory instance FQDN,下面这个格式,这个信息在哪里获取?

{datafactory}.{region}.datafactory.azure.net

表格里描述说了:

Required by the self-hosted integration runtime to connect to the Data Factory service.For new created Data Factory, please find the FQDN from your Self-hosted Integration Runtime key which is in format {datafactory}.{region}.datafactory.azure.net. For old Data factory, if you don't see the FQDN in your Self-hosted Integration key, please use *.frontend.clouddatahub.net instead.

啰里啰唆的说了一大推,还是来张图说明,更简单:

借这个机会想分享的是另外一个信息,就是对于那些同时使用Azure Global版和Azure China版的企业用户,一定要注意Azure所有服务的FQDN,他们的后缀是不同的,今天在帮同事解答这个问题的时候,找到一个比较有用的文档,里面有Azure Global和Azure China相关服务的FQDN详细信息,见下表。希望对你有所帮助。

Service category Azure Global Azure in China
Azure (in general) *.windows.net *.chinacloudapi.cn
Microsoft Entra ID https://login.microsoftonline.com https://login.chinacloudapi.cn
Azure App Configuration *.azconfig.io *.azconfig.azure.cn
Azure compute *.cloudapp.net *.chinacloudapp.cn
Azure data https://{location}.experiments.azureml.net https://{location}.experiments.ml.azure.cn
Azure storage *.blob.core.windows.net *.queue.core.windows.net *.table.core.windows.net  *.dfs.core.windows.net *.blob.core.chinacloudapi.cn *.queue.core.chinacloudapi.cn *.table.core.chinacloudapi.cn   *.dfs.core.chinacloudapi.cn
Azure management https://management.azure.com/ https://management.chinacloudapi.cn/
Azure service management https://management.core.windows.net https://management.core.chinacloudapi.cn
Azure Resource Manager https://management.azure.com https://management.chinacloudapi.cn
Azure portal https://portal.azure.com https://portal.azure.cn
SQL Database *.database.windows.net *.database.chinacloudapi.cn
SQL Azure DB management API https://management.database.windows.net https://management.database.chinacloudapi.cn
Azure Service Bus *.servicebus.windows.net *.servicebus.chinacloudapi.cn
Azure SignalR Service *.service.signalr.net *.signalr.azure.cn
Azure Time Series Insights *.timeseries.azure.com *.insights.timeseries.azure.cn *.timeseries.azure.cn *.insights.timeseries.azure.cn
Azure Access Control Service *.accesscontrol.windows.net *.accesscontrol.chinacloudapi.cn
Azure HDInsight *.azurehdinsight.net *.azurehdinsight.cn
SQL DB import/export service endpoint
 1. China East https://sh1prod-dacsvc.chinacloudapp.cn/dacwebservice.svc
2. China North https://bj1prod-dacsvc.chinacloudapp.cn/dacwebservice.svc
MySQL PaaS
*.mysqldb.chinacloudapi.cn
Azure Service Fabric cluster *.cloudapp.azure.com *.chinaeast.chinacloudapp.cn
Azure Spring Cloud *.azuremicroservices.io *.microservices.azure.cn
Microsoft Entra ID *.onmicrosoft.com *.partner.onmschina.cn
Microsoft Entra logon https://login.microsoftonline.com https://login.partner.microsoftonline.cn
Microsoft Graph https://graph.microsoft.com https://microsoftgraph.chinacloudapi.cn
Azure AI services https://api.projectoxford.ai/face/v1.0 https://api.cognitive.azure.cn/face/v1.0
Azure Bot Services <*.botframework.com> <*.botframework.azure.cn>
Azure Key Vault API *.vault.azure.net *.vault.azure.cn
Azure Container Apps Default Domain *.azurecontainerapps.io No default domain is provided for external environment. The custom domain is required.
Azure Container Apps Event Stream Endpoint \<region\>.azurecontainerapps.dev `<region>.chinanorth3.azurecontainerapps-dev.cn``
详见官网:

https://learn.microsoft.com/en-us/azure/reliability/sovereign-cloud-china#azure-in-china-rest-endpoints

点击关注本公众号,解锁更多Azure知识!


原文作者:BPShare;如有侵权,请联系管理员删除。

上一篇: 聊聊Delta Lake - 1
请登录后发表评论 登录
全部评论
干过测试,做过运维,还兼职过售前+投标+实施+售后+客户培训。前两年入坑大数据开发,熟悉Azure + Databricks大数据相关产品。 喜欢研究技术,所以搞了一个公众号:BPShare,分享一些经验和心得。欢迎骚扰~~~

注册时间:2020-02-17

  • 博文量
    90
  • 访问量
    44234