来自Azure App Service的Kafka连接

问题描述

您好，Azure支持团队，

   我需要从Azure App Service连接HDInsight Kafka.根据文档，我已通过VNET将Azure App Service与HDInsight Kafka连接.我能够从App Service控制台到Kafka工作程序节点进行tcpping操作

tcpping 10.2.X.X:9092 

一切正常.

但是从我的Java应用程序(在App Service上)，它不起作用.我收到以下错误

tworkClient:241 [Producer clientId = producer-1]无法建立到节点1001的连接.经纪人可能不可用.
2018-08-17T10:26:41,897 + 0200        W [kafka-生产者网络线程| producer-1] o.a.k.c.NetworkClient:241 [Producer clientId = producer-1]无法建立到节点1002的连接.经纪人可能不可用.
2018-08-17T10:26:42,589 + 0200        W [kafka-生产者网络线程| producer-1] o.a.k.c.NetworkClient:241 [Producer clientId = producer-1]无法建立到节点1003的连接.经纪人可能不可用.

我已经从Kafka的Ambari UI配置了IP发布. (advertise.listeners和listeners)

但是通过ssh连接时，我看不到实际的server.properties中的更改.

我已经使用SSH创建了主题，还使用SSH测试了生产者和使用者.那些在工作.

无论如何，都可以对Java客户端的连接问题进行故障排除.我确实在VNET上配置了DNS，也没有防火墙.

感谢和问候

Moumita Sarkar

解决方案

Hi Azure Support Team,

    I need to connect HDInsight Kafka from Azure App Service. As per the documentation I have connected the Azure App Service with the HDInsight Kafka through VNET. I am able to do tcpping from the App Service Console to the Kafka worker node 

tcpping 10.2.X.X:9092 

It is working fine.

But from my Java application(On the App Service) it is not working. I am getting the below error

tworkClient:241 [Producer clientId=producer-1] Connection to node 1001 could not be established. Broker may not be available.
2018-08-17T10:26:41,897+0200        W [kafka-producer-network-thread | producer-1] o.a.k.c.NetworkClient:241 [Producer clientId=producer-1] Connection to node 1002 could not be established. Broker may not be available.
2018-08-17T10:26:42,589+0200        W [kafka-producer-network-thread | producer-1] o.a.k.c.NetworkClient:241 [Producer clientId=producer-1] Connection to node 1003 could not be established. Broker may not be available.

I have configured IP Publishing from the Ambari UI of the Kafka. (advertise.listeners and listeners) 

But I cannot see the changes in the actual server.properties when connecting through ssh.

I have created the Topic with SSH and also tested the producer and consumer with SSH. Those are working.

Is there anyway to troubleshoot the connection issue from the Java Client. I do have DNS configured on the VNET also no Firewall.

Thanks and Regards

Moumita Sarkar

解决方案

这篇关于来自Azure App Service的Kafka连接的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！