我试图通过Java执行apache pulsar生产者和使用者程序,我在GCP虚拟机中独立安装了apache-pulsar,并以独立模式启动集群。
下一步是我在Windows eclipse中提供了一个Maven构建,并在GCP机器中上传了相同的jar文件。在Windows eclipse中执行生产者和使用者程序时,我遇到了连接被拒绝的错误,这很明显,因为在Windows机器中未安装脉冲星。
但是,当我在GCP实例中尝试相同的操作时,即使集群已经启动,我也遇到了与没有找到类定义错误相关的错误。
pom.xml >>>
<project xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>pulsar-client-project</groupId>
<artifactId>pulsar-client-project</artifactId>
<version>0.0.1-SNAPSHOT</version>
<packaging>jar</packaging>
<name>pulsar-client-project</name>
<url>http://maven.apache.org</url>
<properties>
<java.version>1.8</java.version>
<maven.compiler.source>1.8</maven.compiler.source>
<maven.compiler.target>1.8</maven.compiler.target>
</properties>
<dependencies>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<version>3.8.1</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.pulsar</groupId>
<artifactId>pulsar-client</artifactId>
<version>2.0.1-incubating</version>
</dependency>
</dependencies>
</project>
ProducerTutorial.java >>>
package pulsar_client_project.pulsar_client_project;
import org.apache.pulsar.client.api.CompressionType;
import org.apache.pulsar.client.api.Message;
import org.apache.pulsar.client.api.MessageBuilder;
import org.apache.pulsar.client.api.MessageId;
import org.apache.pulsar.client.api.Producer;
import org.apache.pulsar.client.api.PulsarClient;
import org.apache.pulsar.client.api.PulsarClientException;
//import org.slf4j.Logger;
//import org.slf4j.LoggerFactory;
import java.io.IOException;
import java.util.stream.IntStream;
public class ProducerTutorial {
// private static final Logger log =
LoggerFactory.getLogger(ProducerTutorial.class);
private static final String SERVICE_URL = "pulsar://localhost:6650";
private static final String TOPIC_NAME = "my-topic";
public static void main(String[] args) throws IOException {
System.out.println("inside main");
// Create a Pulsar client instance. A single instance can be shared across many
// producers and consumer within the same application
PulsarClient client = PulsarClient.builder()
.serviceUrl(SERVICE_URL)
.build();
System.out.println("client.."+client);
// Here you get the chance to configure producer specific settings
Producer<byte[]> producer = client.newProducer()
// Set the topic
.topic(TOPIC_NAME)
// Enable compression
.compressionType(CompressionType.LZ4)
.create();
System.out.println("producer.."+producer);
// Once the producer is created, it can be used for the entire application life-cycle
// log.info("Created producer for the topic {}", TOPIC_NAME);
// Send 10 test messages
IntStream.range(1, 11).forEach(i -> {
String content = String.format("hello-pulsar-%d", i);
// Build a message object
Message<byte[]> msg = MessageBuilder.create()
.setContent(content.getBytes())
.build();
// Send each message and log message content and ID when successfully received
try {
MessageId msgId = producer.send(msg);
//log.info("Published message '{}' with the ID {}", content, msgId);
} catch (PulsarClientException e) {
//log.error(e.getMessage());
}
});
client.close();
}
}
ConsumerTutorial >>>>
package pulsar_client_project.pulsar_client_project;
import java.io.IOException;
import org.apache.pulsar.client.api.Consumer;
import org.apache.pulsar.client.api.Message;
import org.apache.pulsar.client.api.PulsarClient;
import org.apache.pulsar.client.api.SubscriptionType;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
public class ConsumerTutorial {
//private static final Logger log =
LoggerFactory.getLogger(ConsumerTutorial.class);
private static final String SERVICE_URL = "pulsar://localhost:6650";
private static final String TOPIC_NAME = "my-topic";
private static final String SUBSCRIPTION_NAME = "my-subscription";
public static void main(String[] args) throws IOException {
// Create a Pulsar client instance. A single instance can be shared
across many
// producers and consumer within the same application
System.out.println("inside main");
PulsarClient client = PulsarClient.builder()
.serviceUrl(SERVICE_URL)
.build();
System.out.println("client.."+client);
// Here you get the chance to configure consumer specific settings. eg:
Consumer<byte[]> consumer = client.newConsumer()
.topic(TOPIC_NAME)
// Allow multiple consumers to attach to the same subscription
// and get messages dispatched as a queue
.subscriptionType(SubscriptionType.Shared)
.subscriptionName(SUBSCRIPTION_NAME)
.subscribe();
System.out.println("consumer.."+consumer);
// Once the consumer is created, it can be used for the entire application lifecycle
//log.info("Created consumer for the topic {}", TOPIC_NAME);
do {
// Wait until a message is available
Message<byte[]> msg = consumer.receive();
// Extract the message as a printable string and then log
String content = new String(msg.getData());
// log.info("Received message '{}' with ID {}", content, msg.getMessageId());
// Acknowledge processing of the message so that it can be deleted
consumer.acknowledge(msg);
} while (true);
}
}
那么,什么是ubuntu / GCP VM计算机的合适解决方案。我做错了,请给我指示
提前致谢
最佳答案
ClassNotFoundException表示在您的classpath中找不到该类。
当您从Eclipse本地运行时,当您按下运行按钮时,正在被Eclipse召唤的java进程可以看到pulsar-client类。但是,当您在GCP机器上运行jar时,您没有在类路径中包含来自pulsar-client jar的类,这就是为什么它们丢失的原因:
java -cp pulsar-client-project-0.0.1-SNAPSHOT.jar pulsar_client_project.pulsar_client_project.ConsumerTutorial
上面的命令指出Java进程的类路径是标准JDK类,并且jar
pulsar-client-project-0.0.1-SNAPSHOT
和要运行的类(主类)中的类是pulsar_client_project.pulsar_client_project.ConsumerTutorial
。您需要做的是在GCP机器上提供pulsar-client jar的副本,并将其包含在您的类路径中。例如。
java -cp pulsar-client-project-0.0.1-SNAPSHOT.jar:pulsar-client.jar pulsar_client_project.pulsar_client_project.ConsumerTutorial
要么
java -cp pulsar-client-project-0.0.1-SNAPSHOT.jar;pulsar-client.jar pulsar_client_project.pulsar_client_project.ConsumerTutorial
取决于GCP机器操作系统(
:
通常是unix之类的操作系统上的路径分隔符,而;
通常是Windows系统上的路径分隔符)。在本地运行时,Eclipse会自动执行类似的操作。这样做的可能更简单的方法是将所有项目依赖项包含在生成的jar文件中。如果您这样修改pom:
<project xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>pulsar-client-project</groupId>
<artifactId>pulsar-client-project</artifactId>
<version>0.0.1-SNAPSHOT</version>
<packaging>jar</packaging>
<name>pulsar-client-project</name>
<url>http://maven.apache.org</url>
<properties>
<java.version>1.8</java.version>
<maven.compiler.source>1.8</maven.compiler.source>
<maven.compiler.target>1.8</maven.compiler.target>
</properties>
<dependencies>
<dependency>
<groupId>org.slf4j</groupId>
<artifactId>slf4j-simple</artifactId>
<version>1.7.25</version>
</dependency>
<dependency>
<groupId>junit</groupId>
<artifactId>junit</artifactId>
<version>3.8.1</version>
<scope>test</scope>
</dependency>
<dependency>
<groupId>org.apache.pulsar</groupId>
<artifactId>pulsar-client</artifactId>
<version>2.0.1-incubating</version>
</dependency>
</dependencies>
<build>
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-assembly-plugin</artifactId>
<executions>
<execution>
<phase>package</phase>
<goals>
<goal>single</goal>
</goals>
<configuration>
<descriptorRefs>
<descriptorRef>jar-with-dependencies</descriptorRef>
</descriptorRefs>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
</build>
此处定义了assembly plugin,它将在生成的jar文件
target/pulsar-client-project-0.0.1-SNAPSHOT-jar-with-dependencies
中包括所有依赖项。您可以看到它的大小为〜25 MB,而原始的target/pulsar-client-project-0.0.1-SNAPSHOT.jar
为〜5KB。您也可以使用任何支持zip的存档程序(winzip,peazip,unzip ...)打开jar,并检查jar file format is built upon zip file format之后的内容。现在,当您将较大的jar文件复制到GCP机器时,您应该可以像这样运行它:
java -cp pulsar-client-project-0.0.1-SNAPSHOT-jar-with-dependencies.jar pulsar_client_project.pulsar_client_project.ConsumerTutorial
要么
java -cp pulsar-client-project-0.0.1-SNAPSHOT-jar-with-dependencies.jar pulsar_client_project.pulsar_client_project.ProducerTutorial