Spring集成,运动学粘合剂,localstack异常行为

问题描述 投票:0回答:1

使用测试容器的弹簧集成,运动学结合器和局部堆栈(aws局部环境),我遇到了一个非常奇怪的问题。我有2个频道-A和B。在每个频道上我都有生产者和消费者。我的测试非常简单–我正在发送消息,并验证消费者收到的消息。所以我为每个频道写了1个测试,它对我有用。在第三个测试中,使用通道A无效,因为使用者没有收到消息。

这是第三次测试的日志

2020-05-14 17:27:40.654  INFO 29076 --- [           main] com.blabla.kinesis.demo.MessageProducer  : Sending StatusEvent(status=message2)
2020-05-14 17:27:40.663 DEBUG 29076 --- [           main] o.s.i.a.outbound.KinesisMessageHandler   : org.springframework.integration.aws.outbound.KinesisMessageHandler@5895c065 received message: GenericMessage [payload=byte[57], headers={contentType=application/json, id=de100ebb-518c-2025-7d71-99c94cd8207c, timestamp=1589466460663}]
2020-05-14 17:27:41.455  INFO 29076 --- [esis-consumer-1] a.i.k.KinesisMessageDrivenChannelAdapter : The [ShardConsumer{shardOffset=KinesisShardOffset{iteratorType=LATEST, sequenceNumber='null', timestamp=null, stream='input', shard='shardId-000000000000', reset=false}, state=NEW}] has been started.
2020-05-14 17:27:42.661 DEBUG 29076 --- [esis-consumer-1] a.i.k.KinesisMessageDrivenChannelAdapter : No records for [ShardConsumer{shardOffset=KinesisShardOffset{iteratorType=LATEST, sequenceNumber='null', timestamp=null, stream='input', shard='shardId-000000000000', reset=false}, state=CONSUME}] on sequenceNumber [null]. Suspend consuming for [1000] milliseconds.

从日志中,我看到生产者发送了该消息,但是消费者在此消息之后开始了。如果我之前发送过另一封邮件,则第二封邮件将被使用,没有任何问题,而第一封邮件消失了

我的pom.xml:

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.2.6.RELEASE</version>
        <relativePath/> <!-- lookup parent from repository -->
    </parent>
    <groupId>com.blabla.kinesis</groupId>
    <artifactId>demo</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>demo</name>
    <description>Demo project for Spring Boot</description>

    <properties>
        <java.version>11</java.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-aop</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-test</artifactId>
            <scope>test</scope>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-stream-binder-kinesis</artifactId>
            <version>2.0.1.RELEASE</version>
        </dependency>
        <dependency>
            <groupId>org.testcontainers</groupId>
            <artifactId>localstack</artifactId>
            <version>1.14.1</version>
            <scope>test</scope>
        </dependency>

        <dependency>
            <groupId>org.projectlombok</groupId>
            <artifactId>lombok</artifactId>
            <optional>true</optional>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-test</artifactId>
            <scope>test</scope>
            <exclusions>
                <exclusion>
                    <groupId>org.junit.vintage</groupId>
                    <artifactId>junit-vintage-engine</artifactId>
                </exclusion>
            </exclusions>
        </dependency>
    </dependencies>
    <dependencyManagement>

        <dependencies>
            <dependency>
                <groupId>com.amazonaws</groupId>
                <artifactId>aws-java-sdk-core</artifactId>
                <version>1.11.415</version>
            </dependency>
        </dependencies>
    </dependencyManagement>

    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

</project>
spring-integration amazon-kinesis localstack
1个回答
0
投票

经过数小时的调查,我发现了问题。根本原因是在我的配置中,我仅定义了“ sync”客户端,如下所示:

@Autowired
private LocalStackContainer localStackContainer;

@Bean
public AmazonKinesis kinesisClient() {
    return AmazonKinesisClientBuilder.standard()
            .withEndpointConfiguration(localStackContainer.getEndpointConfiguration(KINESIS))
            .build();
}

@Bean
public AmazonDynamoDB dynamoDBClient() {
    return  AmazonDynamoDBClientBuilder.standard()
            .withEndpointConfiguration(localStackContainer.getEndpointConfiguration(DYNAMODB))
            .build();
}

打开所有调试日志后,我注意到,Spring使用AmazonKinesisAsyncClient对“真正的” AWS进行了api调用。以下配置解决了该问题:

    @Bean
public AmazonDynamoDB dynamoDBClientAsync() {
    return  AmazonDynamoDBAsyncClientBuilder.standard()
            .withEndpointConfiguration(localStackContainer.getEndpointConfiguration(DYNAMODB))
            .build();
}
@Bean
public AmazonKinesis kinesisClientAsync() {
    return AmazonKinesisAsyncClientBuilder.standard()
            .withEndpointConfiguration(localStackContainer.getEndpointConfiguration(KINESIS))
            .build();
}
© www.soinside.com 2019 - 2024. All rights reserved.