我正在设置Docker容器,但无法将logstash配置为在AWS中运行的elasticsearch。
文件夹结构如下
.
├── logstash
│ └── logstash.conf
├── docker-compose.yml
├── Dockerfile
├── file.jar
./logstash/logstash.conf文件看起来像
(当我们使用jar启动服务器时,下面输入路径中的日志文件夹将自动创建与jar文件并行)
input {
file {
path => "/java_pro/log/*/*/*.log"
type => "json"
}
}
output {
elasticsearch {
hosts => [ "https://search-***********.es.amazonaws.com:443" ]
index => "logback-%{+YYYY-MM-dd}"
}
}
Dockerfile
FROM java:8
RUN mkdir -p /java_pro
WORKDIR /java_pro
COPY . /java_pro
EXPOSE 443
CMD java -jar file.jar
泊坞窗,compose.yml
version: "3"
services:
hub:
build: .
volumes:
- .:/java_pro
- static_volume:/java_pro
networks:
- rabbitmq-networks
rabbitmq:
image: "rabbitmq:3-management"
ports:
- "5672:5672"
- "15672:15672"
volumes:
- "rabbitmq_data:/data"
networks:
- rabbitmq-networks
environment:
- RABBITMQ_DEFAULT_USER=****
- RABBITMQ_DEFAULT_PASS=****
logstash:
image: docker.elastic.co/logstash/logstash:6.4.0
ports:
- "9200:9200"
command: logstash -f /etc/logstash/conf.d/logstash.conf
volumes:
- ./logstash/logstash.conf:/etc/logstash/conf.d
environment:
LS_JAVA_OPTS: "-Xmx256m -Xms256m"
networks:
- rabbitmq-networks
networks:
rabbitmq-networks:
driver: bridge
volumes:
rabbitmq_data:
static_volume:
Elasticsearch已在AWS中启动并运行。使用docker-compose运行时出错
No config files found in path {:path=>"/etc/logstash/conf.d/logstash.conf"}
Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://elasticsearch:9200/, :path=>"/"}
Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://elasticsearch:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://elasticsearch:9200/][Manticore::ResolutionFailure] elasticsearch"}
如何解决上述错误并希望使用logstash将所有日志从应用程序推送到elasticsearch。
您在此处挂载了一个文件作为目录名称:
volumes:
- ./logstash/logstash.conf:/etc/logstash/conf.d
安装单个文件时包含文件名:
volumes:
- ./logstash/logstash.conf:/etc/logstash/conf.d/logstash.conf:ro
我也将它标记为只读,因为容器可能没有修改此文件。