Syslog+Fluentd+InfluxDB日志收集系统搭建

环境配置

Sched	2G 2CPU 50GB ens3=>192.168.200.11	KVM虚拟机	CentOS 7
Nova	4G 2CPU 50GB ens3=>192.168.2000.12	KVM虚拟机	CentOS 7

Sched节点配置

配置InfluxDB软件源

# cat <<EOF | sudo tee /etc/yum.repos.d/influxdb.repo

[influxdb]

name = InfluxDB Repository - RHEL \$releasever

baseurl = https://repos.influxdata.com/rhel/\$releasever/\$basearch/stable

enabled = 1

gpgcheck = 1

gpgkey = https://repos.influxdata.com/influxdb.key

EOF

# yum makecache

安装InfluxDB

# yum install influxdb -y

### 设置开机启动

# systemctl start influxdb

# systemctl enable influxdb

# systemctl stop firewalld

# systemctl disable firewalld

### 查询InfluxDB默认配置

# influxd config

### 开启web访问，URL地址http://192.168.200.11:8083

# vim /etc/influxdb/influxdb.conf

[admin]

  enabled = true

# systemctl restart influxdb

### 如果不是使用标准的默认目录，需要手动修改目录权限

# chown -R influxdb:influxdb /mnt/influx

# chown -R influxdb:influxdb /mnt/db

### 创建test数据库

# influx

> CREATE DATABASE test

> use test

安装Fluentd

# yum install epel-release

# yum makecache

# curl -L https://toolbelt.treasuredata.com/sh/install-redhat-td-agent2.sh | sh

安装InfluxDB插件

# td-agent-gem install fluent-plugin-influxdb

配置Fluentd

# vim /etc/td-agent/td-agent.conf

<source>

  type syslog

  port 42185

  tag  system

</source>

<match system.*.*>

  type influxdb

  dbname test

  flush_interval 10s

  host 192.168.200.11

  port 8086

</match>

# systemctl restart td-agent

Nova节点配置

配置rsyslog

# wget http://rpms.adiscon.com/v8-stable/rsyslog.repo -O /etc/yum.repos.d/rsyslog.repo

# yum makecache

# yum install rsyslog

# vim /etc/rsyslog.conf

*.* @192.168.200.11:42185

# systemctl restart rsyslog

验证安装

### 在Nova节点执行

# logger -p "local3.notice" "fwd test"

### 在Sched节点执行

# influx

> USE test

> SHOW MEASUREMENTS

> SELECT * FROM "system.local3.notice"

参考文档

Aggregate and Analyze Syslog with InfluxDB

influxdb的简单使用