信息汇总
ES http://10.193.10.51:9200
Kibana http://10.193.10.51:5601
版本: 5.6.5
服务器
10.193.10.51
10.193.10.52
10.193.10.53
ES
安装
1
2
3
4
5
6
7
8
| wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-5.6.4.rpm
rpm -ivh jdk-8u321-linux-x64.rpm
rpm -ivh elasticsearch-5.6.4.rpm
mkdir /data/elasticsearch/data -p
mkdir /data/elasticsearch/logs -p
chown -R elasticsearch:elasticsearch /data/elasticsearch
|
配置
vi /etc/elasticsearch/elasticsearch.yml
1
2
3
4
5
6
7
8
9
10
11
| cluster.name: es-cluster-dev
node.name: node-01
path.data: /data/elasticsearch/data
path.logs: /data/elasticsearch/logs
network.host: 10.193.10.51
http.port: 9200
discovery.zen.ping.unicast.hosts: ["10.193.10.51", "10.193.10.52", "10.193.10.53"]
discovery.zen.minimum_master_nodes: 2
bootstrap.memory_lock: true
http.cors.enabled: true
http.cors.allow-origin: "*"
|
IK分词器插件
1
2
3
4
5
| wget https://github.com/medcl/elasticsearch-analysis-ik/releases/download/v5.6.16/elasticsearch-analysis-ik-5.6.16.zip
cp elasticsearch-analysis-ik-5.6.4.zip /usr/share/elasticsearch/plugins/
cd /usr/share/elasticsearch/plugins/
unzip elasticsearch-analysis-ik-5.6.4.zip
mv elasticsearch ik
|
测试
http://10.193.10.51:9200
启停
1
2
3
4
5
6
7
| systemctl enable elasticsearch
systemctl start elasticsearch
systemctl status elasticsearch
tail -200f /data/elasticsearch/logs/es-cluster-dev.log
systemctl daemon-reload
systemctl restart elasticsearch
|
设置max_result_window
1
2
3
4
5
6
7
8
| GET /zyachievementindex0424/_settings
PUT /zyachievementindex0424/_settings
{"index.max_result_window" :"1000000"}
curl -XPUT "http://localhost:9200/my_index/_settings" -d '{ "index" : { "max_result_window" : 500000 } }' -H "Content-Type: application/json"
{ "index" : { "max_result_window" : 500000}}
|
Kibana
安装
1
2
3
| wget https://artifacts.elastic.co/downloads/kibana/kibana-5.6.4-x86_64.rpm
rpm -ivh kibana-5.6.4-x86_64.rpm
|
配置
vi /etc/kibana/kibana.yml
启动
1
2
3
4
5
| systemctl enable kibana
systemctl start kibana
systemctl status kibana
systemctl restart kibana
|
测试
http://10.193.10.51:5601
Logstash
安装
1
2
3
| wget https://artifacts.elastic.co/downloads/logstash/logstash-5.6.4.rpm
rpm -ivh logstash-5.6.4.rpm
chown -R logstash:logstash /var/log/logstash
|
配置
vi /etc/logstash/logstash.conf
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
| input {
elasticsearch {
hosts => "10.193.10.21:9200"
index => "hphzptidlegoods-test"
docinfo => true
size => 1000
scroll => "1m"
}
}
filter {
mutate {
remove_field => ["@timestamp", "@version"]
}
}
output {
elasticsearch {
hosts => ["http://10.193.10.51:9200"]
index => "%{[@metadata][_index]}"
document_type => "%{[@metadata][_type]}"
document_id => "%{[@metadata][_id]}"
}
}
|
数据迁移
1
| /usr/share/logstash/bin/logstash "--path.settings" "/etc/logstash" -f /etc/logstash/logstash.conf
|