Ubuntu 18.04에서 Logstash 설치 및 연동 (PostgreSQL->Elasticsearch)

2022. 1. 24. 03:46서버 프로그래밍

1. setup Logstash (with elasticsearch)

https://www.howtoforge.com/tutorial/how-to-install-logstash-on-ubuntu-1804/

 

How to Install Logstash on Ubuntu 18.04

Logstash is a free and open-source tool, and world’s most popular log analysis platform for collecting, parsing, and storing logs for future use. Lo...

www.howtoforge.com

 

2. create pipeline for PostgreSQL and Elasticsearch

https://medium.com/@emreceylan/how-to-sync-postgresql-data-to-elasticsearch-572af15845ad

 

How to Sync PostgreSQL Data to Elasticsearch

In this article I will try to explain how to sync your PostgreSQL data to elasticsearch service using logstash. Although this story is…

medium.com

 

https://jdbc.postgresql.org/download.html

 

PostgreSQL JDBC Download

Download About Binary JAR file downloads of the JDBC driver are available here and the current version with Maven Repository. Because Java is platform neutral, it is a simple process of just downloading the appropriate JAR file and dropping it into your cl

jdbc.postgresql.org

https://stackoverflow.com/questions/35813923/sync-postgresql-data-with-elasticsearch

 

Sync postgreSql data with ElasticSearch

Ultimately I want to have a scalable search solution for the data in PostgreSql. My finding points me towards using Logstash to ship write events from Postgres to ElasticSearch, however I have not ...

stackoverflow.com

https://www.linkedin.com/pulse/logstash-sync-postgres-data-elasticsearch-jess%C3%A9-peixoto?trk=read_related_article-card_title 

 

[Logstash] Sync postgres data to elasticsearch

As elastic stack is a comprehensive toolbox it can be used in the most diverse use cases, but in two specific types of use cases you may encounter the need to synchronize relational databases to elasticsearch. Business analytics, in this type of use case,

www.linkedin.com

https://wefree.tistory.com/21

 

elasticsearch 7 에서 total count 확인하기

GET my-index*/_search { "track_total_hits": true, "query": { "match": { "myfield": { "value": "some" } } } } elasticsearch 7 부터는 결과 개수가 10,000 개 이상일 때, 정확한 개수를 얻기 위해서는 위에..

wefree.tistory.com

https://esbook.kimjmin.net/04-data/4.2-crud

 

4.2 CRUD - 입력, 조회, 수정, 삭제 - Elastic 가이드북

{"_index":"my_index","_type":"_doc","_id":"1","_version":1,"result":"created","_shards":{"total":2,"successful":1,"failed":0},"_seq_no":0,"_primary_term":1}

esbook.kimjmin.net