SlideShare a Scribd company logo
کارگاه پردازش داده توزیع شده 
پردیس- شهیدبهشتی 
دانشکده علوم و مهندسی کامپیوتر 
درس: پایگاه داده توزیع شده 
استاد: دکتر هادی طباطبایی 
ارائه: ابوالفضل صدیقی 
آذر ۱۳۹۳
2 
Elasticsearch Cluster Installation 
Amir Sedighi 
@amirsedighi 
http://hexican.com 
Dec 2014
3 
References 
● http://www.elasticsearch.org 
● http://www.elasticsearch.org/guide/en/elasticsea 
rch/guide/current/index.html
4 
Topics 
● Assumptions 
● First Node 
– Java Installation 
– Downloading and Extracting Elasticsearch 
– Configuration 
● Cloning 
● Starting ES Cluster 
● ES REST API 
● ES General Concepts 
– Index, Shard, Segment 
– Plugins 
● River 
● CSV 
● JDBC 
● Feeder 
● ES Commands 
● ES GUIs 
– Cluster Monitoring 
– Analytical Search and BI
5 
Assumptions 
● You already know about Linux. 
– http://www.slideshare.net/AmirSedighi/distrinuted-data- 
processing-workshop-sbu
6 
Installing Java 
● $ sudo apt-get install default-jdk
7 
Downloading and Extracting 
● http://hadoop.apache.org/releases.html 
● $ tar -zxvf elasticsearch1.3.2.gz
8 
Elasticsearch Configuration 
● You would need to modify elasticsearch.yml 
and append the following as a minimum 
configuration 
cluster.name: hexican 
name.name: "node1" 
node.master: true 
node.data: false
9 
Elasticsearch configuration 
● Minimum ● Rich
10 
Reboot 
● $ sudo reboot
11 
Cloning 
● Clone the first machine and extend your cluster. 
– Find the instruction here: 
● http://www.slideshare.net/AmirSedighi/distrinuted-data-processing- 
workshop-sbu
12 
Plugins
13 
Plugins
14 
Plugins 
● River 
● Feeder
15 
Starting Elasticsearch Cluster 
● You can run nodes one by one 
– $ elasticsearch-1.3.4/bin/elasticsearch 
● You can run all nodes at once using DSH 
– $ dsh -M -a – 'elasticsearch-1.3.4/bin/elasticsearch'
16 
River
17 
River
18 
River
19 
Shutdown Cluster 
$ curl -XPOST 'http://localhost:9200/_cluster/nodes/_all/_shutdown'
20 
Cluster Health
21
22 
Cluster Health
23
24
25
26
27
28 
Metrics
29 
Questions?

More Related Content

What's hot (20)

ODP
Web scraping with nutch solr
Mike Frampton
 
PDF
Ceph BlueStore - новый тип хранилища в Ceph / Максим Воронцов, (Redsys)
Ontico
 
PDF
LCA 2012: High Availability Sprint
hastexo
 
PDF
Philipp Krenn "Elasticsearch (R)Evolution — You Know, for Search…"
Fwdays
 
PDF
深入了解Redis
iammutex
 
PDF
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
OpenStack
 
ODP
Guava
fbenault
 
PPT
Setting up repositories: Technical Requirements, Repository Software, Metad...
Iryna Kuchma
 
PDF
Friends of Solr - Nutch & HDFS
Saumitra Srivastav
 
PDF
Get mysql clusterrunning-windows
JoeSg
 
PDF
Guava Overview Part 2 Bucharest JUG #2
Andrei Savu
 
PDF
Hidden gems in Apache Jackrabbit and BloomReach Forge
Woonsan Ko
 
PDF
Caching. api. http 1.1
Artjoker Digital
 
PPTX
The Proto-Burst Buffer: Experience with the flash-based file system on SDSC's...
Glenn K. Lockwood
 
PDF
TWJUG 2016 - Mogilefs, 簡約可靠的儲存方案
Hua Chu
 
PPT
Mysql cluster
JS Lee
 
PDF
Large Scale Crawling with Apache Nutch and Friends
lucenerevolution
 
PDF
Hosting huge amount of binaries in JCR
Woonsan Ko
 
PDF
MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...
ronwarshawsky
 
PDF
Redis for .NET Developers
Yuriy Guts
 
Web scraping with nutch solr
Mike Frampton
 
Ceph BlueStore - новый тип хранилища в Ceph / Максим Воронцов, (Redsys)
Ontico
 
LCA 2012: High Availability Sprint
hastexo
 
Philipp Krenn "Elasticsearch (R)Evolution — You Know, for Search…"
Fwdays
 
深入了解Redis
iammutex
 
Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE
OpenStack
 
Guava
fbenault
 
Setting up repositories: Technical Requirements, Repository Software, Metad...
Iryna Kuchma
 
Friends of Solr - Nutch & HDFS
Saumitra Srivastav
 
Get mysql clusterrunning-windows
JoeSg
 
Guava Overview Part 2 Bucharest JUG #2
Andrei Savu
 
Hidden gems in Apache Jackrabbit and BloomReach Forge
Woonsan Ko
 
Caching. api. http 1.1
Artjoker Digital
 
The Proto-Burst Buffer: Experience with the flash-based file system on SDSC's...
Glenn K. Lockwood
 
TWJUG 2016 - Mogilefs, 簡約可靠的儲存方案
Hua Chu
 
Mysql cluster
JS Lee
 
Large Scale Crawling with Apache Nutch and Friends
lucenerevolution
 
Hosting huge amount of binaries in JCR
Woonsan Ko
 
MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...
ronwarshawsky
 
Redis for .NET Developers
Yuriy Guts
 

Viewers also liked (7)

PDF
Big Data and Machine Learning Workshop - Day 7 @ UTACM
Amir Sedighi
 
PDF
Dark data
Amir Sedighi
 
PDF
Big Data and Machine Learning Workshop - Day 5 @ UTACM
Amir Sedighi
 
PDF
An Introduction to Apache Kafka
Amir Sedighi
 
PDF
آشنایی با داده‌های بزرگ و تکنیک‌های برنامه‌سازی برای پردازش داده‌های بزرگ
Amir Sedighi
 
PDF
Case Studies on Big-Data Processing and Streaming - Iranian Java User Group
Amir Sedighi
 
PDF
Big Data Processing Utilizing Open-source Technologies - May 2015
Amir Sedighi
 
Big Data and Machine Learning Workshop - Day 7 @ UTACM
Amir Sedighi
 
Dark data
Amir Sedighi
 
Big Data and Machine Learning Workshop - Day 5 @ UTACM
Amir Sedighi
 
An Introduction to Apache Kafka
Amir Sedighi
 
آشنایی با داده‌های بزرگ و تکنیک‌های برنامه‌سازی برای پردازش داده‌های بزرگ
Amir Sedighi
 
Case Studies on Big-Data Processing and Streaming - Iranian Java User Group
Amir Sedighi
 
Big Data Processing Utilizing Open-source Technologies - May 2015
Amir Sedighi
 
Ad

Similar to Elasticsearch 1.x Cluster Installation (VirtualBox) (20)

PPTX
Creating Elasticsearch Snapshots
Vic Hargrave
 
PDF
Null Bachaav - May 07 Attack Monitoring workshop.
Prajal Kulkarni
 
PDF
The elastic stack on docker
SmartWave
 
PDF
Elastic101tutorial Percona Live Europe 2018
Alex Cercel
 
PDF
Elastic 101 tutorial - Percona Europe 2018
Antonios Giannopoulos
 
PDF
Clug 2012 March web server optimisation
grooverdan
 
PDF
OpenStack Tokyo Meeup - Gluster Storage Day
Dan Radez
 
PDF
Building the Enterprise infrastructure with PostgreSQL as the basis for stori...
PavelKonotopov
 
PDF
Hdf installing-hdf
nmrrsc
 
PDF
Red Hat Summit 2017: Wicked Fast PaaS: Performance Tuning of OpenShift and D...
Jeremy Eder
 
PPTX
ElasticSearch 5.x - New Tricks - 2017-02-08 - Elasticsearch Meetup
Alberto Paro
 
PDF
MySQL Webinar 2/4 Performance tuning, hardware, optimisation
Mark Swarbrick
 
PDF
Script it
Giuseppe Maxia
 
PPTX
Xap memory xtend-tutorial-2014
Shay Hassidim
 
PDF
OpenStack LA meetup Feb 18, 2015
Tesora
 
PPTX
Attack monitoring using ElasticSearch Logstash and Kibana
Prajal Kulkarni
 
PPTX
Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware
Leighton Nelson
 
PDF
My SQL 101
Dave Stokes
 
ODP
Caching and tuning fun for high scalability
Wim Godden
 
PPT
Codership's galera cluster installation and quickstart webinar march 2016
Codership Oy - Creators of Galera Cluster
 
Creating Elasticsearch Snapshots
Vic Hargrave
 
Null Bachaav - May 07 Attack Monitoring workshop.
Prajal Kulkarni
 
The elastic stack on docker
SmartWave
 
Elastic101tutorial Percona Live Europe 2018
Alex Cercel
 
Elastic 101 tutorial - Percona Europe 2018
Antonios Giannopoulos
 
Clug 2012 March web server optimisation
grooverdan
 
OpenStack Tokyo Meeup - Gluster Storage Day
Dan Radez
 
Building the Enterprise infrastructure with PostgreSQL as the basis for stori...
PavelKonotopov
 
Hdf installing-hdf
nmrrsc
 
Red Hat Summit 2017: Wicked Fast PaaS: Performance Tuning of OpenShift and D...
Jeremy Eder
 
ElasticSearch 5.x - New Tricks - 2017-02-08 - Elasticsearch Meetup
Alberto Paro
 
MySQL Webinar 2/4 Performance tuning, hardware, optimisation
Mark Swarbrick
 
Script it
Giuseppe Maxia
 
Xap memory xtend-tutorial-2014
Shay Hassidim
 
OpenStack LA meetup Feb 18, 2015
Tesora
 
Attack monitoring using ElasticSearch Logstash and Kibana
Prajal Kulkarni
 
Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware
Leighton Nelson
 
My SQL 101
Dave Stokes
 
Caching and tuning fun for high scalability
Wim Godden
 
Codership's galera cluster installation and quickstart webinar march 2016
Codership Oy - Creators of Galera Cluster
 
Ad

More from Amir Sedighi (8)

PDF
Big Data and Machine Learning Workshop - Day 6 @ UTACM
Amir Sedighi
 
PDF
Big Data and Machine Learning Workshop - Day 4 @ UTACM
Amir Sedighi
 
PDF
Big Data and Machine Learning Workshop - Day 3 @ UTACM
Amir Sedighi
 
PDF
Big Data and Machine Learning Workshop - Day 2 @ UTACM
Amir Sedighi
 
PDF
Big Data and Machine Learning Workshop - Day 1 @ UTACM
Amir Sedighi
 
PDF
Two Case Studies Big-Data and Machine Learning at Scale Solutions in Iran
Amir Sedighi
 
PDF
Helio, a Continues Real-Time Fraud Detection and Monitoring Solution
Amir Sedighi
 
PDF
Opensource Frameworks and BigData Processing
Amir Sedighi
 
Big Data and Machine Learning Workshop - Day 6 @ UTACM
Amir Sedighi
 
Big Data and Machine Learning Workshop - Day 4 @ UTACM
Amir Sedighi
 
Big Data and Machine Learning Workshop - Day 3 @ UTACM
Amir Sedighi
 
Big Data and Machine Learning Workshop - Day 2 @ UTACM
Amir Sedighi
 
Big Data and Machine Learning Workshop - Day 1 @ UTACM
Amir Sedighi
 
Two Case Studies Big-Data and Machine Learning at Scale Solutions in Iran
Amir Sedighi
 
Helio, a Continues Real-Time Fraud Detection and Monitoring Solution
Amir Sedighi
 
Opensource Frameworks and BigData Processing
Amir Sedighi
 

Recently uploaded (20)

PDF
JavaScript - Good or Bad? Tips for Google Tag Manager
📊 Markus Baersch
 
PDF
NIS2 Compliance for MSPs: Roadmap, Benefits & Cybersecurity Trends (2025 Guide)
GRC Kompas
 
PPTX
apidays Singapore 2025 - Designing for Change, Julie Schiller (Google)
apidays
 
PPTX
apidays Helsinki & North 2025 - From Chaos to Clarity: Designing (AI-Ready) A...
apidays
 
PPTX
apidays Singapore 2025 - Generative AI Landscape Building a Modern Data Strat...
apidays
 
PDF
Research Methodology Overview Introduction
ayeshagul29594
 
PPTX
04_Tamás Marton_Intuitech .pptx_AI_Barometer_2025
FinTech Belgium
 
PPTX
BinarySearchTree in datastructures in detail
kichokuttu
 
PPTX
05_Jelle Baats_Tekst.pptx_AI_Barometer_Release_Event
FinTech Belgium
 
PPTX
03_Ariane BERCKMOES_Ethias.pptx_AIBarometer_release_event
FinTech Belgium
 
PPTX
apidays Singapore 2025 - From Data to Insights: Building AI-Powered Data APIs...
apidays
 
PPTX
Powerful Uses of Data Analytics You Should Know
subhashenia
 
PPTX
01_Nico Vincent_Sailpeak.pptx_AI_Barometer_2025
FinTech Belgium
 
PDF
Driving Employee Engagement in a Hybrid World.pdf
Mia scott
 
PPTX
apidays Helsinki & North 2025 - APIs at Scale: Designing for Alignment, Trust...
apidays
 
PDF
The Best NVIDIA GPUs for LLM Inference in 2025.pdf
Tamanna36
 
PPTX
Feb 2021 Ransomware Recovery presentation.pptx
enginsayin1
 
PPTX
SlideEgg_501298-Agentic AI.pptx agentic ai
530BYManoj
 
PPTX
apidays Helsinki & North 2025 - Running a Successful API Program: Best Practi...
apidays
 
PDF
apidays Singapore 2025 - From API Intelligence to API Governance by Harsha Ch...
apidays
 
JavaScript - Good or Bad? Tips for Google Tag Manager
📊 Markus Baersch
 
NIS2 Compliance for MSPs: Roadmap, Benefits & Cybersecurity Trends (2025 Guide)
GRC Kompas
 
apidays Singapore 2025 - Designing for Change, Julie Schiller (Google)
apidays
 
apidays Helsinki & North 2025 - From Chaos to Clarity: Designing (AI-Ready) A...
apidays
 
apidays Singapore 2025 - Generative AI Landscape Building a Modern Data Strat...
apidays
 
Research Methodology Overview Introduction
ayeshagul29594
 
04_Tamás Marton_Intuitech .pptx_AI_Barometer_2025
FinTech Belgium
 
BinarySearchTree in datastructures in detail
kichokuttu
 
05_Jelle Baats_Tekst.pptx_AI_Barometer_Release_Event
FinTech Belgium
 
03_Ariane BERCKMOES_Ethias.pptx_AIBarometer_release_event
FinTech Belgium
 
apidays Singapore 2025 - From Data to Insights: Building AI-Powered Data APIs...
apidays
 
Powerful Uses of Data Analytics You Should Know
subhashenia
 
01_Nico Vincent_Sailpeak.pptx_AI_Barometer_2025
FinTech Belgium
 
Driving Employee Engagement in a Hybrid World.pdf
Mia scott
 
apidays Helsinki & North 2025 - APIs at Scale: Designing for Alignment, Trust...
apidays
 
The Best NVIDIA GPUs for LLM Inference in 2025.pdf
Tamanna36
 
Feb 2021 Ransomware Recovery presentation.pptx
enginsayin1
 
SlideEgg_501298-Agentic AI.pptx agentic ai
530BYManoj
 
apidays Helsinki & North 2025 - Running a Successful API Program: Best Practi...
apidays
 
apidays Singapore 2025 - From API Intelligence to API Governance by Harsha Ch...
apidays
 

Elasticsearch 1.x Cluster Installation (VirtualBox)

  • 1. کارگاه پردازش داده توزیع شده پردیس- شهیدبهشتی دانشکده علوم و مهندسی کامپیوتر درس: پایگاه داده توزیع شده استاد: دکتر هادی طباطبایی ارائه: ابوالفضل صدیقی آذر ۱۳۹۳
  • 2. 2 Elasticsearch Cluster Installation Amir Sedighi @amirsedighi http://hexican.com Dec 2014
  • 3. 3 References ● http://www.elasticsearch.org ● http://www.elasticsearch.org/guide/en/elasticsea rch/guide/current/index.html
  • 4. 4 Topics ● Assumptions ● First Node – Java Installation – Downloading and Extracting Elasticsearch – Configuration ● Cloning ● Starting ES Cluster ● ES REST API ● ES General Concepts – Index, Shard, Segment – Plugins ● River ● CSV ● JDBC ● Feeder ● ES Commands ● ES GUIs – Cluster Monitoring – Analytical Search and BI
  • 5. 5 Assumptions ● You already know about Linux. – http://www.slideshare.net/AmirSedighi/distrinuted-data- processing-workshop-sbu
  • 6. 6 Installing Java ● $ sudo apt-get install default-jdk
  • 7. 7 Downloading and Extracting ● http://hadoop.apache.org/releases.html ● $ tar -zxvf elasticsearch1.3.2.gz
  • 8. 8 Elasticsearch Configuration ● You would need to modify elasticsearch.yml and append the following as a minimum configuration cluster.name: hexican name.name: "node1" node.master: true node.data: false
  • 9. 9 Elasticsearch configuration ● Minimum ● Rich
  • 10. 10 Reboot ● $ sudo reboot
  • 11. 11 Cloning ● Clone the first machine and extend your cluster. – Find the instruction here: ● http://www.slideshare.net/AmirSedighi/distrinuted-data-processing- workshop-sbu
  • 14. 14 Plugins ● River ● Feeder
  • 15. 15 Starting Elasticsearch Cluster ● You can run nodes one by one – $ elasticsearch-1.3.4/bin/elasticsearch ● You can run all nodes at once using DSH – $ dsh -M -a – 'elasticsearch-1.3.4/bin/elasticsearch'
  • 19. 19 Shutdown Cluster $ curl -XPOST 'http://localhost:9200/_cluster/nodes/_all/_shutdown'
  • 21. 21
  • 23. 23
  • 24. 24
  • 25. 25
  • 26. 26
  • 27. 27