Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
(R)Evolution
Philipp Krenn @xeraa
Revolution
https://db-engines.com/en/ranking/
search+engine
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Who uses Elasticsearch?
Infrastructure | Developer Advocate
http://thedudeabides.com/articles/
the_birth_of_compass
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
$ curl http://localhost:9200
{
"name" : "elasticsearch1",
"cluster_name" : "docker-cluster",
"cluster_uuid" : "MrmBv92dTQqh-z7pX2OkWw",
"version" : {
"number" : "5.6.1",
"build_hash" : "667b497",
"build_date" : "2017-09-14T19:22:05.189Z",
"build_snapshot" : false,
"lucene_version" : "6.6.1"
},
"tagline" : "You Know, for Search"
}
$ curl -u elastic:changeme http://localhost:9200
{
"name" : "elasticsearch1",
"cluster_name" : "docker-cluster",
"cluster_uuid" : "MrmBv92dTQqh-z7pX2OkWw",
"version" : {
"number" : "5.6.1",
"build_hash" : "667b497",
"build_date" : "2017-09-14T19:22:05.189Z",
"build_snapshot" : false,
"lucene_version" : "6.6.1"
},
"tagline" : "You Know, for Search"
}
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
ELK Stack
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Elastic Stack
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Evolution
Strictness*
5.0
*
Demo
Parameters & configs
Bootstrap checks
Shard Allocation API*
5.2
*
Demo
Cross Cluster Search
5.3
Tribe node
https://github.com/elastic/elasticsearch/
issues/4708
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Cross cluster search
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Rolling Upgrades*
6.0
*
Demo
Floodstage Watermark*
6.0
*
Demo
Low 85%
High 90%
Floodstage 95%
Sequence Numbers*
6.0
*
Demo
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Cross datacenter replication
6.x
Types*
5.6 to 8.0
*
Demo
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Why
Data types
Sparsity
Scoring
How
5.6 opt-in single type
6.x single type
7.x type optional in API
8.x no more types
https://www.elastic.co/guide/en/elasticsearch/reference/5.6/
removal-of-types.html#_schedule_for_removal_of_mapping_types
Adaptive Replica Selection
6.1
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Pick best shard
Exponentially Weighted Moving Average
(EWMA)
Piggyback on requests
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Off by default
cluster.routing.use_adaptive_replica_selection
Benchmarks
∞
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017
Rally
https://elasticsearch-benchmarks.elastic.co
Conclusion
Strictness
Shard Allocation API
Cross Cluster Search
Rolling Upgrades
Floodstage Watermark
Sequence Numbers
Types
Adaptive Replica Selection
Questions?
Now & Elastic booth
Philipp Krenn @xeraa

More Related Content

PDF
Apache MXNet Distributed Training Explained In Depth by Viacheslav Kovalevsky...
PPTX
Creating Reusable Puppet Profiles
PDF
Autoscaling with hashi_corp_nomad
PDF
Ansible with AWS
PPTX
Ansible fest Presentation slides
PDF
Building Distributed System with Celery on Docker Swarm
PPTX
Rubyslava + PyVo #48
PDF
What's new in Ansible 2.0
Apache MXNet Distributed Training Explained In Depth by Viacheslav Kovalevsky...
Creating Reusable Puppet Profiles
Autoscaling with hashi_corp_nomad
Ansible with AWS
Ansible fest Presentation slides
Building Distributed System with Celery on Docker Swarm
Rubyslava + PyVo #48
What's new in Ansible 2.0

What's hot (20)

PPT
Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQ
PDF
Terraforming the Kubernetes Land
PPTX
Run Node Run
PDF
Seastar @ NYCC++UG
PDF
Infrastructure as Code in Google Cloud
KEY
fog or: How I Learned to Stop Worrying and Love the Cloud
PDF
Comparison nodejs frameworks using Polls API
ODP
Puppet and the HashiCorp Suite
PDF
Build a Complex, Realtime Data Management App with Postgres 14!
PDF
Infrastructure as Code with Terraform
PPTX
Nomad + Flatcar: a harmonious marriage of lightweights
PDF
Terraform 0.9 + good practices
PDF
Scalable Angular 2 Application Architecture
KEY
fog or: How I Learned to Stop Worrying and Love the Cloud (OpenStack Edition)
PDF
Developing Terraform Modules at Scale - HashiTalks 2021
PDF
Seastar @ SF/BA C++UG
PDF
Weird things we've seen with OpenStack Neutron
PPTX
Infrastructure as Code: Introduction to Terraform
PDF
Блохин Леонид - "Mist, как часть Hydrosphere"
ODP
Meetup cassandra sfo_jdbc
Realtime Analytics Using MongoDB, Python, Gevent, and ZeroMQ
Terraforming the Kubernetes Land
Run Node Run
Seastar @ NYCC++UG
Infrastructure as Code in Google Cloud
fog or: How I Learned to Stop Worrying and Love the Cloud
Comparison nodejs frameworks using Polls API
Puppet and the HashiCorp Suite
Build a Complex, Realtime Data Management App with Postgres 14!
Infrastructure as Code with Terraform
Nomad + Flatcar: a harmonious marriage of lightweights
Terraform 0.9 + good practices
Scalable Angular 2 Application Architecture
fog or: How I Learned to Stop Worrying and Love the Cloud (OpenStack Edition)
Developing Terraform Modules at Scale - HashiTalks 2021
Seastar @ SF/BA C++UG
Weird things we've seen with OpenStack Neutron
Infrastructure as Code: Introduction to Terraform
Блохин Леонид - "Mist, как часть Hydrosphere"
Meetup cassandra sfo_jdbc
Ad

Similar to Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017 (20)

PDF
Philipp Krenn "Elasticsearch (R)Evolution — You Know, for Search…"
PDF
Voxxed Athens 2018 - Elasticsearch (R)Evolution — You Know, for Search...
PDF
The elastic stack on docker
PPTX
Elastic pivorak
PPTX
Elasticsearch, Logstash, Kibana. Cool search, analytics, data mining and more...
PPTX
Elastic Meetup Belgium - December 2018
PPTX
Dev nexus 2017
PPTX
Elastic stack Presentation
PPTX
Elasticsearch - DevNexus 2015
PPTX
Elasticsearch { "Meetup" : "talk" }
PPTX
Perl and Elasticsearch
PDF
Elasticsearch
PPT
Elk presentation1#3
PDF
Elasticsearch, a distributed search engine with real-time analytics
PPT
How ElasticSearch lives in my DevOps life
PDF
Vancouver part 1 intro to elasticsearch and kibana-beginner's crash course ...
PPTX
Elasticsearch Introduction
PDF
Elasticsearch Introduction at BigData meetup
PPTX
Intro elasticsearch taswarbhatti
PDF
Elastic 101 tutorial - Percona Europe 2018
Philipp Krenn "Elasticsearch (R)Evolution — You Know, for Search…"
Voxxed Athens 2018 - Elasticsearch (R)Evolution — You Know, for Search...
The elastic stack on docker
Elastic pivorak
Elasticsearch, Logstash, Kibana. Cool search, analytics, data mining and more...
Elastic Meetup Belgium - December 2018
Dev nexus 2017
Elastic stack Presentation
Elasticsearch - DevNexus 2015
Elasticsearch { "Meetup" : "talk" }
Perl and Elasticsearch
Elasticsearch
Elk presentation1#3
Elasticsearch, a distributed search engine with real-time analytics
How ElasticSearch lives in my DevOps life
Vancouver part 1 intro to elasticsearch and kibana-beginner's crash course ...
Elasticsearch Introduction
Elasticsearch Introduction at BigData meetup
Intro elasticsearch taswarbhatti
Elastic 101 tutorial - Percona Europe 2018
Ad

More from Big Data Spain (20)

PDF
Big Data, Big Quality? by Irene Gonzálvez at Big Data Spain 2017
PDF
Scaling a backend for a big data and blockchain environment by Rafael Ríos at...
PDF
AI: The next frontier by Amparo Alonso at Big Data Spain 2017
PDF
Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017
PDF
Presentation: Boost Hadoop and Spark with in-memory technologies by Akmal Cha...
PDF
Data science for lazy people, Automated Machine Learning by Diego Hueltes at ...
PDF
Training Deep Learning Models on Multiple GPUs in the Cloud by Enrique Otero ...
PDF
Unbalanced data: Same algorithms different techniques by Eric Martín at Big D...
PDF
State of the art time-series analysis with deep learning by Javier Ordóñez at...
PDF
Trading at market speed with the latest Kafka features by Iñigo González at B...
PDF
Unified Stream Processing at Scale with Apache Samza by Jake Maes at Big Data...
PDF
The Analytic Platform behind IBM’s Watson Data Platform by Luciano Resende a...
PDF
Artificial Intelligence and Data-centric businesses by Óscar Méndez at Big Da...
PDF
Why big data didn’t end causal inference by Totte Harinen at Big Data Spain 2017
PDF
Meme Index. Analyzing fads and sensations on the Internet by Miguel Romero at...
PDF
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
PDF
End of the Myth: Ultra-Scalable Transactional Management by Ricardo Jiménez-P...
PDF
Attacking Machine Learning used in AntiVirus with Reinforcement by Rubén Mart...
PDF
More people, less banking: Blockchain by Salvador Casquero at Big Data Spain ...
PDF
Make the elephant fly, once again by Sourygna Luangsay at Big Data Spain 2017
Big Data, Big Quality? by Irene Gonzálvez at Big Data Spain 2017
Scaling a backend for a big data and blockchain environment by Rafael Ríos at...
AI: The next frontier by Amparo Alonso at Big Data Spain 2017
Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017
Presentation: Boost Hadoop and Spark with in-memory technologies by Akmal Cha...
Data science for lazy people, Automated Machine Learning by Diego Hueltes at ...
Training Deep Learning Models on Multiple GPUs in the Cloud by Enrique Otero ...
Unbalanced data: Same algorithms different techniques by Eric Martín at Big D...
State of the art time-series analysis with deep learning by Javier Ordóñez at...
Trading at market speed with the latest Kafka features by Iñigo González at B...
Unified Stream Processing at Scale with Apache Samza by Jake Maes at Big Data...
The Analytic Platform behind IBM’s Watson Data Platform by Luciano Resende a...
Artificial Intelligence and Data-centric businesses by Óscar Méndez at Big Da...
Why big data didn’t end causal inference by Totte Harinen at Big Data Spain 2017
Meme Index. Analyzing fads and sensations on the Internet by Miguel Romero at...
Vehicle Big Data that Drives Smart City Advancement by Mike Branch at Big Dat...
End of the Myth: Ultra-Scalable Transactional Management by Ricardo Jiménez-P...
Attacking Machine Learning used in AntiVirus with Reinforcement by Rubén Mart...
More people, less banking: Blockchain by Salvador Casquero at Big Data Spain ...
Make the elephant fly, once again by Sourygna Luangsay at Big Data Spain 2017

Recently uploaded (20)

PDF
4 layer Arch & Reference Arch of IoT.pdf
PDF
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj
PPTX
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
PDF
Auditboard EB SOX Playbook 2023 edition.
PPTX
Internet of Everything -Basic concepts details
PDF
LMS bot: enhanced learning management systems for improved student learning e...
PPTX
future_of_ai_comprehensive_20250822032121.pptx
PDF
Planning-an-Audit-A-How-To-Guide-Checklist-WP.pdf
DOCX
Basics of Cloud Computing - Cloud Ecosystem
PDF
Rapid Prototyping: A lecture on prototyping techniques for interface design
PDF
MENA-ECEONOMIC-CONTEXT-VC MENA-ECEONOMIC
PDF
Aug23rd - Mulesoft Community Workshop - Hyd, India.pdf
PDF
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
PPTX
MuleSoft-Compete-Deck for midddleware integrations
PDF
“The Future of Visual AI: Efficient Multimodal Intelligence,” a Keynote Prese...
PDF
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
PPTX
agenticai-neweraofintelligence-250529192801-1b5e6870.pptx
PPTX
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
PDF
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
PDF
Data Virtualization in Action: Scaling APIs and Apps with FME
4 layer Arch & Reference Arch of IoT.pdf
IT-ITes Industry bjjbnkmkhkhknbmhkhmjhjkhj
GROUP4NURSINGINFORMATICSREPORT-2 PRESENTATION
Auditboard EB SOX Playbook 2023 edition.
Internet of Everything -Basic concepts details
LMS bot: enhanced learning management systems for improved student learning e...
future_of_ai_comprehensive_20250822032121.pptx
Planning-an-Audit-A-How-To-Guide-Checklist-WP.pdf
Basics of Cloud Computing - Cloud Ecosystem
Rapid Prototyping: A lecture on prototyping techniques for interface design
MENA-ECEONOMIC-CONTEXT-VC MENA-ECEONOMIC
Aug23rd - Mulesoft Community Workshop - Hyd, India.pdf
Transform-Your-Supply-Chain-with-AI-Driven-Quality-Engineering.pdf
MuleSoft-Compete-Deck for midddleware integrations
“The Future of Visual AI: Efficient Multimodal Intelligence,” a Keynote Prese...
The-2025-Engineering-Revolution-AI-Quality-and-DevOps-Convergence.pdf
agenticai-neweraofintelligence-250529192801-1b5e6870.pptx
AI-driven Assurance Across Your End-to-end Network With ThousandEyes
CXOs-Are-you-still-doing-manual-DevOps-in-the-age-of-AI.pdf
Data Virtualization in Action: Scaling APIs and Apps with FME

Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017