Elasticsearch 5.x Cookbook - Third Edition (e-book) Żory

Over 170 advanced recipes to search, analyze, deploy, manage, and monitor data effectively with Elasticsearch 5.xAbout This BookDeploy and manage simple Elasticsearch nodes as well as complex cluster topologiesWrite native plugins to extend the functionalities of Elasticsearch 5.x to boost your businessPacked with clear, step-by-step recipes to walk you through the capabilities of Elasticsearch 5.xWho This Book Is ForIf you are a developer who wants to get the most out of Elasticsearch for advanced search and analytics, this is the book for you. Some understanding of JSON is expected. If you want to extend Elasticsearch, understanding of Java and related technologies is also required. What You Will LearnChoose the best Elasticsearch cloud topology to deploy and power it up with external pluginsDevelop tailored mapping to take full control of index stepsBuild complex queries through managing indices and documentsOptimize search results through executing analytics aggregationsMonitor the performance of the cluster and nodesInstall Kibana to monitor cluster and extend Kibana for pluginsIntegrate Elasticsearch in Java, Scala, Python and Big Data applicationsIn DetailElasticsearch is a Lucene-based distributed search server that allows users to index and search unstructured content with petabytes of data. This book is your one-stop guide to master the complete Elasticsearch ecosystem.We'll guide you through comprehensive recipes on what's new in Elasticsearch 5.x, showing you how to create complex queries and analytics, and perform index mapping, aggregation, and scripting. Further on, you will explore the modules of Cluster and Node monitoring and see ways to back up and restore a snapshot of an index.You will understand how to install Kibana to monitor a cluster and also to extend Kibana for plugins. Finally, you will also see how you can integrate your Java, Scala, Python, and Big Data applications such as Apache Spark and Pig with Elasticsearch, and add enhanced functionalities with custom plugins.By the end of this book, you will have an in-depth knowledge of the implementation of the Elasticsearch architecture and will be able to manage data efficiently and effectively with Elasticsearch.Style and approachThis book follows a problem-solution approach to effectively use and manage Elasticsearch. Each recipe focuses on a particular task at hand, and is explained in a very simple, easy to understand manner. Spis treści: Elasticsearch 5.x Cookbook Third Edition Credits About the Author About the Reviewer www.PacktPub.com eBooks, discount offers, and more Why subscribe? Customer Feedback Dedication Preface What this book covers What you need for this book Who this book is for Sections Getting ready How to do it How it works Theres more See also Conventions Reader feedback Customer support Downloading the example code Errata Piracy Questions 1. Getting Started Introduction Understanding node and cluster Getting ready How it work... There's more... See also Understanding node services Getting ready How it works... Managing your data Getting ready How it works... There's more... Best practices See also Understanding cluster, replication, and sharding Getting ready How it works... Best practice There's more... Solving the yellow status Solving the red status See also Communicating with Elasticsearch Getting ready How it works... Using the HTTP protocol Getting ready How to do it... How it works... There's more... Using the native protocol Getting ready How to do it... How it works... There's more... See also 2. Downloading and Setup Introduction Downloading and installing Elasticsearch Getting ready How to do it... How it works... There's more... See also Setting up networking Getting ready How to do it... How it works... See also Setting up a node Getting ready How to do it... How it works... There's more... See also Setting up for Linux systems Getting ready How to do it... How it works... Setting up different node types Getting ready How to do it... How it works... Setting up a client node Getting ready How to do it... How it works... Setting up an ingestion node Getting ready How to do it... How it works... Installing plugins in Elasticsearch Getting ready How to do it... How it works... There's more... See also Installing plugins manually Getting ready How to do it... How it works... Removing a plugin Getting ready How to do it... How it works... Changing logging settings Getting ready How to do it... How it works... Setting up a node via Docker Getting ready How to do it... How it works... There's more... See also 3. Managing Mappings Introduction Using explicit mapping creation Getting ready How to do it... How it works... There's more... See also Mapping base types Getting ready How to do it... How it works... There's more... See also Mapping arrays Getting ready How to do it... How it works... Mapping an object Getting ready How to do it... How it works... See also Mapping a document Getting ready How to do it... How it works... See also Using dynamic templates in document mapping Getting ready How to do it... How it works... There's more... See also Managing nested objects Getting ready How to do it... How it works... There's more... See also Managing child document Getting ready How to do it... How it works... There's more... See also Adding a field with multiple mapping Getting ready How to do it... How it works... There's more... See also Mapping a GeoPoint field Getting ready How to do it... How it works... There's more... Mapping a GeoShape field Getting ready How to do it How it works... See also Mapping an IP field Getting ready How to do it... How it works... Mapping an attachment field Getting ready How to do it... How it works... There's more... See also Adding metadata to a mapping Getting ready How to do it... How it works... Specifying a different analyzer Getting ready How to do it... How it works... See also Mapping a completion field Getting ready How to do it... How it works... See also 4. Basic Operations Introduction Creating an index Getting ready How to do it... How it works... There's more... See also Deleting an index Getting ready How to do it... How it works... See also Opening/closing an index Getting ready How to do it... How it works... See also Putting a mapping in an index Getting ready How to do it... How it works... There's more... See also Getting a mapping Getting ready How to do it... How it works... See also Reindexing an index Getting ready How to do it... How it works... See also Refreshing an index Getting ready How to do it... How it works... See also Flushing an index Getting ready How to do it... How it works... See also ForceMerge an index Getting ready How to do it... How it works... There's more... See also Shrinking an index Getting ready How to do it... How it works... There's more... See also Checking if an index or type exists Getting ready How to do it... How it works... Managing index settings Getting ready How to do it... How it works... There's more... See also Using index aliases Getting ready How to do it... How it works... There's more... Rollover an index Getting ready How to do it How it works... See also Indexing a document Getting ready How to do it... How it works... There's more... See also Getting a document Getting ready How to do it... How it works... There is more... See also Deleting a document Getting ready How to do it... How it works... See also Updating a document Getting ready How to do it... How it works... See also Speeding up atomic operations (bulk operations) Getting ready How to do it... How it works... Speeding up GET operations (multi GET) Getting ready How to do it... How it works... See also... 5. Search Introduction Executing a search Getting ready How to do it... How it works... There's more... See also Sorting results Getting ready How to do it... How it works... There's more... See also Highlighting results Getting ready How to do it... How it works See also Executing a scrolling query Getting ready How to do it... How it works... There's more... See also Using the search_after functionality Getting ready How to do it... How it works... See also Returning inner hits in results Getting ready How to do it... How it works... See also Suggesting a correct query Getting ready How to do it... How it works... See also Counting matched results Getting ready How to do it... How it works... There's more... See also Explaining a query Getting ready How to do it... How it works... Query profiling Getting ready How to do it... How it works... Deleting by query Getting ready How to do it... How it works... There's more... See also Updating by query Getting ready How to do it... How it works... There's more... See also Matching all the documents Getting ready How to do it... How it works... See also Using a boolean query Getting ready How to do it... How it works... 6. Text and Numeric Queries Introduction Using a term query Getting ready How to do it... How it works... There's more... Using a terms query Getting ready How to do it... How it works... There's more... See also Using a prefix query Getting ready How to do it... How it works... There's more... See also Using a wildcard query Getting ready How to do it... How it works... See also Using a regexp query Getting ready How to do it... How it works... See also Using span queries Getting ready How to do it... How it works... See also Using a match query Getting ready How to do it... How it works... See also Using a query string query Getting ready How to do it... How it works... There's more... See also Using a simple query string query Getting ready How to do it... How it works... See also Using the range query Getting ready How to do it... How it works... There's more... The common terms query Getting ready How to do it... How it works... See also Using IDs query Getting ready How to do it... How it works... See also Using the function score query Getting ready How to do it... How it works... See also Using the exists query Getting ready How to do it... How it works... Using the template query Getting ready How to do it... How it works... There's more... See also 7. Relationships and Geo Queries Introduction Using the has_child query Getting ready How to do it... How it works... There's more... See also Using the has_parent query Getting ready How to do it... How it works... See also Using nested queries Getting ready How to do it... How it works... See also Using the geo_bounding_box query Getting ready How to do it... How it works... See also Using the geo_polygon query Getting ready How to do it... How it works... See also Using the geo_distance query Getting ready How to do it... How it works... See also Using the geo_distance_range query Getting ready How to do it... How it works... See also 8. Aggregations Introduction Executing an aggregation Getting ready How to do it... How it works... See also Executing stats aggregations Getting ready How to do it... How it works... See also Executing terms aggregation Getting ready How to do it... How it works... There's more... See also Executing significant terms aggregation Getting ready How to do it... How it works... Executing range aggregations Getting ready How to do it... How it works... There's more... See also Executing histogram aggregations Getting ready How to do it... How it works... There's more... See also Executing date histogram aggregations Getting ready How to do it... How it works... See also Executing filter aggregations Getting ready How to do it... How it works... There's more... See also Executing filters aggregations Getting ready How to do it... How it works... Executing global aggregations Getting ready How to do it... How it works... Executing geo distance aggregations Getting ready How to do it... How it works... See also Executing children aggregations Getting ready How to do it... How it works... Executing nested aggregations Getting ready How to do it... How it works... There's more... Executing top hit aggregations Getting ready How to do it... How it works... See also Executing a matrix stats aggregation Getting ready How to do it... How it works... Executing geo bounds aggregations Getting ready How to do it... How it works... See also Executing geo centroid aggregations Getting ready How to do it... How it works... See also 9. Scripting Introduction Painless scripting Getting ready How to do it... How it works... There's more See also Installing additional script plugins Getting ready How to do it... How it works... There's more... Managing scripts Getting ready How to do it... How it works... There's more... See also Sorting data using scripts Getting ready How to do it... How it works... There's more... Computing return fields with scripting Getting ready How to do it... How it works... See also Filtering a search via scripting Getting ready How to do it... How it works... There's more... See also Using scripting in aggregations Getting ready How to do it... How it works... Updating a document using scripts Getting ready How to do it... How it works... There's more... Reindexing with a script Getting ready How to do it... How it works... 10. Managing Clusters and Nodes Introduction Controlling cluster health via an API Getting ready How to do it... How it works... There's more... See also Controlling cluster state via an API Getting ready How to do it... How it works... There's more... See also Getting nodes information via API Getting ready How to do it... How it works... There's more... See also Getting node statistics via the API Getting ready How to do it... How it works... There's more... Using the task management API Getting ready How to do it... How it works... There's more... See also Hot thread API Getting ready How to do it... How it works... Managing the shard allocation Getting ready How to do it... How it works... There's more... See also Monitoring segments with the segment API Getting ready How to do it... How it works... See also Cleaning the cache Getting ready How to do it... How it works... 11. Backup and Restore Introduction Managing repositories Getting ready How to do it... How it works... There's more... See also Executing a snapshot Getting ready How to do it... How it works... There's more... Restoring a snapshot Getting ready How to do it... How it works... Setting up a NFS share for backup Getting ready How to do it... How it works... Reindexing from a remote cluster Getting ready How to do it... How it works... See also 12. User Interfaces Introduction Installing and using Cerebro Getting ready How to do it... How it works... There's more... Installing Kibana and X-Pack Getting ready How to do it... How it works... Managing Kibana dashboards Getting ready How to do it... How it works... Monitoring with Kibana Getting ready How to do it... How it works... See also Using Kibana dev-console Getting ready How to do it... How it works... There's more... Visualizing data with Kibana Getting ready How to do it... How it works... Installing Kibana plugins Getting ready How to do it... How it works... Generating graph with Kibana Getting ready How to do it... How it works... 13. Ingest Introduction Pipeline definition Getting ready How to do it... How it works... There's more... Put an ingest pipeline Getting ready How to do it... How it works... Get an ingest pipeline Getting ready How to do it... How it works... There's more... Delete an ingest pipeline Getting ready How to do it... How it works... Simulate an ingest pipeline Getting ready How to do it... How it works... There's more... Built-in processors Getting ready How to do it... How it works... See also Grok processor Getting ready How to do it... How it works... See also Using the ingest attachment plugin Getting ready How to do it... How it works... Using the ingest GeoIP plugin Getting ready How to do it... How it works... See also 14. Java Integration Introduction Creating a standard Java HTTP client Getting ready How to do it... How it works... See also Creating an HTTP Elasticsearch client Getting ready How to do it... How it works... See also Creating a native client Getting ready How to do it... How it works... There's more... See also Managing indices with the native client Getting ready How to do it... How it works... See also Managing mappings Getting ready How to do it... How it works... There's more... See also Managing documents Getting ready How to do it... How it works... See also Managing bulk actions Getting ready How to do it... How it works... Building a query Getting ready How to do it... How it works... There's more... Executing a standard search Getting ready How to do it... How it works... See also Executing a search with aggregations Getting ready How to do it... How it works... See also Executing a scroll search Getting ready How to do it... How it works... See also 15. Scala Integration Introduction Creating a client in Scala Getting ready How to do it... How it works... See also Managing indices Getting ready How to do it... How it works... See also Managing mappings Getting ready How to do it... How it works... See also Managing documents Getting ready How to do it... How it works... There's more... See also Executing a standard search Getting ready How to do it... How it works... See also Executing a search with aggregations Getting ready How to do it... How it works... See also 16. Python Integration Introduction Creating a client Getting ready How to do it... How it works See also Managing indices Getting ready How to do it How it works There's more See also Managing mappings include the mapping Getting ready How to do it How it works See also Managing documents Getting ready How to do it How it works See also Executing a standard search Getting ready How to do it How it works See also Executing a search with aggregations Getting ready How to do it How it works See also 17. Plugin Development Introduction Creating a plugin Getting ready How to do it... How it works... There's more... Creating an analyzer plugin Getting ready How to do it... How it works... There's more... Creating a REST plugin Getting ready How to do it... How it works... See also Creating a cluster action Getting ready How to do it... How it works... See also Creating an ingest plugin Getting ready How to do it... How it works... 18. Big Data Integration Introduction Installing Apache Spark Getting ready How to do it... How it works... There's more... Indexing data via Apache Spark Getting ready How to do it... How it works... See also Indexing data with meta via Apache Spark Getting ready How to do it... How it works... There's more... Reading data with Apache Spark Getting ready How to do it... How it works... Reading data using SparkSQL Getting ready How to do it... How it works... Indexing data with Apache Pig Getting ready How to do it... How it works...