"Fossies" - the Fresh Open Source Software Archive

Member "elasticsearch-6.8.23/docs/reference/release-notes/6.0.asciidoc" (29 Dec 2021, 226229 Bytes) of package /linux/www/elasticsearch-6.8.23-src.tar.gz:


As a special service "Fossies" has tried to format the requested source page into HTML format (assuming AsciiDoc format). Alternatively you can here view or download the uninterpreted source code file. A member file download can also be achieved by clicking within a package contents listing on the according byte size field.

A hint: This file contains one or more very long lines, so maybe it is better readable using the pure text view mode that shows the contents as wrapped lines within the browser window.


{es} version 6.0.1

Breaking Changes

Scroll
  • Fail queries with scroll that explicitely set request_cache {es-pull}27342[#27342]

Enhancements

Core
  • Fix classes that can exit {es-pull}27518[#27518]

Discovery
  • Stop responding to ping requests before master abdication {es-pull}27329[#27329] (issue: {es-issue}27328[#27328])

Plugin Repository S3
  • Remove S3 output stream {es-pull}27280[#27280] (issue: {es-issue}27278[#27278])

  • Update to AWS SDK 1.11.223 {es-pull}27278[#27278]

Search
  • fix unnecessary logger creation {es-pull}27349[#27349]

Sequence IDs
  • Log primary-replica resync failures {es-pull}27421[#27421] (issues: {es-issue}24841[#24841], {es-issue}27418[#27418])

Snapshot/Restore
  • Remove XContentType auto detection in BlobStoreRepository {es-pull}27480[#27480]

Bug Fixes

Cluster
  • Properly format IndexGraveyard deletion date as date {es-pull}27362[#27362]

Core
  • Do not set data paths on no local storage required {es-pull}27587[#27587] (issue: {es-issue}27572[#27572])

  • Ensure threadcontext is preserved when refresh listeners are invoked {es-pull}27565[#27565]

  • Avoid NPE when getting build information {es-pull}27442[#27442]

  • When building Settings do not set SecureSettings if empty {es-pull}26988[#26988] (issue: {es-issue}316[#316])

Engine
  • Reset LiveVersionMap on sync commit {es-pull}27534[#27534] (issue: {es-issue}27516[#27516])

  • Carry over version map size to prevent excessive resizing {es-pull}27516[#27516] (issue: {es-issue}20498[#20498])

Inner Hits
  • Return an empty _source for nested inner hit when filtering on a field that doesn’t exist {es-pull}27531[#27531]

Machine Learning
  • Fixed analytics problem where sparse data resulted in "update failed" errors in the logs.

Mapping
  • Fix dynamic mapping update generation. {es-pull}27467[#27467]

  • Fixed rounding of bounds in scaled float comparison {es-pull}27207[#27207] (issue: {es-issue}27189[#27189])

Nested Docs
  • Ensure nested documents have consistent version and seq_ids {es-pull}27455[#27455]

Network
  • Throw UOE from compressible bytes stream reset {es-pull}27564[#27564] (issue: {es-issue}24927[#24927])

  • Bubble exceptions when closing compressible streams {es-pull}27542[#27542] (issue: {es-issue}27540[#27540])

Plugin Lang Painless
  • Painless: Fix errors allowing void to be assigned to def. {es-pull}27460[#27460] (issue: {es-issue}27210[#27210])

Plugin Repository GCS
  • Create new handlers for every new request in GoogleCloudStorageService {es-pull}27339[#27339] (issue: {es-issue}27092[#27092])

Recovery
  • Flush old indices on primary promotion and relocation {es-pull}27580[#27580] (issue: {es-issue}27536[#27536])

Reindex API
  • Reindex: Fix headers in reindex action {es-pull}26937[#26937] (issue: {es-issue}22976[#22976])

Search
  • Fix profiling naming issues {es-pull}27133[#27133]

Security
  • Fixed error that occurred when attempting to audit system_access_granted events.

  • Fixed the setup-passwords command such that it fails appropriately when invalid URLs are specified in the --url option and when {security} is not enabled.

Sequence IDs
  • Fix resync request serialization {es-pull}27418[#27418] (issue: {es-issue}24841[#24841])

Snapshot/Restore
  • Do not swallow exception in ChecksumBlobStoreFormat.writeAtomic() {es-pull}27597[#27597]

  • Delete shard store files before restoring a snapshot {es-pull}27476[#27476] (issues: {es-issue}20220[#20220], {es-issue}26865[#26865])

  • Fix snapshot getting stuck in INIT state {es-pull}27214[#27214] (issue: {es-issue}27180[#27180])

  • Fix default value of ignore_unavailable for snapshot REST API (#25359) {es-pull}27056[#27056] (issue: {es-issue}25359[#25359])

  • Do not create directory on readonly repository (#21495) {es-pull}26909[#26909] (issue: {es-issue}21495[#21495])

Watcher
  • Fixed handling of Hipchat rooms. For example, room names with spaces did not work as expected. For more information, see [actions-hipchat].

Upgrades

Plugin Discovery EC2
  • Upgrade AWS SDK Jackson Databind to 2.6.7.1 {es-pull}27361[#27361] (issues: {es-issue}27278[#27278], {es-issue}27359[#27359])

Plugin Discovery GCE
  • Update Google SDK to version 1.23.0 {es-pull}27381[#27381] (issue: {es-issue}26636[#26636])

{es} version 6.0.0

Breaking Changes

Aggregations
  • Change parsing of numeric to and from parameters in date_range aggregation {es-pull}25376[#25376] (issue: {es-issue}17920[#17920])

Aliases
  • Wrong behavior deleting alias {es-pull}23997[#23997] (issues: {es-issue}10106[#10106], {es-issue}23960[#23960])

Allocation
  • Remove cluster.routing.allocation.snapshot.relocation_enabled setting {es-pull}20994[#20994]

Analysis
  • Do not allow custom analyzers to have the same names as built-in analyzers {es-pull}22349[#22349] (issue: {es-issue}22263[#22263])

  • Removing query-string parameters in _analyze API {es-pull}20704[#20704] (issue: {es-issue}20246[#20246])

CAT API
  • Write -1 on unbounded queue in cat thread pool {es-pull}21342[#21342] (issue: {es-issue}21187[#21187])

CRUD
  • Disallow VersionType.FORCE for GetRequest {es-pull}21079[#21079] (issue: {es-issue}20995[#20995])

  • Disallow VersionType.FORCE versioning for 6.x indices {es-pull}20995[#20995] (issue: {es-issue}20377[#20377])

  • If the index does not exist, delete document will not auto create it {es-pull}24518[#24518] (issue: {es-issue}15425[#15425])

Cluster
  • Disallow : in cluster and index/alias names {es-pull}26247[#26247] (issue: {es-issue}23892[#23892])

  • No longer allow cluster name in data path {es-pull}20433[#20433] (issue: {es-issue}20391[#20391])

Core
  • Simplify file store {es-pull}24402[#24402] (issue: {es-issue}24390[#24390])

  • Make boolean conversion strict {es-pull}22200[#22200]

  • Remove the default store type. {es-pull}21616[#21616]

  • Remove store throttling. {es-pull}21573[#21573]

Geo
  • Remove deprecated geo search features {es-pull}22876[#22876]

  • Reduce GeoDistance Insanity {es-pull}19846[#19846]

Highlighting
  • Remove the postings highlighter and make unified the default highlighter choice {es-pull}25028[#25028]

Index APIs
  • Remove (deprecated) support for '+' in index expressions {es-pull}25274[#25274] (issue: {es-issue}24515[#24515])

  • Delete index API to work only against concrete indices {es-pull}25268[#25268] (issues: {es-issue}2318[#2318], {es-issue}23997[#23997])

  • Open/Close index api to allow_no_indices by default {es-pull}24401[#24401] (issues: {es-issue}24031[#24031], {es-issue}24341[#24341])

  • Remove support for controversial ignore_unavailable and allow_no_indices from indices exists api {es-pull}20712[#20712]

Index Templates
  • Allows multiple patterns to be specified for index templates {es-pull}21009[#21009] (issue: {es-issue}20690[#20690])

Indexed Scripts/Templates
  • Scripting: Remove search template actions {es-pull}25717[#25717]

Ingest
  • update ingest-user-agent regexes.yml {es-pull}25608[#25608]

  • remove ingest.new_date_format {es-pull}25583[#25583]

Inner Hits
  • Return the _source of inner hit nested as is without wrapping it into its full path context {es-pull}26982[#26982] (issues: {es-issue}26102[#26102], {es-issue}26944[#26944])

Java API
  • Enforce Content-Type requirement on the rest layer and remove deprecated methods {es-pull}23146[#23146] (issue: {es-issue}19388[#19388])

Java REST Client
  • Remove deprecated created and found from index, delete and bulk {es-pull}25516[#25516] (issues: {es-issue}19566[#19566], {es-issue}19630[#19630], {es-issue}19633[#19633])

Mapping
  • Reject out of range numbers for float, double and half_float {es-pull}25826[#25826] (issue: {es-issue}25534[#25534])

  • Enforce at most one type. {es-pull}24428[#24428] (issue: {es-issue}24317[#24317])

  • Disallow include_in_all for 6.0+ indices {es-pull}22970[#22970] (issue: {es-issue}22923[#22923])

  • Disable _all by default, disallow configuring _all on 6.0+ indices {es-pull}22144[#22144] (issues: {es-issue}19784[#19784], {es-issue}20925[#20925], {es-issue}21341[#21341])

  • Throw an exception on unrecognized "match_mapping_type" {es-pull}22090[#22090] (issue: {es-issue}17285[#17285])

Network
  • Remove unused Netty-related settings {es-pull}26161[#26161]

  • Remove blocking TCP clients and servers {es-pull}22639[#22639]

  • Remove modules/transport_netty_3 in favor of netty_4 {es-pull}21590[#21590]

  • Remove LocalTransport in favor of MockTcpTransport {es-pull}20695[#20695]

Packaging
  • Configure heap dump path out of the box {es-pull}26755[#26755] (issue: {es-issue}26665[#26665])

  • Remove support for ES_INCLUDE {es-pull}25804[#25804]

  • Setup: Change default heap to 1G {es-pull}25695[#25695]

  • Use config directory to find jvm.options {es-pull}25679[#25679] (issue: {es-issue}23004[#23004])

  • Remove implicit 32-bit support {es-pull}25435[#25435]

  • Remove default path settings {es-pull}25408[#25408] (issue: {es-issue}25357[#25357])

  • Remove path.conf setting {es-pull}25392[#25392] (issue: {es-issue}25357[#25357])

  • Honor masking of systemd-sysctl.service {es-pull}24234[#24234] (issues: {es-issue}21899[#21899], {es-issue}806[#806])

  • Rename CONF_DIR to ES_PATH_CONF {es-pull}26197[#26197] (issue: {es-issue}26154[#26154])

  • Remove customization of ES_USER and ES_GROUP {es-pull}23989[#23989] (issue: {es-issue}23848[#23848])

Percolator
  • Remove deprecated percolate and mpercolate apis {es-pull}22331[#22331]

Plugin Analysis ICU
  • Upgrade icu4j for the ICU analysis plugin to 59.1 {es-pull}25243[#25243] (issue: {es-issue}21425[#21425])

  • Upgrade icu4j to latest version {es-pull}24821[#24821]

Plugin Delete By Query
  • Require explicit query in _delete_by_query API {es-pull}23632[#23632] (issue: {es-issue}23629[#23629])

Plugin Discovery Azure Classic
  • Remove discovery.type BWC layer from the EC2/Azure/GCE plugins {es-pull}25080[#25080] (issue: {es-issue}24543[#24543])

Plugin Discovery EC2
  • Ec2 Discovery: Cleanup deprecated settings {es-pull}24150[#24150]

  • Discovery EC2: Remove region setting {es-pull}23991[#23991] (issue: {es-issue}22758[#22758])

  • AWS Plugins: Remove signer type setting {es-pull}23984[#23984] (issue: {es-issue}22599[#22599])

Plugin Lang JS
  • Remove lang-python and lang-javascript {es-pull}20734[#20734] (issue: {es-issue}20698[#20698])

Plugin Mapper Attachment
  • Remove mapper attachments plugin {es-pull}20416[#20416] (issue: {es-issue}18837[#18837])

Plugin Repository Azure
  • Remove global repositories.azure settings {es-pull}23262[#23262] (issues: {es-issue}22800[#22800], {es-issue}22856[#22856])

  • Remove auto creation of container for azure repository {es-pull}22858[#22858] (issue: {es-issue}22857[#22857])

Plugin Repository GCS
  • GCS Repository: Remove specifying credential file on disk {es-pull}24727[#24727]

Plugin Repository S3
  • S3 Repository: Cleanup deprecated settings {es-pull}24097[#24097]

  • S3 Repository: Remove region setting {es-pull}22853[#22853] (issue: {es-issue}22758[#22758])

  • S3 Repository: Remove bucket auto create {es-pull}22846[#22846] (issue: {es-issue}22761[#22761])

  • S3 Repository: Remove env var and sysprop credentials support {es-pull}22842[#22842]

  • Remove deprecated S3 settings {es-pull}24445[#24445]

Plugins
  • Make plugin loading stricter {es-pull}25405[#25405]

Query DSL
  • Remove deprecated type and slop field in match query {es-pull}26720[#26720]

  • Remove several parse field deprecations in query builders {es-pull}26711[#26711]

  • Remove deprecated parameters from ids_query {es-pull}26508[#26508]

  • Refactor QueryStringQuery for 6.0 {es-pull}25646[#25646] (issue: {es-issue}25574[#25574])

  • Change split_on_whitespace default to false {es-pull}25570[#25570] (issue: {es-issue}25470[#25470])

  • Remove deprecated template query {es-pull}24577[#24577] (issue: {es-issue}19390[#19390])

  • Throw exception in scroll requests using from {es-pull}26235[#26235] (issue: {es-issue}9373[#9373])

  • Remove deprecated minimum_number_should_match in BoolQueryBuilder {es-pull}22416[#22416]

  • Remove support for empty queries {es-pull}22092[#22092] (issue: {es-issue}17624[#17624])

  • Remove deprecated query names: in, geo_bbox, mlt, fuzzy_match and match_fuzzy {es-pull}21852[#21852]

  • The terms query should always map to a Lucene TermsQuery. {es-pull}21786[#21786]

  • Be strict when parsing values searching for booleans {es-pull}21555[#21555] (issue: {es-issue}21545[#21545])

  • Remove collect payloads parameter {es-pull}20385[#20385]

REST
  • IndexClosedException to return 400 rather than 403 {es-pull}25752[#25752]

  • Remove comma-separated feature parsing for GetIndicesAction {es-pull}24723[#24723] (issue: {es-issue}24437[#24437])

  • Improve REST error handling when endpoint does not support HTTP verb, add OPTIONS support {es-pull}24437[#24437] (issues: {es-issue}0[#0], {es-issue}15335[#15335], {es-issue}17916[#17916])

  • Remove ldjson support and document ndjson for bulk/msearch {es-pull}23049[#23049] (issue: {es-issue}23025[#23025])

  • Enable strict duplicate checks for all XContent types {es-pull}22225[#22225] (issues: {es-issue}19614[#19614], {es-issue}22073[#22073])

  • Enable strict duplicate checks for JSON content {es-pull}22073[#22073] (issue: {es-issue}19614[#19614])

  • Remove lenient stats parsing {es-pull}21417[#21417] (issues: {es-issue}20722[#20722], {es-issue}21410[#21410])

  • Remove allow unquoted JSON {es-pull}20388[#20388] (issues: {es-issue}17674[#17674], {es-issue}17801[#17801])

  • Remove FORCE version_type {es-pull}20377[#20377] (issue: {es-issue}19769[#19769])

Scripting
  • remove lang url parameter from stored script requests {es-pull}25779[#25779] (issue: {es-issue}22887[#22887])

  • Disallow lang to be used with Stored Scripts {es-pull}25610[#25610]

  • Remove Deprecated Script Settings {es-pull}24756[#24756] (issue: {es-issue}24532[#24532])

  • Scripting: Remove native scripts {es-pull}24726[#24726] (issue: {es-issue}19966[#19966])

  • Scripting: Remove file scripts {es-pull}24627[#24627] (issue: {es-issue}21798[#21798])

  • Make dates be ReadableDateTimes in scripts {es-pull}22948[#22948] (issue: {es-issue}22875[#22875])

  • Remove groovy scripting language {es-pull}21607[#21607]

  • Remove script access to term statistics {es-pull}19462[#19462] (issue: {es-issue}19359[#19359])

Search
  • Make index in TermsLookup mandatory {es-pull}25753[#25753] (issue: {es-issue}25750[#25750])

  • Removes FieldStats API {es-pull}25628[#25628] (issue: {es-issue}25577[#25577])

  • Remove deprecated fielddata_fields from search request {es-pull}25566[#25566] (issue: {es-issue}25537[#25537])

  • Removes deprecated fielddata_fields {es-pull}25537[#25537] (issue: {es-issue}19027[#19027])

  • ProfileResult and CollectorResult should print machine readable timing information {es-pull}22561[#22561]

  • Remove indices query {es-pull}21837[#21837] (issue: {es-issue}17710[#17710])

  • Remove ignored type parameter in search_shards api {es-pull}21688[#21688]

Security
  • Added new security limitations:

    • When a user’s role enables document level security for an index and suggesters are specified, the specified suggesters are ignored. For more information about suggesters, see {ref}/search-suggesters.html[Suggesters].

    • When document level security is enabled, search requests cannot be profiled. For more information about profiling, see the {ref}/search-profile.html[Profile API].

Sequence IDs
  • Change certain replica failures not to fail the replica shard {es-pull}22874[#22874] (issue: {es-issue}10708[#10708])

Settings
  • Settings: Remove shared setting property {es-pull}24728[#24728]

  • Settings: Remove support for yaml and json config files {es-pull}24664[#24664] (issue: {es-issue}19391[#19391])

Shadow Replicas
  • Remove shadow replicas {es-pull}23906[#23906] (issue: {es-issue}22024[#22024])

Similarities
  • Similarity should accept dynamic settings when possible {es-pull}20339[#20339] (issue: {es-issue}6727[#6727])

Breaking Java Changes

Aggregations
  • Remove the unused SignificantTerms.compareTerm() method {es-pull}24714[#24714]

  • Make SignificantTerms.Bucket an interface rather than an abstract class {es-pull}24670[#24670] (issue: {es-issue}24492[#24492])

  • Fix NPE when values is omitted on percentile_ranks agg {es-pull}26046[#26046]

  • Make Terms.Bucket an interface rather than an abstract class {es-pull}24492[#24492]

  • Compound order for histogram aggregations {es-pull}22343[#22343] (issues: {es-issue}14771[#14771], {es-issue}20003[#20003], {es-issue}23613[#23613])

Internal
  • Collapses package structure for some bucket aggs {es-pull}25579[#25579] (issue: {es-issue}22868[#22868])

Java API
  • Remove deprecated IdsQueryBuilder ctor {es-pull}25529[#25529]

  • Removing unneeded getTookInMillis method {es-pull}23923[#23923]

  • Java api: ActionRequestBuilder#execute to return a PlainActionFuture {es-pull}24415[#24415] (issues: {es-issue}24412[#24412], {es-issue}9201[#9201])

Java High Level REST Client
  • Unify the result interfaces from get and search in Java client {es-pull}25361[#25361] (issue: {es-issue}16440[#16440])

  • Allow RestHighLevelClient to use plugins {es-pull}25024[#25024]

Java REST Client
  • Rename client artifacts {es-pull}25693[#25693] (issue: {es-issue}20248[#20248])

Network
  • Simplify TransportAddress {es-pull}20798[#20798]

Plugin Delete By Query
  • Move DeleteByQuery and Reindex requests into core {es-pull}24578[#24578]

Plugins
  • Drop name from TokenizerFactory {es-pull}24869[#24869]

Query DSL
  • Remove QueryParseContext {es-pull}25486[#25486]

  • Remove QueryParseContext from parsing QueryBuilders {es-pull}25448[#25448]

REST
  • Return index name and empty map for /{index}/_alias with no aliases {es-pull}25114[#25114] (issues: {es-issue}24723[#24723], {es-issue}25090[#25090])

Deprecations

Index APIs
  • Deprecated use of + in index expressions {es-pull}24585[#24585] (issue: {es-issue}24515[#24515])

Index Templates
  • Restore deprecation warning for invalid match_mapping_type values {es-pull}22304[#22304]

Indexed Scripts/Templates
  • Scripting: Deprecate stored search template apis {es-pull}25437[#25437] (issue: {es-issue}24596[#24596])

Internal
  • Deprecate XContentType auto detection methods in XContentFactory {es-pull}22181[#22181] (issue: {es-issue}19388[#19388])

Percolator
  • Deprecate percolate query’s document_type parameter. {es-pull}25199[#25199]

Plugins
  • Plugins: Add backcompat for sha1 checksums {es-pull}26748[#26748] (issue: {es-issue}26746[#26746])

Scripting
  • Scripting: Change keys for inline/stored scripts to source/id {es-pull}25127[#25127]

  • Scripting: Deprecate native scripts {es-pull}24692[#24692] (issue: {es-issue}19966[#19966])

  • Scripting: Deprecate index lookup {es-pull}24691[#24691] (issue: {es-issue}19359[#19359])

  • Deprecate Fine Grain Settings for Scripts {es-pull}24573[#24573] (issue: {es-issue}24532[#24532])

  • Scripting: Deprecate file script settings {es-pull}24555[#24555] (issue: {es-issue}21798[#21798])

  • Scripting: Deprecate file scripts {es-pull}24552[#24552] (issue: {es-issue}21798[#21798])

Settings
  • Settings: Update settings deprecation from yml to yaml {es-pull}24663[#24663] (issue: {es-issue}19391[#19391])

  • Deprecate settings in .yml and .json {es-pull}24059[#24059] (issue: {es-issue}19391[#19391])

Tribe Node
  • Deprecate tribe service {es-pull}24598[#24598] (issue: {es-issue}24581[#24581])

New Features

Aggregations
  • SignificantText aggregation - like significant_terms, but for text {es-pull}24432[#24432] (issue: {es-issue}23674[#23674])

Analysis
  • Expose simplepattern and simplepatternsplit tokenizers {es-pull}25159[#25159] (issue: {es-issue}23363[#23363])

  • Parse synonyms with the same analysis chain {es-pull}8049[#8049] (issue: {es-issue}7199[#7199])

Core
  • Enable index-time sorting {es-pull}24055[#24055] (issue: {es-issue}6720[#6720])

Internal
  • Automatically adjust search threadpool queue_size {es-pull}23884[#23884] (issue: {es-issue}3890[#3890])

Mapping
  • Add new ip_range field type {es-pull}24433[#24433]

Parent/Child
  • Move parent_id query to the parent-join module {es-pull}25072[#25072] (issue: {es-issue}20257[#20257])

  • Introduce ParentJoinFieldMapper, a field mapper that creates parent/child relation within documents of the same index {es-pull}24978[#24978] (issue: {es-issue}20257[#20257])

Plugin Analysis ICU
  • Add ICUCollationFieldMapper {es-pull}24126[#24126]

Search
  • Automatically early terminate search query based on index sorting {es-pull}24864[#24864] (issue: {es-issue}6720[#6720])

Sequence IDs
  • Add a scheduled translog retention check {es-pull}25622[#25622] (issues: {es-issue}10708[#10708], {es-issue}25294[#25294])

  • Initialize sequence numbers on a shrunken index {es-pull}25321[#25321] (issue: {es-issue}10708[#10708])

  • Initialize primary term for shrunk indices {es-pull}25307[#25307] (issue: {es-issue}10708[#10708])

  • Introduce translog size and age based retention policies {es-pull}25147[#25147] (issue: {es-issue}10708[#10708])

Stats
  • Adds nodes usage API to monitor usages of actions {es-pull}24169[#24169]

Task Manager
  • Task Management [ISSUE] {es-pull}15117[#15117]

Upgrade API
  • TemplateUpgraders should be called during rolling restart {es-pull}25263[#25263] (issues: {es-issue}24379[#24379], {es-issue}24680[#24680])

Enhancements

Aggregations
  • Add strict parsing of aggregation ranges {es-pull}25769[#25769]

  • Adds rewrite phase to aggregations {es-pull}25495[#25495] (issue: {es-issue}17676[#17676])

  • Tweak AggregatorBase.addRequestCircuitBreakerBytes {es-pull}25162[#25162] (issue: {es-issue}24511[#24511])

  • Add superset size to Significant Term REST response {es-pull}24865[#24865]

  • Add document count to Matrix Stats aggregation response {es-pull}24776[#24776]

  • Adds an implementation of LogLogBeta for the cardinality aggregation {es-pull}22323[#22323] (issue: {es-issue}22230[#22230])

  • Support distance units in GeoHashGrid aggregation precision {es-pull}26291[#26291] (issue: {es-issue}5042[#5042])

  • Reject multiple methods in percentiles aggregation {es-pull}26163[#26163] (issue: {es-issue}26095[#26095])

  • Use global_ordinals_hash execution mode when sorting by sub aggregations. {es-pull}26014[#26014] (issue: {es-issue}24359[#24359])

  • Add a specialized deferring collector for terms aggregator {es-pull}25190[#25190]

  • Agg builder accessibility fixes {es-pull}24323[#24323]

  • Remove support for the include/pattern syntax. {es-pull}23141[#23141] (issue: {es-issue}22933[#22933])

  • Promote longs to doubles when a terms agg mixes decimal and non-decimal numbers {es-pull}22449[#22449] (issue: {es-issue}22232[#22232])

Allocation
  • Adjust status on bad allocation explain requests {es-pull}25503[#25503] (issue: {es-issue}25458[#25458])

  • Promote replica on the highest version node {es-pull}25277[#25277] (issue: {es-issue}10708[#10708])

Analysis
  • [Analysis] Support normalizer in request param {es-pull}24767[#24767] (issue: {es-issue}23347[#23347])

  • Enforce validation for PathHierarchy tokenizer {es-pull}23510[#23510]

  • [analysis-icu] Allow setting unicodeSetFilter {es-pull}20814[#20814] (issue: {es-issue}20820[#20820])

  • Match- and MultiMatchQueryBuilder should only allow setting analyzer on string values {es-pull}23684[#23684] (issue: {es-issue}21665[#21665])

Bulk
  • Simplify bulk request execution {es-pull}20109[#20109]

CAT API
  • expand /_cat/nodes to return information about hard drive {es-pull}21775[#21775] (issue: {es-issue}21679[#21679])

CRUD
  • Added validation for upsert request {es-pull}24282[#24282] (issue: {es-issue}16671[#16671])

Circuit Breakers
  • ScriptService: Replace max compilation per minute setting with max compilation rate {es-pull}26399[#26399]

Cluster
  • Validate a joining node’s version with version of existing cluster nodes {es-pull}25808[#25808]

  • Switch indices read-only if a node runs out of disk space {es-pull}25541[#25541] (issue: {es-issue}24299[#24299])

  • Add a cluster block that allows to delete indices that are read-only {es-pull}24678[#24678]

  • Separate publishing from applying cluster states {es-pull}24236[#24236]

  • Adds cluster state size to /_cluster/state response {es-pull}23440[#23440] (issue: {es-issue}3415[#3415])

Core
  • Allow InputStreamStreamInput array size validation where applicable {es-pull}26692[#26692]

  • Refactor bootstrap check results and error messages {es-pull}26637[#26637]

  • Add BootstrapContext to expose settings and recovered state to bootstrap checks {es-pull}26628[#26628]

  • Unit testable index creation task on MetaDataCreateIndexService {es-pull}25961[#25961]

  • Ignore .DS_Store files on macOS {es-pull}27108[#27108] (issue: {es-issue}23982[#23982])

  • Add max file size bootstrap check {es-pull}25974[#25974]

  • Add compatibility versions to main action response {es-pull}25799[#25799]

  • Index ids in binary form. {es-pull}25352[#25352] (issues: {es-issue}18154[#18154], {es-issue}24615[#24615])

  • Explicitly reject duplicate data paths {es-pull}25178[#25178]

  • Use SPI in High Level Rest Client to load XContent parsers {es-pull}25097[#25097]

  • Upgrade to lucene-7.0.0-snapshot-a0aef2f {es-pull}24775[#24775]

  • Speed up PK lookups at index time. {es-pull}19856[#19856]

  • Use Java 9 FilePermission model {es-pull}26302[#26302] (issue: {es-issue}21534[#21534])

  • Add friendlier message on bad keystore permissions {es-pull}26284[#26284]

  • Epoch millis and second formats accept float implicitly {es-pull}26119[#26119] (issue: {es-issue}14641[#14641])

  • Remove connect SocketPermissions from core {es-pull}22797[#22797]

  • Add repository-url module and move URLRepository {es-pull}22752[#22752] (issue: {es-issue}22116[#22116])

  • Remove accept SocketPermissions from core {es-pull}22622[#22622] (issue: {es-issue}22116[#22116])

  • Move IfConfig.logIfNecessary call into bootstrap {es-pull}22455[#22455] (issue: {es-issue}22116[#22116])

  • Remove artificial default processors limit {es-pull}20874[#20874] (issue: {es-issue}20828[#20828])

  • Simplify write failure handling {es-pull}19105[#19105] (issue: {es-issue}20109[#20109])

  • Improve bootstrap checks error messages {es-pull}24548[#24548]

Discovery
  • Allow plugins to validate cluster-state on join {es-pull}26595[#26595]

Engine
  • Add refresh stats tracking for realtime get {es-pull}25052[#25052] (issue: {es-issue}24806[#24806])

  • Introducing a translog deletion policy {es-pull}24950[#24950]

  • Fill missing sequence IDs up to max sequence ID when recovering from store {es-pull}24238[#24238] (issue: {es-issue}10708[#10708])

  • Use sequence numbers to identify out of order delivery in replicas & recovery {es-pull}24060[#24060] (issue: {es-issue}10708[#10708])

  • Add replica ops with version conflict to translog {es-pull}22626[#22626]

  • Clarify global checkpoint recovery {es-pull}21934[#21934] (issue: {es-issue}21254[#21254])

  • Move the IndexDeletionPolicy to be engine internal {es-pull}24930[#24930] (issue: {es-issue}10708[#10708])

Exceptions
  • IllegalStateException: Only duplicated jar instead of classpath {es-pull}24953[#24953]

Highlighting
  • Picks offset source for the unified highlighter directly from the es mapping {es-pull}25747[#25747] (issue: {es-issue}25699[#25699])

Index APIs
  • Let primary own its replication group {es-pull}25692[#25692] (issue: {es-issue}25485[#25485])

  • Create index request should return the index name {es-pull}25139[#25139] (issue: {es-issue}23044[#23044])

Index Templates
  • Fix error message for a put index template request without index_patterns {es-pull}27102[#27102] (issue: {es-issue}27100[#27100])

Ingest
  • Add Ingest-Processor specific Rest Endpoints & Add Grok endpoint {es-pull}25059[#25059] (issue: {es-issue}24725[#24725])

  • Port support for commercial GeoIP2 databases from Logstash. {es-pull}24889[#24889]

  • add exclude_keys option to KeyValueProcessor {es-pull}24876[#24876] (issue: {es-issue}23856[#23856])

  • Allow removing multiple fields in ingest processor {es-pull}24750[#24750] (issue: {es-issue}24622[#24622])

  • Add target_field parameter to ingest processors {es-pull}24133[#24133] (issues: {es-issue}23228[#23228], {es-issue}23682[#23682])

Inner Hits
  • Reuse inner hit query weight {es-pull}24571[#24571] (issue: {es-issue}23917[#23917])

Internal
  • TemplateUpgradeService should only run on the master {es-pull}27294[#27294]

  • Cleanup IndexFieldData visibility {es-pull}25900[#25900]

  • Bump the min compat version to 5.6.0 {es-pull}25805[#25805]

  • "shard started" should show index and shard ID {es-pull}25157[#25157]

  • Break out clear scroll logic from TransportClearScrollAction {es-pull}25125[#25125] (issue: {es-issue}25094[#25094])

  • Add helper methods to TransportActionProxy to identify proxy actions and requests {es-pull}25124[#25124]

  • Add remote cluster infrastructure to fetch discovery nodes. {es-pull}25123[#25123] (issue: {es-issue}25094[#25094])

  • Add the ability to set eager_global_ordinals in the new parent-join field {es-pull}25019[#25019]

  • Disallow multiple parent-join fields per mapping {es-pull}25002[#25002]

  • Remove the need for _UNRELEASED suffix in versions {es-pull}24798[#24798] (issue: {es-issue}24768[#24768])

  • Optimize the order of bytes in uuids for better compression. {es-pull}24615[#24615] (issue: {es-issue}18209[#18209])

  • Prevent cluster internal ClusterState.Custom impls to leak to a client {es-pull}26232[#26232]

  • Use holder pattern for lazy deprecation loggers {es-pull}26218[#26218] (issue: {es-issue}26210[#26210])

  • Allow ClusterState.Custom to be created on initial cluster states {es-pull}26144[#26144]

  • Try to convince the JVM not to lose stacktraces {es-pull}24426[#24426] (issue: {es-issue}24376[#24376])

  • Make document write requests immutable {es-pull}23038[#23038]

  • Add assertions enabled helper {es-pull}24834[#24834]

Java API
  • Always Accumulate Transport Exceptions {es-pull}25017[#25017] (issue: {es-issue}23099[#23099])

Java High Level REST Client
  • [DOCS] restructure java clients docs pages {es-pull}25517[#25517]

  • Use SPI in High Level Rest Client to load XContent parsers {es-pull}25098[#25098] (issues: {es-issue}25024[#25024], {es-issue}25097[#25097])

  • Add support for clear scroll to high level REST client {es-pull}25038[#25038]

  • Add search scroll method to high level REST client {es-pull}24938[#24938] (issue: {es-issue}23331[#23331])

  • Add search method to high level REST client {es-pull}24796[#24796] (issues: {es-issue}24794[#24794], {es-issue}24795[#24795])

  • Make RestHighLevelClient Closeable and simplify its creation {es-pull}26180[#26180] (issue: {es-issue}26086[#26086])

  • Add info method to High Level Rest client {es-pull}23350[#23350]

  • Add support for named xcontent parsers to high level REST client {es-pull}23328[#23328]

  • Add BulkRequest support to High Level Rest client {es-pull}23312[#23312]

  • Add UpdateRequest support to High Level Rest client {es-pull}23266[#23266]

  • Add delete API to the High Level Rest Client {es-pull}23187[#23187]

  • Add Index API to High Level Rest Client {es-pull}23040[#23040]

  • Add get/exists method to RestHighLevelClient {es-pull}22706[#22706]

  • Add fromxcontent methods to delete response {es-pull}22680[#22680] (issue: {es-issue}22229[#22229])

  • Add REST high level client gradle submodule and first simple method {es-pull}22371[#22371]

  • Add doc_count to ParsedMatrixStats {es-pull}24952[#24952] (issue: {es-issue}24776[#24776])

  • Add fromXContent method to ClearScrollResponse {es-pull}24909[#24909]

  • ClearScrollRequest to implement ToXContentObject {es-pull}24907[#24907]

  • SearchScrollRequest to implement ToXContentObject {es-pull}24906[#24906] (issue: {es-issue}3889[#3889])

  • Add aggs parsers for high level REST Client {es-pull}24824[#24824] (issues: {es-issue}23965[#23965], {es-issue}23973[#23973], {es-issue}23974[#23974], {es-issue}24085[#24085], {es-issue}24160[#24160], {es-issue}24162[#24162], {es-issue}24182[#24182], {es-issue}24183[#24183], {es-issue}24208[#24208], {es-issue}24213[#24213], {es-issue}24239[#24239], {es-issue}24284[#24284], {es-issue}24312[#24312], {es-issue}24330[#24330], {es-issue}24365[#24365], {es-issue}24371[#24371], {es-issue}24442[#24442], {es-issue}24521[#24521], {es-issue}24524[#24524], {es-issue}24564[#24564], {es-issue}24583[#24583], {es-issue}24589[#24589], {es-issue}24648[#24648], {es-issue}24667[#24667], {es-issue}24675[#24675], {es-issue}24682[#24682], {es-issue}24700[#24700], {es-issue}24706[#24706], {es-issue}24717[#24717], {es-issue}24720[#24720], {es-issue}24738[#24738], {es-issue}24746[#24746], {es-issue}24789[#24789], {es-issue}24791[#24791], {es-issue}24794[#24794], {es-issue}24796[#24796], {es-issue}24822[#24822])

Java REST Client
  • Shade external dependencies in the rest client jar {es-pull}25780[#25780] (issue: {es-issue}25208[#25208])

  • RestClient uses system properties and system default SSLContext {es-pull}25757[#25757] (issue: {es-issue}23231[#23231])

  • Wrap rest httpclient with doPrivileged blocks {es-pull}22603[#22603] (issue: {es-issue}22116[#22116])

Logging
  • Prevent excessive disk consumption by log files {es-pull}25660[#25660]

  • Use LRU set to reduce repeat deprecation messages {es-pull}25474[#25474] (issue: {es-issue}25457[#25457])

Mapping
  • More efficient encoding of range fields. {es-pull}26470[#26470] (issue: {es-issue}26443[#26443])

  • Don’t detect source’s XContentType in DocumentParser.parseDocument() {es-pull}26880[#26880]

  • Better validation of copy_to. {es-pull}25983[#25983]

  • Optimize terms queries on ip addresses to use a PointInSetQuery whenever possible. {es-pull}25669[#25669] (issue: {es-issue}25667[#25667])

  • Loosen the restrictions on disabling _all in 6.x {es-pull}26259[#26259]

  • Date detection should not rely on a hardcoded set of characters. {es-pull}22171[#22171] (issue: {es-issue}1694[#1694])

  • Identify documents by their _id. {es-pull}24460[#24460]

Network
  • Add additional low-level logging handler {es-pull}26887[#26887]

  • Unwrap causes when maybe dying {es-pull}26884[#26884]

  • Move TransportStats accounting into TcpTransport {es-pull}25251[#25251]

  • Simplify connection closing and cleanups in TcpTransport {es-pull}25250[#25250]

  • Disable the Netty recycler in the client {es-pull}24793[#24793] (issues: {es-issue}22452[#22452], {es-issue}24721[#24721])

  • Remove Netty logging hack {es-pull}24653[#24653] (issues: {es-issue}24469[#24469], {es-issue}5624[#5624], {es-issue}6568[#6568], {es-issue}6696[#6696])

  • Isolate SocketPermissions to Netty {es-pull}23057[#23057]

  • Wrap netty accept/connect ops with doPrivileged {es-pull}22572[#22572] (issue: {es-issue}22116[#22116])

  • Replace Socket, ServerSocket, and HttpServer usages in tests with mocksocket versions {es-pull}22287[#22287] (issue: {es-issue}22116[#22116])

Packaging
  • Remove memlock suggestion from systemd service {es-pull}25979[#25979]

  • Set address space limit in systemd service file {es-pull}25975[#25975]

  • Version option should display if snapshot {es-pull}25970[#25970]

  • Ignore JVM options before checking Java version {es-pull}25969[#25969]

  • Also skip JAVA_TOOL_OPTIONS on Windows {es-pull}25968[#25968]

  • Introduce elasticsearch-env for Windows {es-pull}25958[#25958]

  • Introduce elasticsearch-env {es-pull}25815[#25815] (issue: {es-issue}20286[#20286])

  • Stop exporting HOSTNAME from scripts {es-pull}25807[#25807]

  • Set number of processes in systemd unit file {es-pull}24970[#24970] (issue: {es-issue}20874[#20874])

Parent/Child
  • Remove ParentJoinFieldSubFetchPhase {es-pull}25550[#25550] (issue: {es-issue}25363[#25363])

  • Support parent id being specified as number in the _source {es-pull}25547[#25547]

Percolator
  • Store the QueryBuilder’s Writable representation instead of its XContent representation {es-pull}25456[#25456]

  • Add support for selecting percolator query candidate matches containing wildcard / prefix queries {es-pull}25351[#25351]

Plugin Discovery EC2
  • Read ec2 discovery address from aws instance tags {es-pull}22743[#22743] (issue: {es-issue}22566[#22566])

Plugin Lang Painless
  • Allow Custom Whitelists in Painless {es-pull}25557[#25557]

  • Update Painless to Allow Augmentation from Any Class {es-pull}25360[#25360]

  • Add Needs Methods to Painless Script Context Factories {es-pull}25267[#25267]

  • Support Script Context Stateful Factory in Painless {es-pull}25233[#25233]

  • Generate Painless Factory for Creating Script Instances {es-pull}25120[#25120]

  • Update Painless to Use New Script Contexts {es-pull}25015[#25015]

  • Optimize instance creation in LambdaBootstrap {es-pull}24618[#24618]

  • Make Painless Compiler Use an Instance Per Context {es-pull}24972[#24972]

  • Make PainlessScript An Interface {es-pull}24966[#24966]

Plugin Repository GCS
  • GCS Repository: Add secure storage of credentials {es-pull}24697[#24697]

Plugin Repository HDFS
  • Add permission checks before reading from HDFS stream {es-pull}26716[#26716] (issue: {es-issue}26714[#26714])

  • Add doPrivilege blocks for socket connect ops in repository-hdfs {es-pull}22793[#22793] (issue: {es-issue}22116[#22116])

  • Add Kerberos support for Repo HDFS plugin [ISSUE] {es-pull}21990[#21990]

Plugin Repository S3
  • S3 Repository: Add back repository level credentials {es-pull}24609[#24609]

Plugins
  • Adjust SHA-512 supported format on plugin install {es-pull}27093[#27093]

  • Move tribe to a module {es-pull}25778[#25778]

  • Plugins can register pre-configured char filters {es-pull}25000[#25000] (issue: {es-issue}23658[#23658])

  • Add purge option to remove plugin CLI {es-pull}24981[#24981]

  • Allow plugins to register pre-configured tokenizers {es-pull}24751[#24751] (issues: {es-issue}24223[#24223], {es-issue}24572[#24572])

  • Move ReindexAction class to core {es-pull}24684[#24684] (issue: {es-issue}24578[#24578])

  • Make PreConfiguredTokenFilter harder to misuse {es-pull}24572[#24572] (issue: {es-issue}23658[#23658])

  • Plugins: Remove leniency for missing plugins dir {es-pull}24173[#24173]

  • Add doPrivilege blocks for socket connect operations in plugins {es-pull}22534[#22534] (issue: {es-issue}22116[#22116])

Query DSL
  • Make slop optional when parsing span_near query {es-pull}25677[#25677] (issue: {es-issue}25642[#25642])

  • Require a field when a seed is provided to the random_score function. {es-pull}25594[#25594] (issue: {es-issue}25240[#25240])

  • Add support for auto_generate_synonyms_phrase_query in match_query, multi_match_query, query_string and simple_query_string {es-pull}23147[#23147]

REST
  • Cat shards bytes {es-pull}26952[#26952]

  • Refactor PathTrie and RestController to use a single trie for all methods {es-pull}25459[#25459] (issue: {es-issue}24437[#24437])

  • Make ObjectParser support string to boolean conversion {es-pull}24668[#24668] (issue: {es-issue}21802[#21802])

Recovery
  • Introduce a History UUID as a requirement for ops based recovery {es-pull}26577[#26577] (issue: {es-issue}10708[#10708])

  • Goodbye, Translog Views {es-pull}25962[#25962]

  • Disallow multiple concurrent recovery attempts for same target shard {es-pull}25428[#25428]

  • Live primary-replica resync (no rollback) {es-pull}24841[#24841] (issue: {es-issue}10708[#10708])

  • Peer Recovery: remove maxUnsafeAutoIdTimestamp hand off {es-pull}24243[#24243] (issue: {es-issue}24149[#24149])

  • Introduce sequence-number-based recovery {es-pull}22484[#22484] (issue: {es-issue}10708[#10708])

Scripting
  • Scripting: Rename SearchScript.needsScores to needs_score {es-pull}25235[#25235]

  • Scripting: Add optional context parameter to put stored script requests {es-pull}25014[#25014]

  • Add New Security Script Settings {es-pull}24637[#24637] (issue: {es-issue}24532[#24532])

  • Add StatefulFactoryType as optional intermediate factory in script contexts {es-pull}24974[#24974] (issue: {es-issue}20426[#20426])

  • Make contexts available to ScriptEngine construction {es-pull}24896[#24896]

  • Make ScriptEngine.compile generic on the script context {es-pull}24873[#24873]

  • Add instance and compiled classes to script contexts {es-pull}24868[#24868]

Search
  • Add soft limit on allowed number of script fields in request {es-pull}26598[#26598] (issue: {es-issue}26390[#26390])

  • Add a soft limit for the number of requested doc-value fields {es-pull}26574[#26574] (issue: {es-issue}26390[#26390])

  • Rewrite search requests on the coordinating nodes {es-pull}25814[#25814] (issue: {es-issue}25791[#25791])

  • Ensure query resources are fetched asynchronously during rewrite {es-pull}25791[#25791]

  • Introduce a new Rewriteable interface to streamline rewriting {es-pull}25788[#25788]

  • Reduce the scope of QueryRewriteContext {es-pull}25787[#25787]

  • Reduce the overhead of timeouts and low-level search cancellation. {es-pull}25776[#25776]

  • Reduce profiling overhead. {es-pull}25772[#25772] (issue: {es-issue}24799[#24799])

  • Prevent can_match requests from sending to incompatible nodes {es-pull}25705[#25705] (issue: {es-issue}25704[#25704])

  • Add a shard filter search phase to pre-filter shards based on query rewriting {es-pull}25658[#25658]

  • Ensure we rewrite common queries to match_none if possible {es-pull}25650[#25650]

  • Limit the number of concurrent shard requests per search request {es-pull}25632[#25632]

  • Add cluster name validation to RemoteClusterConnection {es-pull}25568[#25568]

  • Speed up sorted scroll when the index sort matches the search sort {es-pull}25138[#25138] (issue: {es-issue}6720[#6720])

  • Leverage scorerSupplier when applicable. {es-pull}25109[#25109]

  • Add Cross Cluster Search support for scroll searches {es-pull}25094[#25094]

  • Track EWMA[1] of task execution time in search threadpool executor {es-pull}24989[#24989] (issue: {es-issue}24915[#24915])

  • Query range fields by doc values when they are expected to be more efficient than points {es-pull}24823[#24823] (issue: {es-issue}24314[#24314])

  • Search: Fairer balancing when routing searches by session ID {es-pull}24671[#24671] (issue: {es-issue}24642[#24642])

  • Add parsing from xContent to Suggest {es-pull}22903[#22903]

  • Add parsing from xContent to ShardSearchFailure {es-pull}22699[#22699]

  • Eliminate array access in tight loops when profiling is enabled. {es-pull}24959[#24959]

  • Support Multiple Inner Hits on a Field Collapse Request {es-pull}24517[#24517]

  • Expand cross cluster search indices for search requests to the concrete index or to it’s aliases {es-pull}24502[#24502]

Search Templates
  • Add max concurrent searches to multi template search {es-pull}24255[#24255] (issues: {es-issue}20912[#20912], {es-issue}21907[#21907])

Sequence IDs
  • Roll translog generation on primary promotion {es-pull}27313[#27313]

  • Restoring from snapshot should force generation of a new history uuid {es-pull}26694[#26694] (issues: {es-issue}10708[#10708], {es-issue}26544[#26544], {es-issue}26557[#26557], {es-issue}26577[#26577])

  • Add global checkpoint tracking on the primary {es-pull}26666[#26666] (issue: {es-issue}26591[#26591])

  • Introduce global checkpoint background sync {es-pull}26591[#26591] (issues: {es-issue}26573[#26573], {es-issue}26630[#26630], {es-issue}26666[#26666])

  • Move UNASSIGNED_SEQ_NO and NO_OPS_PERFORMED to SequenceNumbers` {es-pull}26494[#26494] (issue: {es-issue}10708[#10708])

  • Move primary term from ReplicationRequest to ConcreteShardRequest {es-pull}25822[#25822]

  • Add reason to global checkpoint updates on replica {es-pull}25612[#25612] (issue: {es-issue}10708[#10708])

  • Introduce primary/replica mode for GlobalCheckPointTracker {es-pull}25468[#25468]

  • Throw back replica local checkpoint on new primary {es-pull}25452[#25452] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Update global checkpoint when increasing primary term on replica {es-pull}25422[#25422] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Enable a long translog retention policy by default {es-pull}25294[#25294] (issues: {es-issue}10708[#10708], {es-issue}25147[#25147])

  • Introduce primary context {es-pull}25122[#25122] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Block older operations on primary term transition {es-pull}24779[#24779] (issue: {es-issue}10708[#10708])

  • Block global checkpoint advances when recovering {es-pull}24404[#24404] (issue: {es-issue}10708[#10708])

  • Add primary term to doc write response {es-pull}24171[#24171] (issue: {es-issue}10708[#10708])

  • Preserve multiple translog generations {es-pull}24015[#24015] (issue: {es-issue}10708[#10708])

  • Introduce translog generation rolling {es-pull}23606[#23606] (issue: {es-issue}10708[#10708])

  • Replicate write failures {es-pull}23314[#23314]

  • Introduce sequence-number-aware translog {es-pull}22822[#22822] (issue: {es-issue}10708[#10708])

  • Introduce translog no-op {es-pull}22291[#22291] (issue: {es-issue}10708[#10708])

  • Tighten sequence numbers recovery {es-pull}22212[#22212] (issue: {es-issue}10708[#10708])

  • Add BWC layer to seq no infra and enable BWC tests {es-pull}22185[#22185] (issue: {es-issue}21670[#21670])

  • Add internal _primary_term doc values field, fix _seq_no indexing {es-pull}21637[#21637] (issues: {es-issue}10708[#10708], {es-issue}21480[#21480])

  • Add global checkpoint to translog checkpoints {es-pull}21254[#21254]

  • Sequence numbers commit data for Lucene uses Iterable interface {es-pull}20793[#20793] (issue: {es-issue}10708[#10708])

  • Simplify GlobalCheckpointService and properly hook it for cluster state updates {es-pull}20720[#20720]

  • Fill gaps on primary promotion {es-pull}24945[#24945] (issue: {es-issue}10708[#10708])

  • Introduce clean transition on primary promotion {es-pull}24925[#24925] (issue: {es-issue}10708[#10708])

  • Guarantee that translog generations are seqNo conflict free {es-pull}24825[#24825] (issues: {es-issue}10708[#10708], {es-issue}24779[#24779])

  • Inline global checkpoints {es-pull}24513[#24513] (issue: {es-issue}10708[#10708])

Settings
  • Add disk threshold settings validation {es-pull}25600[#25600] (issue: {es-issue}25560[#25560])

  • Enable cross-setting validation {es-pull}25560[#25560] (issue: {es-issue}25541[#25541])

  • Validate transport.profiles.* settings {es-pull}25508[#25508]

  • Cleanup network / transport related settings {es-pull}25489[#25489]

  • Emit settings deprecation logging at most once {es-pull}25457[#25457]

  • IndexMetaData: Introduce internal format index setting {es-pull}25292[#25292]

  • Persist created keystore on startup unless keystore is present {es-pull}26253[#26253] (issue: {es-issue}26126[#26126])

  • Settings: Add keystore.seed auto generated secure setting {es-pull}26149[#26149]

  • Settings: Add keystore creation to add commands {es-pull}26126[#26126]

Snapshot/Restore
  • Fixed references to Multi Index Syntax {es-pull}27283[#27283]

  • Improves snapshot logging and snapshot deletion error handling {es-pull}25264[#25264]

  • Enhances get snapshots API to allow retrieving repository index only {es-pull}24477[#24477] (issue: {es-issue}24288[#24288])

Stats
  • Update IndexShard#refreshMetric via a ReferenceManager.RefreshListener {es-pull}25083[#25083] (issues: {es-issue}24806[#24806], {es-issue}25052[#25052])

  • Expose disk usage estimates in nodes stats {es-pull}22081[#22081] (issue: {es-issue}8686[#8686])

Store
  • Remote support for lucene versions without checksums {es-pull}24021[#24021]

Suggesters
  • Remove deprecated _suggest endpoint {es-pull}22203[#22203] (issue: {es-issue}20305[#20305])

Task Manager
  • Add descriptions to bulk tasks {es-pull}22059[#22059] (issue: {es-issue}21768[#21768])

Translog
  • Translog file recovery should not rely on lucene commits {es-pull}25005[#25005] (issue: {es-issue}24950[#24950])

Bug Fixes

Aggregations
  • Do not delegate a null scorer to LeafBucketCollectors {es-pull}26747[#26747] (issue: {es-issue}26611[#26611])

  • Create weights lazily in filter and filters aggregation {es-pull}26983[#26983]

  • Fix IndexOutOfBoundsException in histograms for NaN doubles (#26787) {es-pull}26856[#26856] (issue: {es-issue}26787[#26787])

  • Scripted_metric _agg parameter disappears if params are provided {es-pull}19863[#19863] (issue: {es-issue}19768[#19768])

  • Fixes array out of bounds for value count agg {es-pull}26038[#26038] (issue: {es-issue}17379[#17379])

  • Aggregations bug: Significant_text fails on arrays of text. {es-pull}25030[#25030] (issue: {es-issue}25029[#25029])

  • Check bucket metric ages point to a multi bucket agg {es-pull}26215[#26215] (issue: {es-issue}25775[#25775])

  • Terms aggregation should remap global ordinal buckets when a sub-aggregator is used to sort the terms {es-pull}24941[#24941] (issue: {es-issue}24788[#24788])

  • Correctly set doc_count when MovAvg "predicts" values on existing buckets {es-pull}24892[#24892] (issue: {es-issue}24327[#24327])

  • DateHistogram: Fix extended_bounds with offset {es-pull}23789[#23789] (issue: {es-issue}23776[#23776])

  • Fix ArrayIndexOutOfBoundsException when no ranges are specified in the query {es-pull}23241[#23241] (issue: {es-issue}22881[#22881])

Aliases
  • mget with an alias shouldn’t ignore alias routing {es-pull}25697[#25697] (issue: {es-issue}25696[#25696])

  • GET aliases should 404 if aliases are missing {es-pull}25043[#25043] (issue: {es-issue}24644[#24644])

Allocation
  • Fix DiskThresholdMonitor flood warning {es-pull}26204[#26204] (issue: {es-issue}26201[#26201])

  • Allow wildcards for shard IP filtering {es-pull}26187[#26187] (issues: {es-issue}22591[#22591], {es-issue}26184[#26184])

Analysis
  • Pre-configured shingle filter should disable graph analysis {es-pull}25853[#25853] (issue: {es-issue}25555[#25555])

  • PatternAnalyzer should lowercase wildcard queries when lowercase is true. {es-pull}24967[#24967]

CAT API
  • Fix NPE for /_cat/indices when no primary shard {es-pull}26953[#26953] (issue: {es-issue}26942[#26942])

CRUD
  • Serialize and expose timeout of acknowledged requests in REST layer {es-pull}26189[#26189] (issue: {es-issue}26213[#26213])

  • Fix silent loss of last command to _bulk and _msearch due to missing newline {es-pull}25740[#25740] (issue: {es-issue}7601[#7601])

Cache
  • Reduce the default number of cached queries. {es-pull}26949[#26949] (issue: {es-issue}26938[#26938])

  • fix bug of weight computation {es-pull}24856[#24856]

Circuit Breakers
  • Checks the circuit breaker before allocating bytes for a new big array {es-pull}25010[#25010] (issue: {es-issue}24790[#24790])

Cluster
  • Register setting cluster.indices.tombstones.size {es-pull}26193[#26193] (issue: {es-issue}26191[#26191])

Core
  • Correctly encode warning headers {es-pull}27269[#27269] (issue: {es-issue}27244[#27244])

  • Fix cache compute if absent for expired entries {es-pull}26516[#26516]

  • Timed runnable should delegate to abstract runnable {es-pull}27095[#27095] (issue: {es-issue}27069[#27069])

  • Stop invoking non-existent syscall {es-pull}27016[#27016] (issue: {es-issue}20179[#20179])

  • MetaData Builder doesn’t properly prevent an alias with the same name as an index {es-pull}26804[#26804]

  • Release operation permit on thread-pool rejection {es-pull}25930[#25930] (issue: {es-issue}25863[#25863])

  • Node should start up despite of a lingering .es_temp_file {es-pull}21210[#21210] (issue: {es-issue}21007[#21007])

  • Fix cache expire after access {es-pull}24546[#24546]

Dates
  • Fix typo in date format {es-pull}26503[#26503] (issue: {es-issue}26500[#26500])

Discovery
  • MasterNodeChangePredicate should use the node instance to detect master change {es-pull}25877[#25877] (issue: {es-issue}25471[#25471])

Engine
  • Die with dignity while merging {es-pull}27265[#27265] (issue: {es-issue}19272[#19272])

  • Engine - do not index operations with seq# lower than the local checkpoint into lucene {es-pull}25827[#25827] (issues: {es-issue}1[#1], {es-issue}2[#2], {es-issue}25592[#25592])

Geo
  • Fix typo in GeoUtils#isValidLongitude {es-pull}25121[#25121]

Highlighting
  • Fix percolator highlight sub fetch phase to not highlight query twice {es-pull}26622[#26622]

  • FastVectorHighlighter should not cache the field query globally {es-pull}25197[#25197] (issue: {es-issue}25171[#25171])

  • Higlighters: Fix MultiPhrasePrefixQuery rewriting {es-pull}25103[#25103] (issue: {es-issue}25088[#25088])

  • Fix nested query highlighting {es-pull}26305[#26305] (issue: {es-issue}26230[#26230])

Index APIs
  • Shrink API should ignore templates {es-pull}25380[#25380] (issue: {es-issue}25035[#25035])

  • Rollover max docs should only count primaries {es-pull}24977[#24977] (issue: {es-issue}24217[#24217])

  • Validates updated settings on closed indices {es-pull}24487[#24487] (issue: {es-issue}23787[#23787])

Ingest
  • date processor should not fail if timestamp is specified as json number {es-pull}26986[#26986] (issue: {es-issue}26967[#26967])

  • date_index_name processor should not fail if timestamp is specified as json number {es-pull}26910[#26910] (issue: {es-issue}26890[#26890])

  • Sort Processor does not have proper behavior with targetField {es-pull}25237[#25237] (issue: {es-issue}24133[#24133])

  • fix grok’s pattern parsing to validate pattern names in expression {es-pull}25063[#25063] (issue: {es-issue}22831[#22831])

  • Remove support for Visio and potm files {es-pull}22079[#22079] (issue: {es-issue}22077[#22077])

  • Fix floating-point error when DateProcessor parses UNIX {es-pull}24947[#24947]

  • add option for _ingest.timestamp to use new ZonedDateTime (5.x backport) {es-pull}24030[#24030] (issues: {es-issue}23168[#23168], {es-issue}23174[#23174])

Inner Hits
  • Do not allow inner hits that fetch _source and have a non nested object field as parent {es-pull}25749[#25749] (issue: {es-issue}25315[#25315])

  • When fetching nested inner hits only access stored fields when needed {es-pull}25864[#25864] (issue: {es-issue}6[#6])

  • If size / offset are out of bounds just do a plain count {es-pull}20556[#20556] (issue: {es-issue}20501[#20501])

  • Fix Source filtering in new field collapsing feature {es-pull}24068[#24068] (issue: {es-issue}24063[#24063])

Internal
  • Bump version to 6.0.1 [OPEN] {es-pull}27386[#27386]

  • IndexShard.routingEntry should only be updated once all internal state is ready {es-pull}26776[#26776]

  • Catch exceptions and inform handler in RemoteClusterConnection#collectNodes {es-pull}26725[#26725] (issue: {es-issue}26700[#26700])

  • Internal: Add versionless alias for rest client codebase in policy files {es-pull}26521[#26521]

  • Upgrade Lucene to version 7.0.1 {es-pull}26926[#26926]

  • Fix BytesReferenceStreamInput#skip with offset {es-pull}25634[#25634]

  • Fix race condition in RemoteClusterConnection node supplier {es-pull}25432[#25432]

  • Initialise empty lists in BaseTaskResponse constructor {es-pull}25290[#25290]

  • Extract a common base class for scroll executions {es-pull}24979[#24979] (issue: {es-issue}16555[#16555])

  • Obey lock order if working with store to get metadata snapshots {es-pull}24787[#24787] (issue: {es-issue}24481[#24481])

  • Fix Version based BWC and set correct minCompatVersion {es-pull}24732[#24732]

  • Fix _field_caps serialization in order to support cross cluster search {es-pull}24722[#24722]

  • Avoid race when shutting down controller processes {es-pull}24579[#24579]

  • Fix handling of document failure exception in InternalEngine {es-pull}22718[#22718]

  • Ensure remote cluster is connected before fetching _field_caps {es-pull}24845[#24845] (issue: {es-issue}24763[#24763])

Java API
  • BulkProcessor flush runnable preserves the thread context from creation time {es-pull}26718[#26718] (issue: {es-issue}26596[#26596])

Java High Level REST Client
  • Make RestHighLevelClient’s Request class public {es-pull}26627[#26627] (issue: {es-issue}26455[#26455])

  • Forbid direct usage of ContentType.create() methods {es-pull}26457[#26457] (issues: {es-issue}22769[#22769], {es-issue}26438[#26438])

  • Make ShardSearchTarget optional when parsing ShardSearchFailure {es-pull}27078[#27078] (issue: {es-issue}27055[#27055])

Java REST Client
  • Better message text for ResponseException {es-pull}26564[#26564]

  • rest-client-sniffer: configurable threadfactory {es-pull}26897[#26897]

Logging
  • Allow not configure logging without config {es-pull}26209[#26209] (issues: {es-issue}20575[#20575], {es-issue}24076[#24076])

Machine Learning
  • Fixed a race condition when simultaneous close requests are made for the same job.

Mapping
  • Allow copying from a field to another field that belongs to the same nested object. {es-pull}26774[#26774] (issue: {es-issue}26763[#26763])

  • Fixed bug that mapper_parsing_exception is thrown for numeric field with ignore_malformed=true when inserting "NaN" {es-pull}25967[#25967] (issue: {es-issue}25289[#25289])

  • Coerce decimal strings for whole number types by truncating the decimal part {es-pull}25835[#25835] (issue: {es-issue}25819[#25819])

  • Fix parsing of ip range queries. {es-pull}25768[#25768] (issue: {es-issue}25636[#25636])

  • Disable date field mapping changing {es-pull}25285[#25285] (issue: {es-issue}25271[#25271])

  • Correctly enable _all for older 5.x indices {es-pull}25087[#25087] (issue: {es-issue}25068[#25068])

  • token_count datatype should handle null value {es-pull}25046[#25046] (issue: {es-issue}24928[#24928])

  • keep _parent field while updating child type mapping {es-pull}24407[#24407] (issue: {es-issue}23381[#23381])

  • ICUCollationKeywordFieldMapper use SortedSetDocValuesField {es-pull}26267[#26267]

  • Fix serialization of the _all field. {es-pull}26143[#26143] (issue: {es-issue}26136[#26136])

More Like This
  • Pass over _routing value with more_like_this items to be retrieved {es-pull}24679[#24679] (issue: {es-issue}23699[#23699])

NOT CLASSIFIED
  • DocumentMissingException during Logstash scripted upsert [ISSUE] {es-pull}27148[#27148]

  • An assertion trips when master opens an index from before 5.x [ISSUE] {es-pull}24809[#24809]

Nested Docs
  • In case of a single type the _id field should be added to the nested document instead of _uid field {es-pull}25149[#25149]

  • Inner hits source filtering not working [ISSUE] {es-pull}23090[#23090]

Network
  • Fixed ByteBuf leaking in org.elasticsearch.http.netty4.Netty4HttpRequestHandler {es-pull}27222[#27222] (issues: {es-issue}3[#3], {es-issue}4[#4], {es-issue}5[#5], {es-issue}6[#6])

  • Check for closed connection while opening {es-pull}26932[#26932]

  • Ensure pending transport handlers are invoked for all channel failures {es-pull}25150[#25150]

  • Notify onConnectionClosed rather than onNodeDisconnect to prune transport handlers {es-pull}24639[#24639] (issues: {es-issue}24557[#24557], {es-issue}24575[#24575], {es-issue}24632[#24632])

  • Release pipelined http responses on close {es-pull}26226[#26226]

  • Fix error message if an incompatible node connects {es-pull}24884[#24884]

Packaging
  • Fix handling of Windows paths containing parentheses {es-pull}26916[#26916] (issue: {es-issue}26454[#26454])

  • Exit Windows scripts promptly on failure {es-pull}25959[#25959]

  • Pass config path as a system property {es-pull}25943[#25943]

  • ES_HOME needs to be made absolute before attempt at traversal {es-pull}25865[#25865]

  • Fix elasticsearch-keystore handling of path.conf {es-pull}25811[#25811]

  • Stop disabling explicit GC {es-pull}25759[#25759]

  • Avoid failing install if system-sysctl is masked {es-pull}25657[#25657] (issue: {es-issue}24234[#24234])

  • Get short path name for native controllers {es-pull}25344[#25344]

  • When stopping via systemd only kill the JVM, not its control group {es-pull}25195[#25195]

  • remove remaining references to scripts directory {es-pull}24771[#24771]

  • Handle parentheses in batch file path {es-pull}24731[#24731] (issue: {es-issue}24712[#24712])

  • Detect modified keystore on package removal {es-pull}26300[#26300]

  • Create keystore on RPM and Debian package install {es-pull}26282[#26282]

  • Add safer empty variable checking for Windows {es-pull}26268[#26268] (issue: {es-issue}26261[#26261])

  • Export HOSTNAME environment variable {es-pull}26262[#26262] (issues: {es-issue}25807[#25807], {es-issue}26255[#26255])

  • Fix daemonization command status test {es-pull}26196[#26196] (issue: {es-issue}26080[#26080])

  • Set RuntimeDirectory in systemd service {es-pull}23526[#23526]

Parent/Child
  • The default _parent field should not try to load global ordinals {es-pull}25851[#25851] (issue: {es-issue}25849[#25849])

Percolator
  • Also support query extraction for queries wrapped inside a ESToParentBlockJoinQuery {es-pull}26754[#26754]

  • Fix range queries with date range based on current time in percolator queries. {es-pull}24666[#24666] (issue: {es-issue}23921[#23921])

Plugin Analysis Kuromoji
  • Fix kuromoji default stoptags {es-pull}26600[#26600] (issue: {es-issue}26519[#26519])

Plugin Analysis Phonetic
  • Fix beidermorse phonetic token filter for unspecified languageset {es-pull}27112[#27112] (issue: {es-issue}26771[#26771])

Plugin Discovery File
  • Fix discovery-file plugin to use custom config path {es-pull}26662[#26662] (issue: {es-issue}26660[#26660])

Plugin Ingest Attachment
  • Add missing mime4j library {es-pull}22764[#22764] (issue: {es-issue}22077[#22077])

Plugin Lang Painless
  • Painless: allow doubles to be casted to longs. {es-pull}25936[#25936]

Plugin Repository Azure
  • Azure snapshots can not be restored anymore {es-pull}26778[#26778] (issues: {es-issue}22858[#22858], {es-issue}26751[#26751], {es-issue}26777[#26777])

  • Snapshot : azure module - accelerate the listing of files (used in delete snapshot) {es-pull}25710[#25710] (issue: {es-issue}25424[#25424])

  • Use Azure upload method instead of our own implementation {es-pull}26751[#26751]

  • Make calls to CloudBlobContainer#exists privileged {es-pull}25937[#25937] (issue: {es-issue}25931[#25931])

Plugin Repository GCS
  • Ensure that gcs client creation is privileged {es-pull}25938[#25938] (issue: {es-issue}25932[#25932])

Plugin Repository HDFS
  • Add Log4j to SLF4J binding for repository-hdfs {es-pull}26514[#26514] (issue: {es-issue}26512[#26512])

  • Upgrading HDFS Repository Plugin to use HDFS 2.8.1 Client {es-pull}25497[#25497] (issue: {es-issue}25450[#25450])

Plugin Repository S3
  • Avoid SecurityException in repository-S3 on DefaultS3OutputStream.flush() {es-pull}25254[#25254] (issue: {es-issue}25192[#25192])

  • Wrap getCredentials() in a doPrivileged() block {es-pull}23297[#23297] (issues: {es-issue}22534[#22534], {es-issue}23271[#23271])

Plugins
  • X-Pack plugin download fails on Windows desktop [ISSUE] {es-pull}24570[#24570]

  • Fix plugin installation permissions {es-pull}24527[#24527] (issue: {es-issue}24480[#24480])

Query DSL
  • Fixed incomplete JSON body on count request making org.elasticsearch.rest.action.RestActions#parseTopLevelQueryBuilder go into endless loop {es-pull}26680[#26680] (issue: {es-issue}26083[#26083])

  • SpanNearQueryBuilder should return the inner clause when a single clause is provided {es-pull}25856[#25856] (issue: {es-issue}25630[#25630])

  • Refactor field expansion for match, multi_match and query_string query {es-pull}25726[#25726] (issues: {es-issue}25551[#25551], {es-issue}25556[#25556])

  • WrapperQueryBuilder should also rewrite the parsed query {es-pull}25480[#25480]

REST
  • Rest test fixes {es-pull}27354[#27354]

  • Fix inconsistencies in the rest api specs for cat.snapshots {es-pull}26996[#26996] (issues: {es-issue}25737[#25737], {es-issue}26923[#26923])

  • Fix inconsistencies in the rest api specs for *_script {es-pull}26971[#26971] (issue: {es-issue}26923[#26923])

  • exists template needs a template name {es-pull}25988[#25988]

  • Fix handling of invalid error trace parameter {es-pull}25785[#25785] (issue: {es-issue}25774[#25774])

  • Fix handling of exceptions thrown on HEAD requests {es-pull}25172[#25172] (issue: {es-issue}21125[#21125])

  • Fixed NPEs caused by requests without content. {es-pull}23497[#23497] (issue: {es-issue}24701[#24701])

  • Fix get mappings HEAD requests {es-pull}23192[#23192] (issue: {es-issue}21125[#21125])

Recovery
  • Close translog view after primary-replica resync {es-pull}25862[#25862] (issue: {es-issue}24841[#24841])

Reindex API
  • Fix update_by_query’s default size parameter {es-pull}26784[#26784] (issue: {es-issue}26761[#26761])

  • Reindex: don’t duplicate _source parameter {es-pull}24629[#24629] (issue: {es-issue}24628[#24628])

  • Add qa module that tests reindex-from-remote against pre-5.0 versions of Elasticsearch {es-pull}24561[#24561] (issues: {es-issue}23828[#23828], {es-issue}24520[#24520])

Scroll
  • Fix single shard scroll within a cluster with nodes in version >= 5.3 and ⇐ 5.3 {es-pull}24512[#24512]

Search
  • Fail query when a sort is provided in conjunction with rescorers {es-pull}26510[#26510]

  • Let search phases override max concurrent requests {es-pull}26484[#26484] (issue: {es-issue}26198[#26198])

  • Avoid stack overflow on search phases {es-pull}27069[#27069] (issue: {es-issue}27042[#27042])

  • Fix search_after with geo distance sorting {es-pull}26891[#26891]

  • Fix serialization errors when cross cluster search goes to a single shard {es-pull}26881[#26881] (issue: {es-issue}26833[#26833])

  • Early termination with index sorting should not set terminated_early in the response {es-pull}26597[#26597] (issue: {es-issue}26408[#26408])

  • Format doc values fields. {es-pull}22146[#22146]

  • Fix term(s) query for range field {es-pull}25918[#25918]

  • Caching a MinDocQuery can lead to wrong results. {es-pull}25909[#25909]

  • Fix random score generation when no seed is provided. {es-pull}25908[#25908]

  • Merge FunctionScoreQuery and FiltersFunctionScoreQuery {es-pull}25889[#25889] (issues: {es-issue}15709[#15709], {es-issue}23628[#23628])

  • Respect cluster alias in _index aggs and queries {es-pull}25885[#25885] (issue: {es-issue}25606[#25606])

  • First increment shard stats before notifying and potentially sending response {es-pull}25818[#25818]

  • Remove assertion about deviation when casting to a float. {es-pull}25806[#25806] (issue: {es-issue}25330[#25330])

  • Prevent skipping shards if a suggest builder is present {es-pull}25739[#25739] (issue: {es-issue}25658[#25658])

  • Ensure remote cluster alias is preserved in inner hits aggs {es-pull}25627[#25627] (issue: {es-issue}25606[#25606])

  • Do not search locally if remote index pattern resolves to no indices {es-pull}25436[#25436] (issue: {es-issue}25426[#25426])

  • Adds check for negative search request size {es-pull}25397[#25397] (issue: {es-issue}22530[#22530])

  • Make sure range queries are correctly profiled. {es-pull}25108[#25108]

  • Fix RangeFieldMapper rangeQuery to properly handle relations {es-pull}24808[#24808] (issue: {es-issue}24744[#24744])

  • Fix ExpandSearchPhase when response contains no hits {es-pull}24688[#24688] (issue: {es-issue}24672[#24672])

  • Refactor simple_query_string to handle text part like multi_match and query_string {es-pull}26145[#26145] (issue: {es-issue}25726[#25726])

  • Fix exists in query_string on empty indices. {es-pull}25993[#25993] (issue: {es-issue}25956[#25956])

  • Fix script field sort returning Double.MAX_VALUE for all documents {es-pull}24942[#24942] (issue: {es-issue}24940[#24940])

  • Compute the took time of the query after the expand phase of field collapsing {es-pull}24902[#24902] (issue: {es-issue}24900[#24900])

Security
  • Prevented 6.0 nodes from joining clusters with un-upgraded version 5 .security indices. For upgrade instructions, see {stack-ref}/upgrading-elastic-stack.html[Upgrading the Elastic Stack].

  • Enabled read-only access to the index audit log by the _xpack internal user. For more information, see [internal-users].

  • Updated the concrete security index such that it is now always named .security-6. In 6.0 beta and RC releases, it was sometimes named .security-v6.

  • Fixed handling of exceptions when retrieving roles from a native roles store. For more information about configuring a native realm, see [native-realm].

Sequence IDs
  • Fire global checkpoint sync under system context {es-pull}26984[#26984]

  • Fix pre-6.0 response to unknown replication actions {es-pull}25744[#25744] (issue: {es-issue}10708[#10708])

  • Track local checkpoint on primary immediately {es-pull}25434[#25434] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355], {es-issue}25415[#25415])

  • Initialize max unsafe auto ID timestamp on shrink {es-pull}25356[#25356] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Use correct primary term for replicating NOOPs {es-pull}25128[#25128]

  • Handle already closed while filling gaps {es-pull}25021[#25021] (issue: {es-issue}24925[#24925])

  • TranslogWriter.assertNoSeqNumberConflict failure [ISSUE] {es-pull}26710[#26710]

  • Avoid losing ops in file-based recovery {es-pull}22945[#22945] (issue: {es-issue}22484[#22484])

  • Handle primary failure handling replica response {es-pull}24926[#24926] (issue: {es-issue}24935[#24935])

Settings
  • Emit settings deprecation logging on empty update {es-pull}27017[#27017] (issue: {es-issue}26419[#26419])

  • Fix filtering for ListSetting {es-pull}26914[#26914]

  • Fix settings serialization to not serialize secure settings or not take the total size into account {es-pull}25323[#25323]

  • Keystore CLI should use the AddFileKeyStoreCommand for files {es-pull}25298[#25298]

  • Allow resetting settings that use an IP validator {es-pull}24713[#24713] (issue: {es-issue}24709[#24709])

  • Updating an unrecognized setting should error out with that reason [ISSUE] {es-pull}25607[#25607]

  • Settings: Fix setting groups to include secure settings {es-pull}25076[#25076] (issue: {es-issue}25069[#25069])

Similarities
  • Add boolean similarity to built in similarity types {es-pull}26613[#26613]

Snapshot/Restore
  • Snapshot/Restore: better handle incorrect chunk_size settings in FS repo {es-pull}26844[#26844] (issue: {es-issue}26843[#26843])

  • Snapshot/Restore: Ensure that shard failure reasons are correctly stored in CS {es-pull}25941[#25941] (issue: {es-issue}25878[#25878])

  • Output all empty snapshot info fields if in verbose mode {es-pull}25455[#25455] (issue: {es-issue}24477[#24477])

  • Remove redundant and broken MD5 checksum from repository-s3 {es-pull}25270[#25270] (issue: {es-issue}25269[#25269])

  • Consolidates the logic for cleaning up snapshots on master election {es-pull}24894[#24894] (issue: {es-issue}24605[#24605])

  • Removes completed snapshot from cluster state on master change {es-pull}24605[#24605] (issue: {es-issue}24452[#24452])

  • Keep snapshot restore state and routing table in sync {es-pull}20836[#20836] (issue: {es-issue}19774[#19774])

  • Master failover during snapshotting could leave the snapshot incomplete [OPEN] [ISSUE] {es-pull}25281[#25281]

  • Fix inefficient (worst case exponential) loading of snapshot repository {es-pull}24510[#24510] (issue: {es-issue}24509[#24509])

Stats
  • Fix RestGetAction name typo {es-pull}27266[#27266]

  • Keep cumulative elapsed scroll time in microseconds {es-pull}27068[#27068] (issue: {es-issue}27046[#27046])

  • _nodes/stats should not fail due to concurrent AlreadyClosedException {es-pull}25016[#25016] (issue: {es-issue}23099[#23099])

  • Avoid double decrement on current query counter {es-pull}24922[#24922] (issues: {es-issue}22996[#22996], {es-issue}24872[#24872])

  • Adjust available and free bytes to be non-negative on huge FSes {es-pull}24911[#24911] (issues: {es-issue}23093[#23093], {es-issue}24453[#24453])

Suggesters
  • Fix division by zero in phrase suggester that causes assertion to fail {es-pull}27149[#27149]

  • Context suggester should filter doc values field {es-pull}25858[#25858] (issue: {es-issue}25404[#25404])

  • Fix context suggester to read values from keyword type field {es-pull}24200[#24200] (issue: {es-issue}24129[#24129])

Templates
  • Tests: Fix FullClusterRestartIT.testSnapshotRestore test failing in 6.x {es-pull}27218[#27218] (issue: {es-issue}27213[#27213])

Translog
  • Fix Translog.Delete serialization for sequence numbers {es-pull}22543[#22543]

Upgrade API
  • Upgrade API: fix excessive logging and unnecessary template updates {es-pull}26698[#26698] (issue: {es-issue}26673[#26673])

Regressions

Bulk
  • Only re-parse operation if a mapping update was needed {es-pull}23832[#23832] (issue: {es-issue}23665[#23665])

Highlighting
  • Fix Fast Vector Highlighter NPE on match phrase prefix {es-pull}25116[#25116] (issue: {es-issue}25088[#25088])

Search
  • Always use DisjunctionMaxQuery to build cross fields disjunction {es-pull}25115[#25115] (issue: {es-issue}23966[#23966])

Sequence IDs
  • Indexing performance degradation in 6.0.0-beta1 [ISSUE] {es-pull}26339[#26339]

Upgrades

Core
  • Upgrade to Lucene 7.0.0 {es-pull}26744[#26744]

  • Upgrade to lucene-7.0.0-snapshot-d94a5f0. {es-pull}26441[#26441]

  • Upgrade to lucene-7.0.0-snapshot-a128fcb. {es-pull}26090[#26090]

  • Upgrade to a Lucene 7 snapshot {es-pull}24089[#24089] (issues: {es-issue}23966[#23966], {es-issue}24086[#24086], {es-issue}24087[#24087], {es-issue}24088[#24088])

Logging
  • Upgrade to Log4j 2.9.1 {es-pull}26750[#26750] (issues: {es-issue}109[#109], {es-issue}26464[#26464], {es-issue}26467[#26467])

  • Upgrade to Log4j 2.9.0 {es-pull}26450[#26450] (issue: {es-issue}23798[#23798])

Network
  • Upgrade to Netty 4.1.13.Final {es-pull}25581[#25581] (issues: {es-issue}24729[#24729], {es-issue}6866[#6866])

  • Upgrade to Netty 4.1.11.Final {es-pull}24652[#24652]

Plugin Ingest Attachment
  • Update to Tika 1.14 {es-pull}21591[#21591] (issue: {es-issue}20390[#20390])

Upgrade API
  • Improve stability and logging of TemplateUpgradeServiceIT tests {es-pull}25386[#25386] (issue: {es-issue}25382[#25382])

{es} version 6.0.0-rc2

Breaking Changes

Inner Hits
  • Return the _source of inner hit nested as is without wrapping it into its full path context {es-pull}26982[#26982] (issues: {es-issue}26102[#26102], {es-issue}26944[#26944])

Enhancements

Core
  • Ignore .DS_Store files on macOS {es-pull}27108[#27108] (issue: {es-issue}23982[#23982])

Index Templates
  • Fix error message for a put index template request without index_patterns {es-pull}27102[#27102] (issue: {es-issue}27100[#27100])

Machine Learning
  • Added the xpack.ml.max_model_memory_limit setting, which can be dynamically updated. For more information, see [ml-settings].

  • Added checks and error messages for the ml.enabled and ml.max_open_jobs node attributes. These are reserved for internal use and their values should be set by using xpack.ml.enabled and xpack.ml.max_open_jobs {ml} settings.

Mapping
  • Don’t detect source’s XContentType in DocumentParser.parseDocument() {es-pull}26880[#26880]

Network
  • Add additional low-level logging handler {es-pull}26887[#26887]

  • Unwrap causes when maybe dying {es-pull}26884[#26884]

Plugins
  • Adjust SHA-512 supported format on plugin install {es-pull}27093[#27093]

REST
  • Cat shards bytes {es-pull}26952[#26952]

Security
  • Improved the error messages that are returned by the setup-passwords command.

Watcher
  • Added verification that the required templates exist before {watcher} starts. For more information, see [scripts-templates].

  • Added the xpack.watcher.history.cleaner_service.enabled setting. You can use this setting to enable or disable the cleaner service, which removes previous versions of {watcher} indices (for example, .watcher-history*) when it determines that they are old. For more information, see [notification-settings].

Bug Fixes

Aggregations
  • Create weights lazily in filter and filters aggregation {es-pull}26983[#26983]

  • Fix IndexOutOfBoundsException in histograms for NaN doubles (#26787) {es-pull}26856[#26856] (issue: {es-issue}26787[#26787])

  • Scripted_metric _agg parameter disappears if params are provided {es-pull}19863[#19863] (issue: {es-issue}19768[#19768])

CAT API
  • Fix NPE for /_cat/indices when no primary shard {es-pull}26953[#26953] (issue: {es-issue}26942[#26942])

Cache
  • Reduce the default number of cached queries. {es-pull}26949[#26949] (issue: {es-issue}26938[#26938])

Core
  • Timed runnable should delegate to abstract runnable {es-pull}27095[#27095] (issue: {es-issue}27069[#27069])

  • Stop invoking non-existent syscall {es-pull}27016[#27016] (issue: {es-issue}20179[#20179])

  • MetaData Builder doesn’t properly prevent an alias with the same name as an index {es-pull}26804[#26804]

Ingest
  • date processor should not fail if timestamp is specified as json number {es-pull}26986[#26986] (issue: {es-issue}26967[#26967])

  • date_index_name processor should not fail if timestamp is specified as json number {es-pull}26910[#26910] (issue: {es-issue}26890[#26890])

Internal
  • Upgrade Lucene to version 7.0.1 {es-pull}26926[#26926]

Java High Level REST Client
  • Make ShardSearchTarget optional when parsing ShardSearchFailure {es-pull}27078[#27078] (issue: {es-issue}27055[#27055])

Java REST Client
  • rest-client-sniffer: configurable threadfactory {es-pull}26897[#26897]

Machine Learning
  • Fixed a scenario where models were incorrectly combined. This problem occurred when anomaly detectors were considered to be the same despite having different partition field values.

  • Cleaned up the job closure process for situations where the job was still in the process of opening.

Mapping
  • wrong link target for datatype murmur3 {es-pull}27143[#27143]

Network
  • Check for closed connection while opening {es-pull}26932[#26932]

Packaging
  • Fix handling of Windows paths containing parentheses {es-pull}26916[#26916] (issue: {es-issue}26454[#26454])

Percolator
  • Also support query extraction for queries wrapped inside a ESToParentBlockJoinQuery {es-pull}26754[#26754]

Plugin Analysis Phonetic
  • Fix beidermorse phonetic token filter for unspecified languageset {es-pull}27112[#27112] (issue: {es-issue}26771[#26771])

Plugin Repository Azure
  • Use Azure upload method instead of our own implementation {es-pull}26751[#26751]

REST
  • Fix inconsistencies in the rest api specs for cat.snapshots {es-pull}26996[#26996] (issues: {es-issue}25737[#25737], {es-issue}26923[#26923])

  • Fix inconsistencies in the rest api specs for *_script {es-pull}26971[#26971] (issue: {es-issue}26923[#26923])

  • exists template needs a template name {es-pull}25988[#25988]

Reindex API
  • Fix update_by_query’s default size parameter {es-pull}26784[#26784] (issue: {es-issue}26761[#26761])

Search
  • Avoid stack overflow on search phases {es-pull}27069[#27069] (issue: {es-issue}27042[#27042])

  • Fix search_after with geo distance sorting {es-pull}26891[#26891]

  • Fix serialization errors when cross cluster search goes to a single shard {es-pull}26881[#26881] (issue: {es-issue}26833[#26833])

  • Early termination with index sorting should not set terminated_early in the response {es-pull}26597[#26597] (issue: {es-issue}26408[#26408])

  • Format doc values fields. {es-pull}22146[#22146]

Security
  • Enabled PKI realms to obtain the password for the truststore from either the truststore.secure_password or the truststore.password setting. For more information, see [ref-pki-settings].

  • Fixed document level security such that if your role has authority to access a root document, you also have access to its nested documents.

  • Fixed an issue that caused LDAP authentication requests to be slow and to require multiple binds when authenticating in user search mode.

Sequence IDs
  • Fire global checkpoint sync under system context {es-pull}26984[#26984]

Settings
  • Emit settings deprecation logging on empty update {es-pull}27017[#27017] (issue: {es-issue}26419[#26419])

  • Fix filtering for ListSetting {es-pull}26914[#26914]

Stats
  • Keep cumulative elapsed scroll time in microseconds {es-pull}27068[#27068] (issue: {es-issue}27046[#27046])

Suggesters
  • Fix division by zero in phrase suggester that causes assertion to fail {es-pull}27149[#27149]

{es} version 6.0.0-rc1

Breaking Changes

Packaging
  • Configure heap dump path out of the box {es-pull}26755[#26755] (issue: {es-issue}26665[#26665])

Query DSL
  • Remove deprecated type and slop field in match query {es-pull}26720[#26720]

  • Remove several parse field deprecations in query builders {es-pull}26711[#26711]

  • Remove deprecated parameters from ids_query {es-pull}26508[#26508]

Deprecations

Plugins
  • Plugins: Add backcompat for sha1 checksums {es-pull}26748[#26748] (issue: {es-issue}26746[#26746])

Security
  • The xpack.security.authc.token.passphrase is deprecated. If this setting is not used, the cluster automatically generates a key, which is the recommended method. See [security-settings].

Enhancements

Core
  • Allow InputStreamStreamInput array size validation where applicable {es-pull}26692[#26692]

  • Refactor bootstrap check results and error messages {es-pull}26637[#26637]

  • Add BootstrapContext to expose settings and recovered state to bootstrap checks {es-pull}26628[#26628]

  • Unit testable index creation task on MetaDataCreateIndexService {es-pull}25961[#25961]

Discovery
  • Allow plugins to validate cluster-state on join {es-pull}26595[#26595]

Mapping
  • More efficient encoding of range fields. {es-pull}26470[#26470] (issue: {es-issue}26443[#26443])

Plugin Repository HDFS
  • Add permission checks before reading from HDFS stream {es-pull}26716[#26716] (issue: {es-issue}26714[#26714])

Recovery
  • Introduce a History UUID as a requirement for ops based recovery {es-pull}26577[#26577] (issue: {es-issue}10708[#10708])

Security
  • Added requirement for TLS/SSL when a cluster with security is running in production. If you try to upgrade to a production license when security is enabled, the upgrade is not successful until you configure TLS. For more information, see [ssl-tls].

  • Added bootstrap check that enforces the use of TLS when security is enabled and you are using a production license.

Scripting
  • ScriptService: Replace max compilation per minute setting with max compilation rate {es-pull}26399[#26399]

Search
  • Add soft limit on allowed number of script fields in request {es-pull}26598[#26598] (issue: {es-issue}26390[#26390])

  • Add a soft limit for the number of requested doc-value fields {es-pull}26574[#26574] (issue: {es-issue}26390[#26390])

Sequence IDs
  • Restoring from snapshot should force generation of a new history uuid {es-pull}26694[#26694] (issues: {es-issue}10708[#10708], {es-issue}26544[#26544], {es-issue}26557[#26557], {es-issue}26577[#26577])

  • Add global checkpoint tracking on the primary {es-pull}26666[#26666] (issue: {es-issue}26591[#26591])

  • Introduce global checkpoint background sync {es-pull}26591[#26591] (issues: {es-issue}26573[#26573], {es-issue}26630[#26630], {es-issue}26666[#26666])

  • Move UNASSIGNED_SEQ_NO and NO_OPS_PERFORMED to SequenceNumbers` {es-pull}26494[#26494] (issue: {es-issue}10708[#10708])

Bug Fixes

Aggregations
  • Do not delegate a null scorer to LeafBucketCollectors {es-pull}26747[#26747] (issue: {es-issue}26611[#26611])

Core
  • Fix cache compute if absent for expired entries {es-pull}26516[#26516]

Dates
  • Fix typo in date format {es-pull}26503[#26503] (issue: {es-issue}26500[#26500])

Highlighting
  • Fix percolator highlight sub fetch phase to not highlight query twice {es-pull}26622[#26622]

Inner Hits
  • Do not allow inner hits that fetch _source and have a non nested object field as parent {es-pull}25749[#25749] (issue: {es-issue}25315[#25315])

Internal
  • IndexShard.routingEntry should only be updated once all internal state is ready {es-pull}26776[#26776]

  • Catch exceptions and inform handler in RemoteClusterConnection#collectNodes {es-pull}26725[#26725] (issue: {es-issue}26700[#26700])

  • Internal: Add versionless alias for rest client codebase in policy files {es-pull}26521[#26521]

Java API
  • BulkProcessor flush runnable preserves the thread context from creation time {es-pull}26718[#26718] (issue: {es-issue}26596[#26596])

Java High Level REST Client
  • Make RestHighLevelClient’s Request class public {es-pull}26627[#26627] (issue: {es-issue}26455[#26455])

  • Forbid direct usage of ContentType.create() methods {es-pull}26457[#26457] (issues: {es-issue}22769[#22769], {es-issue}26438[#26438])

Java REST Client
  • Better message text for ResponseException {es-pull}26564[#26564]

Machine Learning
  • Fixed problem with dropped or duplicated data when datafeeds used aggregations.

  • Fixed problems when model plot is enabled and there are sparse metrics.

  • Improved modeling of long-term trends.

  • Fixed a bug in calculation of mean values for seasonal components.

  • Added more accurate adherence to model memory limit.

Mapping
  • Allow copying from a field to another field that belongs to the same nested object. {es-pull}26774[#26774] (issue: {es-issue}26763[#26763])

Monitoring
  • Fixed the email message when cluster license expiration issues are resolved.

Plugin Analysis Kuromoji
  • Fix kuromoji default stoptags {es-pull}26600[#26600] (issue: {es-issue}26519[#26519])

Plugin Discovery File
  • Fix discovery-file plugin to use custom config path {es-pull}26662[#26662] (issue: {es-issue}26660[#26660])

Plugin Repository Azure
  • Azure snapshots can not be restored anymore {es-pull}26778[#26778] (issues: {es-issue}22858[#22858], {es-issue}26751[#26751], {es-issue}26777[#26777])

  • Snapshot : azure module - accelerate the listing of files (used in delete snapshot) {es-pull}25710[#25710] (issue: {es-issue}25424[#25424])

Plugin Repository HDFS
  • Add Log4j to SLF4J binding for repository-hdfs {es-pull}26514[#26514] (issue: {es-issue}26512[#26512])

Query DSL
  • Fixed incomplete JSON body on count request making org.elasticsearch.rest.action.RestActions#parseTopLevelQueryBuilder go into endless loop {es-pull}26680[#26680] (issue: {es-issue}26083[#26083])

Search
  • Fail query when a sort is provided in conjunction with rescorers {es-pull}26510[#26510]

  • Let search phases override max concurrent requests {es-pull}26484[#26484] (issue: {es-issue}26198[#26198])

Security
  • Added ability infer the keystore type from its pathname when the type is not specified.

  • Added usability improvements for the password bootstrap tool. For more information, see [setup-passwords].

Similarities
  • Add boolean similarity to built in similarity types {es-pull}26613[#26613]

Upgrade API
  • Upgrade API: fix excessive logging and unnecessary template updates {es-pull}26698[#26698] (issue: {es-issue}26673[#26673])

Watcher
  • Fixed {watcher} such that it loads only active watches.

Upgrades

Core
  • Upgrade to Lucene 7.0.0 {es-pull}26744[#26744]

  • Upgrade to lucene-7.0.0-snapshot-d94a5f0. {es-pull}26441[#26441]

Logging
  • Upgrade to Log4j 2.9.1 {es-pull}26750[#26750] (issues: {es-issue}109[#109], {es-issue}26464[#26464], {es-issue}26467[#26467])

  • Upgrade to Log4j 2.9.0 {es-pull}26450[#26450] (issue: {es-issue}23798[#23798])

{es} version 6.0.0-beta2

Breaking Changes

Analysis
  • Do not allow custom analyzers to have the same names as built-in analyzers {es-pull}22349[#22349] (issue: {es-issue}22263[#22263])

Cluster
  • Disallow : in cluster and index/alias names {es-pull}26247[#26247] (issue: {es-issue}23892[#23892])

Inner Hits
  • Unfiltered nested source should keep its full path {es-pull}26102[#26102] (issues: {es-issue}18567[#18567], {es-issue}23090[#23090])

Mapping
  • Reject out of range numbers for float, double and half_float {es-pull}25826[#25826] (issue: {es-issue}25534[#25534])

Network
  • Remove unused Netty-related settings {es-pull}26161[#26161]

Packaging
  • Rename CONF_DIR to ES_PATH_CONF {es-pull}26197[#26197] (issue: {es-issue}26154[#26154])

Query DSL
  • Throw exception in scroll requests using from {es-pull}26235[#26235] (issue: {es-issue}9373[#9373])

Breaking Java Changes

Aggregations
  • Fix NPE when values is omitted on percentile_ranks agg {es-pull}26046[#26046]

Deprecations

Machine Learning
  • The max_running_jobs node property is deprecated and is replaced by xpack.ml.max_open_jobs. See [ml-settings].

Enhancements

Aggregations
  • Support distance units in GeoHashGrid aggregation precision {es-pull}26291[#26291] (issue: {es-issue}5042[#5042])

  • Reject multiple methods in percentiles aggregation {es-pull}26163[#26163] (issue: {es-issue}26095[#26095])

  • Use global_ordinals_hash execution mode when sorting by sub aggregations. {es-pull}26014[#26014] (issue: {es-issue}24359[#24359])

  • Add a specialized deferring collector for terms aggregator {es-pull}25190[#25190]

Core
  • Use Java 9 FilePermission model {es-pull}26302[#26302] (issue: {es-issue}21534[#21534])

  • Add friendlier message on bad keystore permissions {es-pull}26284[#26284]

  • Epoch millis and second formats accept float implicitly {es-pull}26119[#26119] (issue: {es-issue}14641[#14641])

Internal
  • Prevent cluster internal ClusterState.Custom impls to leak to a client {es-pull}26232[#26232]

  • Use holder pattern for lazy deprecation loggers {es-pull}26218[#26218] (issue: {es-issue}26210[#26210])

  • Allow ClusterState.Custom to be created on initial cluster states {es-pull}26144[#26144]

Java High Level REST Client
  • Make RestHighLevelClient Closeable and simplify its creation {es-pull}26180[#26180] (issue: {es-issue}26086[#26086])

Machine Learning
  • Added xpack.ml.max_open_jobs as a node attribute. See [ml-settings].

Mapping
  • Loosen the restrictions on disabling _all in 6.x {es-pull}26259[#26259]

Percolator
  • Store the QueryBuilder’s Writable representation instead of its XContent representation {es-pull}25456[#25456]

  • Add support for selecting percolator query candidate matches containing wildcard / prefix queries {es-pull}25351[#25351]

Security
  • Added the keystore.seed setting to create a randomly generated bootstrap password if an actual password is not present.

  • The bootstrap.password secure setting is now managed locally on each node and no longer updates the security index.

  • The xpack.security.authc.token.passphrase setting is no longer mandatory when using the token service. The cluster automatically generates a secure key on startup. See {ref}/security-settings.html[Security Settings in {es}].

  • Added reserved kibana_dashboard_only_user role. For more information, see {kibana-ref}/xpack-dashboard-only-mode.html[Kibana Dashboard Only Mode].

Settings
  • Persist created keystore on startup unless keystore is present {es-pull}26253[#26253] (issue: {es-issue}26126[#26126])

  • Settings: Add keystore.seed auto generated secure setting {es-pull}26149[#26149]

  • Settings: Add keystore creation to add commands {es-pull}26126[#26126]

Bug Fixes

Aggregations
  • Check bucket metric ages point to a multi bucket agg {es-pull}26215[#26215] (issue: {es-issue}25775[#25775])

Allocation
  • Fix DiskThresholdMonitor flood warning {es-pull}26204[#26204] (issue: {es-issue}26201[#26201])

  • Allow wildcards for shard IP filtering {es-pull}26187[#26187] (issues: {es-issue}22591[#22591], {es-issue}26184[#26184])

CRUD
  • Serialize and expose timeout of acknowledged requests in REST layer {es-pull}26189[#26189] (issue: {es-issue}26213[#26213])

  • Fix silent loss of last command to _bulk and _msearch due to missing newline {es-pull}25740[#25740] (issue: {es-issue}7601[#7601])

Cluster
  • Register setting cluster.indices.tombstones.size {es-pull}26193[#26193] (issue: {es-issue}26191[#26191])

Highlighting
  • Fix nested query highlighting {es-pull}26305[#26305] (issue: {es-issue}26230[#26230])

Logging
  • Allow not configure logging without config {es-pull}26209[#26209] (issues: {es-issue}20575[#20575], {es-issue}24076[#24076])

Machine Learning
  • Fixed calculation of bucket count and empty bucket count statistics.

Mapping
  • ICUCollationKeywordFieldMapper use SortedSetDocValuesField {es-pull}26267[#26267]

  • Fix serialization of the _all field. {es-pull}26143[#26143] (issue: {es-issue}26136[#26136])

Network
  • Release pipelined http responses on close {es-pull}26226[#26226]

Packaging
  • Detect modified keystore on package removal {es-pull}26300[#26300]

  • Create keystore on RPM and Debian package install {es-pull}26282[#26282]

  • Add safer empty variable checking for Windows {es-pull}26268[#26268] (issue: {es-issue}26261[#26261])

  • Export HOSTNAME environment variable {es-pull}26262[#26262] (issues: {es-issue}25807[#25807], {es-issue}26255[#26255])

  • Fix daemonization command status test {es-pull}26196[#26196] (issue: {es-issue}26080[#26080])

  • Set RuntimeDirectory in systemd service {es-pull}23526[#23526]

Search
  • Refactor simple_query_string to handle text part like multi_match and query_string {es-pull}26145[#26145] (issue: {es-issue}25726[#25726])

  • Fix exists in query_string on empty indices. {es-pull}25993[#25993] (issue: {es-issue}25956[#25956])

Security
  • The xpack.security.authc.token.enabled setting now defaults to true when HTTPS is enabled. See [token-service-settings].

  • Improved the safety of file updates in the x-pack/users tool.

  • Bootstrap checks no longer fail when checking secure settings.

  • The setup-password tool no longer fails when using a default elasticsearch.yml configuration file.

  • Fixed validation of the input parameters in the create token API.

Watcher
  • Ensured that a watch can be activated and deactivated during execution.

  • Ensured watch execution always uses the latest watch including its latest status.

Upgrades

Core
  • Upgrade to lucene-7.0.0-snapshot-a128fcb. {es-pull}26090[#26090]

{es} version 6.0.0-beta1

Breaking Changes

Aggregations
  • Change parsing of numeric to and from parameters in date_range aggregation {es-pull}25376[#25376] (issue: {es-issue}17920[#17920])

Aliases
  • Wrong behavior deleting alias {es-pull}23997[#23997] (issues: {es-issue}10106[#10106], {es-issue}23960[#23960])

Highlighting
  • Remove the postings highlighter and make unified the default highlighter choice {es-pull}25028[#25028]

Index APIs
  • Remove (deprecated) support for '+' in index expressions {es-pull}25274[#25274] (issue: {es-issue}24515[#24515])

  • Delete index API to work only against concrete indices {es-pull}25268[#25268] (issues: {es-issue}2318[#2318], {es-issue}23997[#23997])

Indexed Scripts/Templates
  • Scripting: Remove search template actions {es-pull}25717[#25717]

Ingest
  • update ingest-user-agent regexes.yml {es-pull}25608[#25608]

  • remove ingest.new_date_format {es-pull}25583[#25583]

Java REST Client
  • Remove deprecated created and found from index, delete and bulk {es-pull}25516[#25516] (issues: {es-issue}19566[#19566], {es-issue}19630[#19630], {es-issue}19633[#19633])

Packaging
  • Remove support for ES_INCLUDE {es-pull}25804[#25804]

  • Setup: Change default heap to 1G {es-pull}25695[#25695]

  • Use config directory to find jvm.options {es-pull}25679[#25679] (issue: {es-issue}23004[#23004])

  • Remove implicit 32-bit support {es-pull}25435[#25435]

  • Remove default path settings {es-pull}25408[#25408] (issue: {es-issue}25357[#25357])

  • Remove path.conf setting {es-pull}25392[#25392] (issue: {es-issue}25357[#25357])

  • Honor masking of systemd-sysctl.service {es-pull}24234[#24234] (issues: {es-issue}21899[#21899], {es-issue}806[#806])

Plugin Analysis ICU
  • Upgrade icu4j for the ICU analysis plugin to 59.1 {es-pull}25243[#25243] (issue: {es-issue}21425[#21425])

Plugin Discovery Azure Classic
  • Remove discovery.type BWC layer from the EC2/Azure/GCE plugins {es-pull}25080[#25080] (issue: {es-issue}24543[#24543])

Plugin Repository GCS
  • GCS Repository: Remove specifying credential file on disk {es-pull}24727[#24727]

Plugins
  • Make plugin loading stricter {es-pull}25405[#25405]

Query DSL
  • Refactor QueryStringQuery for 6.0 {es-pull}25646[#25646] (issue: {es-issue}25574[#25574])

  • Change split_on_whitespace default to false {es-pull}25570[#25570] (issue: {es-issue}25470[#25470])

  • Remove deprecated template query {es-pull}24577[#24577] (issue: {es-issue}19390[#19390])

REST
  • IndexClosedException to return 400 rather than 403 {es-pull}25752[#25752]

  • Remove comma-separated feature parsing for GetIndicesAction {es-pull}24723[#24723] (issue: {es-issue}24437[#24437])

  • Improve REST error handling when endpoint does not support HTTP verb, add OPTIONS support {es-pull}24437[#24437] (issues: {es-issue}0[#0], {es-issue}15335[#15335], {es-issue}17916[#17916])

Scripting
  • remove lang url parameter from stored script requests {es-pull}25779[#25779] (issue: {es-issue}22887[#22887])

  • Disallow lang to be used with Stored Scripts {es-pull}25610[#25610]

  • Remove Deprecated Script Settings {es-pull}24756[#24756] (issue: {es-issue}24532[#24532])

  • Scripting: Remove native scripts {es-pull}24726[#24726] (issue: {es-issue}19966[#19966])

  • Scripting: Remove file scripts {es-pull}24627[#24627] (issue: {es-issue}21798[#21798])

Search
  • Make index in TermsLookup mandatory {es-pull}25753[#25753] (issue: {es-issue}25750[#25750])

  • Removes FieldStats API {es-pull}25628[#25628] (issue: {es-issue}25577[#25577])

  • Remove deprecated fielddata_fields from search request {es-pull}25566[#25566] (issue: {es-issue}25537[#25537])

  • Removes deprecated fielddata_fields {es-pull}25537[#25537] (issue: {es-issue}19027[#19027])

Security
  • A new bootstrap check enforces that TLS/SSL is required for inter-node communication when running in production mode. See [encrypting-communications].

  • A new bootstrap check enforces that HTTPS is used by the built-in token service when running in {ref}/bootstrap-checks.html#dev-vs-prod-mode[production mode]. To disable the token service, set xpack.security.authc.token.enabled to false in your elasticsearch.yml. See [token-service-settings].

Settings
  • Settings: Remove shared setting property {es-pull}24728[#24728]

  • Settings: Remove support for yaml and json config files {es-pull}24664[#24664] (issue: {es-issue}19391[#19391])

Similarities
  • Similarity should accept dynamic settings when possible {es-pull}20339[#20339] (issue: {es-issue}6727[#6727])

Breaking Java Changes

Aggregations
  • Remove the unused SignificantTerms.compareTerm() method {es-pull}24714[#24714]

  • Make SignificantTerms.Bucket an interface rather than an abstract class {es-pull}24670[#24670] (issue: {es-issue}24492[#24492])

Internal
  • Collapses package structure for some bucket aggs {es-pull}25579[#25579] (issue: {es-issue}22868[#22868])

Java API
  • Remove deprecated IdsQueryBuilder ctor {es-pull}25529[#25529]

  • Removing unneeded getTookInMillis method {es-pull}23923[#23923]

Java High Level REST Client
  • Unify the result interfaces from get and search in Java client {es-pull}25361[#25361] (issue: {es-issue}16440[#16440])

  • Allow RestHighLevelClient to use plugins {es-pull}25024[#25024]

Java REST Client
  • Rename client artifacts {es-pull}25693[#25693] (issue: {es-issue}20248[#20248])

Plugin Delete By Query
  • Move DeleteByQuery and Reindex requests into core {es-pull}24578[#24578]

Query DSL
  • Remove QueryParseContext {es-pull}25486[#25486]

  • Remove QueryParseContext from parsing QueryBuilders {es-pull}25448[#25448]

REST
  • Return index name and empty map for /{index}/_alias with no aliases {es-pull}25114[#25114] (issues: {es-issue}24723[#24723], {es-issue}25090[#25090])

Deprecations

Index APIs
  • Deprecated use of + in index expressions {es-pull}24585[#24585] (issue: {es-issue}24515[#24515])

Indexed Scripts/Templates
  • Scripting: Deprecate stored search template apis {es-pull}25437[#25437] (issue: {es-issue}24596[#24596])

Percolator
  • Deprecate percolate query’s document_type parameter. {es-pull}25199[#25199]

Scripting
  • Scripting: Change keys for inline/stored scripts to source/id {es-pull}25127[#25127]

  • Scripting: Deprecate native scripts {es-pull}24692[#24692] (issue: {es-issue}19966[#19966])

  • Scripting: Deprecate index lookup {es-pull}24691[#24691] (issue: {es-issue}19359[#19359])

  • Deprecate Fine Grain Settings for Scripts {es-pull}24573[#24573] (issue: {es-issue}24532[#24532])

  • Scripting: Deprecate file script settings {es-pull}24555[#24555] (issue: {es-issue}21798[#21798])

  • Scripting: Deprecate file scripts {es-pull}24552[#24552] (issue: {es-issue}21798[#21798])

Settings
  • Settings: Update settings deprecation from yml to yaml {es-pull}24663[#24663] (issue: {es-issue}19391[#19391])

Tribe Node
  • Deprecate tribe service {es-pull}24598[#24598] (issue: {es-issue}24581[#24581])

New Features

Analysis
  • Expose simplepattern and simplepatternsplit tokenizers {es-pull}25159[#25159] (issue: {es-issue}23363[#23363])

  • Parse synonyms with the same analysis chain {es-pull}8049[#8049] (issue: {es-issue}7199[#7199])

Parent/Child
  • Move parent_id query to the parent-join module {es-pull}25072[#25072] (issue: {es-issue}20257[#20257])

  • Introduce ParentJoinFieldMapper, a field mapper that creates parent/child relation within documents of the same index {es-pull}24978[#24978] (issue: {es-issue}20257[#20257])

Search
  • Automatically early terminate search query based on index sorting {es-pull}24864[#24864] (issue: {es-issue}6720[#6720])

Sequence IDs
  • Add a scheduled translog retention check {es-pull}25622[#25622] (issues: {es-issue}10708[#10708], {es-issue}25294[#25294])

  • Initialize sequence numbers on a shrunken index {es-pull}25321[#25321] (issue: {es-issue}10708[#10708])

  • Initialize primary term for shrunk indices {es-pull}25307[#25307] (issue: {es-issue}10708[#10708])

  • Introduce translog size and age based retention policies {es-pull}25147[#25147] (issue: {es-issue}10708[#10708])

Stats
  • Adds nodes usage API to monitor usages of actions {es-pull}24169[#24169]

Task Manager
  • Task Management {es-pull}15117[#15117]

Upgrade API
  • TemplateUpgraders should be called during rolling restart {es-pull}25263[#25263] (issues: {es-issue}24379[#24379], {es-issue}24680[#24680])

Enhancements

Aggregations
  • Add strict parsing of aggregation ranges {es-pull}25769[#25769]

  • Adds rewrite phase to aggregations {es-pull}25495[#25495] (issue: {es-issue}17676[#17676])

  • Tweak AggregatorBase.addRequestCircuitBreakerBytes {es-pull}25162[#25162] (issue: {es-issue}24511[#24511])

  • Add superset size to Significant Term REST response {es-pull}24865[#24865]

  • Add document count to Matrix Stats aggregation response {es-pull}24776[#24776]

  • Adds an implementation of LogLogBeta for the cardinality aggregation {es-pull}22323[#22323] (issue: {es-issue}22230[#22230])

Allocation
  • Adjust status on bad allocation explain requests {es-pull}25503[#25503] (issue: {es-issue}25458[#25458])

  • Promote replica on the highest version node {es-pull}25277[#25277] (issue: {es-issue}10708[#10708])

Analysis
  • [Analysis] Support normalizer in request param {es-pull}24767[#24767] (issue: {es-issue}23347[#23347])

  • Enforce validation for PathHierarchy tokenizer {es-pull}23510[#23510]

  • [analysis-icu] Allow setting unicodeSetFilter {es-pull}20814[#20814] (issue: {es-issue}20820[#20820])

CAT API
  • expand /_cat/nodes to return information about hard drive {es-pull}21775[#21775] (issue: {es-issue}21679[#21679])

Cluster
  • Validate a joining node’s version with version of existing cluster nodes {es-pull}25808[#25808]

  • Switch indices read-only if a node runs out of disk space {es-pull}25541[#25541] (issue: {es-issue}24299[#24299])

  • Add a cluster block that allows to delete indices that are read-only {es-pull}24678[#24678]

Core
  • Add max file size bootstrap check {es-pull}25974[#25974]

  • Add compatibility versions to main action response {es-pull}25799[#25799]

  • Index ids in binary form. {es-pull}25352[#25352] (issues: {es-issue}18154[#18154], {es-issue}24615[#24615])

  • Explicitly reject duplicate data paths {es-pull}25178[#25178]

  • Use SPI in High Level Rest Client to load XContent parsers {es-pull}25097[#25097]

  • Upgrade to lucene-7.0.0-snapshot-a0aef2f {es-pull}24775[#24775]

  • Speed up PK lookups at index time. {es-pull}19856[#19856]

Engine
  • Add refresh stats tracking for realtime get {es-pull}25052[#25052] (issue: {es-issue}24806[#24806])

  • Introducing a translog deletion policy {es-pull}24950[#24950]

Exceptions
  • IllegalStateException: Only duplicated jar instead of classpath {es-pull}24953[#24953]

Highlighting
  • Picks offset source for the unified highlighter directly from the es mapping {es-pull}25747[#25747] (issue: {es-issue}25699[#25699])

Index APIs
  • Let primary own its replication group {es-pull}25692[#25692] (issue: {es-issue}25485[#25485])

  • Create index request should return the index name {es-pull}25139[#25139] (issue: {es-issue}23044[#23044])

Ingest
  • Add Ingest-Processor specific Rest Endpoints & Add Grok endpoint {es-pull}25059[#25059] (issue: {es-issue}24725[#24725])

  • Port support for commercial GeoIP2 databases from Logstash. {es-pull}24889[#24889]

  • add exclude_keys option to KeyValueProcessor {es-pull}24876[#24876] (issue: {es-issue}23856[#23856])

  • Allow removing multiple fields in ingest processor {es-pull}24750[#24750] (issue: {es-issue}24622[#24622])

  • Add target_field parameter to ingest processors {es-pull}24133[#24133] (issues: {es-issue}23228[#23228], {es-issue}23682[#23682])

Inner Hits
  • Reuse inner hit query weight {es-pull}24571[#24571] (issue: {es-issue}23917[#23917])

Internal
  • Cleanup IndexFieldData visibility {es-pull}25900[#25900]

  • Bump the min compat version to 5.6.0 {es-pull}25805[#25805]

  • "shard started" should show index and shard ID {es-pull}25157[#25157]

  • Break out clear scroll logic from TransportClearScrollAction {es-pull}25125[#25125] (issue: {es-issue}25094[#25094])

  • Add helper methods to TransportActionProxy to identify proxy actions and requests {es-pull}25124[#25124]

  • Add remote cluster infrastructure to fetch discovery nodes. {es-pull}25123[#25123] (issue: {es-issue}25094[#25094])

  • Add the ability to set eager_global_ordinals in the new parent-join field {es-pull}25019[#25019]

  • Disallow multiple parent-join fields per mapping {es-pull}25002[#25002]

  • Remove the need for _UNRELEASED suffix in versions {es-pull}24798[#24798] (issue: {es-issue}24768[#24768])

  • Optimize the order of bytes in uuids for better compression. {es-pull}24615[#24615] (issue: {es-issue}18209[#18209])

Java API
  • Always Accumulate Transport Exceptions {es-pull}25017[#25017] (issue: {es-issue}23099[#23099])

Java High Level REST Client
  • [DOCS] restructure java clients docs pages {es-pull}25517[#25517]

  • Use SPI in High Level Rest Client to load XContent parsers {es-pull}25098[#25098] (issues: {es-issue}25024[#25024], {es-issue}25097[#25097])

  • Add support for clear scroll to high level REST client {es-pull}25038[#25038]

  • Add search scroll method to high level REST client {es-pull}24938[#24938] (issue: {es-issue}23331[#23331])

  • Add search method to high level REST client {es-pull}24796[#24796] (issues: {es-issue}24794[#24794], {es-issue}24795[#24795])

Java REST Client
  • Shade external dependencies in the rest client jar {es-pull}25780[#25780] (issue: {es-issue}25208[#25208])

  • RestClient uses system properties and system default SSLContext {es-pull}25757[#25757] (issue: {es-issue}23231[#23231])

Logging
  • Prevent excessive disk consumption by log files {es-pull}25660[#25660]

  • Use LRU set to reduce repeat deprecation messages {es-pull}25474[#25474] (issue: {es-issue}25457[#25457])

Mapping
  • Better validation of copy_to. {es-pull}25983[#25983]

  • Optimize terms queries on ip addresses to use a PointInSetQuery whenever possible. {es-pull}25669[#25669] (issue: {es-issue}25667[#25667])

Network
  • Move TransportStats accounting into TcpTransport {es-pull}25251[#25251]

  • Simplify connection closing and cleanups in TcpTransport {es-pull}25250[#25250]

  • Disable the Netty recycler in the client {es-pull}24793[#24793] (issues: {es-issue}22452[#22452], {es-issue}24721[#24721])

  • Remove Netty logging hack {es-pull}24653[#24653] (issues: {es-issue}24469[#24469], {es-issue}5624[#5624], {es-issue}6568[#6568], {es-issue}6696[#6696])

Packaging
  • Remove memlock suggestion from systemd service {es-pull}25979[#25979]

  • Set address space limit in systemd service file {es-pull}25975[#25975]

  • Version option should display if snapshot {es-pull}25970[#25970]

  • Ignore JVM options before checking Java version {es-pull}25969[#25969]

  • Also skip JAVA_TOOL_OPTIONS on Windows {es-pull}25968[#25968]

  • Introduce elasticsearch-env for Windows {es-pull}25958[#25958]

  • Introduce elasticsearch-env {es-pull}25815[#25815] (issue: {es-issue}20286[#20286])

  • Stop exporting HOSTNAME from scripts {es-pull}25807[#25807]

Parent/Child
  • Remove ParentJoinFieldSubFetchPhase {es-pull}25550[#25550] (issue: {es-issue}25363[#25363])

  • Support parent id being specified as number in the _source {es-pull}25547[#25547]

Plugin Lang Painless
  • Allow Custom Whitelists in Painless {es-pull}25557[#25557]

  • Update Painless to Allow Augmentation from Any Class {es-pull}25360[#25360]

  • Add Needs Methods to Painless Script Context Factories {es-pull}25267[#25267]

  • Support Script Context Stateful Factory in Painless {es-pull}25233[#25233]

  • Generate Painless Factory for Creating Script Instances {es-pull}25120[#25120]

  • Update Painless to Use New Script Contexts {es-pull}25015[#25015]

  • Optimize instance creation in LambdaBootstrap {es-pull}24618[#24618]

Plugin Repository GCS
  • GCS Repository: Add secure storage of credentials {es-pull}24697[#24697]

Plugin Repository S3
  • S3 Repository: Add back repository level credentials {es-pull}24609[#24609]

Plugins
  • Move tribe to a module {es-pull}25778[#25778]

  • Plugins can register pre-configured char filters {es-pull}25000[#25000] (issue: {es-issue}23658[#23658])

  • Add purge option to remove plugin CLI {es-pull}24981[#24981]

  • Allow plugins to register pre-configured tokenizers {es-pull}24751[#24751] (issues: {es-issue}24223[#24223], {es-issue}24572[#24572])

  • Move ReindexAction class to core {es-pull}24684[#24684] (issue: {es-issue}24578[#24578])

  • Make PreConfiguredTokenFilter harder to misuse {es-pull}24572[#24572] (issue: {es-issue}23658[#23658])

Query DSL
  • Make slop optional when parsing span_near query {es-pull}25677[#25677] (issue: {es-issue}25642[#25642])

  • Require a field when a seed is provided to the random_score function. {es-pull}25594[#25594] (issue: {es-issue}25240[#25240])

REST
  • Refactor PathTrie and RestController to use a single trie for all methods {es-pull}25459[#25459] (issue: {es-issue}24437[#24437])

  • Make ObjectParser support string to boolean conversion {es-pull}24668[#24668] (issue: {es-issue}21802[#21802])

Recovery
  • Goodbye, Translog Views {es-pull}25962[#25962]

  • Disallow multiple concurrent recovery attempts for same target shard {es-pull}25428[#25428]

  • Live primary-replica resync (no rollback) {es-pull}24841[#24841] (issue: {es-issue}10708[#10708])

Scripting
  • Scripting: Rename SearchScript.needsScores to needs_score {es-pull}25235[#25235]

  • Scripting: Add optional context parameter to put stored script requests {es-pull}25014[#25014]

  • Add New Security Script Settings {es-pull}24637[#24637] (issue: {es-issue}24532[#24532])

Search
  • Rewrite search requests on the coordinating nodes {es-pull}25814[#25814] (issue: {es-issue}25791[#25791])

  • Ensure query resources are fetched asynchronously during rewrite {es-pull}25791[#25791]

  • Introduce a new Rewriteable interface to streamline rewriting {es-pull}25788[#25788]

  • Reduce the scope of QueryRewriteContext {es-pull}25787[#25787]

  • Reduce the overhead of timeouts and low-level search cancellation. {es-pull}25776[#25776]

  • Reduce profiling overhead. {es-pull}25772[#25772] (issue: {es-issue}24799[#24799])

  • Prevent can_match requests from sending to incompatible nodes {es-pull}25705[#25705] (issue: {es-issue}25704[#25704])

  • Add a shard filter search phase to pre-filter shards based on query rewriting {es-pull}25658[#25658]

  • Ensure we rewrite common queries to match_none if possible {es-pull}25650[#25650]

  • Limit the number of concurrent shard requests per search request {es-pull}25632[#25632]

  • Add cluster name validation to RemoteClusterConnection {es-pull}25568[#25568]

  • Speed up sorted scroll when the index sort matches the search sort {es-pull}25138[#25138] (issue: {es-issue}6720[#6720])

  • Leverage scorerSupplier when applicable. {es-pull}25109[#25109]

  • Add Cross Cluster Search support for scroll searches {es-pull}25094[#25094]

  • Track EWMA[1] of task execution time in search threadpool executor {es-pull}24989[#24989] (issue: {es-issue}24915[#24915])

  • Query range fields by doc values when they are expected to be more efficient than points {es-pull}24823[#24823] (issue: {es-issue}24314[#24314])

  • Search: Fairer balancing when routing searches by session ID {es-pull}24671[#24671] (issue: {es-issue}24642[#24642])

Sequence IDs
  • Move primary term from ReplicationRequest to ConcreteShardRequest {es-pull}25822[#25822]

  • Add reason to global checkpoint updates on replica {es-pull}25612[#25612] (issue: {es-issue}10708[#10708])

  • Introduce primary/replica mode for GlobalCheckPointTracker {es-pull}25468[#25468]

  • Throw back replica local checkpoint on new primary {es-pull}25452[#25452] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Update global checkpoint when increasing primary term on replica {es-pull}25422[#25422] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Enable a long translog retention policy by default {es-pull}25294[#25294] (issues: {es-issue}10708[#10708], {es-issue}25147[#25147])

  • Introduce primary context {es-pull}25122[#25122] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Block older operations on primary term transition {es-pull}24779[#24779] (issue: {es-issue}10708[#10708])

Settings
  • Add disk threshold settings validation {es-pull}25600[#25600] (issue: {es-issue}25560[#25560])

  • Enable cross-setting validation {es-pull}25560[#25560] (issue: {es-issue}25541[#25541])

  • Validate transport.profiles.* settings {es-pull}25508[#25508]

  • Cleanup network / transport related settings {es-pull}25489[#25489]

  • Emit settings deprecation logging at most once {es-pull}25457[#25457]

  • IndexMetaData: Introduce internal format index setting {es-pull}25292[#25292]

Snapshot/Restore
  • Improves snapshot logging and snapshot deletion error handling {es-pull}25264[#25264]

Stats
  • Update IndexShard#refreshMetric via a ReferenceManager.RefreshListener {es-pull}25083[#25083] (issues: {es-issue}24806[#24806], {es-issue}25052[#25052])

Translog
  • Translog file recovery should not rely on lucene commits {es-pull}25005[#25005] (issue: {es-issue}24950[#24950])

Bug Fixes

Aggregations
  • Fixes array out of bounds for value count agg {es-pull}26038[#26038] (issue: {es-issue}17379[#17379])

  • Aggregations bug: Significant_text fails on arrays of text. {es-pull}25030[#25030] (issue: {es-issue}25029[#25029])

Aliases
  • mget with an alias shouldn’t ignore alias routing {es-pull}25697[#25697] (issue: {es-issue}25696[#25696])

  • GET aliases should 404 if aliases are missing {es-pull}25043[#25043] (issue: {es-issue}24644[#24644])

Analysis
  • Pre-configured shingle filter should disable graph analysis {es-pull}25853[#25853] (issue: {es-issue}25555[#25555])

Circuit Breakers
  • Checks the circuit breaker before allocating bytes for a new big array {es-pull}25010[#25010] (issue: {es-issue}24790[#24790])

Core
  • Release operation permit on thread-pool rejection {es-pull}25930[#25930] (issue: {es-issue}25863[#25863])

  • Node should start up despite of a lingering .es_temp_file {es-pull}21210[#21210] (issue: {es-issue}21007[#21007])

Discovery
  • MasterNodeChangePredicate should use the node instance to detect master change {es-pull}25877[#25877] (issue: {es-issue}25471[#25471])

Engine
  • Engine - do not index operations with seq# lower than the local checkpoint into lucene {es-pull}25827[#25827] (issues: {es-issue}1[#1], {es-issue}2[#2], {es-issue}25592[#25592])

Geo
  • Fix typo in GeoUtils#isValidLongitude {es-pull}25121[#25121]

Highlighting
  • FastVectorHighlighter should not cache the field query globally {es-pull}25197[#25197] (issue: {es-issue}25171[#25171])

  • Higlighters: Fix MultiPhrasePrefixQuery rewriting {es-pull}25103[#25103] (issue: {es-issue}25088[#25088])

Index APIs
  • Shrink API should ignore templates {es-pull}25380[#25380] (issue: {es-issue}25035[#25035])

  • Rollover max docs should only count primaries {es-pull}24977[#24977] (issue: {es-issue}24217[#24217])

Ingest
  • Sort Processor does not have proper behavior with targetField {es-pull}25237[#25237] (issue: {es-issue}24133[#24133])

  • fix grok’s pattern parsing to validate pattern names in expression {es-pull}25063[#25063] (issue: {es-issue}22831[#22831])

Inner Hits
  • When fetching nested inner hits only access stored fields when needed {es-pull}25864[#25864] (issue: {es-issue}6[#6])

Internal
  • Fix BytesReferenceStreamInput#skip with offset {es-pull}25634[#25634]

  • Fix race condition in RemoteClusterConnection node supplier {es-pull}25432[#25432]

  • Initialise empty lists in BaseTaskResponse constructor {es-pull}25290[#25290]

  • Extract a common base class for scroll executions {es-pull}24979[#24979] (issue: {es-issue}16555[#16555])

  • Obey lock order if working with store to get metadata snapshots {es-pull}24787[#24787] (issue: {es-issue}24481[#24481])

  • Fix Version based BWC and set correct minCompatVersion {es-pull}24732[#24732]

  • Fix _field_caps serialization in order to support cross cluster search {es-pull}24722[#24722]

  • Avoid race when shutting down controller processes {es-pull}24579[#24579]

Mapping
  • Fix parsing of ip range queries. {es-pull}25768[#25768] (issue: {es-issue}25636[#25636])

  • Disable date field mapping changing {es-pull}25285[#25285] (issue: {es-issue}25271[#25271])

  • Correctly enable _all for older 5.x indices {es-pull}25087[#25087] (issue: {es-issue}25068[#25068])

  • token_count datatype should handle null value {es-pull}25046[#25046] (issue: {es-issue}24928[#24928])

  • keep _parent field while updating child type mapping {es-pull}24407[#24407] (issue: {es-issue}23381[#23381])

More Like This
  • Pass over _routing value with more_like_this items to be retrieved {es-pull}24679[#24679] (issue: {es-issue}23699[#23699])

Nested Docs
  • In case of a single type the _id field should be added to the nested document instead of _uid field {es-pull}25149[#25149]

Network
  • Ensure pending transport handlers are invoked for all channel failures {es-pull}25150[#25150]

  • Notify onConnectionClosed rather than onNodeDisconnect to prune transport handlers {es-pull}24639[#24639] (issues: {es-issue}24557[#24557], {es-issue}24575[#24575], {es-issue}24632[#24632])

Packaging
  • Exit Windows scripts promptly on failure {es-pull}25959[#25959]

  • Pass config path as a system property {es-pull}25943[#25943]

  • ES_HOME needs to be made absolute before attempt at traversal {es-pull}25865[#25865]

  • Fix elasticsearch-keystore handling of path.conf {es-pull}25811[#25811]

  • Stop disabling explicit GC {es-pull}25759[#25759]

  • Avoid failing install if system-sysctl is masked {es-pull}25657[#25657] (issue: {es-issue}24234[#24234])

  • Get short path name for native controllers {es-pull}25344[#25344]

  • When stopping via systemd only kill the JVM, not its control group {es-pull}25195[#25195]

  • remove remaining references to scripts directory {es-pull}24771[#24771]

  • Handle parentheses in batch file path {es-pull}24731[#24731] (issue: {es-issue}24712[#24712])

Parent/Child
  • The default _parent field should not try to load global ordinals {es-pull}25851[#25851] (issue: {es-issue}25849[#25849])

Percolator
  • Fix range queries with date range based on current time in percolator queries. {es-pull}24666[#24666] (issue: {es-issue}23921[#23921])

Plugin Lang Painless
  • Painless: allow doubles to be casted to longs. {es-pull}25936[#25936]

Plugin Repository Azure
  • Make calls to CloudBlobContainer#exists privileged {es-pull}25937[#25937] (issue: {es-issue}25931[#25931])

Plugin Repository GCS
  • Ensure that gcs client creation is privileged {es-pull}25938[#25938] (issue: {es-issue}25932[#25932])

Plugin Repository HDFS
  • Upgrading HDFS Repository Plugin to use HDFS 2.8.1 Client {es-pull}25497[#25497] (issue: {es-issue}25450[#25450])

Plugin Repository S3
  • Avoid SecurityException in repository-S3 on DefaultS3OutputStream.flush() {es-pull}25254[#25254] (issue: {es-issue}25192[#25192])

Plugins
  • X-Pack plugin download fails on Windows desktop {es-pull}24570[#24570]

Query DSL
  • SpanNearQueryBuilder should return the inner clause when a single clause is provided {es-pull}25856[#25856] (issue: {es-issue}25630[#25630])

  • Refactor field expansion for match, multi_match and query_string query {es-pull}25726[#25726] (issues: {es-issue}25551[#25551], {es-issue}25556[#25556])

  • WrapperQueryBuilder should also rewrite the parsed query {es-pull}25480[#25480]

REST
  • Fix handling of invalid error trace parameter {es-pull}25785[#25785] (issue: {es-issue}25774[#25774])

  • Fix handling of exceptions thrown on HEAD requests {es-pull}25172[#25172] (issue: {es-issue}21125[#21125])

  • Fixed NPEs caused by requests without content. {es-pull}23497[#23497] (issue: {es-issue}24701[#24701])

  • Fix get mappings HEAD requests {es-pull}23192[#23192] (issue: {es-issue}21125[#21125])

Recovery
  • Close translog view after primary-replica resync {es-pull}25862[#25862] (issue: {es-issue}24841[#24841])

Reindex API
  • Reindex: don’t duplicate _source parameter {es-pull}24629[#24629] (issue: {es-issue}24628[#24628])

  • Add qa module that tests reindex-from-remote against pre-5.0 versions of Elasticsearch {es-pull}24561[#24561] (issues: {es-issue}23828[#23828], {es-issue}24520[#24520])

Search
  • Caching a MinDocQuery can lead to wrong results. {es-pull}25909[#25909]

  • Fix random score generation when no seed is provided. {es-pull}25908[#25908]

  • Merge FunctionScoreQuery and FiltersFunctionScoreQuery {es-pull}25889[#25889] (issues: {es-issue}15709[#15709], {es-issue}23628[#23628])

  • Respect cluster alias in _index aggs and queries {es-pull}25885[#25885] (issue: {es-issue}25606[#25606])

  • First increment shard stats before notifying and potentially sending response {es-pull}25818[#25818]

  • Remove assertion about deviation when casting to a float. {es-pull}25806[#25806] (issue: {es-issue}25330[#25330])

  • Prevent skipping shards if a suggest builder is present {es-pull}25739[#25739] (issue: {es-issue}25658[#25658])

  • Ensure remote cluster alias is preserved in inner hits aggs {es-pull}25627[#25627] (issue: {es-issue}25606[#25606])

  • Do not search locally if remote index pattern resolves to no indices {es-pull}25436[#25436] (issue: {es-issue}25426[#25426])

  • Adds check for negative search request size {es-pull}25397[#25397] (issue: {es-issue}22530[#22530])

  • Make sure range queries are correctly profiled. {es-pull}25108[#25108]

  • Fix RangeFieldMapper rangeQuery to properly handle relations {es-pull}24808[#24808] (issue: {es-issue}24744[#24744])

  • Fix ExpandSearchPhase when response contains no hits {es-pull}24688[#24688] (issue: {es-issue}24672[#24672])

Sequence IDs
  • Fix pre-6.0 response to unknown replication actions {es-pull}25744[#25744] (issue: {es-issue}10708[#10708])

  • Track local checkpoint on primary immediately {es-pull}25434[#25434] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355], {es-issue}25415[#25415])

  • Initialize max unsafe auto ID timestamp on shrink {es-pull}25356[#25356] (issues: {es-issue}10708[#10708], {es-issue}25355[#25355])

  • Use correct primary term for replicating NOOPs {es-pull}25128[#25128]

  • Handle already closed while filling gaps {es-pull}25021[#25021] (issue: {es-issue}24925[#24925])

Settings
  • Fix settings serialization to not serialize secure settings or not take the total size into account {es-pull}25323[#25323]

  • Keystore CLI should use the AddFileKeyStoreCommand for files {es-pull}25298[#25298]

  • Allow resetting settings that use an IP validator {es-pull}24713[#24713] (issue: {es-issue}24709[#24709])

Snapshot/Restore
  • Snapshot/Restore: Ensure that shard failure reasons are correctly stored in CS {es-pull}25941[#25941] (issue: {es-issue}25878[#25878])

  • Output all empty snapshot info fields if in verbose mode {es-pull}25455[#25455] (issue: {es-issue}24477[#24477])

  • Remove redundant and broken MD5 checksum from repository-s3 {es-pull}25270[#25270] (issue: {es-issue}25269[#25269])

  • Consolidates the logic for cleaning up snapshots on master election {es-pull}24894[#24894] (issue: {es-issue}24605[#24605])

  • Removes completed snapshot from cluster state on master change {es-pull}24605[#24605] (issue: {es-issue}24452[#24452])

Stats
  • _nodes/stats should not fail due to concurrent AlreadyClosedException {es-pull}25016[#25016] (issue: {es-issue}23099[#23099])

Suggesters
  • Context suggester should filter doc values field {es-pull}25858[#25858] (issue: {es-issue}25404[#25404])

Regressions

Highlighting
  • Fix Fast Vector Highlighter NPE on match phrase prefix {es-pull}25116[#25116] (issue: {es-issue}25088[#25088])

Search
  • Always use DisjunctionMaxQuery to build cross fields disjunction {es-pull}25115[#25115] (issue: {es-issue}23966[#23966])

Upgrades

Network
  • Upgrade to Netty 4.1.13.Final {es-pull}25581[#25581] (issues: {es-issue}24729[#24729], {es-issue}6866[#6866])

  • Upgrade to Netty 4.1.11.Final {es-pull}24652[#24652]

Upgrade API
  • Improve stability and logging of TemplateUpgradeServiceIT tests {es-pull}25386[#25386] (issue: {es-issue}25382[#25382])

{es} version 6.0.0-alpha2

Breaking Changes

CRUD
  • Deleting a document from a non-existing index creates the indexIf the index does not exist, delete document will not auto create it {es-pull}24518[#24518] (issue: {es-issue}15425[#15425])

Plugin Analysis ICU
  • Upgrade icu4j to latest version {es-pull}24821[#24821]

Plugin Repository S3
  • Remove deprecated S3 settings {es-pull}24445[#24445]

Scripting
  • Remove script access to term statistics {es-pull}19462[#19462] (issue: {es-issue}19359[#19359])

Watcher
  • The watch _status field has been renamed to status, as underscores in field names will not be allowed.

Breaking Java Changes

Aggregations
  • Make Terms.Bucket an interface rather than an abstract class {es-pull}24492[#24492]

  • Compound order for histogram aggregations {es-pull}22343[#22343] (issues: {es-issue}14771[#14771], {es-issue}20003[#20003], {es-issue}23613[#23613])

Plugins
  • Drop name from TokenizerFactory {es-pull}24869[#24869]

Deprecations

Settings
  • Deprecate settings in .yml and .json {es-pull}24059[#24059] (issue: {es-issue}19391[#19391])

New Features

Aggregations
  • SignificantText aggregation - like significant_terms, but for text {es-pull}24432[#24432] (issue: {es-issue}23674[#23674])

Internal
  • Automatically adjust search threadpool queue_size {es-pull}23884[#23884] (issue: {es-issue}3890[#3890])

Mapping
  • Add new ip_range field type {es-pull}24433[#24433]

Plugin Analysis ICU
  • Add ICUCollationFieldMapper {es-pull}24126[#24126]

Enhancements

Core
  • Improve bootstrap checks error messages {es-pull}24548[#24548]

Engine
  • Move the IndexDeletionPolicy to be engine internal {es-pull}24930[#24930] (issue: {es-issue}10708[#10708])

Internal
  • Add assertions enabled helper {es-pull}24834[#24834]

Java High Level REST Client
  • Add doc_count to ParsedMatrixStats {es-pull}24952[#24952] (issue: {es-issue}24776[#24776])

  • Add fromXContent method to ClearScrollResponse {es-pull}24909[#24909]

  • ClearScrollRequest to implement ToXContentObject {es-pull}24907[#24907]

  • SearchScrollRequest to implement ToXContentObject {es-pull}24906[#24906] (issue: {es-issue}3889[#3889])

  • Add aggs parsers for high level REST Client {es-pull}24824[#24824] (issues: {es-issue}23965[#23965], {es-issue}23973[#23973], {es-issue}23974[#23974], {es-issue}24085[#24085], {es-issue}24160[#24160], {es-issue}24162[#24162], {es-issue}24182[#24182], {es-issue}24183[#24183], {es-issue}24208[#24208], {es-issue}24213[#24213], {es-issue}24239[#24239], {es-issue}24284[#24284], {es-issue}24312[#24312], {es-issue}24330[#24330], {es-issue}24365[#24365], {es-issue}24371[#24371], {es-issue}24442[#24442], {es-issue}24521[#24521], {es-issue}24524[#24524], {es-issue}24564[#24564], {es-issue}24583[#24583], {es-issue}24589[#24589], {es-issue}24648[#24648], {es-issue}24667[#24667], {es-issue}24675[#24675], {es-issue}24682[#24682], {es-issue}24700[#24700], {es-issue}24706[#24706], {es-issue}24717[#24717], {es-issue}24720[#24720], {es-issue}24738[#24738], {es-issue}24746[#24746], {es-issue}24789[#24789], {es-issue}24791[#24791], {es-issue}24794[#24794], {es-issue}24796[#24796], {es-issue}24822[#24822])

Mapping
  • Identify documents by their _id. {es-pull}24460[#24460]

Packaging
  • Set number of processes in systemd unit file {es-pull}24970[#24970] (issue: {es-issue}20874[#20874])

Plugin Lang Painless
  • Make Painless Compiler Use an Instance Per Context {es-pull}24972[#24972]

  • Make PainlessScript An Interface {es-pull}24966[#24966]

Recovery
  • Introduce primary context {es-pull}25031[#25031] (issue: {es-issue}10708[#10708])

Scripting
  • Add StatefulFactoryType as optional intermediate factory in script contexts {es-pull}24974[#24974] (issue: {es-issue}20426[#20426])

  • Make contexts available to ScriptEngine construction {es-pull}24896[#24896]

  • Make ScriptEngine.compile generic on the script context {es-pull}24873[#24873]

  • Add instance and compiled classes to script contexts {es-pull}24868[#24868]

Search
  • Eliminate array access in tight loops when profiling is enabled. {es-pull}24959[#24959]

  • Support Multiple Inner Hits on a Field Collapse Request {es-pull}24517[#24517]

  • Expand cross cluster search indices for search requests to the concrete index or to it’s aliases {es-pull}24502[#24502]

Search Templates
  • Add max concurrent searches to multi template search {es-pull}24255[#24255] (issues: {es-issue}20912[#20912], {es-issue}21907[#21907])

Security
  • Adapted indices resolution to use new ignoreAliases index option.

  • Added the logstash_admin role, which provides access to .logstash-* indices for managing configurations.

Sequence IDs
  • Fill gaps on primary promotion {es-pull}24945[#24945] (issue: {es-issue}10708[#10708])

  • Introduce clean transition on primary promotion {es-pull}24925[#24925] (issue: {es-issue}10708[#10708])

  • Guarantee that translog generations are seqNo conflict free {es-pull}24825[#24825] (issues: {es-issue}10708[#10708], {es-issue}24779[#24779])

  • Inline global checkpoints {es-pull}24513[#24513] (issue: {es-issue}10708[#10708])

Snapshot/Restore
  • Enhances get snapshots API to allow retrieving repository index only {es-pull}24477[#24477] (issue: {es-issue}24288[#24288])

Watcher
  • Watcher indices no longer use multiple types.

Bug Fixes

Aggregations
  • Terms aggregation should remap global ordinal buckets when a sub-aggregator is used to sort the terms {es-pull}24941[#24941] (issue: {es-issue}24788[#24788])

  • Correctly set doc_count when MovAvg "predicts" values on existing buckets {es-pull}24892[#24892] (issue: {es-issue}24327[#24327])

  • DateHistogram: Fix extended_bounds with offset {es-pull}23789[#23789] (issue: {es-issue}23776[#23776])

  • Fix ArrayIndexOutOfBoundsException when no ranges are specified in the query {es-pull}23241[#23241] (issue: {es-issue}22881[#22881])

Analysis
  • PatternAnalyzer should lowercase wildcard queries when lowercase is true. {es-pull}24967[#24967]

Cache
  • fix bug of weight computation {es-pull}24856[#24856]

Core
  • Fix cache expire after access {es-pull}24546[#24546]

Graph
  • Reinstated _xpack/graph/_explore as the correct graph endpoint. _xpack/_graph/_explore is deprecated and will be removed in v7.0.

Index APIs
  • Validates updated settings on closed indices {es-pull}24487[#24487] (issue: {es-issue}23787[#23787])

Ingest
  • Fix floating-point error when DateProcessor parses UNIX {es-pull}24947[#24947]

  • add option for _ingest.timestamp to use new ZonedDateTime (5.x backport) {es-pull}24030[#24030] (issues: {es-issue}23168[#23168], {es-issue}23174[#23174])

Inner Hits
  • Fix Source filtering in new field collapsing feature {es-pull}24068[#24068] (issue: {es-issue}24063[#24063])

Internal
  • Ensure remote cluster is connected before fetching _field_caps {es-pull}24845[#24845] (issue: {es-issue}24763[#24763])

Machine Learning
  • If the initial cluster state update to install the Machine Learning Metadata fails, the update is now retried.

Network
  • Fix error message if an incompatible node connects {es-pull}24884[#24884]

Plugins
  • Fix plugin installation permissions {es-pull}24527[#24527] (issue: {es-issue}24480[#24480])

Scroll
  • Fix single shard scroll within a cluster with nodes in version >= 5.3 and ⇐ 5.3 {es-pull}24512[#24512]

Search
  • Fix script field sort returning Double.MAX_VALUE for all documents {es-pull}24942[#24942] (issue: {es-issue}24940[#24940])

  • Compute the took time of the query after the expand phase of field collapsing {es-pull}24902[#24902] (issue: {es-issue}24900[#24900])

Sequence IDs
  • Handle primary failure handling replica response {es-pull}24926[#24926] (issue: {es-issue}24935[#24935])

Snapshot/Restore
  • Fix inefficient (worst case exponential) loading of snapshot repository {es-pull}24510[#24510] (issue: {es-issue}24509[#24509])

Stats
  • Avoid double decrement on current query counter {es-pull}24922[#24922] (issues: {es-issue}22996[#22996], {es-issue}24872[#24872])

  • Adjust available and free bytes to be non-negative on huge FSes {es-pull}24911[#24911] (issues: {es-issue}23093[#23093], {es-issue}24453[#24453])

Suggesters
  • Fix context suggester to read values from keyword type field {es-pull}24200[#24200] (issue: {es-issue}24129[#24129])

{es} version 6.0.0-alpha1

Breaking Changes

Allocation
  • Remove cluster.routing.allocation.snapshot.relocation_enabled setting {es-pull}20994[#20994]

Analysis
  • Removing query-string parameters in _analyze API {es-pull}20704[#20704] (issue: {es-issue}20246[#20246])

CAT API
  • Write -1 on unbounded queue in cat thread pool {es-pull}21342[#21342] (issue: {es-issue}21187[#21187])

CRUD
  • Disallow VersionType.FORCE for GetRequest {es-pull}21079[#21079] (issue: {es-issue}20995[#20995])

  • Disallow VersionType.FORCE versioning for 6.x indices {es-pull}20995[#20995] (issue: {es-issue}20377[#20377])

Cluster
  • No longer allow cluster name in data path {es-pull}20433[#20433] (issue: {es-issue}20391[#20391])

Core
  • Simplify file store {es-pull}24402[#24402] (issue: {es-issue}24390[#24390])

  • Make boolean conversion strict {es-pull}22200[#22200]

  • Remove the default store type. {es-pull}21616[#21616]

  • Remove store throttling. {es-pull}21573[#21573]

Geo
  • Remove deprecated geo search features {es-pull}22876[#22876]

  • Reduce GeoDistance Insanity {es-pull}19846[#19846]

Index APIs
  • Open/Close index api to allow_no_indices by default {es-pull}24401[#24401] (issues: {es-issue}24031[#24031], {es-issue}24341[#24341])

  • Remove support for controversial ignore_unavailable and allow_no_indices from indices exists api {es-pull}20712[#20712]

Index Templates
  • Allows multiple patterns to be specified for index templates {es-pull}21009[#21009] (issue: {es-issue}20690[#20690])

Java API
  • Enforce Content-Type requirement on the rest layer and remove deprecated methods {es-pull}23146[#23146] (issue: {es-issue}19388[#19388])

Mapping
  • Enforce at most one type. {es-pull}24428[#24428] (issue: {es-issue}24317[#24317])

  • Disallow include_in_all for 6.0+ indices {es-pull}22970[#22970] (issue: {es-issue}22923[#22923])

  • Disable _all by default, disallow configuring _all on 6.0+ indices {es-pull}22144[#22144] (issues: {es-issue}19784[#19784], {es-issue}20925[#20925], {es-issue}21341[#21341])

  • Throw an exception on unrecognized "match_mapping_type" {es-pull}22090[#22090] (issue: {es-issue}17285[#17285])

Network
  • Remove blocking TCP clients and servers {es-pull}22639[#22639]

  • Remove modules/transport_netty_3 in favor of netty_4 {es-pull}21590[#21590]

  • Remove LocalTransport in favor of MockTcpTransport {es-pull}20695[#20695]

Packaging
  • Remove customization of ES_USER and ES_GROUP {es-pull}23989[#23989] (issue: {es-issue}23848[#23848])

Percolator
  • Remove deprecated percolate and mpercolate apis {es-pull}22331[#22331]

Plugin Delete By Query
  • Require explicit query in _delete_by_query API {es-pull}23632[#23632] (issue: {es-issue}23629[#23629])

Plugin Discovery EC2
  • Ec2 Discovery: Cleanup deprecated settings {es-pull}24150[#24150]

  • Discovery EC2: Remove region setting {es-pull}23991[#23991] (issue: {es-issue}22758[#22758])

  • AWS Plugins: Remove signer type setting {es-pull}23984[#23984] (issue: {es-issue}22599[#22599])

Plugin Lang JS
  • Remove lang-python and lang-javascript {es-pull}20734[#20734] (issue: {es-issue}20698[#20698])

Plugin Mapper Attachment
  • Remove mapper attachments plugin {es-pull}20416[#20416] (issue: {es-issue}18837[#18837])

Plugin Repository Azure
  • Remove global repositories.azure settings {es-pull}23262[#23262] (issues: {es-issue}22800[#22800], {es-issue}22856[#22856])

  • Remove auto creation of container for azure repository {es-pull}22858[#22858] (issue: {es-issue}22857[#22857])

Plugin Repository S3
  • S3 Repository: Cleanup deprecated settings {es-pull}24097[#24097]

  • S3 Repository: Remove region setting {es-pull}22853[#22853] (issue: {es-issue}22758[#22758])

  • S3 Repository: Remove bucket auto create {es-pull}22846[#22846] (issue: {es-issue}22761[#22761])

  • S3 Repository: Remove env var and sysprop credentials support {es-pull}22842[#22842]

Query DSL
  • Remove deprecated minimum_number_should_match in BoolQueryBuilder {es-pull}22416[#22416]

  • Remove support for empty queries {es-pull}22092[#22092] (issue: {es-issue}17624[#17624])

  • Remove deprecated query names: in, geo_bbox, mlt, fuzzy_match and match_fuzzy {es-pull}21852[#21852]

  • The terms query should always map to a Lucene TermsQuery. {es-pull}21786[#21786]

  • Be strict when parsing values searching for booleans {es-pull}21555[#21555] (issue: {es-issue}21545[#21545])

  • Remove collect payloads parameter {es-pull}20385[#20385]

REST
  • Remove ldjson support and document ndjson for bulk/msearch {es-pull}23049[#23049] (issue: {es-issue}23025[#23025])

  • Enable strict duplicate checks for all XContent types {es-pull}22225[#22225] (issues: {es-issue}19614[#19614], {es-issue}22073[#22073])

  • Enable strict duplicate checks for JSON content {es-pull}22073[#22073] (issue: {es-issue}19614[#19614])

  • Remove lenient stats parsing {es-pull}21417[#21417] (issues: {es-issue}20722[#20722], {es-issue}21410[#21410])

  • Remove allow unquoted JSON {es-pull}20388[#20388] (issues: {es-issue}17674[#17674], {es-issue}17801[#17801])

  • Remove FORCE version_type {es-pull}20377[#20377] (issue: {es-issue}19769[#19769])

Scripting
  • Make dates be ReadableDateTimes in scripts {es-pull}22948[#22948] (issue: {es-issue}22875[#22875])

  • Remove groovy scripting language {es-pull}21607[#21607]

Search
  • ProfileResult and CollectorResult should print machine readable timing information {es-pull}22561[#22561]

  • Remove indices query {es-pull}21837[#21837] (issue: {es-issue}17710[#17710])

  • Remove ignored type parameter in search_shards api {es-pull}21688[#21688]

Security
  • A new bootstrap check enforces that default passwords are disabled for the built-in users when running in {ref}/bootstrap-checks.html#dev-vs-prod-mode[production mode]. You must set xpack.security.authc.accept_default_password to false in your elasticsearch.yml. For more information, see [security-settings] and [setting-up-authentication].

  • A new configuration setting is available to disable support for the default password ("changeme"). For more information, see {ref}/built-in-users.html#disabling-default-password[Disable default password functionality].

Sequence IDs
  • Change certain replica failures not to fail the replica shard {es-pull}22874[#22874] (issue: {es-issue}10708[#10708])

Shadow Replicas
  • Remove shadow replicas {es-pull}23906[#23906] (issue: {es-issue}22024[#22024])

Watcher
  • The built-in HTTP client used in webhooks, the http input and the http email attachment has been replaced. This results in the need to always escape all parts of an URL.

  • The new built-in HTTP client also enforces a maximum request size, which defaults to 10mb.

Breaking Java Changes

Java API
  • Java api: ActionRequestBuilder#execute to return a PlainActionFuture {es-pull}24415[#24415] (issues: {es-issue}24412[#24412], {es-issue}9201[#9201])

Network
  • Simplify TransportAddress {es-pull}20798[#20798]

Deprecations

Index Templates
  • Restore deprecation warning for invalid match_mapping_type values {es-pull}22304[#22304]

Internal
  • Deprecate XContentType auto detection methods in XContentFactory {es-pull}22181[#22181] (issue: {es-issue}19388[#19388])

New Features

Core
  • Enable index-time sorting {es-pull}24055[#24055] (issue: {es-issue}6720[#6720])

Enhancements

Aggregations
  • Agg builder accessibility fixes {es-pull}24323[#24323]

  • Remove support for the include/pattern syntax. {es-pull}23141[#23141] (issue: {es-issue}22933[#22933])

  • Promote longs to doubles when a terms agg mixes decimal and non-decimal numbers {es-pull}22449[#22449] (issue: {es-issue}22232[#22232])

Analysis
  • Match- and MultiMatchQueryBuilder should only allow setting analyzer on string values {es-pull}23684[#23684] (issue: {es-issue}21665[#21665])

Bulk
  • Simplify bulk request execution {es-pull}20109[#20109]

CRUD
  • Added validation for upsert request {es-pull}24282[#24282] (issue: {es-issue}16671[#16671])

Cluster
  • Separate publishing from applying cluster states {es-pull}24236[#24236]

  • Adds cluster state size to /_cluster/state response {es-pull}23440[#23440] (issue: {es-issue}3415[#3415])

Core
  • Remove connect SocketPermissions from core {es-pull}22797[#22797]

  • Add repository-url module and move URLRepository {es-pull}22752[#22752] (issue: {es-issue}22116[#22116])

  • Remove accept SocketPermissions from core {es-pull}22622[#22622] (issue: {es-issue}22116[#22116])

  • Move IfConfig.logIfNecessary call into bootstrap {es-pull}22455[#22455] (issue: {es-issue}22116[#22116])

  • Remove artificial default processors limit {es-pull}20874[#20874] (issue: {es-issue}20828[#20828])

  • Simplify write failure handling {es-pull}19105[#19105] (issue: {es-issue}20109[#20109])

Engine
  • Fill missing sequence IDs up to max sequence ID when recovering from store {es-pull}24238[#24238] (issue: {es-issue}10708[#10708])

  • Use sequence numbers to identify out of order delivery in replicas & recovery {es-pull}24060[#24060] (issue: {es-issue}10708[#10708])

  • Add replica ops with version conflict to translog {es-pull}22626[#22626]

  • Clarify global checkpoint recovery {es-pull}21934[#21934] (issue: {es-issue}21254[#21254])

Internal
  • Try to convince the JVM not to lose stacktraces {es-pull}24426[#24426] (issue: {es-issue}24376[#24376])

  • Make document write requests immutable {es-pull}23038[#23038]

Java High Level REST Client
  • Add info method to High Level Rest client {es-pull}23350[#23350]

  • Add support for named xcontent parsers to high level REST client {es-pull}23328[#23328]

  • Add BulkRequest support to High Level Rest client {es-pull}23312[#23312]

  • Add UpdateRequest support to High Level Rest client {es-pull}23266[#23266]

  • Add delete API to the High Level Rest Client {es-pull}23187[#23187]

  • Add Index API to High Level Rest Client {es-pull}23040[#23040]

  • Add get/exists method to RestHighLevelClient {es-pull}22706[#22706]

  • Add fromxcontent methods to delete response {es-pull}22680[#22680] (issue: {es-issue}22229[#22229])

  • Add REST high level client gradle submodule and first simple method {es-pull}22371[#22371]

Java REST Client
  • Wrap rest httpclient with doPrivileged blocks {es-pull}22603[#22603] (issue: {es-issue}22116[#22116])

Mapping
  • Date detection should not rely on a hardcoded set of characters. {es-pull}22171[#22171] (issue: {es-issue}1694[#1694])

Network
  • Isolate SocketPermissions to Netty {es-pull}23057[#23057]

  • Wrap netty accept/connect ops with doPrivileged {es-pull}22572[#22572] (issue: {es-issue}22116[#22116])

  • Replace Socket, ServerSocket, and HttpServer usages in tests with mocksocket versions {es-pull}22287[#22287] (issue: {es-issue}22116[#22116])

Plugin Discovery EC2
  • Read ec2 discovery address from aws instance tags {es-pull}22743[#22743] (issue: {es-issue}22566[#22566])

Plugin Repository HDFS
  • Add doPrivilege blocks for socket connect ops in repository-hdfs {es-pull}22793[#22793] (issue: {es-issue}22116[#22116])

Plugins
  • Add doPrivilege blocks for socket connect operations in plugins {es-pull}22534[#22534] (issue: {es-issue}22116[#22116])

Recovery
  • Peer Recovery: remove maxUnsafeAutoIdTimestamp hand off {es-pull}24243[#24243] (issue: {es-issue}24149[#24149])

  • Introduce sequence-number-based recovery {es-pull}22484[#22484] (issue: {es-issue}10708[#10708])

Search
  • Add parsing from xContent to Suggest {es-pull}22903[#22903]

  • Add parsing from xContent to ShardSearchFailure {es-pull}22699[#22699]

Sequence IDs
  • Block global checkpoint advances when recovering {es-pull}24404[#24404] (issue: {es-issue}10708[#10708])

  • Add primary term to doc write response {es-pull}24171[#24171] (issue: {es-issue}10708[#10708])

  • Preserve multiple translog generations {es-pull}24015[#24015] (issue: {es-issue}10708[#10708])

  • Introduce translog generation rolling {es-pull}23606[#23606] (issue: {es-issue}10708[#10708])

  • Replicate write failures {es-pull}23314[#23314]

  • Introduce sequence-number-aware translog {es-pull}22822[#22822] (issue: {es-issue}10708[#10708])

  • Introduce translog no-op {es-pull}22291[#22291] (issue: {es-issue}10708[#10708])

  • Tighten sequence numbers recovery {es-pull}22212[#22212] (issue: {es-issue}10708[#10708])

  • Add BWC layer to seq no infra and enable BWC tests {es-pull}22185[#22185] (issue: {es-issue}21670[#21670])

  • Add internal _primary_term doc values field, fix _seq_no indexing {es-pull}21637[#21637] (issues: {es-issue}10708[#10708], {es-issue}21480[#21480])

  • Add global checkpoint to translog checkpoints {es-pull}21254[#21254]

  • Sequence numbers commit data for Lucene uses Iterable interface {es-pull}20793[#20793] (issue: {es-issue}10708[#10708])

  • Simplify GlobalCheckpointService and properly hook it for cluster state updates {es-pull}20720[#20720]

Stats
  • Expose disk usage estimates in nodes stats {es-pull}22081[#22081] (issue: {es-issue}8686[#8686])

Store
  • Remote support for lucene versions without checksums {es-pull}24021[#24021]

Suggesters
  • Remove deprecated _suggest endpoint {es-pull}22203[#22203] (issue: {es-issue}20305[#20305])

Task Manager
  • Add descriptions to bulk tasks {es-pull}22059[#22059] (issue: {es-issue}21768[#21768])

Bug Fixes

Ingest
  • Remove support for Visio and potm files {es-pull}22079[#22079] (issue: {es-issue}22077[#22077])

Inner Hits
  • If size / offset are out of bounds just do a plain count {es-pull}20556[#20556] (issue: {es-issue}20501[#20501])

Internal
  • Fix handling of document failure exception in InternalEngine {es-pull}22718[#22718]

Plugin Ingest Attachment
  • Add missing mime4j library {es-pull}22764[#22764] (issue: {es-issue}22077[#22077])

Plugin Repository S3
  • Wrap getCredentials() in a doPrivileged() block {es-pull}23297[#23297] (issues: {es-issue}22534[#22534], {es-issue}23271[#23271])

Sequence IDs
  • Avoid losing ops in file-based recovery {es-pull}22945[#22945] (issue: {es-issue}22484[#22484])

Snapshot/Restore
  • Keep snapshot restore state and routing table in sync {es-pull}20836[#20836] (issue: {es-issue}19774[#19774])

Translog
  • Fix Translog.Delete serialization for sequence numbers {es-pull}22543[#22543]

Watcher
  • The HTTP client respects timeouts now and does not get stuck leading to stuck watches.

Regressions

Bulk
  • Only re-parse operation if a mapping update was needed {es-pull}23832[#23832] (issue: {es-issue}23665[#23665])

Upgrades

Core
  • Upgrade to a Lucene 7 snapshot {es-pull}24089[#24089] (issues: {es-issue}23966[#23966], {es-issue}24086[#24086], {es-issue}24087[#24087], {es-issue}24088[#24088])

Plugin Ingest Attachment
  • Update to Tika 1.14 {es-pull}21591[#21591] (issue: {es-issue}20390[#20390])

{es} version 6.0.0-alpha1 (Changes previously released in 5.x)

The changes listed below were first released in the 5.x series. Changes released for the first time in Elasticsearch 6.0.0-alpha1 are listed in {es} version 6.0.0-alpha1.

Breaking Changes

Aliases
  • Validate alias names the same as index names {es-pull}20771[#20771] (issue: {es-issue}20748[#20748])

CRUD
  • Fixed naming inconsistency for fields/stored_fields in the APIs {es-pull}20166[#20166] (issues: {es-issue}18943[#18943], {es-issue}20155[#20155])

Core
  • Add system call filter bootstrap check {es-pull}21940[#21940]

  • Remove ignore system bootstrap checks {es-pull}20511[#20511]

Internal
  • _flush should block by default {es-pull}20597[#20597] (issue: {es-issue}20569[#20569])

Packaging
  • Rename service.bat to elasticsearch-service.bat {es-pull}20496[#20496] (issue: {es-issue}17528[#17528])

Plugin Lang Painless
  • Remove all date 'now' methods from Painless {es-pull}20766[#20766] (issue: {es-issue}20762[#20762])

Query DSL
  • Fix name of enabled_position_increments {es-pull}22895[#22895]

REST
  • Change separator for shards preference {es-pull}20786[#20786] (issues: {es-issue}20722[#20722], {es-issue}20769[#20769])

Search
  • Remove DFS_QUERY_AND_FETCH as a search type {es-pull}22787[#22787]

Settings
  • Remove support for default settings {es-pull}24093[#24093] (issues: {es-issue}23981[#23981], {es-issue}24052[#24052], {es-issue}24074[#24074])

Breaking Java Changes

Aggregations
  • Move getProperty method out of MultiBucketsAggregation.Bucket interface {es-pull}23988[#23988]

  • Remove getProperty method from Aggregations interface and impl {es-pull}23972[#23972]

  • Move getProperty method out of Aggregation interface {es-pull}23949[#23949]

Allocation
  • Cluster Explain API uses the allocation process to explain shard allocation decisions {es-pull}22182[#22182] (issues: {es-issue}20347[#20347], {es-issue}20634[#20634], {es-issue}21103[#21103], {es-issue}21662[#21662], {es-issue}21691[#21691])

Cluster
  • Remove PROTO-based custom cluster state components {es-pull}22336[#22336] (issue: {es-issue}21868[#21868])

Core
  • Remove ability to plug-in TransportService {es-pull}20505[#20505]

Discovery
  • Remove pluggability of ElectMasterService {es-pull}21031[#21031]

Exceptions
  • Remove IndexTemplateAlreadyExistsException and IndexShardAlreadyExistsException {es-pull}21539[#21539] (issue: {es-issue}21494[#21494])

  • Replace IndexAlreadyExistsException with ResourceAlreadyExistsException {es-pull}21494[#21494]

Ingest
  • Change type of ingest doc meta-data field 'TIMESTAMP' to Date {es-pull}22234[#22234] (issue: {es-issue}22074[#22074])

Internal
  • Replace SearchExtRegistry with namedObject {es-pull}22492[#22492]

  • Replace Suggesters with namedObject {es-pull}22491[#22491]

  • Consolidate the last easy parser construction {es-pull}22095[#22095]

  • Introduce XContentParser#namedObject {es-pull}22003[#22003]

  • Pass executor name to request interceptor to support async intercept calls {es-pull}21089[#21089]

  • Remove TransportService#registerRequestHandler leniency {es-pull}20469[#20469] (issue: {es-issue}20468[#20468])

Java API
  • Fold InternalSearchHits and friends into their interfaces {es-pull}23042[#23042]

Network
  • Remove HttpServer and HttpServerAdapter in favor of a simple dispatch method {es-pull}22636[#22636] (issue: {es-issue}18482[#18482])

  • Unguice Transport and friends {es-pull}20526[#20526]

Plugins
  • Deguice rest handlers {es-pull}22575[#22575]

  • Plugins: Replace Rest filters with RestHandler wrapper {es-pull}21905[#21905]

  • Plugins: Remove support for onModule {es-pull}21416[#21416]

  • Cleanup sub fetch phase extension point {es-pull}20382[#20382]

Query DSL
  • Resolve index names in indices_boost {es-pull}21393[#21393] (issue: {es-issue}4756[#4756])

Scripting
  • Refactor ScriptType to be a Top-Level Class {es-pull}21136[#21136]

Search
  • Remove QUERY_AND_FETCH search type {es-pull}22996[#22996]

  • Cluster search shards improvements: expose ShardId, adjust visibility of some members {es-pull}21752[#21752]

Deprecations

Java API
  • Add BulkProcessor methods with XContentType parameter {es-pull}23078[#23078] (issue: {es-issue}22691[#22691])

  • Deprecate and remove "minimumNumberShouldMatch" in BoolQueryBuilder {es-pull}22403[#22403]

Plugin Repository S3
  • S3 Repository: Deprecate remaining repositories.s3.* settings {es-pull}24144[#24144] (issue: {es-issue}24143[#24143])

  • Deprecate specifying credentials through env vars, sys props, and remove profile files {es-pull}22567[#22567] (issues: {es-issue}21041[#21041], {es-issue}22479[#22479])

Query DSL
  • Add deprecation logging message for 'fuzzy' query {es-pull}20993[#20993] (issue: {es-issue}15760[#15760])

REST
  • Optionally require a valid content type for all rest requests with content {es-pull}22691[#22691] (issue: {es-issue}19388[#19388])

Scripting
  • Change Namespace for Stored Script to Only Use Id {es-pull}22206[#22206]

Shadow Replicas
  • Add a deprecation notice to shadow replicas {es-pull}22647[#22647] (issue: {es-issue}22024[#22024])

Stats
  • Deprecate _field_stats endpoint {es-pull}23914[#23914]

New Features

Aggregations
  • Initial version of an adjacency matrix using the Filters aggregation {es-pull}22239[#22239] (issue: {es-issue}22169[#22169])

Analysis
  • Adds pattern keyword marker filter support {es-pull}23600[#23600] (issue: {es-issue}4877[#4877])

  • Expose WordDelimiterGraphTokenFilter {es-pull}23327[#23327] (issue: {es-issue}23104[#23104])

  • Synonym Graph Support (LUCENE-6664) {es-pull}21517[#21517]

  • Expose Lucenes Ukrainian analyzer {es-pull}21176[#21176] (issue: {es-issue}19433[#19433])

CAT API
  • Provides a cat api endpoint for templates. {es-pull}20545[#20545] (issue: {es-issue}20467[#20467])

CRUD
  • Allow an index to be partitioned with custom routing {es-pull}22274[#22274] (issue: {es-issue}21585[#21585])

Highlighting
  • Integrate UnifiedHighlighter {es-pull}21621[#21621] (issue: {es-issue}21376[#21376])

Index APIs
  • Add FieldCapabilities (_field_caps) API {es-pull}23007[#23007] (issue: {es-issue}22438[#22438])

Ingest
  • introduce KV Processor in Ingest Node {es-pull}22272[#22272] (issue: {es-issue}22222[#22222])

Mapping
  • Add the ability to set a normalizer on keyword fields. {es-pull}21919[#21919] (issue: {es-issue}18064[#18064])

  • Add RangeFieldMapper for numeric and date range types {es-pull}21002[#21002] (issue: {es-issue}20999[#20999])

Plugin Discovery File
  • File-based discovery plugin {es-pull}20394[#20394] (issue: {es-issue}20323[#20323])

Query DSL
  • Add "all fields" execution mode to simple_query_string query {es-pull}21341[#21341] (issues: {es-issue}19784[#19784], {es-issue}20925[#20925])

  • Add support for quote_field_suffix to simple_query_string. {es-pull}21060[#21060] (issue: {es-issue}18641[#18641])

  • Add "all field" execution mode to query_string query {es-pull}20925[#20925] (issue: {es-issue}19784[#19784])

Reindex API
  • Add automatic parallelization support to reindex and friends {es-pull}20767[#20767] (issue: {es-issue}20624[#20624])

Search
  • Introduce incremental reduction of TopDocs {es-pull}23946[#23946]

  • Add federated cross cluster search capabilities {es-pull}22502[#22502] (issue: {es-issue}21473[#21473])

  • Add field collapsing for search request {es-pull}22337[#22337] (issue: {es-issue}21833[#21833])

Settings
  • Add infrastructure for elasticsearch keystore {es-pull}22335[#22335]

Similarities
  • Adds boolean similarity to Elasticsearch {es-pull}23637[#23637] (issue: {es-issue}6731[#6731])

Enhancements

Aggregations
  • Add count to rest output of geo_centroid {es-pull}24387[#24387] (issue: {es-issue}24366[#24366])

  • Allow scripted metric agg to access _score {es-pull}24295[#24295]

  • Add BucketMetricValue interface {es-pull}24188[#24188]

  • Move aggs CommonFields and TYPED_KEYS_DELIMITER from InternalAggregation to Aggregation {es-pull}23987[#23987]

  • Use ParseField for aggs CommonFields rather than String {es-pull}23717[#23717]

  • Share XContent rendering code in terms aggs {es-pull}23680[#23680]

  • Add unit tests for ParentToChildAggregator {es-pull}23305[#23305] (issue: {es-issue}22278[#22278])

  • First step towards incremental reduction of query responses {es-pull}23253[#23253]

  • value_type is useful regardless of scripting. {es-pull}22160[#22160] (issue: {es-issue}20163[#20163])

  • Support for partitioning set of terms {es-pull}21626[#21626] (issue: {es-issue}21487[#21487])

  • Rescorer should be applied in the TopHits aggregation {es-pull}20978[#20978] (issue: {es-issue}19317[#19317])

Aliases
  • Handle multiple aliases in _cat/aliases api {es-pull}23698[#23698] (issue: {es-issue}23661[#23661])

Allocation
  • Trigger replica recovery restarts by master when primary relocation completes {es-pull}23926[#23926] (issue: {es-issue}23904[#23904])

  • Makes the same_shard host dynamically updatable {es-pull}23397[#23397] (issue: {es-issue}22992[#22992])

  • Include stale replica shard info when explaining an unassigned primary {es-pull}22826[#22826]

  • Adds setting level to allocation decider explanations {es-pull}22268[#22268] (issue: {es-issue}21771[#21771])

  • Improves allocation decider decision explanation messages {es-pull}21771[#21771]

  • Prepares allocator decision objects for use with the allocation explain API {es-pull}21691[#21691]

  • Balance step in BalancedShardsAllocator for a single shard {es-pull}21103[#21103]

  • Process more expensive allocation deciders last {es-pull}20724[#20724] (issue: {es-issue}12815[#12815])

  • Separates decision making from decision application in BalancedShardsAllocator {es-pull}20634[#20634]

Analysis
  • Support Keyword type in Analyze API {es-pull}23161[#23161]

  • Expose FlattenGraphTokenFilter {es-pull}22643[#22643]

  • Analyze API Position Length Support {es-pull}22574[#22574]

  • Remove AnalysisService and reduce it to a simple name to analyzer mapping {es-pull}20627[#20627] (issues: {es-issue}19827[#19827], {es-issue}19828[#19828])

CAT API
  • Adding built-in sorting capability to _cat apis. {es-pull}20658[#20658] (issue: {es-issue}16975[#16975])

  • Add health status parameter to cat indices API {es-pull}20393[#20393]

CRUD
  • Use correct block levels for TRA subclasses {es-pull}22224[#22224]

  • Make index and delete operation execute as a single bulk item {es-pull}21964[#21964]

Cache
  • Do not cache term queries. {es-pull}21566[#21566] (issues: {es-issue}16031[#16031], {es-issue}20116[#20116])

  • Parse alias filters on the coordinating node {es-pull}20916[#20916]

Circuit Breakers
  • Closing a ReleasableBytesStreamOutput closes the underlying BigArray {es-pull}23941[#23941]

  • Add used memory amount to CircuitBreakingException message (#22521) {es-pull}22693[#22693] (issue: {es-issue}22521[#22521])

  • Cluster Settings Updates should not trigger circuit breakers. {es-pull}20827[#20827]

Cluster
  • Extract a common base class to allow services to listen to remote cluster config updates {es-pull}24367[#24367]

  • Prevent nodes from joining if newer indices exist in the cluster {es-pull}23843[#23843]

  • Connect to new nodes concurrently {es-pull}22984[#22984] (issue: {es-issue}22828[#22828])

  • Keep NodeConnectionsService in sync with current nodes in the cluster state {es-pull}22509[#22509]

  • Add a generic way of checking version before serializing custom cluster object {es-pull}22376[#22376] (issue: {es-issue}22313[#22313])

  • Add validation for supported index version on node join, restore, upgrade & open index {es-pull}21830[#21830] (issue: {es-issue}21670[#21670])

  • Let ClusterStateObserver only hold onto state that’s needed for change detection {es-pull}21631[#21631] (issue: {es-issue}21568[#21568])

  • Cache successful shard deletion checks {es-pull}21438[#21438]

  • Remove mutable status field from cluster state {es-pull}21379[#21379]

  • Skip shard management code when updating cluster state on client/tribe nodes {es-pull}20731[#20731]

  • Add clusterUUID to RestMainAction output {es-pull}20503[#20503]

Core
  • Regex upgrades {es-pull}24316[#24316] (issue: {es-issue}24226[#24226])

  • Detect remnants of path.data/default.path.data bug {es-pull}24099[#24099] (issues: {es-issue}23981[#23981], {es-issue}24052[#24052], {es-issue}24074[#24074], {es-issue}24093[#24093])

  • Await termination after shutting down executors {es-pull}23889[#23889]

  • Add early-access check {es-pull}23743[#23743] (issue: {es-issue}23668[#23668])

  • Adapter action future should restore interrupts {es-pull}23618[#23618] (issue: {es-issue}23617[#23617])

  • Disable bootstrap checks for single-node discovery {es-pull}23598[#23598] (issues: {es-issue}23585[#23585], {es-issue}23595[#23595])

  • Enable explicitly enforcing bootstrap checks {es-pull}23585[#23585] (issue: {es-issue}21864[#21864])

  • Add equals/hashcode method to ReplicationResponse {es-pull}23215[#23215]

  • Simplify ElasticsearchException rendering as a XContent {es-pull}22611[#22611]

  • Remove setLocalNode from ClusterService and TransportService {es-pull}22608[#22608]

  • Rename bootstrap.seccomp to bootstrap.system_call_filter {es-pull}22226[#22226] (issue: {es-issue}21940[#21940])

  • Cleanup random stats serialization code {es-pull}22223[#22223]

  • Avoid corruption when deserializing booleans {es-pull}22152[#22152]

  • Reduce memory pressure when sending large terms queries. {es-pull}21776[#21776]

  • Install a security manager on startup {es-pull}21716[#21716]

  • Log node ID on startup {es-pull}21673[#21673]

  • Ensure source filtering automatons are only compiled once {es-pull}20857[#20857] (issue: {es-issue}20839[#20839])

  • Improve scheduling fairness when batching cluster state changes with equal priority {es-pull}20775[#20775] (issue: {es-issue}20768[#20768])

  • Add production warning for pre-release builds {es-pull}20674[#20674]

  • Add serial collector bootstrap check {es-pull}20558[#20558]

  • Do not log full bootstrap checks exception {es-pull}19989[#19989]

Dates
  • Improve error handling for epoch format parser with time zone (#22621) {es-pull}23689[#23689]

Discovery
  • Introduce single-node discovery {es-pull}23595[#23595]

  • UnicastZenPing shouldn’t ping the address of the local node {es-pull}23567[#23567]

  • MasterFaultDetection can start after the initial cluster state has been processed {es-pull}23037[#23037] (issue: {es-issue}22828[#22828])

  • Simplify Unicast Zen Ping {es-pull}22277[#22277] (issues: {es-issue}19370[#19370], {es-issue}21739[#21739], {es-issue}22120[#22120], {es-issue}22194[#22194])

  • Prefer joining node with conflicting transport address when becoming master {es-pull}22134[#22134] (issues: {es-issue}22049[#22049], {es-issue}22120[#22120])

Engine
  • Engine: store maxUnsafeAutoIdTimestamp in commit {es-pull}24149[#24149]

  • Replace EngineClosedException with AlreadyClosedExcpetion {es-pull}22631[#22631]

Exceptions
  • Add BWC layer for Exceptions {es-pull}21694[#21694] (issue: {es-issue}21656[#21656])

Geo
  • Optimize geo-distance sorting. {es-pull}20596[#20596] (issue: {es-issue}20450[#20450])

Highlighting
  • Add support for fragment_length in the unified highlighter {es-pull}23431[#23431]

  • Add BreakIteratorBoundaryScanner support {es-pull}23248[#23248]

Index APIs
  • Open and close index to honour allow_no_indices option {es-pull}24222[#24222] (issue: {es-issue}24031[#24031])

  • Wildcard cluster names for cross cluster search {es-pull}23985[#23985] (issue: {es-issue}23893[#23893])

  • Indexing: Add shard id to indexing operation listener {es-pull}22606[#22606]

  • Better error when can’t auto create index {es-pull}22488[#22488] (issues: {es-issue}21448[#21448], {es-issue}22435[#22435])

  • Add date-math support to _rollover {es-pull}20709[#20709]

Ingest
  • Lazy load the geoip databases {es-pull}23337[#23337]

  • add ignore_missing flag to ingest plugins {es-pull}22273[#22273]

  • Added ability to remove pipelines via wildcards (#22149) {es-pull}22191[#22191] (issue: {es-issue}22149[#22149])

  • Enables the ability to inject serialized json fields into root of document {es-pull}22179[#22179] (issue: {es-issue}21898[#21898])

  • compile ScriptProcessor inline scripts when creating ingest pipelines {es-pull}21858[#21858] (issue: {es-issue}21842[#21842])

  • add ignore_missing option to SplitProcessor {es-pull}20982[#20982] (issues: {es-issue}19995[#19995], {es-issue}20840[#20840])

  • add ignore_missing option to convert,trim,lowercase,uppercase,grok,rename {es-pull}20194[#20194] (issue: {es-issue}19995[#19995])

  • introduce the JSON Processor {es-pull}20128[#20128] (issue: {es-issue}20052[#20052])

Internal
  • Add cross cluster support to _field_caps {es-pull}24463[#24463] (issue: {es-issue}24334[#24334])

  • Log JVM arguments on startup {es-pull}24451[#24451]

  • Preserve cluster alias throughout search execution to lookup nodes by cluster and ID {es-pull}24438[#24438]

  • Move RemoteClusterService into TransportService {es-pull}24424[#24424]

  • Enum related performance additions. {es-pull}24274[#24274] (issue: {es-issue}24226[#24226])

  • Add a dedicated TransportRemoteInfoAction for consistency {es-pull}24040[#24040] (issue: {es-issue}23969[#23969])

  • Simplify sorted top docs merging in SearchPhaseController {es-pull}23881[#23881]

  • Synchronized CollapseTopFieldDocs with lucenes relatives {es-pull}23854[#23854]

  • Cleanup SearchPhaseController interface {es-pull}23844[#23844]

  • Do not create String instances in 'Strings' methods accepting StringBuilder {es-pull}22907[#22907]

  • Improve connection closing in RemoteClusterConnection {es-pull}22804[#22804] (issue: {es-issue}22803[#22803])

  • Remove some more usages of ParseFieldMatcher {es-pull}22437[#22437] (issues: {es-issue}19552[#19552], {es-issue}22130[#22130])

  • Remove some more usages of ParseFieldMatcher {es-pull}22398[#22398] (issues: {es-issue}19552[#19552], {es-issue}22130[#22130])

  • Remove some more usages of ParseFieldMatcher {es-pull}22395[#22395] (issues: {es-issue}19552[#19552], {es-issue}22130[#22130])

  • Remove some ParseFieldMatcher usages {es-pull}22389[#22389] (issues: {es-issue}19552[#19552], {es-issue}22130[#22130])

  • Introduce ToXContentObject interface {es-pull}22387[#22387] (issue: {es-issue}16347[#16347])

  • Add infrastructure to manage network connections outside of Transport/TransportService {es-pull}22194[#22194]

  • Replace strict parsing mode with response headers assertions {es-pull}22130[#22130] (issues: {es-issue}11859[#11859], {es-issue}19552[#19552], {es-issue}20993[#20993])

  • Start using ObjectParser for aggs. {es-pull}22048[#22048] (issue: {es-issue}22009[#22009])

  • Don’t output null source node in RecoveryFailedException {es-pull}21963[#21963]

  • ClusterService should expose "applied" cluster states (i.e., remove ClusterStateStatus) {es-pull}21817[#21817]

  • Rename ClusterState#lookupPrototypeSafe to lookupPrototype and remove "unsafe" unused variant {es-pull}21686[#21686]

  • ShardActiveResponseHandler shouldn’t hold to an entire cluster state {es-pull}21470[#21470] (issue: {es-issue}21394[#21394])

  • Remove unused ClusterService dependency from SearchPhaseController {es-pull}21421[#21421]

  • Remove special case in case no action filters are registered {es-pull}21251[#21251]

  • Use TimveValue instead of long for CacheBuilder methods {es-pull}20887[#20887]

  • Remove SearchContext#current and all it’s threadlocals {es-pull}20778[#20778] (issue: {es-issue}19341[#19341])

  • Remove poor-mans compression in InternalSearchHit and friends {es-pull}20472[#20472]

Java API
  • Added types options to DeleteByQueryRequest {es-pull}23265[#23265] (issue: {es-issue}21984[#21984])

  • prevent NPE when trying to uncompress a null BytesReference {es-pull}22386[#22386]

Java High Level REST Client
  • Add utility method to parse named XContent objects with typed prefix {es-pull}24240[#24240] (issue: {es-issue}22965[#22965])

  • Convert suggestion response parsing to use NamedXContentRegistry {es-pull}23355[#23355]

  • UpdateRequest implements ToXContent {es-pull}23289[#23289]

  • Add javadoc for DocWriteResponse.Builders {es-pull}23267[#23267]

  • Expose WriteRequest.RefreshPolicy string representation {es-pull}23106[#23106]

  • Use typed_keys parameter to prefix suggester names by type in search responses {es-pull}23080[#23080] (issue: {es-issue}22965[#22965])

  • Add parsing from xContent to MainResponse {es-pull}22934[#22934]

  • Parse elasticsearch exception’s root causes {es-pull}22924[#22924]

  • Add parsing method to BytesRestResponse’s error {es-pull}22873[#22873]

  • Add parsing methods to BulkItemResponse {es-pull}22859[#22859]

  • Add parsing method for ElasticsearchException.generateFailureXContent() {es-pull}22815[#22815]

  • Add parsing method for ElasticsearchException.generateThrowableXContent() {es-pull}22783[#22783]

  • Add parsing methods for UpdateResponse {es-pull}22586[#22586]

  • Add parsing from xContent to InternalSearchHit and InternalSearchHits {es-pull}22429[#22429]

  • Add fromxcontent methods to index response {es-pull}22229[#22229]

  • Add fromXContent() methods for ReplicationResponse {es-pull}22196[#22196] (issue: {es-issue}22082[#22082])

  • Add parsing method for ElasticsearchException {es-pull}22143[#22143]

  • Add fromXContent method to GetResponse {es-pull}22082[#22082]

Java REST Client
  • move ignore parameter support from yaml test client to low level rest client {es-pull}22637[#22637]

  • Warn log deprecation warnings received from server {es-pull}21895[#21895]

  • Support Preemptive Authentication with RestClient {es-pull}21336[#21336]

  • Provide error message when rest request path is null {es-pull}21233[#21233] (issue: {es-issue}21232[#21232])

Logging
  • Log deleting indices at info level {es-pull}22627[#22627] (issue: {es-issue}22605[#22605])

  • Expose logs base path {es-pull}22625[#22625]

  • Log failure to connect to node at info instead of debug {es-pull}21809[#21809] (issue: {es-issue}6468[#6468])

  • Truncate log messages from the end {es-pull}21609[#21609] (issue: {es-issue}21602[#21602])

  • Ensure logging is initialized in CLI tools {es-pull}20575[#20575]

  • Give useful error message if log config is missing {es-pull}20493[#20493]

  • Complete Elasticsearch logger names {es-pull}20457[#20457] (issue: {es-issue}20326[#20326])

  • Logging shutdown hack {es-pull}20389[#20389] (issue: {es-issue}20304[#20304])

  • Disable console logging {es-pull}20387[#20387]

  • Warn on not enough masters during election {es-pull}20063[#20063] (issue: {es-issue}8362[#8362])

Mapping
  • Do not index _type when there is at most one type. {es-pull}24363[#24363]

  • Only allow one type on 6.0 indices {es-pull}24317[#24317] (issue: {es-issue}15613[#15613])

  • token_count type : add an option to count tokens (fix #23227) {es-pull}24175[#24175] (issue: {es-issue}23227[#23227])

  • Atomic mapping updates across types {es-pull}22220[#22220]

  • Only update DocumentMapper if field type changes {es-pull}22165[#22165]

  • Better error message when _parent isn’t an object {es-pull}21987[#21987]

  • Create the QueryShardContext lazily in DocumentMapperParser. {es-pull}21287[#21287]

Nested Docs
  • Avoid adding unnecessary nested filters when ranges are used. {es-pull}23427[#23427]

Network
  • Set available processors for Netty {es-pull}24420[#24420] (issue: {es-issue}6224[#6224])

  • Adjust default Netty receive predictor size to 64k {es-pull}23542[#23542] (issue: {es-issue}23185[#23185])

  • Keep the pipeline handler queue small initially {es-pull}23335[#23335]

  • Set network receive predictor size to 32kb {es-pull}23284[#23284] (issue: {es-issue}23185[#23185])

  • TransportService.connectToNode should validate remote node ID {es-pull}22828[#22828] (issue: {es-issue}22194[#22194])

  • Disable the Netty recycler {es-pull}22452[#22452] (issues: {es-issue}22189[#22189], {es-issue}22360[#22360], {es-issue}22406[#22406], {es-issue}5904[#5904])

  • Tell Netty not to be unsafe in transport client {es-pull}22284[#22284]

  • Introduce a low level protocol handshake {es-pull}22094[#22094]

  • Detach handshake from connect to node {es-pull}22037[#22037]

  • Reduce number of connections per node depending on the nodes role {es-pull}21849[#21849]

  • Add a connect timeout to the ConnectionProfile to allow per node connect timeouts {es-pull}21847[#21847] (issue: {es-issue}19719[#19719])

  • Grant Netty permission to read system somaxconn {es-pull}21840[#21840]

  • Remove connectToNodeLight and replace it with a connection profile {es-pull}21799[#21799]

  • Lazy resolve unicast hosts {es-pull}21630[#21630] (issues: {es-issue}14441[#14441], {es-issue}16412[#16412])

  • Fix handler name on message not fully read {es-pull}21478[#21478]

  • Handle rejected pings on shutdown gracefully {es-pull}20842[#20842]

  • Network: Allow to listen on virtual interfaces. {es-pull}19568[#19568] (issues: {es-issue}17473[#17473], {es-issue}19537[#19537])

Packaging
  • Introduce Java version check {es-pull}23194[#23194] (issue: {es-issue}21102[#21102])

  • Improve the out-of-the-box experience {es-pull}21920[#21920] (issues: {es-issue}18317[#18317], {es-issue}21783[#21783])

  • Add empty plugins dir for archive distributions {es-pull}21204[#21204] (issue: {es-issue}20342[#20342])

  • Make explicit missing settings for Windows service {es-pull}21200[#21200] (issue: {es-issue}18317[#18317])

  • Change permissions on config files {es-pull}20966[#20966]

  • Add quiet option to disable console logging {es-pull}20422[#20422] (issues: {es-issue}15315[#15315], {es-issue}16159[#16159], {es-issue}17220[#17220])

Percolator
  • Allowing range queries with now ranges inside percolator queries {es-pull}23921[#23921] (issue: {es-issue}23859[#23859])

  • Add term extraction support for MultiPhraseQuery {es-pull}23176[#23176]

Plugin Discovery EC2
  • Settings: Migrate ec2 discovery sensitive settings to elasticsearch keystore {es-pull}23961[#23961] (issue: {es-issue}22475[#22475])

  • Add support for ca-central-1 region to EC2 and S3 plugins {es-pull}22458[#22458] (issue: {es-issue}22454[#22454])

  • Support for eu-west-2 (London) cloud-aws plugin {es-pull}22308[#22308] (issue: {es-issue}22306[#22306])

  • Add us-east-2 AWS region {es-pull}21961[#21961] (issue: {es-issue}21881[#21881])

  • Add setting to set read timeout for EC2 discovery and S3 repository plugins {es-pull}21956[#21956] (issue: {es-issue}19078[#19078])

Plugin Ingest GeoIp
  • Cache results of geoip lookups {es-pull}22231[#22231] (issue: {es-issue}22074[#22074])

Plugin Lang Painless
  • Allow painless to load stored fields {es-pull}24290[#24290]

  • Start on custom whitelists for Painless {es-pull}23563[#23563]

  • Fix Painless’s implementation of interfaces returning primitives {es-pull}23298[#23298] (issue: {es-issue}22983[#22983])

  • Allow painless to implement more interfaces {es-pull}22983[#22983]

  • Generate reference links for painless API {es-pull}22775[#22775]

  • Painless: Add augmentation to String for base 64 {es-pull}22665[#22665] (issue: {es-issue}22648[#22648])

  • Improve painless’s ScriptException generation {es-pull}21762[#21762] (issue: {es-issue}21733[#21733])

  • Add Debug.explain to painless {es-pull}21723[#21723] (issue: {es-issue}20263[#20263])

  • Implement the ?: operator in painless {es-pull}21506[#21506]

  • In painless suggest a long constant if int won’t do {es-pull}21415[#21415] (issue: {es-issue}21313[#21313])

  • Support decimal constants with trailing [dD] in painless {es-pull}21412[#21412] (issue: {es-issue}21116[#21116])

  • Implement reading from null safe dereferences {es-pull}21239[#21239]

  • Painless negative offsets {es-pull}21080[#21080] (issue: {es-issue}20870[#20870])

  • Remove more equivalents of the now method from the Painless whitelist. {es-pull}21047[#21047]

  • Disable regexes by default in painless {es-pull}20427[#20427] (issue: {es-issue}20397[#20397])

Plugin Repository Azure
  • Add Backoff policy to azure repository {es-pull}23387[#23387] (issue: {es-issue}22728[#22728])

Plugin Repository S3
  • Removes the retry mechanism from the S3 blob store {es-pull}23952[#23952] (issue: {es-issue}22845[#22845])

  • S3 Repository: Eagerly load static settings {es-pull}23910[#23910]

  • S3 repository: Add named configurations {es-pull}22762[#22762] (issues: {es-issue}22479[#22479], {es-issue}22520[#22520])

  • Make the default S3 buffer size depend on the available memory. {es-pull}21299[#21299]

Plugins
  • Plugins: Add support for platform specific plugins {es-pull}24265[#24265]

  • Plugins: Remove leniency for missing plugins dir {es-pull}24173[#24173]

  • Modify permissions dialog for plugins {es-pull}23742[#23742]

  • Plugins: Add plugin cli specific exit codes {es-pull}23599[#23599] (issue: {es-issue}15295[#15295])

  • Plugins: Output better error message when existing plugin is incompatible {es-pull}23562[#23562] (issue: {es-issue}20691[#20691])

  • Add the ability to define search response listeners in search plugin {es-pull}22682[#22682]

  • Pass ThreadContext to transport interceptors to allow header modification {es-pull}22618[#22618] (issue: {es-issue}22585[#22585])

  • Provide helpful error message if a plugin exists {es-pull}22305[#22305] (issue: {es-issue}22084[#22084])

  • Add shutdown hook for closing CLI commands {es-pull}22126[#22126] (issue: {es-issue}22111[#22111])

  • Allow plugins to install bootstrap checks {es-pull}22110[#22110]

  • Clarify that plugins can be closed {es-pull}21669[#21669]

  • Plugins: Convert custom discovery to pull based plugin {es-pull}21398[#21398]

  • Removing plugin that isn’t installed shouldn’t trigger usage information {es-pull}21272[#21272] (issue: {es-issue}21250[#21250])

  • Remove pluggability of ZenPing {es-pull}21049[#21049]

  • Make UnicastHostsProvider extension pull based {es-pull}21036[#21036]

  • Revert "Display plugins versions" {es-pull}20807[#20807] (issues: {es-issue}18683[#18683], {es-issue}20668[#20668])

  • Provide error message when plugin id is missing {es-pull}20660[#20660]

Query DSL
  • Make it possible to validate a query on all shards instead of a single random shard {es-pull}23697[#23697] (issue: {es-issue}18254[#18254])

  • QueryString and SimpleQueryString Graph Support {es-pull}22541[#22541]

  • Additional Graph Support in Match Query {es-pull}22503[#22503] (issue: {es-issue}22490[#22490])

  • RangeQuery WITHIN case now normalises query {es-pull}22431[#22431] (issue: {es-issue}22412[#22412])

  • Un-deprecate fuzzy query {es-pull}22088[#22088] (issue: {es-issue}15760[#15760])

  • support numeric bounds with decimal parts for long/integer/short/byte datatypes {es-pull}21972[#21972] (issue: {es-issue}21600[#21600])

  • Using ObjectParser in MatchAllQueryBuilder and IdsQueryBuilder {es-pull}21273[#21273]

  • Expose splitOnWhitespace in Query String Query {es-pull}20965[#20965] (issue: {es-issue}20841[#20841])

  • Throw error if query element doesn’t end with END_OBJECT {es-pull}20528[#20528] (issue: {es-issue}20515[#20515])

  • Remove lowercase_expanded_terms and locale from query-parser options. {es-pull}20208[#20208] (issue: {es-issue}9978[#9978])

REST
  • Allow passing single scrollID in clear scroll API body {es-pull}24242[#24242] (issue: {es-issue}24233[#24233])

  • Validate top-level keys when parsing mget requests {es-pull}23746[#23746] (issue: {es-issue}23720[#23720])

  • Cluster stats should not render empty http/transport types {es-pull}23735[#23735]

  • Add parameter to prefix aggs name with type in search responses {es-pull}22965[#22965]

  • Add a REST spec for the create API {es-pull}20924[#20924]

  • Add response params to REST params did you mean {es-pull}20753[#20753] (issues: {es-issue}20722[#20722], {es-issue}20747[#20747])

  • Add did you mean to strict REST params {es-pull}20747[#20747] (issue: {es-issue}20722[#20722])

Reindex API
  • Increase visibility of doExecute so it can be used directly {es-pull}22614[#22614]

  • Improve error message when reindex-from-remote gets bad json {es-pull}22536[#22536] (issue: {es-issue}22330[#22330])

  • Reindex: Better error message for pipeline in wrong place {es-pull}21985[#21985]

  • Timeout improvements for rest client and reindex {es-pull}21741[#21741] (issue: {es-issue}21707[#21707])

  • Add "simple match" support for reindex-from-remote whitelist {es-pull}21004[#21004]

  • Make reindex-from-remote ignore unknown fields {es-pull}20591[#20591] (issue: {es-issue}20504[#20504])

Scripting
  • Expose multi-valued dates to scripts and document painless’s date functions {es-pull}22875[#22875] (issue: {es-issue}22162[#22162])

  • Wrap VerifyError in ScriptException {es-pull}21769[#21769]

  • Log ScriptException’s xcontent if file script compilation fails {es-pull}21767[#21767] (issue: {es-issue}21733[#21733])

  • Support binary field type in script values {es-pull}21484[#21484] (issue: {es-issue}14469[#14469])

  • Mustache: Add {{#url}}{{/url}} function to URL encode strings {es-pull}20838[#20838]

  • Expose ctx._now in update scripts {es-pull}20835[#20835] (issue: {es-issue}17895[#17895])

Search
  • Remove leniency when merging fetched hits in a search response phase {es-pull}24158[#24158]

  • Set shard count limit to unlimited {es-pull}24012[#24012]

  • Streamline shard index availability in all SearchPhaseResults {es-pull}23788[#23788]

  • Search took time should use a relative clock {es-pull}23662[#23662]

  • Prevent negative from parameter in SearchSourceBuilder {es-pull}23358[#23358] (issue: {es-issue}23324[#23324])

  • Remove unnecessary result sorting in SearchPhaseController {es-pull}23321[#23321]

  • Expose batched_reduce_size via _search {es-pull}23288[#23288] (issue: {es-issue}23253[#23253])

  • Adding fromXContent to Suggest and Suggestion class {es-pull}23226[#23226] (issue: {es-issue}23202[#23202])

  • Adding fromXContent to Suggestion.Entry and subclasses {es-pull}23202[#23202]

  • Add CollapseSearchPhase as a successor for the FetchSearchPhase {es-pull}23165[#23165]

  • Integrate IndexOrDocValuesQuery. {es-pull}23119[#23119]

  • Detach SearchPhases from AbstractSearchAsyncAction {es-pull}23118[#23118]

  • Fix GraphQuery expectation after Lucene upgrade to 6.5 {es-pull}23117[#23117] (issue: {es-issue}23102[#23102])

  • Nested queries should avoid adding unnecessary filters when possible. {es-pull}23079[#23079] (issue: {es-issue}20797[#20797])

  • Add xcontent parsing to completion suggestion option {es-pull}23071[#23071]

  • Add xcontent parsing to suggestion options {es-pull}23018[#23018]

  • Separate reduce (aggs, suggest and profile) from merging fetched hits {es-pull}23017[#23017]

  • Add a setting to disable remote cluster connections on a node {es-pull}23005[#23005]

  • First step towards separating individual search phases {es-pull}22802[#22802]

  • Add parsing from xContent to SearchProfileShardResults and nested classes {es-pull}22649[#22649]

  • Move SearchTransportService and SearchPhaseController creation outside of TransportSearchAction constructor {es-pull}21754[#21754]

  • Don’t carry ShardRouting around when not needed in AbstractSearchAsyncAction {es-pull}21753[#21753]

  • ShardSearchRequest to take ShardId constructor argument rather than the whole ShardRouting {es-pull}21750[#21750]

  • Use index uuid as key in the alias filter map rather than the index name {es-pull}21749[#21749]

  • Add indices and filter information to search shards api output {es-pull}21738[#21738] (issue: {es-issue}20916[#20916])

  • remove pointless catch exception in TransportSearchAction {es-pull}21689[#21689]

  • Optimize query with types filter in the URL (t/t/_search) {es-pull}20979[#20979]

  • Makes search action cancelable by task management API {es-pull}20405[#20405]

Search Templates
  • Add profile and explain parameters to template API {es-pull}20451[#20451]

Settings
  • Add secure file setting to keystore {es-pull}24001[#24001]

  • Add a property to mark setting as final {es-pull}23872[#23872]

  • Remove obsolete index setting index.version.minimum_compatible. {es-pull}23593[#23593]

  • Provide a method to retrieve a closeable char[] from a SecureString {es-pull}23389[#23389]

  • Update indices settings api to support CBOR and SMILE format {es-pull}23309[#23309] (issues: {es-issue}23242[#23242], {es-issue}23245[#23245])

  • Improve setting deprecation message {es-pull}23156[#23156] (issue: {es-issue}22849[#22849])

  • Add secure settings validation on startup {es-pull}22894[#22894]

  • Allow comma delimited array settings to have a space after each entry {es-pull}22591[#22591] (issue: {es-issue}22297[#22297])

  • Allow affix settings to be dynamic / updatable {es-pull}22526[#22526]

  • Allow affix settings to delegate to actual settings {es-pull}22523[#22523]

  • Make s3 repository sensitive settings use secure settings {es-pull}22479[#22479]

  • Speed up filter and prefix settings operations {es-pull}22249[#22249]

  • Add precise logging on unknown or invalid settings {es-pull}20951[#20951] (issue: {es-issue}20946[#20946])

Snapshot/Restore
  • Ensure every repository has an incompatible-snapshots blob {es-pull}24403[#24403] (issue: {es-issue}22267[#22267])

  • Change snapshot status error to use generic SnapshotException {es-pull}24355[#24355] (issue: {es-issue}24225[#24225])

  • Duplicate snapshot name throws InvalidSnapshotNameException {es-pull}22921[#22921] (issue: {es-issue}18228[#18228])

  • Fixes retrieval of the latest snapshot index blob {es-pull}22700[#22700]

  • Use general cluster state batching mechanism for snapshot state updates {es-pull}22528[#22528] (issue: {es-issue}14899[#14899])

  • Synchronize snapshot deletions on the cluster state {es-pull}22313[#22313] (issue: {es-issue}19957[#19957])

  • Abort snapshots on a node that leaves the cluster {es-pull}21084[#21084] (issue: {es-issue}20876[#20876])

Stats
  • Show JVM arguments {es-pull}24450[#24450]

  • Add cross-cluster search remote cluster info API {es-pull}23969[#23969] (issue: {es-issue}23925[#23925])

  • Add geo_point to FieldStats {es-pull}21947[#21947] (issue: {es-issue}20707[#20707])

  • Include unindexed field in FieldStats response {es-pull}21821[#21821] (issue: {es-issue}21952[#21952])

  • Remove load average leniency {es-pull}21380[#21380]

  • Strengthen handling of unavailable cgroup stats {es-pull}21094[#21094] (issue: {es-issue}21029[#21029])

  • Add basic cgroup CPU metrics {es-pull}21029[#21029]

Suggesters
  • Provide informative error message in case of unknown suggestion context. {es-pull}24241[#24241]

  • Allow different data types for category in Context suggester {es-pull}23491[#23491] (issue: {es-issue}22358[#22358])

Task Manager
  • Limit IndexRequest toString() length {es-pull}22832[#22832]

  • Improve the error message if task and node isn’t found {es-pull}22062[#22062] (issue: {es-issue}22027[#22027])

  • Add descriptions to create snapshot and restore snapshot tasks. {es-pull}21901[#21901] (issue: {es-issue}21768[#21768])

  • Add proper descriptions to reindex, update-by-query and delete-by-query tasks. {es-pull}21841[#21841] (issue: {es-issue}21768[#21768])

  • Add search task descriptions {es-pull}21740[#21740]

Tribe Node
  • Add support for merging custom meta data in tribe node {es-pull}21552[#21552] (issues: {es-issue}20544[#20544], {es-issue}20791[#20791], {es-issue}9372[#9372])

Upgrade API
  • Allow plugins to upgrade templates and index metadata on startup {es-pull}24379[#24379]

Bug Fixes

Aggregations
  • InternalPercentilesBucket should not rely on ordered percents array {es-pull}24336[#24336] (issue: {es-issue}24331[#24331])

  • Align behavior HDR percentiles iterator with percentile() method {es-pull}24206[#24206]

  • The filter and significant_terms aggregations should parse the filter as a filter, not a query. {es-pull}23797[#23797]

  • Completion suggestion should also consider text if prefix/regex is missing {es-pull}23451[#23451] (issue: {es-issue}23340[#23340])

  • Fixes the per term error in the terms aggregation {es-pull}23399[#23399]

  • Fixes terms error count for multiple reduce phases {es-pull}23291[#23291] (issue: {es-issue}23286[#23286])

  • Fix scaled_float numeric type in aggregations {es-pull}22351[#22351] (issue: {es-issue}22350[#22350])

  • Allow terms aggregations on pure boolean scripts. {es-pull}22201[#22201] (issue: {es-issue}20941[#20941])

  • Fix numeric terms aggregations with includes/excludes and minDocCount=0 {es-pull}22141[#22141] (issue: {es-issue}22140[#22140])

  • Fix missing on aggs on boolean fields. {es-pull}22135[#22135] (issue: {es-issue}22009[#22009])

  • IP range masks exclude the maximum address of the range. {es-pull}22018[#22018] (issue: {es-issue}22005[#22005])

  • Fix other_bucket on the filters agg to be enabled if a key is set. {es-pull}21994[#21994] (issue: {es-issue}21951[#21951])

  • Rewrite Queries/Filter in FilterAggregationBuilder and ensure client usage marks query as non-cachable {es-pull}21303[#21303] (issue: {es-issue}21301[#21301])

  • Percentiles bucket fails for 100th percentile {es-pull}21218[#21218]

  • Thread safety for scripted significance heuristics {es-pull}21113[#21113] (issue: {es-issue}18120[#18120])

  • ip_range aggregation should accept null bounds. {es-pull}21043[#21043] (issue: {es-issue}21006[#21006])

  • Fixes bug preventing script sort working on top_hits aggregation {es-pull}21023[#21023] (issue: {es-issue}21022[#21022])

  • Fixed writeable name from range to geo_distance {es-pull}20860[#20860]

  • Fix date_range aggregation to not cache if now is used {es-pull}20740[#20740]

  • The top_hits aggregation should compile scripts only once. {es-pull}20738[#20738]

Allocation
  • Discard stale node responses from async shard fetching {es-pull}24434[#24434] (issue: {es-issue}24007[#24007])

  • Cannot force allocate primary to a node where the shard already exists {es-pull}22031[#22031] (issue: {es-issue}22021[#22021])

  • Promote shadow replica to primary when initializing primary fails {es-pull}22021[#22021]

  • Trim in-sync allocations set only when it grows {es-pull}21976[#21976] (issue: {es-issue}21719[#21719])

  • Allow master to assign primary shard to node that has shard store locked during shard state fetching {es-pull}21656[#21656] (issue: {es-issue}19416[#19416])

  • Keep a shadow replicas' allocation id when it is promoted to primary {es-pull}20863[#20863] (issue: {es-issue}20650[#20650])

  • IndicesClusterStateService should clean local started when re-assigns an initializing shard with the same aid {es-pull}20687[#20687]

  • IndexRoutingTable.initializeEmpty shouldn’t override supplied primary RecoverySource {es-pull}20638[#20638] (issue: {es-issue}20637[#20637])

  • Update incoming recoveries stats when shadow replica is reinitialized {es-pull}20612[#20612]

  • index.routing.allocation.initial_recovery limits replica allocation {es-pull}20589[#20589]

Analysis
  • AsciiFoldingFilter’s multi-term component should never preserve the original token. {es-pull}21982[#21982]

  • Pre-built analysis factories do not implement MultiTermAware correctly. {es-pull}21981[#21981]

  • Can load non-PreBuiltTokenFilter in Analyze API {es-pull}20396[#20396]

  • Named analyzer should close the analyzer that it wraps {es-pull}20197[#20197]

Bulk
  • Reject empty IDs {es-pull}24118[#24118] (issue: {es-issue}24116[#24116])

CAT API
  • Consume full_id request parameter early {es-pull}21270[#21270] (issue: {es-issue}21266[#21266])

CRUD
  • Reject external versioning and explicit version numbers on create {es-pull}21998[#21998]

  • MultiGet should not fail entirely if alias resolves to many indices {es-pull}20858[#20858] (issue: {es-issue}20845[#20845])

  • Fixed date math expression support in multi get requests. {es-pull}20659[#20659] (issue: {es-issue}17957[#17957])

Cache
  • Invalidate cached query results if query timed out {es-pull}22807[#22807] (issue: {es-issue}22789[#22789])

  • Fix the request cache keys to not hold references to the SearchContext. {es-pull}21284[#21284]

  • Prevent requests that use scripts or now() from being cached {es-pull}20750[#20750] (issue: {es-issue}20645[#20645])

Circuit Breakers
  • ClusterState publishing shouldn’t trigger circuit breakers {es-pull}20986[#20986] (issues: {es-issue}20827[#20827], {es-issue}20960[#20960])

Cluster
  • Don’t set local node on cluster state used for node join validation {es-pull}23311[#23311] (issues: {es-issue}21830[#21830], {es-issue}3[#3], {es-issue}4[#4], {es-issue}6[#6], {es-issue}9[#9])

  • Allow a cluster state applier to create an observer and wait for a better state {es-pull}23132[#23132] (issue: {es-issue}21817[#21817])

  • Cluster allocation explain to never return empty response body {es-pull}23054[#23054]

  • IndicesService handles all exceptions during index deletion {es-pull}22433[#22433]

  • Remove cluster update task when task times out {es-pull}21578[#21578] (issue: {es-issue}21568[#21568])

Core
  • Check for default.path.data included in path.data {es-pull}24285[#24285] (issue: {es-issue}24283[#24283])

  • Improve performance of extracting warning value {es-pull}24114[#24114] (issue: {es-issue}24018[#24018])

  • Reject duplicate settings on the command line {es-pull}24053[#24053]

  • Restrict build info loading to ES jar, not any jar {es-pull}24049[#24049] (issue: {es-issue}21955[#21955])

  • Streamline foreign stored context restore and allow to perserve response headers {es-pull}22677[#22677] (issue: {es-issue}22647[#22647])

  • Support negative numbers in readVLong {es-pull}22314[#22314]

  • Add a StreamInput#readArraySize method that ensures sane array sizes {es-pull}21697[#21697]

  • Use a buffer to do character to byte conversion in StreamOutput#writeString {es-pull}21680[#21680] (issue: {es-issue}21660[#21660])

  • Fix ShardInfo#toString {es-pull}21319[#21319]

  • Protect BytesStreamOutput against overflows of the current number of written bytes. {es-pull}21174[#21174] (issue: {es-issue}21159[#21159])

  • Return target index name even if _rollover conditions are not met {es-pull}21138[#21138]

  • .es_temp_file remains after system crash, causing it not to start again {es-pull}21007[#21007] (issue: {es-issue}20992[#20992])

  • StoreStatsCache should also ignore AccessDeniedException when checking file size {es-pull}20790[#20790] (issue: {es-issue}17580[#17580])

Dates
  • Fix time zone rounding edge case for DST overlaps {es-pull}21550[#21550] (issue: {es-issue}20833[#20833])

Discovery
  • ZenDiscovery - only validate min_master_nodes values if local node is master {es-pull}23915[#23915] (issue: {es-issue}23695[#23695])

  • Close InputStream when receiving cluster state in PublishClusterStateAction {es-pull}22711[#22711]

  • Do not reply to pings from another cluster {es-pull}21894[#21894] (issue: {es-issue}21874[#21874])

  • Add current cluster state version to zen pings and use them in master election {es-pull}20384[#20384] (issue: {es-issue}20348[#20348])

Engine
  • Close and flush refresh listeners on shard close {es-pull}22342[#22342]

  • Die with dignity on the Lucene layer {es-pull}21721[#21721] (issue: {es-issue}19272[#19272])

  • Fix InternalEngine#isThrottled to not always return false. {es-pull}21592[#21592]

  • Retrying replication requests on replica doesn’t call onRetry {es-pull}21189[#21189] (issue: {es-issue}20211[#20211])

  • Take refresh IOExceptions into account when catching ACE in InternalEngine {es-pull}20546[#20546] (issue: {es-issue}19975[#19975])

Exceptions
  • Stop returning "es." internal exception headers as http response headers {es-pull}22703[#22703] (issue: {es-issue}17593[#17593])

  • Fixing shard recovery error message to report the number of docs correctly for each node {es-pull}22515[#22515] (issue: {es-issue}21893[#21893])

Highlighting
  • Fix FiltersFunctionScoreQuery highlighting {es-pull}21827[#21827]

  • Fix highlighting on a stored keyword field {es-pull}21645[#21645] (issue: {es-issue}21636[#21636])

  • Fix highlighting of MultiTermQuery within a FunctionScoreQuery {es-pull}20400[#20400] (issue: {es-issue}20392[#20392])

Index APIs
  • Fixes restore of a shrunken index when initial recovery node is gone {es-pull}24322[#24322] (issue: {es-issue}24257[#24257])

  • Honor update request timeout {es-pull}23825[#23825]

  • Ensure shrunk indices carry over version information from its source {es-pull}22469[#22469] (issue: {es-issue}22373[#22373])

  • Validate the _rollover target index name early to also fail if dry_run=true {es-pull}21330[#21330] (issue: {es-issue}21149[#21149])

  • Only negate index expression on all indices with preceding wildcard {es-pull}20898[#20898] (issues: {es-issue}19800[#19800], {es-issue}20033[#20033])

  • Fix IndexNotFoundException in multi index search request. {es-pull}20188[#20188] (issue: {es-issue}3839[#3839])

Index Templates
  • Fix integer overflows when dealing with templates. {es-pull}21628[#21628] (issue: {es-issue}21622[#21622])

Ingest
  • Improve missing ingest processor error {es-pull}23379[#23379] (issue: {es-issue}23392[#23392])

  • update _ingest.timestamp to use new ZonedDateTime {es-pull}23174[#23174] (issue: {es-issue}23168[#23168])

  • fix date-processor to a new default year for every new pipeline execution {es-pull}22601[#22601] (issue: {es-issue}22547[#22547])

  • fix index out of bounds error in KV Processor {es-pull}22288[#22288] (issue: {es-issue}22272[#22272])

  • Fixes GrokProcessor’s ignorance of named-captures with same name. {es-pull}22131[#22131] (issue: {es-issue}22117[#22117])

  • fix trace_match behavior for when there is only one grok pattern {es-pull}21413[#21413] (issue: {es-issue}21371[#21371])

  • Stored scripts and ingest node configurations should be included into a snapshot {es-pull}21227[#21227] (issue: {es-issue}21184[#21184])

  • make painless the default scripting language for ScriptProcessor {es-pull}20981[#20981] (issue: {es-issue}20943[#20943])

  • no null values in ingest configuration error messages {es-pull}20616[#20616]

  • JSON Processor was not properly added {es-pull}20613[#20613]

Inner Hits
  • Replace NestedChildrenQuery with ParentChildrenBlockJoinQuery {es-pull}24016[#24016] (issue: {es-issue}24009[#24009])

  • Changed DisMaxQueryBuilder to extract inner hits from leaf queries {es-pull}23512[#23512] (issue: {es-issue}23482[#23482])

  • Inner hits and ignore unmapped {es-pull}21693[#21693] (issue: {es-issue}21620[#21620])

  • Skip adding a parent field to nested documents. {es-pull}21522[#21522] (issue: {es-issue}21503[#21503])

Internal
  • Fix NPE if field caps request has a field that exists not in all indices {es-pull}24504[#24504]

  • Add infrastructure to mark contexts as system contexts {es-pull}23830[#23830]

  • Always restore the ThreadContext for operations delayed due to a block {es-pull}23349[#23349]

  • Index creation and setting update may not return deprecation logging {es-pull}22702[#22702]

  • Rethrow ExecutionException from the loader to concurrent callers of Cache#computeIfAbsent {es-pull}21549[#21549]

  • Restore thread’s original context before returning to the ThreadPool {es-pull}21411[#21411]

  • Fix NPE in SearchContext.toString() {es-pull}21069[#21069]

  • Prevent AbstractArrays from release bytes more than once {es-pull}20819[#20819]

  • Source filtering should treat dots in field names as sub objects. {es-pull}20736[#20736] (issue: {es-issue}20719[#20719])

  • IndicesAliasesRequest should not implement CompositeIndicesRequest {es-pull}20726[#20726]

  • Ensure elasticsearch doesn’t start with unuspported indices {es-pull}20514[#20514] (issue: {es-issue}20512[#20512])

Java API
  • Don’t output empty ext object in SearchSourceBuilder#toXContent {es-pull}22093[#22093] (issue: {es-issue}20969[#20969])

  • Transport client: Fix remove address to actually work {es-pull}21743[#21743]

  • Add a HostFailureListener to notify client code if a node got disconnected {es-pull}21709[#21709] (issue: {es-issue}21424[#21424])

  • Fix InternalSearchHit#hasSource to return the proper boolean value {es-pull}21441[#21441] (issue: {es-issue}21419[#21419])

  • Null checked for source when calling sourceRef {es-pull}21431[#21431] (issue: {es-issue}19279[#19279])

  • ClusterAdminClient.prepareDeletePipeline method should accept pipeline id to delete {es-pull}21228[#21228]

  • fix IndexResponse#toString to print out shards info {es-pull}20562[#20562]

Java High Level REST Client
  • Correctly parse BulkItemResponse.Failure’s status {es-pull}23432[#23432]

Java REST Client
  • Make buffer limit configurable in HeapBufferedConsumerFactory {es-pull}23970[#23970] (issue: {es-issue}23958[#23958])

  • RestClient asynchronous execution should not throw exceptions {es-pull}23307[#23307]

  • Don’t use null charset in RequestLogger {es-pull}22197[#22197] (issue: {es-issue}22190[#22190])

  • Rest client: don’t reuse the same HttpAsyncResponseConsumer across multiple retries {es-pull}21378[#21378]

Logging
  • Do not prematurely shutdown Log4j {es-pull}21519[#21519] (issue: {es-issue}21514[#21514])

  • Assert status logger does not warn on Log4j usage {es-pull}21339[#21339]

  • Fix logger names for Netty {es-pull}21223[#21223] (issue: {es-issue}20457[#20457])

  • Fix logger when you can not create an azure storage client {es-pull}20670[#20670] (issues: {es-issue}20633[#20633], {es-issue}20669[#20669])

  • Avoid unnecessary creation of prefix loggers {es-pull}20571[#20571] (issue: {es-issue}20570[#20570])

  • Fix logging hierarchy configs {es-pull}20463[#20463]

  • Fix prefix logging {es-pull}20429[#20429]

Mapping
  • Preserve response headers when creating an index {es-pull}23950[#23950] (issue: {es-issue}23947[#23947])

  • Improves disabled fielddata error message {es-pull}23841[#23841] (issue: {es-issue}22768[#22768])

  • Fix MapperService StackOverflowError {es-pull}23605[#23605] (issue: {es-issue}23604[#23604])

  • Fix NPE with scaled floats stats when field is not indexed {es-pull}23528[#23528] (issue: {es-issue}23487[#23487])

  • Range types causing GetFieldMappingsIndexRequest to fail due to NullPointerException in RangeFieldMapper.doXContentBody when include_defaults=true is on the query string {es-pull}22925[#22925]

  • Disallow introducing illegal object mappings (double '..') {es-pull}22891[#22891] (issue: {es-issue}22794[#22794])

  • The _all default mapper is not completely configured. {es-pull}22236[#22236]

  • Fix MapperService.allEnabled(). {es-pull}22227[#22227]

  • Dynamic date fields should use the format that was used to detect it is a date. {es-pull}22174[#22174] (issue: {es-issue}9410[#9410])

  • Sub-fields should not accept include_in_all parameter {es-pull}21971[#21971] (issue: {es-issue}21710[#21710])

  • Mappings: Fix get mapping when no indexes exist to not fail in response generation {es-pull}21924[#21924] (issue: {es-issue}21916[#21916])

  • Fail to index fields with dots in field names when one of the intermediate objects is nested. {es-pull}21787[#21787] (issue: {es-issue}21726[#21726])

  • Uncommitted mapping updates should not efect existing indices {es-pull}21306[#21306] (issue: {es-issue}21189[#21189])

Nested Docs
  • Fix bug in query builder rewrite that ignores the ignore_unmapped option {es-pull}22456[#22456]

Network
  • Respect promises on pipelined responses {es-pull}23317[#23317] (issues: {es-issue}23310[#23310], {es-issue}23322[#23322])

  • Ensure that releasing listener is called {es-pull}23310[#23310]

  • Pass forceExecution flag to transport interceptor {es-pull}22739[#22739]

  • Ensure new connections won’t be opened if transport is closed or closing {es-pull}22589[#22589] (issue: {es-issue}22554[#22554])

  • Prevent open channel leaks if handshake times out or is interrupted {es-pull}22554[#22554]

  • Execute low level handshake in #openConnection {es-pull}22440[#22440]

  • Handle connection close / reset events gracefully during handshake {es-pull}22178[#22178]

  • Do not lose host information when pinging {es-pull}21939[#21939] (issue: {es-issue}21828[#21828])

  • DiscoveryNode and TransportAddress should preserve host information {es-pull}21828[#21828]

  • Die with dignity on the network layer {es-pull}21720[#21720] (issue: {es-issue}19272[#19272])

  • Fix connection close header handling {es-pull}20956[#20956] (issue: {es-issue}20938[#20938])

  • Ensure port range is readable in the exception message {es-pull}20893[#20893]

  • Prevent double release in TcpTransport if send listener throws an exception {es-pull}20880[#20880]

Packaging
  • Fall back to non-atomic move when removing plugins {es-pull}23548[#23548] (issue: {es-issue}35[#35])

  • Another fix for handling of paths on Windows {es-pull}22132[#22132] (issue: {es-issue}21921[#21921])

  • Fix handling of spaces in Windows paths {es-pull}21921[#21921] (issues: {es-issue}20809[#20809], {es-issue}21525[#21525])

  • Add option to skip kernel parameters on install {es-pull}21899[#21899] (issue: {es-issue}21877[#21877])

  • Set vm.max_map_count on systemd package install {es-pull}21507[#21507]

  • Export ES_JVM_OPTIONS for SysV init {es-pull}21445[#21445] (issue: {es-issue}21255[#21255])

  • Debian: configure start-stop-daemon to not go into background {es-pull}21343[#21343] (issues: {es-issue}12716[#12716], {es-issue}21300[#21300])

  • Generate POM files with non-wildcard excludes {es-pull}21234[#21234] (issue: {es-issue}21170[#21170])

  • [Packaging] Do not remove scripts directory on upgrade {es-pull}20452[#20452]

  • [Package] Remove bin/lib/modules directories on RPM uninstall/upgrade {es-pull}20448[#20448]

Parent/Child
  • Add null check in case of orphan child document {es-pull}22772[#22772] (issue: {es-issue}22770[#22770])

Percolator
  • Fix memory leak when percolator uses bitset or field data cache {es-pull}24115[#24115] (issue: {es-issue}24108[#24108])

  • Fix NPE in percolator’s 'now' range check for percolator queries with range queries {es-pull}22356[#22356] (issue: {es-issue}22355[#22355])

Plugin Analysis Stempel
  • Fix thread safety of Stempel’s token filter factory {es-pull}22610[#22610] (issue: {es-issue}21911[#21911])

Plugin Discovery EC2
  • Fix ec2 discovery when used with IAM profiles. {es-pull}21048[#21048] (issue: {es-issue}21039[#21039])

Plugin Ingest GeoIp
  • [ingest-geoip] update geoip to not include null-valued results from {es-pull}20455[#20455]

Plugin Lang Painless
  • painless: Fix method references to ctor with the new LambdaBootstrap and cleanup code {es-pull}24406[#24406]

  • Fix Painless Lambdas for Java 9 {es-pull}24070[#24070] (issue: {es-issue}23473[#23473])

  • Fix painless’s regex lexer and error messages {es-pull}23634[#23634]

  • Replace Painless’s Cast with casting strategies {es-pull}23369[#23369]

  • Fix Bad Casts In Painless {es-pull}23282[#23282] (issue: {es-issue}23238[#23238])

  • Don’t allow casting from void to def in painless {es-pull}22969[#22969] (issue: {es-issue}22908[#22908])

  • Fix def invoked qualified method refs {es-pull}22918[#22918]

  • Whitelist some ScriptDocValues in painless {es-pull}22600[#22600] (issue: {es-issue}22584[#22584])

  • Update Painless Loop Counter to be Higher {es-pull}22560[#22560] (issue: {es-issue}22508[#22508])

  • Fix some issues with painless’s strings {es-pull}22393[#22393] (issue: {es-issue}22372[#22372])

  • Test fix for def equals in Painless {es-pull}21945[#21945] (issue: {es-issue}21801[#21801])

  • Fix a VerifyError bug in Painless {es-pull}21765[#21765]

  • Fix Lambdas in Painless to be Able to Use Top-Level Variables Such as params and doc {es-pull}21635[#21635] (issues: {es-issue}20869[#20869], {es-issue}21479[#21479])

  • Fix String Concatenation Bug In Painless {es-pull}20623[#20623]

Plugin Repository Azure
  • Azure blob store’s readBlob() method first checks if the blob exists {es-pull}23483[#23483] (issue: {es-issue}23480[#23480])

  • Fixes default chunk size for Azure repositories {es-pull}22577[#22577] (issue: {es-issue}22513[#22513])

  • readonly on azure repository must be taken into account {es-pull}22055[#22055] (issues: {es-issue}22007[#22007], {es-issue}22053[#22053])

Plugin Repository HDFS
  • Fixing permission errors for KERBEROS security mode for HDFS Repository {es-pull}23439[#23439] (issue: {es-issue}22156[#22156])

Plugin Repository S3
  • Handle BlobPath’s trailing separator case. Add test cases to BlobPathTests.java {es-pull}23091[#23091]

  • Fixes leading forward slash in S3 repository base_path {es-pull}20861[#20861]

Plugins
  • Fix delete of plugin directory on remove plugin {es-pull}24266[#24266] (issue: {es-issue}24252[#24252])

  • Use a marker file when removing a plugin {es-pull}24252[#24252] (issue: {es-issue}24231[#24231])

  • Remove hidden file leniency from plugin service {es-pull}23982[#23982] (issue: {es-issue}12465[#12465])

  • Add check for null pluginName in remove command {es-pull}22930[#22930] (issue: {es-issue}22922[#22922])

  • Use sysprop like with es.path.home to pass conf dir {es-pull}18870[#18870] (issue: {es-issue}18689[#18689])

Query DSL
  • FuzzyQueryBuilder should error when parsing array of values {es-pull}23762[#23762] (issue: {es-issue}23759[#23759])

  • Fix parsing for max_determinized_states {es-pull}22749[#22749] (issue: {es-issue}22722[#22722])

  • Fix script score function that combines _score and weight {es-pull}22713[#22713] (issue: {es-issue}21483[#21483])

  • Fixes date range query using epoch with timezone {es-pull}21542[#21542] (issue: {es-issue}21501[#21501])

  • Allow overriding all-field leniency when lenient option is specified {es-pull}21504[#21504] (issues: {es-issue}20925[#20925], {es-issue}21341[#21341])

  • Max score should be updated when a rescorer is used {es-pull}20977[#20977] (issue: {es-issue}20651[#20651])

  • Fixes MultiMatchQuery so that it doesn’t provide a null context {es-pull}20882[#20882]

  • Fix silently accepting malformed queries {es-pull}20515[#20515] (issue: {es-issue}20500[#20500])

  • Fix match_phrase_prefix query with single term on _all field {es-pull}20471[#20471] (issue: {es-issue}20470[#20470])

REST
  • [API] change wait_for_completion default according to docs {es-pull}23672[#23672]

  • Deprecate request_cache for clear-cache {es-pull}23638[#23638] (issue: {es-issue}22748[#22748])

  • HTTP transport stashes the ThreadContext instead of the RestController {es-pull}23456[#23456]

  • Fix date format in warning headers {es-pull}23418[#23418] (issue: {es-issue}23275[#23275])

  • Align REST specs for HEAD requests {es-pull}23313[#23313] (issue: {es-issue}21125[#21125])

  • Correct warning header to be compliant {es-pull}23275[#23275] (issue: {es-issue}22986[#22986])

  • Fix get HEAD requests {es-pull}23186[#23186] (issue: {es-issue}21125[#21125])

  • Handle bad HTTP requests {es-pull}23153[#23153] (issue: {es-issue}23034[#23034])

  • Fix get source HEAD requests {es-pull}23151[#23151] (issue: {es-issue}21125[#21125])

  • Properly encode location header {es-pull}23133[#23133] (issues: {es-issue}21057[#21057], {es-issue}23115[#23115])

  • Fix template HEAD requests {es-pull}23130[#23130] (issue: {es-issue}21125[#21125])

  • Fix index HEAD requests {es-pull}23112[#23112] (issue: {es-issue}21125[#21125])

  • Fix alias HEAD requests {es-pull}23094[#23094] (issue: {es-issue}21125[#21125])

  • Strict level parsing for indices stats {es-pull}21577[#21577] (issue: {es-issue}21024[#21024])

  • The routing query string param is supported by mget but was missing from the rest spec {es-pull}21357[#21357]

  • fix thread_pool_patterns path variable definition {es-pull}21332[#21332]

  • Read indices options in indices upgrade API {es-pull}21281[#21281] (issue: {es-issue}21099[#21099])

  • ensure the XContentBuilder is always closed in RestBuilderListener {es-pull}21124[#21124]

  • Add correct Content-Length on HEAD requests {es-pull}21123[#21123] (issue: {es-issue}21077[#21077])

  • Make sure HEAD / has 0 Content-Length {es-pull}21077[#21077] (issue: {es-issue}21075[#21075])

  • Adds percent-encoding for Location headers {es-pull}21057[#21057] (issue: {es-issue}21016[#21016])

  • Whitelist node stats indices level parameter {es-pull}21024[#21024] (issue: {es-issue}20722[#20722])

  • Remove lenient URL parameter parsing {es-pull}20722[#20722] (issue: {es-issue}14719[#14719])

  • XContentBuilder: Avoid building self-referencing objects {es-pull}20550[#20550] (issues: {es-issue}19475[#19475], {es-issue}20540[#20540])

Recovery
  • Provide target allocation id as part of start recovery request {es-pull}24333[#24333] (issue: {es-issue}24167[#24167])

  • Fix primary relocation for shadow replicas {es-pull}22474[#22474] (issue: {es-issue}20300[#20300])

  • Don’t close store under CancellableThreads {es-pull}22434[#22434] (issue: {es-issue}22325[#22325])

  • Use a fresh recovery id when retrying recoveries {es-pull}22325[#22325] (issue: {es-issue}22043[#22043])

  • Allow flush/force_merge/upgrade on shard marked as relocated {es-pull}22078[#22078] (issue: {es-issue}22043[#22043])

  • Fix concurrency issues between cancelling a relocation and marking shard as relocated {es-pull}20443[#20443]

Reindex API
  • Fix throttled reindex_from_remote {es-pull}23953[#23953] (issues: {es-issue}23828[#23828], {es-issue}23945[#23945])

  • Fix reindex with a remote source on a version before 2.0.0 {es-pull}23805[#23805]

  • Make reindex wait for cleanup before responding {es-pull}23677[#23677] (issue: {es-issue}23653[#23653])

  • Reindex: do not log when can’t clear old scroll {es-pull}22942[#22942] (issue: {es-issue}22937[#22937])

  • Fix reindex-from-remote from <2.0 {es-pull}22931[#22931] (issue: {es-issue}22893[#22893])

  • Fix reindex from remote clearing scroll {es-pull}22525[#22525] (issue: {es-issue}22514[#22514])

  • Fix source filtering in reindex-from-remote {es-pull}22514[#22514] (issue: {es-issue}22507[#22507])

  • Remove content type detection from reindex-from-remote {es-pull}22504[#22504] (issue: {es-issue}22329[#22329])

  • Don’t close rest client from its callback {es-pull}22061[#22061] (issue: {es-issue}22027[#22027])

  • Keep context during reindex’s retries {es-pull}21941[#21941]

  • Ignore IllegalArgumentException with assertVersionSerializable {es-pull}21409[#21409] (issues: {es-issue}20767[#20767], {es-issue}21350[#21350])

  • Bump reindex-from-remote’s buffer to 200mb {es-pull}21222[#21222] (issue: {es-issue}21185[#21185])

  • Fix reindex-from-remote for parent/child from <2.0 {es-pull}21070[#21070] (issue: {es-issue}21044[#21044])

Scripting
  • Convert script/template objects to json format internally {es-pull}23308[#23308] (issue: {es-issue}23245[#23245])

  • Script: Fix value of ctx._now to be current epoch time in milliseconds {es-pull}23175[#23175] (issue: {es-issue}23169[#23169])

  • Expose ip fields as strings in scripts. {es-pull}21997[#21997] (issue: {es-issue}21977[#21977])

  • Add support for booleans in scripts {es-pull}20950[#20950] (issue: {es-issue}20949[#20949])

  • Native scripts should be created once per index, not per segment. {es-pull}20609[#20609]

Search
  • Include all aliases including non-filtering in _search_shards response {es-pull}24489[#24489]

  • Cross Cluster Search: propagate original indices per cluster {es-pull}24328[#24328]

  • Query string default field {es-pull}24214[#24214]

  • Speed up parsing of large terms queries. {es-pull}24210[#24210]

  • IndicesQueryCache should delegate the scorerSupplier method. {es-pull}24209[#24209]

  • Disable graph analysis at query time for shingle and cjk filters producing tokens of different size {es-pull}23920[#23920] (issue: {es-issue}23918[#23918])

  • Fix cross-cluster remote node gateway attributes {es-pull}23863[#23863]

  • Use a fixed seed for computing term hashCode in TermsSliceQuery {es-pull}23795[#23795]

  • Honor max concurrent searches in multi-search {es-pull}23538[#23538] (issue: {es-issue}23527[#23527])

  • Avoid stack overflow in multi-search {es-pull}23527[#23527] (issue: {es-issue}23523[#23523])

  • Fix query_string_query to transform "foo:*" in an exists query on the field name {es-pull}23433[#23433] (issue: {es-issue}23356[#23356])

  • Factor out filling of TopDocs in SearchPhaseController {es-pull}23380[#23380] (issues: {es-issue}19356[#19356], {es-issue}23357[#23357])

  • Replace blocking calls in ExpandCollapseSearchResponseListener by asynchronous requests {es-pull}23053[#23053] (issue: {es-issue}23048[#23048])

  • Ensure fixed serialization order of InnerHitBuilder {es-pull}22820[#22820] (issue: {es-issue}22808[#22808])

  • Improve concurrency of ShardCoreKeyMap. {es-pull}22316[#22316]

  • Make -0 compare less than +0 consistently. {es-pull}22173[#22173] (issue: {es-issue}22167[#22167])

  • Fix boost_mode propagation when the function score query builder is rewritten {es-pull}22172[#22172] (issue: {es-issue}22138[#22138])

  • FiltersAggregationBuilder: rewriting filter queries, the same way as in FilterAggregationBuilder {es-pull}22076[#22076]

  • Fix cross_fields type on multi_match query with synonyms {es-pull}21638[#21638] (issue: {es-issue}21633[#21633])

  • Fix match_phrase_prefix on boosted fields {es-pull}21623[#21623] (issue: {es-issue}21613[#21613])

  • Respect default search timeout {es-pull}21599[#21599] (issues: {es-issue}12211[#12211], {es-issue}21595[#21595])

  • Remove LateParsingQuery to prevent timestamp access after context is frozen {es-pull}21328[#21328] (issue: {es-issue}21295[#21295])

  • Make range queries round up upper bounds again. {es-pull}20582[#20582] (issues: {es-issue}20579[#20579], {es-issue}8889[#8889])

  • Throw error when trying to fetch fields from source and source is disabled {es-pull}20424[#20424] (issues: {es-issue}20093[#20093], {es-issue}20408[#20408])

Search Templates
  • No longer add illegal content type option to stored search templates {es-pull}24251[#24251] (issue: {es-issue}24227[#24227])

  • SearchTemplateRequest to implement CompositeIndicesRequest {es-pull}21865[#21865] (issue: {es-issue}21747[#21747])

Settings
  • Do not set path.data in environment if not set {es-pull}24132[#24132] (issue: {es-issue}24099[#24099])

  • Correct handling of default and array settings {es-pull}24074[#24074] (issues: {es-issue}23981[#23981], {es-issue}24052[#24052])

  • Fix merge scheduler config settings {es-pull}23391[#23391]

  • Settings: Fix keystore cli prompting for yes/no to handle console returning null {es-pull}23320[#23320]

  • Expose search.highlight.term_vector_multi_value as a node level setting {es-pull}22999[#22999]

  • NPE when no setting name passed to elasticsearch-keystore {es-pull}22609[#22609]

  • Handle spaces in action.auto_create_index gracefully {es-pull}21790[#21790] (issue: {es-issue}21449[#21449])

  • Fix settings diff generation for affix and group settings {es-pull}21788[#21788]

  • Don’t reset non-dynamic settings unless explicitly requested {es-pull}21646[#21646] (issue: {es-issue}21593[#21593])

  • Fix Setting.timeValue() method {es-pull}20696[#20696] (issue: {es-issue}20662[#20662])

  • Add a hard limit for index.number_of_shard {es-pull}20682[#20682]

  • Include complex settings in settings requests {es-pull}20622[#20622]

Snapshot/Restore
  • Fixes maintaining the shards a snapshot is waiting on {es-pull}24289[#24289]

  • Fixes snapshot status on failed snapshots {es-pull}23833[#23833] (issue: {es-issue}23716[#23716])

  • Fixes snapshot deletion handling on in-progress snapshot failure {es-pull}23703[#23703] (issue: {es-issue}23663[#23663])

  • Prioritize listing index-N blobs over index.latest in reading snapshots {es-pull}23333[#23333]

  • Gracefully handles pre 2.x compressed snapshots {es-pull}22267[#22267]

  • URLRepository should throw NoSuchFileException to correctly adhere to readBlob contract {es-pull}22069[#22069] (issue: {es-issue}22004[#22004])

  • Fixes shard level snapshot metadata loading when index-N file is missing {es-pull}21813[#21813]

  • Ensures cleanup of temporary index-* generational blobs during snapshotting {es-pull}21469[#21469] (issue: {es-issue}21462[#21462])

  • Fixes get snapshot duplicates when asking for _all {es-pull}21340[#21340] (issue: {es-issue}21335[#21335])

Stats
  • Avoid overflow when computing total FS stats {es-pull}23641[#23641]

  • Handle existence of cgroup version 2 hierarchy {es-pull}23493[#23493] (issue: {es-issue}23486[#23486])

  • Handle long overflow when adding paths' totals {es-pull}23293[#23293] (issue: {es-issue}23093[#23093])

  • Fix control group pattern {es-pull}23219[#23219] (issue: {es-issue}23218[#23218])

  • Fix total disk bytes returning negative value {es-pull}23093[#23093]

  • Implement stats for geo_point and geo_shape field {es-pull}22391[#22391] (issue: {es-issue}22384[#22384])

  • Use reader for doc stats {es-pull}22317[#22317] (issue: {es-issue}22285[#22285])

  • Avoid NPE in NodeService#stats if HTTP is disabled {es-pull}22060[#22060] (issue: {es-issue}22058[#22058])

  • Add support for "include_segment_file_sizes" in indices stats REST handler {es-pull}21879[#21879] (issue: {es-issue}21878[#21878])

  • Remove output_uuid parameter from cluster stats {es-pull}21020[#21020] (issue: {es-issue}20722[#20722])

  • Fix FieldStats deserialization of ip field {es-pull}20522[#20522] (issue: {es-issue}20516[#20516])

Task Manager
  • Task Management: Make TaskInfo parsing forwards compatible {es-pull}24073[#24073] (issue: {es-issue}23250[#23250])

  • Fix hanging cancelling task with no children {es-pull}22796[#22796]

  • Fix broken TaskInfo.toString() {es-pull}22698[#22698] (issue: {es-issue}22387[#22387])

  • Task cancellation command should wait for all child nodes to receive cancellation request before returning {es-pull}21397[#21397] (issue: {es-issue}21126[#21126])

Term Vectors
  • Fix _termvectors with preference to not hit NPE {es-pull}21959[#21959]

  • Return correct term statistics when a field is not found in a shard {es-pull}21922[#21922] (issue: {es-issue}21906[#21906])

Tribe Node
  • Add socket permissions for tribe nodes {es-pull}21546[#21546] (issues: {es-issue}16392[#16392], {es-issue}21122[#21122])

Regressions

Bulk
  • Fix _bulk response when it can’t create an index {es-pull}24048[#24048] (issues: {es-issue}22488[#22488], {es-issue}24028[#24028])

Core
  • Source filtering: only accept array items if the previous include pattern matches {es-pull}22593[#22593] (issue: {es-issue}22557[#22557])

Highlighting
  • Handle SynonymQuery extraction for the FastVectorHighlighter {es-pull}20829[#20829] (issue: {es-issue}20781[#20781])

Logging
  • Restores the original default format of search slow log {es-pull}21770[#21770] (issue: {es-issue}21711[#21711])

Network
  • You had one job Netty logging guard {es-pull}24469[#24469] (issues: {es-issue}5624[#5624], {es-issue}6568[#6568])

Plugin Discovery EC2
  • Fix ec2 discovery when used with IAM profiles. {es-pull}21042[#21042] (issue: {es-issue}21039[#21039])

Plugin Repository S3
  • Fix s3 repository when used with IAM profiles {es-pull}21058[#21058] (issue: {es-issue}21048[#21048])

Plugins
  • Plugins: Add back user agent when downloading plugins {es-pull}20872[#20872]

Search
  • Handle specialized term queries in MappedFieldType.extractTerm(Query) {es-pull}21889[#21889] (issue: {es-issue}21882[#21882])

Upgrades

Aggregations
  • Upgrade HDRHistogram to 2.1.9 {es-pull}23254[#23254] (issue: {es-issue}23239[#23239])

Core
  • Upgrade to Lucene 6.5.0 {es-pull}23750[#23750]

  • Upgrade from JNA 4.2.2 to JNA 4.4.0 {es-pull}23636[#23636]

  • Upgrade to lucene-6.5.0-snapshot-d00c5ca {es-pull}23385[#23385]

  • Upgrade to lucene-6.5.0-snapshot-f919485. {es-pull}23087[#23087]

  • Upgrade to Lucene 6.4.0 {es-pull}22724[#22724]

  • Update Jackson to 2.8.6 {es-pull}22596[#22596] (issue: {es-issue}22266[#22266])

  • Upgrade to lucene-6.4.0-snapshot-084f7a0. {es-pull}22413[#22413]

  • Upgrade to lucene-6.4.0-snapshot-ec38570 {es-pull}21853[#21853]

  • Upgrade to lucene-6.3.0. {es-pull}21464[#21464]

Dates
  • Update Joda Time to version 2.9.5 {es-pull}21468[#21468] (issues: {es-issue}20911[#20911], {es-issue}332[#332], {es-issue}373[#373], {es-issue}378[#378], {es-issue}379[#379], {es-issue}386[#386], {es-issue}394[#394], {es-issue}396[#396], {es-issue}397[#397], {es-issue}404[#404], {es-issue}69[#69])

Internal
  • Upgrade to Lucene 6.4.1. {es-pull}22978[#22978]

Logging
  • Upgrade to Log4j 2.8.2 {es-pull}23995[#23995]

  • Upgrade Log4j 2 to version 2.7 {es-pull}20805[#20805] (issue: {es-issue}20304[#20304])

Network
  • Upgrade Netty to 4.1.10.Final {es-pull}24414[#24414]

  • Upgrade to Netty 4.1.9 {es-pull}23540[#23540] (issues: {es-issue}23172[#23172], {es-issue}6308[#6308], {es-issue}6374[#6374])

  • Upgrade to Netty 4.1.8 {es-pull}23055[#23055]

  • Upgrade to Netty 4.1.7 {es-pull}22587[#22587]

  • Upgrade to Netty 4.1.6 {es-pull}21051[#21051]

Plugin Repository Azure
  • Update to Azure Storage 5.0.0 {es-pull}23517[#23517] (issue: {es-issue}23448[#23448])