User Community Service Desk Downloads
If you can't find the product or version you're looking for, visit support.ataccama.com/downloads

Catalog Search Plugin Configuration

In on-premise deployments, the following properties configure the behavior of the Catalog Search plugin in Metadata Management Module (MMM). The properties are specified in the mmm-backend/etc/application.properties configuration file.

Properties

Property Data type Description

plugin.catalog-search.ataccama.one.cache.expire-after

String

Defines for how long the search cache is stored, starting from the last WRITE transaction.

For a list of accepted units, see Duration units.

plugin.catalog-search.ataccama.one.engine.elasticsearch.evolution.enabled

Boolean

If set to true, Elasticsearch-Evolution is enabled. Elasticsearch-Evolution is a library for migrating Elasticsearch mappings, thanks to which upgrades are done automatically as the application promotes configuration changes itself.

Default value: true.

plugin.catalog-search.ataccama.one.engine.elasticsearch.evolution.locations[0]

String

The location from where Elasticsearch-Evolution migration scripts or configuration files are fetched. When defining multiple locations, set the index number accordingly.

Default value: /es/CHANGELOG.md.

plugin.catalog-search.ataccama.one.engine.elasticsearch.evolution.history-max-query-size

Number

The maximum allowed query size while already executed change sets are being validated. This value has to be higher than the total count of Elasticsearch-Evolution change sets.

Default value: 1000.

plugin.catalog-search.ataccama.one.engine.elasticsearch.evolution.history-index

String

The name of the history index used by Elasticsearch-Evolution. This is where the internal state of Elasticsearch-Evolution is persisted and where the executed migration scripts are logged (in other words, all applied change sets).

Default value: .changelog_com_ataccama_one_catalog.

plugin.catalog-search.ataccama.one.engine.elasticsearch.index.settings.static.index.number_of_shards

Number

Defines how many primary shards an index is expected to have. For more information, see Elasticsearch Index Modules.

Default value: 1.

plugin.catalog-search.ataccama.one.engine.elasticsearch.index.settings.static.index.number_of_replicas

Number

Specifies how many replicas each primary shard has. For more information, see Elasticsearch Index Modules.

Default value: 1.

plugin.catalog-search.ataccama.one.mmm.index.drop-first

String

Configures whether all data should be cleared from the Elasticsearch index. It should be set to the same value as the property ataccama.one.mmm.drop-first.

Default value: ${ataccama.one.mmm.drop-first:false}.

plugin.catalog-search.ataccama.one.engine

String

The name of the engine used for search.

Default value: ELASTICSEARCH.

plugin.catalog-search.ataccama.one.engine.elasticsearch.hosts

String

A comma-separated list of Elasticsearch hosts. Must include the scheme as well.

Default value: http://localhost:9200.

plugin.catalog-search.ataccama.one.engine.elasticsearch.analyzer.text.delimiter

String

The separator used to break down a search query into normalized tokens. By default, the delimiter is a space character. Default value: ' '.

plugin.catalog-search.ataccama.one.engine.elasticsearch.aggregation.bucket.size

Number

Configures how many aggregation buckets are retrieved in a single aggregation batch. For more information, see Bucket Aggregations.

plugin.catalog-search.ataccama.one.engine.elasticsearch.indices.catalog-search

String

The name of the Elasticsearch index (BLUE) used for catalog search.

Default value: com_ataccama_one_index_catalog_search_blue.

plugin.catalog-search.ataccama.one.engine.elasticsearch.indices.catalog-search.blue

String

The name of the Elasticsearch index (BLUE) used for catalog search. By default, references the property indices.catalog-search.

plugin.catalog-search.ataccama.one.engine.elasticsearch.indices.catalog-search.green

String

The name of the Elasticsearch index (GREEN) used for catalog search.

Default value: com_ataccama_one_catalog_search_green.

plugin.catalog-search.ataccama.one.engine.elasticsearch.aliases.catalog-search

String

The name of the Elasticsearch alias (PRODUCTION) used for catalog search.

Default value: com_ataccama_one_catalog_search.

plugin.catalog-search.ataccama.one.engine.elasticsearch.aliases.catalog-search.production

String

The name of the Elasticsearch alias (PRODUCTION) used for catalog search. By default, references the property aliases.catalog-search.

plugin.catalog-search.ataccama.one.engine.elasticsearch.aliases.catalog-search.staging

String

The name of the Elasticsearch alias (STAGING) used for catalog search.

Default value: com_ataccama_one_catalog_search_staging.

plugin.catalog-search.ataccama.one.engine.elasticsearch.query-templates.catalog-search

String

The name of the Elasticsearch query template for catalog search.

Default value: com_ataccama_one_template_catalog_search.

plugin.catalog-search.ataccama.one.engine.elasticsearch.query-templates.catalog-search-filter-suggestion

String

The name of the Elasticsearch filter suggestion template for catalog search.

Default value: com_ataccama_one_template_catalog_search_filter_suggestion.

plugin.catalog-search.ataccama.one.engine.elasticsearch.scripts.catalog-search-node-update

String

The name of the Elasticsearch stored script for updating the catalog search node.

Default value: com_ataccama_one_script_catalog_search_node_update.

plugin.catalog-search.ataccama.one.engine.elasticsearch.scripts.catalog-search-node-delete

String

The name of the Elasticsearch stored script for deleting the catalog search node.

Default value: com_ataccama_one_script_catalog_search_node_delete.

plugin.catalog-search.ataccama.one.engine.elasticsearch.query-templates.com_ataccama_one_template_optimistically_lock_catalog_item

String

The name of the Elasticsearch query template for concurrency control.

Default value: com_ataccama_one_template_optimistically_lock_catalog_items.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].annotation.name

String

The annotation name for the default sorting property.

Default value: SORTABLE.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].annotation.value

String

The annotation value for the default sorting property.

Default value: DOCUMENT_NAME.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].property-name

String

The name of the node property used as the default sorting field (with index 0).

The sorting field is identified using one of the following combinations:

  • property-name, node-name

  • property-name, referenced-node-node-name, referenced-node-property-name

  • property-name, node-name, referenced-node-node-name, referenced-node-property-name

Semantically, the sorting is done by the node, the node referenced by another node, or both.

When defining multiple default sorting fields, make sure to change the index number accordingly for each additional sorting field.

For example:

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[1].property-name=name
plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[1].node-node-name=catalogItem
plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[1].order=ASC
plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[1].field-type=KEYWORD

Default value: profiledAt.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].node-node-name

String

The name of the node used as the default sorting field (with index 0).

Default value: catalogItemProfile.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].referenced-node-node-name

String

The name of the referenced node used as the default sorting field (with index 0). For example, catalogItem.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].referenced-node-property-name

String

The name of the referenced node property used as the default sorting field (with index 0). For example, owner.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].order

String

The sorting order used for the default sorting field (with index 0). Allowed values: ASC, DESC.

Default value: DESC.

plugin.catalog-search.ataccama.one.engine.elasticsearch.default-sorting.properties[0].field-type

String

The data type of the default sorting field (with index 0). Must match the data type of the default-sorting.properties[0].property-name property. Allowed values: KEYWORD, DATETIME, NUMBER.

Default value: DATETIME.

plugin.catalog-search.ataccama.one.engine.elasticsearch.max-bulk-size

String

Defines the maximum size of bulk request which can be send to Elasticsearch. The property type is Spring DataSize.

Bulk requests to Elasticsearch can be refused because of size (due to the Elasticsearch parameter http.max_content_length) so this chunk mechanism is implemented to divide bulk request to chunks and send them separately.

Default value: 10MB. For a full list of accepted units, see Size units.

plugin.catalog-search.ataccama.one.eventqueue.poll-interval

String

Configures how often the event queue is polled for updates.

Default value: 10s. For a full list of accepted units, see Duration units.

plugin.catalog-search.ataccama.one.eventqueue.poll-bulk-size

Number

The number of events that can be polled in a single batch.

Default value: 100.

plugin.catalog-search.ataccama.one.eventqueue.poll-initial-delay

String

Defines the delay of the event processing job execution after the plugin starts. This is needed to prevent interference with other plugins that start later, which could lead to issues with starting MMM.

Default value: 30s.

plugin.catalog-search.ataccama.one.eventqueue.retry-backoff-periods

Number

An array of durations, with each duration representing the waiting period before the next retry is attempted. The number of durations determines the number of reprocessing attempts before an event is considered unsuccessful.

Default settings:

plugin.catalog-search.ataccama.one.eventqueue.retry-backoff-periods[0]=5s
plugin.catalog-search.ataccama.one.eventqueue.retry-backoff-periods[1]=1m
plugin.catalog-search.ataccama.one.eventqueue.retry-backoff-periods[2]=5m

plugin.catalog-search.ataccama.one.engine.elasticsearch.read-repair-probability

Number

Defines the probability of catalog search read repair process execution.

plugin.catalog-search.ataccama.one.engine.elasticsearch.read-repair.worker-pool-size

Number

Defines the thread pool size for catalog search read repair functionality.

plugin.catalog-search.ataccama.one.eventqueue.processed-event-retention-policy

String

Determines how successfully processed events are handled. By default, such events are deleted after the time period defined in the property processed-event-retention-period.

Another option is KEEP, which disables the cleanup. In that case, the stored events should be managed through the database itself.

Default value: DELETE_AFTER_RETENTION_PERIOD.

plugin.catalog-search.ataccama.one.eventqueue.processed-event-retention-period

String

The time period after which successfully processed events are cleared. Applicable when the DELETE_AFTER_RETENTION_PERIOD retention policy is used.

Default value: 1h. For a full list of accepted units, see Duration units.

plugin.catalog-search.ataccama.one.eventqueue.failed-event-retention-policy

String

Determines how failed events are handled. By default, such events are deleted after the time period defined in the property failed-event-retention-period.

Default value: DELETE_AFTER_RETENTION_PERIOD.

plugin.catalog-search.ataccama.one.eventqueue.failed-event-retention-period

String

The time period after which failed events are cleared. Applicable when the DELETE_AFTER_RETENTION_PERIOD retention policy is used.

Default value: 7d. For a full list of accepted units, see Duration units.

plugin.catalog-search.ataccama.one.eventqueue.compaction-enabled

Boolean

Enables event compaction.

Default value: true.

plugin.catalog-search.ataccama.one.eventqueue.compaction-interval

String

Configures how often the event queue is checked for new, uncompacted events.

Default value: 5s. For a full list of accepted units, see Duration units.

plugin.catalog-search.ataccama.one.eventqueue.consume-chronologically

Boolean

Defines the consuming order for event queue.

Default value: false.

plugin.catalog-search.ataccama.one.engine.elasticsearch.basic-auth.enabled

Boolean

Enables HTTP basic authentication for the Elasticsearch client.

plugin.catalog-search.ataccama.one.engine.elasticsearch.basic-auth.username

String

The username for the Elasticsearch client. Used if basic authentication is enabled.

plugin.catalog-search.ataccama.one.engine.elasticsearch.basic-auth.password

String

The password for the Elasticsearch client. Used if basic authentication is enabled.

plugin.catalog-search.ataccama.one.engine.elasticsearch.read-repair.worker-pool-size

Number

Defines the thread pool size (number of threads) for catalog search read repair functionality.

plugin.catalog-search.ataccama.one.engine.elasticsearch.read-repair-probability

Float

Performs a cross-checking with MMM to verify whether the searched items are still in MMM. If the items are not there, they are deleted from the search store. Probability is expressed as a floating point number from 0 to 1.

Default value: 0.01 (1% probability).

plugin.catalog-search.ataccama.one.engine.elasticsearch.refresh-enabled

Boolean

A refresh makes recent operations performed on one or more indices available for search immediately after the operation occurs.

Default: false.

plugin.catalog-search.ataccama.one.upgradability.enabled

Boolean

Handles automatic synchronization of data reindexing in Elasticsearch, when data or a schema of data is changed during an upgrade procedure. How data is handled depends on its status during the upgrade procedure:

  • If there is data that is newly created, new data is available in Elasticsearch.

  • If there is data that is newly changed, data is updated in Elasticsearch as well.

  • If there is data that is deleted, outdated data is dropped from Elasticsearch.

Synchronization of data changes and Elasticsearch might take a few minutes, depending on the amount of data. If you notice that the changes are not reflected in search, wait and check if the plugin.catalog-search.ataccama.one.upgradability.configuration-handling plugin is enabled.

plugin.catalog-search.ataccama.one.upgradability.configuration-handling-enabled

Boolean

Handles automatic search configuration changes during the upgrade procedure.

If the plugin is disabled, the plugin.catalog-search.ataccama.one.upgradability.enabled plugin doesn’t not work either and data changes are not reflected in Elasticsearch.

ataccama.client.connection.es_search.http.enabled

Boolean

Enables advanced HTTP configuration for communication with Elasticsearch. This property must be set to true if any other ataccama.client.connection.es_search.http.* property is used.

All ataccama.client.connection.es_search.http.* properties are compatible with the platform-wide TLS configuration. For more information, see TLS Configuration.

ataccama.client.connection.es_search.http.tls.enabled

Boolean

Enables TLS communication between the client and Elasticsearch.

Default value: false.

ataccama.client.connection.es_search.http.tls.trust-store

String

The full path to the truststore file used for the Elasticsearch client. Must contain the Elasticsearch certificate. For example, file:/path/to/truststore.p12.

ataccama.client.connection.es_search.http.tls.trust-store-type

String

The type of the truststore for the Elasticsearch client. Allowed values: PKCS12, JKS.

ataccama.client.connection.es_search.http.tls.trust-store-password

String

The password for the truststore. Used if the truststore is encrypted.

ataccama.client.connection.es_search.http.tls.mtls

Boolean

Enables mTLS for the Elasticsearch client.

Default value: false.

ataccama.client.connection.es_search.http.tls.key-store

String

The full path to the keystore file used for the Elasticsearch client. Must contain the key for the certificate used by Elasticsearch. For example, file:/path/to/keystore.p12.

ataccama.client.connection.es_search.http.tls.key-store-type

String

The type of the keystore for the Elasticsearch client. Allowed values: PKCS12, JKS.

ataccama.client.connection.es_search.http.tls.key-store-password

String

The password for the keystore. Used if the keystore is encrypted.

Accepted units

Duration

Accepted units for time duration are as follows:

  • ns (nanoseconds)

  • us (microseconds)

  • ms (milliseconds)

  • s (seconds)

  • m (minutes)

  • h (hours)

  • d (days)

Size

Accepted units for message size are as follows:

  • B (bytes)

  • KB (kilobytes)

  • MB (megabytes)

  • GB (gigabytes)

  • TB (terabytes)

Was this page useful?