Generic Data Index: elements intermittently missing from index, no error surfaced

[dpfaffenbauer]

Affected Version

2025.1

Affected capability

Bundle version: pimcore/generic-data-index-bundle v2.5.0
Search backend: Elasticsearch/OpenSearch (async / queue-based processing, processSynchronously = false)

Summary

Under normal async operation, elements intermittently never make it into the search index. It does not affect a specific element type or a reproducible set of elements — it happens sporadically to individual elements after a regular save/update.

[dpfaffenbauer]

one way of force reindexing them, as fast as possible is this:

bin/console dbal:run-sql "INSERT IGNORE INTO generic_data_index_queue (elementId, elementType, elementIndexName, operation, operationTime, dispatched) SELECT id,'dataObject',CASE WHEN type='folder' THEN 'data-object-folder' ELSE className END,'update',UNIX_TIMESTAMP()*1000,0 FROM objects WHERE           
  type='folder' OR (type IN ('object','variant') AND className IS NOT NULL AND className <> '')"

[dpfaffenbauer]

here a little command to help reconcile the index: https://gist.github.com/dpfaffenbauer/d1667e6c716c0ddd806e12121d9591aa