elasticsearch - Is it possible to append (instead of restore) a snapshot of indices?

Question

Suppose we have some indices in our cluster. I can make a snapshot of my favorite index and I can restore the same index again to my cluster if the same index is not exists or is closed. But what if the index currently exists and I need to add/append extra data/documents to it ?

Suppose I currently have 100000 documents in my index in my server. I create/add 100 documents to my index in my local system which has the same name, the same mappings and the same settings, the same number of shards and . . ., now I want to add 100 documents to my current index in my server (100000 documents) . What is the best way ?

In MySQL I use export to csv or excel and ... and it is so easy to import or append data to currently existed index.

question from:https://stackoverflow.com/questions/65856298/is-it-possible-to-append-instead-of-restore-a-snapshot-of-indices

Answer 1

There is no Append API for Elasticsearch but I suggest to restore indices with temporary name and use Reindex API to index local data to bigger indices. then delete temporary indices.

also you can use Logstash for this purpose (reindex). build a pipeline which read data from temp indices (Elasticsearch input plugin ) and write data to primary indices (Elasticsearch output plugin)

note: you can't have two indices with the same name in cluster.