databricks - Delta table versioning while writing from a Spark structured streaming job

Question

Will writing to a Delta table from a Spark structured streaming job create a version for every micro batch of data written?

question from:https://stackoverflow.com/questions/65869668/delta-table-versioning-while-writing-from-a-spark-structured-streaming-job

Answer 1

From the docs:

As you write into a Delta table or directory, every operation is automatically versioned.

So, yes you are correct.

Getting the data:

• Using a timestamp

• Using version number

Reference: https://databricks.com/blog/2019/02/04/introducing-delta-time-travel-for-large-scale-data-lakes.html