python - Get the last file name in a S3 folder?

Question

I have a lot of files in the s3 bucket. The folder/file names are in the following format.

s3://bucket/folder/year=1990/1990-01-01.csv
......
s3://bucket/folder/year=2020/2021-01-23.csv

How to use Python to get the last file name? In the above example, it is 2021-01-23.csv.

question from:https://stackoverflow.com/questions/65896284/get-the-last-file-name-in-a-s3-folder

Answer 1

You can check this alternative which uses filter:

import boto3

s3r = boto3.resource('s3')

all_files = list(s3r.Bucket('bucket').objects.filter(Prefix='folder/').all())

print(all_files[-1])

It does not do semantic check based on the dates in your files to find the last one. But the example could be extended to do it as well.