amazon web services - Selective file download in AWS S3 CLI

Question

I have files in S3 bucket, I was trying to download files based on date like 08th aug, 09th Aug, how can I download selective date file?. I used following code but it still downloads entire bucket list

aws s3 cp s3://bucketname/ folder/file --profile pname --exclude "*" --recursive --include "" + "2015-08-09" + "*"

I am not sure, how to achieve this.

Answer 1

This command will copy all files starting with 2015-08-15:

aws s3 cp s3://BUCKET/ folder --exclude "*" --include "2015-08-15*" --recursive

If your goal is to synchronize a set of files without copying them twice, use the sync command:

aws s3 sync s3://BUCKET/ folder

That will copy all files that have been added or modified since the previous sync.

In fact, this is the equivalent of the above cp command:

aws s3 sync s3://BUCKET/ folder --exclude "*" --include "2015-08-15*"

References:

• AWS CLI s3 sync command documentation
• AWS CLI s3 cp command documentation