{"id":3795,"date":"2023-06-26T11:40:25","date_gmt":"2023-06-26T11:40:25","guid":{"rendered":"https:\/\/geekmungus.co.uk\/?p=3795"},"modified":"2023-06-26T11:40:25","modified_gmt":"2023-06-26T11:40:25","slug":"uploading-files-to-aws-s3-using-cli","status":"publish","type":"post","link":"https:\/\/geekmungus.co.uk\/?p=3795","title":{"rendered":"Uploading Files to AWS S3 Using CLI"},"content":{"rendered":"\n

I’ll assume you have your AWS CLI configured so you are able to login to an AWS account. If you need any help on this see: https:\/\/geekmungus.co.uk\/?p=1167<\/a>. Here’s a bit of a cheat sheet on how to use AWS S3 via the CLI.<\/p>\n\n\n\n

Listing Buckets<\/h2>\n\n\n\n
aws s3 ls<\/code><\/pre>\n\n\n\n
Upload One File<\/h2>\n\n\n\n
Upload the file called “myfile.txt” into the S3 bucket called “mybucket1”.<\/p>\n\n\n\n
aws s3 cp c:\\localcopy\\myfile.txt s3:\/\/mybucket1\/<\/code><\/pre>\n\n\n\n
List Contents of a Bucket<\/h2>\n\n\n\n
aws s3 ls s3:\/\/mybucket1\/<\/code><\/pre>\n\n\n\n
Upload Multiple Files<\/h2>\n\n\n\n
Upload the contents of the “c:\\localcopy” directory into the S3 bucket called “mybucket1”, the “recursive” argument is added which ensures that all the files and sub-directories (and the files within) are also uploaded.<\/p>\n\n\n\n
aws s3 cp c:\\localcopy s3:\/\/mybucket1\/ --recursive<\/code><\/pre>\n\n\n\n
Upload Multiple Files (Include and Exclude)<\/h2>\n\n\n\n
In this example, uploading all files to a bucket that have the “.txt” file extension.<\/p>\n\n\n\n
aws s3 cp c:\\localcopy s3:\/\/mybucket1\/ --recursive --exclude * --include *.txt<\/code><\/pre>\n\n\n\n
Download Files (and Multiple Files)<\/h2>\n\n\n\n
Downloading is just a reverse of the upload essentially, you can specify the “–recursive” option if you want to download all files (and sub-directories including their contents).<\/p>\n\n\n\n
aws s3 cp s3:\/\/mybucket1\/ c:\\localcopy\naws s3 cp s3:\/\/mybucket1\/ c:\\localcopy --recursive<\/code><\/pre>\n\n\n\n
Copying Files (Objects) Between S3 Locations<\/h2>\n\n\n\n
To copy a file (object) between S3 locations, you can perform this as follows, so in this example copying a file called “myfile.txt” from S3 “mybucket1” to S3 “mybucket2”.<\/p>\n\n\n\n
aws s3 cp s3:\/\/mybucket1\/myfile.txt s3:\/\/mybucket2\/<\/code><\/pre>\n\n\n\n
Sync Files (Objects)<\/h2>\n\n\n\n
Let’s say you want to sync changed files, you can use the “sync” command, this has a number of ways to use it but a simple upload sync would be:<\/p>\n\n\n\n
aws s3 sync c:\\localcopy s3:\/\/mybucket1\/ --recursive<\/code><\/pre>\n\n\n\n
While a sync but which also deletes files that have been deleted from your source local directory:<\/p>\n\n\n\n
aws s3 sync c:\\localcopy s3:\/\/mybucket1\/ --recursive --delete<\/code><\/pre>\n\n\n\n
Conclusion<\/h2>\n\n\n\n
A bit of a whistle stop tour, but this gives you an overview of some simple commands you can use, which can be helpful for scripting, or just managing files in your S3 buckets.<\/p>\n","protected":false},"excerpt":{"rendered":"
I’ll assume you have your AWS CLI configured so you are able to login to an AWS account. If you need any help on this see: https:\/\/geekmungus.co.uk\/?p=1167. Here’s a bit of a cheat sheet on how to use AWS S3 via the CLI. Listing Buckets Upload One File Upload the file called “myfile.txt” into the … Read more<\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28],"tags":[],"class_list":["post-3795","post","type-post","status-publish","format-standard","hentry","category-aws"],"_links":{"self":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3795","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3795"}],"version-history":[{"count":2,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3795\/revisions"}],"predecessor-version":[{"id":3797,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=\/wp\/v2\/posts\/3795\/revisions\/3797"}],"wp:attachment":[{"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3795"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3795"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/geekmungus.co.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3795"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}