Configuring a Sync to S3 Gateway

Easily push files to Amazon S3 using our Sync feature for Hosted~FTP~ Enterprise T2 and above accounts. By following rules you setup in the Sync process, you can have specified user directories sync towards your S3 server to: upload, move, delete, or upload and move files automatically. This article will cover how to setup a Sync to S3 process.

How to setup Sync to S3

  1. Logging in as the administrator, go to your Sync tab.Sync-tab-home

2. The Sync tab shows you a list of your existing Sync processes for you to easily manage. Click on the Add button to setup and create a new Sync process.

3. See table below for details on setting up each field

Name Name of the Sync process
Actions Select what you want the Sync process to do: Upload, Move, Delete, Upload + Move.

For this use case, please select Upload

Source The source of where the data is located to sync.

For this use case, please select Hosted~FTP~

User+ Use a * to include all users, or place specific usernames separated by a comma (i.e. username1, username2)
User- Place usernames in this field to exclude them from the sync process
Path+ Use a * to include all paths, or place specific paths separated by a comma (i.e. //Folder1/SubFolder1/.*, //Folder1/SubFolder2/.*)

Note: /.* is required to pull all data from the target path

Example in Path+ (does not include subfolders) to filter for a specific file extension: //prod/Folder1/Subfolder1/[^/]*\.csv

Example in Path+ (does include subfolders) to filter for a specific file extension: //prod/Folder1/Subfolder1/.*\.csv

Example in Path+ to include all files and subfolders underneath target folder: //prod/Folder1/Subfolder1/.*

Path- Place paths in this field to exclude them from the sync process
Target The source of where you will sync the data into.

For this use case, please select AWS S3

Access Key Access key provided by your AWS S3
Secret Access Key The secret access key for the AWS S3
Bucket Name Input field for the password or private key
Folder The designated folder to apply the sync process.
Javascript Additional Javascript commands that can be included. (Reach out to our support team for assistance)

4. Manage the Options if required:

Options: To have the sync process run fully, all options must be enabled.
Active Turns the sync process on or off after being created
Accept Accepts additions to the process
Process Disabling this option queues up the sync but does not process. For the sync to process, this must be enabled

5. Click Save to create the sync process. If all options are enabled (by default), the sync will run in the background every time uploaded data meets the rules.

Getting Started
Signing up for a Free Trial
Basic steps to Setup
Purchasing your account
Choosing the right account type: Enterprise and SMB
Logging into your account
How to login with a Web Browser
How to Login to an FTP client via FTP
How to Login to an FTP Client via SFTP
Logging in by FTP URL with Username and Password
Reset and change your password
Administrator Initial Setup
Account-level options
Force Secure Protocols only (FTPS/HTTPS/SFTP)
Enabling a Password Policy
Enabling CJIS Compliance Policy
Add IP whitelisting
Configuring Web Access
Configuring FTP Access
Implementing Multiple Administrators
Branding
Adding branding to your account
Branding Contact Logins
Creating a Custom Subdomain (ftp.yourdomain.com)
Web Interface
Home Tab
Files Tab
Contacts Tab
Users Tab
Plugin Tab
Setup Tab
Adding a User or Contact
Adding a Contact by Email Address
Add a User by Email Address
Add a User by Username
Using Groups
Account setup PDF Guides (*.pdf)
Activated Account Limits
Shared Folders
Configuring for Restricted Shared Folders (FUSN)
Creating Folder Structures for Sharing
Detailed Steps to Sharing Files/Folders
Managing Shared Folder Privileges
Add real-time notifications to uploads/downloads
Audit logs for logins and file transfers
Using the Reports Tab
Enable audit logs for login and file transfers
Accessing and viewing your audit logs
Steps to sharing the logs folder
Anonymous Access
Creating A Public Link
Anonymous Sharing Use Case
Anonymously Sharing Files and Folders
Transferring Files
Uploading Files by Web Browser
Uploading Files by FTP Client
Download your FTP/SFTP server files from any browser
Download files with an FTP client
Drag & Drop
Hosted FTP Drag and Drop
Enabling Drag & Drop on Legacy IE Browsers
Website Plugin
Web Plugin Overview and Guide
Plugin Brand Customization
Embed the Plugin into Your Website
Adding Additional Security (CAPTCHA, Password)
Security and Compliance Info
Security Model Overview
Security Model Details
MFA by User (Multi-Factor Authentication)
MFA by Administrator (Multi-Factor Authentication)
Resetting or Changing MFA
Enabling Single Sign-on
Certificate & Host Key Info
SSL Certificate Info
SSL Server Test
FTPS Host Keys
SFTP (RSA/DSA) Host Keys
Configuring PKI Support
Compliance Info
GDPR
WCAG 2.0
SOC2
CJIS
HIPAA
Bundle Features
Hosted~FTP~ vs. AWS Transfer Family
Group vs. Enterprise bundle features
Enterprise T1 vs. T2 Bundle Comparison
Different user types and function comparisons
Difference between users and contacts
Integrating the Upload Plugin into your Website and Business
Configuring a Sync to SFTP Gateway
Configuring a Sync to S3 Gateway
Account Management
Purchasing your account
Payments & Billing
Choosing a payment plan
Renewing an expired account
Changing a Payment Plan
Changing Credit Card Information
Reviewing billing statements
Trial Account Limits
How is Storage Calculated?
Reviewing account resources and usage
Switching Account Bundles
Changing the Account Administrator
Administrator Access to User Accounts
Cancelling an Account
FTP/FTPS/SFTP Connections
Hosted~FTP~ IP Addresses
SFTP (RSA/DSA) Host Keys
Connect with Plain FTP
Connect with Secure FTPS/SFTP
Connecting with an FTP Client
FTP vs FTPS vs SFTP
Command Line (CLI)
How to connect to your remote site using the command line
How to login to SFTP with one line on Linux
Understanding FTP commands in the command line
Connecting through SFTP by Command Line (CMD)
Using PKI keys to connect to Hosted~FTP~ on linux
Importing PuttyGen PKI Keys to Linux
FTP/FTPeS command line error codes and their meaning
Windows Network Locations
Add Network Location Windows XP
Add Network Location Windows 10/8/7
MAC
Connecting from a Mac Computer Terminal
FileZilla
Using Filezilla with FTP/FTPS
Using FileZilla with SFTP
WebDrive
Connecting to WebDrive
Using WebDrive
WinSCP
Installing WinSCP
Uploading & Downloading with WinSCP
WinSCP Scripting
Executing WINSCP script from a saved site
Executing WINSCP script without a saved site
Transfer new and updated files only
Backup Scripts with WinSCP
Keep Folders up to date
AndFTP
Uploading & Downloading with AndFTP
Searching, Resume Support & Third-party Sharing with AndFTP
FTP, SFTP Use Cases in Industries
EDI document transfers
Integrating the Upload Plugin into your Website and Business
Accounting
Technology
Energy
Healthcare
Printing
Media
Analytics
Retail
Architecture
Finance
Legal
Construction
Education
Engineering
Insurance
Manufacturing
Real Estate
Call Center
Best Practices
Use Cases
Exporting EDI files to FTP for download
User Optimization
Create a Managed User
Giving a User Read-only Access
Giving a User Full Access
Default FTP Folder Destination
Set a 0GB Storage Quota
Importing Multiple Users & Shared Folders
Importing Users in Bulk – Syntax and Definitions
Importing Restricted Shared Folders in Bulk – Syntax and Definitions
Detailed Steps and Example Templates for Importing
Exporting a User List
Combine multiple audit logs
Managing FTP Files and Storage in your Account
Moving Files from a User to an Administrator
Video Tutorials
QuickStart
FUSN
Branding
Web Interface
Home Tab
Files Tab
Web Plugin
AndFTP
AndFTP – Connecting, uploading and downloading
AndFTP – Searching, resume support and third-party sharing
WinSCP
WinSCP – Downloading, Installing and Understanding
WinSCP – Connecting with FTP, FTPS, SFTP, uploading and downloading
WinSCP Backup Script
CyberDuck
Cyberduck– Connecting with FTP,FTPS, SFTP, Uploading and Downloading
Cyberduck– Quick Look, Transfer Queue and Synchronizing
Cyberduck – Bookmarks, Editing and using Multiple Connections
FileZilla
FileZilla -Downloading, Installing and Understanding FileZilla
FileZilla – Connecting with FTP, FTPS, SFTP and uploading and downloading
FileZilla – Importing/Exporting Site Connections, Editing and Logs
FileZilla Tools – Bookmarking, Searching, using Multiple Connections
Our FTP Client Reviews
Desktop FTP Client Summary
Mobile FTP Client Summary
PSFTP Review : Our Rating 7.5/10
NetDrive Review: Our Rating 8.5/10
Filezilla Review: Our Rating 9/10
AndFTP Review:Our Rating 7.8/10
ES File Manager Review: Our Rating 5/10
FTP Ready Review:Our Rating 5/10
FTP On The Go Review:Our Rating 8/10
CyberDuck Review: Our Rating 9/10
Classic FTP Review: Our Rating 8/10
WebDrive Review: Our Rating 9.5/10
Fling FTP Review: Our Rating 9/10
SmartFTP Review: Our Rating 7/10
MultCloud Review: Our Rating 10/10
Troubleshooting
Error: QUOTA_USER_STORAGE or QUOTA_USER_BANDWIDTH
FTP/FTPeS command line error codes and their meaning
Troubleshooting FTP in the command line and common errors.
No matching host key found
Storage Quota Notification: Remedial action
Troubleshooting FTP in the command line and common errors.
Troubleshooting “Can’t verify publisher”
Troubleshooting Drag and Drop
Drag and Drop Troubleshooting for Mac
Troubleshooting FTP/SFTP client connection problems
Troubleshooting slow upload speeds on Windows
No matching host key found
File not visible to admin
File uploaded successfully but not visible in account
Usernames – Guidelines and Restrictions
Download Center
Contact Sales & Support
Joining GoToMeeting by Browser
Joining GoToMeeting by Client
Bitnami