AWS

File synchronization service architecture in AWS

CK CK 3788 
Created at
Updated at  
10,384 0 0

Given the straightforward, stateless client-server architecture in which web services are viewed as resources and can be identified by their URLs, development teams are free to create file sharing and syncing applications for their departments, for enterprises, or for consumers directly.

This diagram represents the core architecture of a scalable and cost-effective file sharing and synchronization platform, using Amazon Web Services.

 

File synchronization service architecture in AWS

 

#

Description

1The file synchronization service endpoint consists of an Elastic Load Balancer distributing incoming requests to a group of application servers hosted on Amazon Elastic Compute Cloud (Amazon EC2) instances. An Auto Scaling group automatically adjusts the number of Amazon EC2 instances depending on the application needs.
2To upload a file, a client first needs to request the permission to the service and get a security token.
3After checking the user's identity, application servers get a temporary credential from AWS Security Token Service (STS). This credential allows users to upload files.
4Users upload files into Amazon Simple Storage Service (Amazon S3), a highly durable storage infrastructure designed for mission-critical and primary data storage. Amazon S3 makes it easy to store and retrieve any amount of data, at any time. Large files can be uploaded by the same client using multiple concurrent threads to maximize bandwidth usage.
5File metadata, version information, and unique identifiers are stored by the application servers on an Amazon DynamoDB table. As the number of files to maintain in the application grows, Amazon DynamoDB tables can store and retrieve any amount of data, and serve.
6File change notifications can be sent via email to users following the resource with Amazon Simple Email Service (Amazon SES), an easy-to-use, cost-effective email solution.
7Other clients sharing the same files will query the service endpoint to check if newer versions are available. This query compares the list of local files checksums with the checksums listed in an Amazon DynamoDB table. If the query finds newer files, they can be retrieved from Amazon S3 and sent to the client application.
Tags AWS Architecture AWS Security Token Service Amazon S3 Auto Scaling ELB Elastic Load Balancing STS Facebook X
Comments 0
Similar posts
  1. Financial services grid computing in AWS
    10,359
  2. Fault Tolerance & High Availability based on multi Availability zones in AWS
    10,821
  3. Image Moderation Chatbot - a serverless chatbot on AWS that monitors chat channels and removes images suggestive or explicit image
    10,431
  4. Disaster recovery solution in AWS for local applications
    11,182
  5. Large scale computing based on huge data sets in AWS
    10,615
  6. Content Distribution for VOD streaming services in AWS
    10,363
  7. Checkout service architecture in AWS for e-commerce website
    11,018
  8. Large scale messenger service architecture in AWS - Slack case study
    11,675
  9. Live streaming / Static Content & Media Service based on AWS
    10,663
  10. Secure and Scalable LAMP Service Architecture in AWS
    10,666
  11. Synchronous online gaming architecutre in AWS - Highly Available, Scalable & Elastic to support Millions of Players
    10,424
  12. Time series processing architecture in AWS
    10,561
  13. Web Application Hosting provides the reliable, scalable, secure, and high-performance infrastructure
    10,620
  14. Web front-end architecture in AWS for e-commerce website
    370
  15. Batch processing composed of job manager, job store and worker based on AWS
    10,454
  16. AWS Architecture for collecting Click-Through Events on Advertisement serving
    10,380
  17. Teraform from the scratch
    1,362
  18. Product Marketing & Recommendation Architecture in AWS for e-commerce website
    10,747
  19. Architecting for Resilience: AWS High Availability Components Including API Gateway
    144
  20. Architecting Dynamic Scale-Out and Scale-In with Docker Containers
    136
  21. Predictable Ad Spend: Architecting Pacing at Hyperscale
    427
  22. Measuring Ad Viewability: AWS Architectures for Programmatic Accountability
    479
  23. Ad Tech Multi-Tenancy: A Spectrum of Isolation Architectures on AWS
    336
  24. Enterprise Data Lake Architecture based on AWS
    10,412
  25. Media sharing service architecture in AWS
    10,374
  26. AWS System Design Example - Instagram Architecture
    1,928
  27. Amagi CLOUDPORT Architecture based on AWS for FAST for channel playout on AWS
    1,330
  28. Integrating VectorDB stored in S3 with Amazon Bedrock
    429
  29. The public could reduce server cost, and enhance performance for global service distribution
    10,744
  30. Uploading files to Amazon S3 with REST API in PHP
    845
  1. A Python script to create an EC2 Spot instance using boto3
    1,610
  2. A Python/PHP code to deregister anormalous instaces in Amazon ECS
    1,860
  3. Where to get AWS API Key at AWS Management Console?
    1,077
  4. Understanding Amazon Bedrock Agent for AI-based ChatBot
    647
  5. "502 Bad Gateway" Error easy to happen at the combination of nginx and node.js in AWS Elastic Beanstalk
    10,495
  6. How to Set Up and Deploy Containerized Applications with AWS ECS
    10,683
  7. Power of Containerized Deployment with AWS ECS
    10,599
  8. FAISS Already Does ANN... So Why Do Top Teams Still Pay for SageMaker?
    314
  9. Recommended Vector DB Structure for Amazon Bedrock Integration
    393
  10. What cause a 502 bad gateway error in AWS environment?
    445
  11. Building an AWS SAM(Serverless Application Model) Project
    901
  12. Check incomplete multipart uploads if AWS S3 storage size is abnormally big huge compared to the origin storage
    11,599
  13. Importing a wild card domain SSL certificate into AWS Certificate Manager
    10,349
  14. AWS Lambda Example based on Teraform
    904
  15. Simple AWS ECS example based on Teraform
    995
  16. Where to get AWS Access Key ?
    11,269
Recently updated
  1. Google OAuth Token Expiration: Causes and Solutions
    29
  2. Why 100% SEO Guarantees Better User Engagement and How to Achieve It in Your Service
    55
  3. Why SPF and DKIM Are Essential for Linux Email Servers?
    49
  4. How do I create animated background for Google Meet?
    22,862
  5. MaxMind GeoLite2 vs. DB-IP Lite vs. ip-api.com: Choosing the Right Free IP Geolocation Solution
    271
  6. Meet Valkey: Why Redis Changed Its License, Why Valkey is Better, and How to Use It as a Drop-in Replacement
    103
  7. How Rogue Web Scrapers Are Stealing My Content and Destroying My Server
    168
  8. Array of arguments passed to script in PHP
    97
  9. Invalid Auction Storms in Ad Tech
    106
  10. Building MRC-Compliant Instrumentation in Ad Tech: Implementation Steps and Key Challenges
    207
  11. The Two Clocks of Ad Server Architecture
    77
  12. Frequency Cap Architecture Overview
    526
  13. Collecting Proof-of-Play from 100,000 Screens
    152
  14. Vector Search in Relational Databases (RDBs): Trends & Usage Environments
    302
  15. What is RedisVL?
    114
  16. Designing a Skill Registry Architecture: Minimize Token Usage and Maximize AI Performance
    246
  17. TPU & GPU Cluster Management Tools
    257
  18. The Concept of Scaffolding in AI Agents
    244
  19. Beyond Static Pipelines: Architecting LLM Multi-Agent Systems for Autonomous Workflow Orchestration
    596
  20. AI-DLC vs. AI-SDLC: Model-Centric vs. System-Centric AI Development
    267
  21. Fine-Tuning Open-Weight LLMs: Training, Licensing, and Deploying Custom Models with Ollama
    353
  22. Inside the Next-Generation Streaming Architecture: Ultra-Low Latency, SGAI, and AI Codecs
    206
  23. Machine Learning: Training vs. Ranking
    229
  24. The Continuous Learning Machine: Designing a Loop That Actually Turns
    228
  25. The Next-Gen Low-Latency Standards: LL-HLS & MoQ
    202
  26. Designing a Data Curation System Around a Vector Database
    230
  27. Extracting Context from Live Video: The Architecture Got Simpler When We Stopped Building Features
    263
  28. The New Ad Stack Behind Live Sports Streaming: Inside SGAI, EABN, and the Standards Race to Fix Live Monetization
    671
  29. Designing MLOps Architectures to Handle Seasonal Data Drift in EV Fleet Models
    200
  30. From 15 to 40+ FPS: Accelerating PyTorch Object Detection on Automotive ECUs
    232