AWS

1 / 2
Architectural Diagram Gallery for Amazon MSK

Architectural Diagram Gallery for Amazon MSK

505

Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that makes it easy for you to build and run applications that use Apache Kafka as a data store.Apache Kafka is an open-source platform for building real-time streaming data p...

Architectural Diagram Gallary for Amazon Kinesis

Architectural Diagram Gallary for Amazon Kinesis

526

High-level architecture of Kinesis Data StreamsThe following diagram illustrates the high-level architecture of Kinesis Data Streams.The producers continually push data to Kinesis Data Streams,and the consumers process the data in real time.Consumers (such...

Real-time Data Streaming Solutions - Kafka vs. Kinesis Comparison

Real-time Data Streaming Solutions - Kafka vs. Kinesis Comparison

857

Both Apache Kafka and Amazon Kinesis are powerful,highly scalable distributed streaming platforms designed to handle high-throughput,low-latency real-time data feeds.They serve as central nervous systems for data,enabling the collection,processing,and anal...

Building a Video Content Recommendation System with Amazon SageMaker

Building a Video Content Recommendation System with Amazon SageMaker

527

This article outlines a practical approach to building a video recommendation system using Amazon SageMaker,leveraging video viewership data and content metadata.We'll cover data preparation,model selection,training,deployment,and inference. What is the ma...

The Immense Scale and Management of Exabyte Data with AWS

The Immense Scale and Management of Exabyte Data with AWS

518

Visualizing an ExabyteAn exabyte (EB) is a staggering unit of data,equal to one quintillion bytes or one billion gigabytes.Visualizing its scale can be challenging,but here are a few attempts to put it into perspective::Books: Imagine digitizing all the bo...

How to change your AWS Credential Region in CLI?

759

Your AWS credentials (Access Key ID and Secret Access Key) are global,but the services you interact with are regional.When you make an API call,you need to specify which region you want to operate in. Here are the primary ways to change your AWS CLI region...

Default Timeout for Amazon Bedrock invoke_model

742

The concept of "default timeout" for Amazon Bedrock invoke_model primarily refers to the client-side timeout of the AWS SDKs (like Boto3) or the AWS CLI,rather than a configurable service-side timeout on Bedrock itself.Bedrock will process your request unt...

When you face 504 Timeout Errors by Amazon ALB

1,487

504 Gateway Timeout errors from an Amazon ALB (Application Load Balancer) indicate that the ALB was unable to receive a response from the target backend within the configured idle timeout period.This is a common issue and can be caused by a variety of fact...

Recommended Vector DB Structure for Amazon Bedrock Integration

394

A Vector DB is a database that stores data as high-dimensional vectors,enabling efficient similarity searches based on vector embeddings generated by machine learning models.JSON-based Vector DBs offer the benefit of storing both vector embeddings and asso...

Integrating VectorDB stored in S3 with Amazon Bedrock

Integrating VectorDB stored in S3 with Amazon Bedrock

429

One of the rising area regarding smart search is to use Vector Database stored in S3 with Amazon Bedrock so you can use it for retrieval-augmented generation (RAG) or semantic search.Amazon Bedrock is a fully managed service that allows developers to acces...

You shouldn't use Amazon CloudFront distribution as an origin

643

You cannot use an Amazon CloudFront distribution as an origin for another CloudFront distribution directly.CloudFront is primarily a content delivery network (CDN),and it's designed to pull content from an origin such as::Amazon S3,Amazon EC2 / Elastic L...

Creating a serverless Apache Kafka publisher using AWS Lambda

Creating a serverless Apache Kafka publisher using AWS Lambda

568

Apache Kafka is a distributed,fault-tolerant,high-throughput streaming platform designed for building real-time data pipelines and streaming applications.Essentially,it acts as a central nervous system for an organization's data,enabling different applicat...

AWS System Design Example - Instagram Architecture

AWS System Design Example - Instagram Architecture

1,928

These are the core features and functionalities that the platform *must* offer to its users.I.User Account Management:Registration / Sign-up:Users must be able to create an account using email address,phone number,or social media (e.g.Facebook).The system ...

A Python script to create an EC2 Spot instance using boto3

1,611

How do you create EC2 Spot InstanceA Python script to create an EC2 Spot instance using boto3.The script launches a spot instance based on an AMI,associates it with a specific security group in a given VPC,and assigns custom tags for easy identification.Pr...

A Python/PHP code to deregister anormalous instaces in Amazon ECS

1,861

An "anomalous" health status in Amazon EC2,despite a healthy CloudWatch report,indicates a discrepancy between the instance's reported health and Amazon's internal monitoring.CloudWatch reflects metrics you've configured; the anomalous status suggests an u...

Where to get AWS API Key at AWS Management Console?

1,078

STEP 1.Log in to the AWS Management Console.STEP 2.Navigate to the IAM Service.STEP 3.Create or Access an IAM User.STEP 4.Generate an API Access Key:Go to the Security credentials tab → Click Create access key under the Access keys section → Select the u...

Understanding Amazon Bedrock Agent for AI-based ChatBot

Understanding Amazon Bedrock Agent for AI-based ChatBot

647

What is Amazon Bedrock?Amazon Bedrock is a fully managed service that makes it easy for customers to build and scale generative AI applications using a variety of foundation models (FMs).Its functional role is to provide access to these powerful,pre-traine...

Secure and Scalable LAMP Service Architecture in AWS

Secure and Scalable LAMP Service Architecture in AWS

10,667

LAMP is an acronym for Linux,Apache,MySQL,and PHP,which are all open-source software components commonly used together to build dynamic websites and web applications.Linux provides the operating system foundation,Apache serves as the web server to handle i...

Web front-end architecture in AWS for e-commerce website

371

AWS Elastic Beanstalk offers a significant benefit for deploying high-availability frontend apps by automatically scaling your application based on traffic demand,ensuring your app stays responsive and accessible even during traffic surges.It handles load ...

Time series processing architecture in AWS

Time series processing architecture in AWS

10,563

When data arrives as a succession of regular measurements,it is known as time series information.Processing of time series information poses systems scaling challenges that the elasticity of AWS services is uniquely positioned to address. This elasticity i...