PoshJosh's Blog

Summary of AWS Services

May 29, 2020

  • ETL - Extract Transform Load
  • EC2 - Elastic Cloud Compute
  • EMR - Elastic MapReduce
  • IAM - Identity and Access Management
  • KMS - Key Management Service
  • ML - Machine Learning
  • RDS - Relational Database Service
  • RI - Reserved Instance
  • S3 - Simple Storage Service
  • SQL - Structured Query Language
  • VPC - Virtual Private Cloud

Analytics

Amazon Athena - serverless, query S3
Interactive query service to analyze data in Amazon S3 using standard SQL.

  • No need for complex ETL jobs to prepare your data for analysis
  • Integrates with AWS GlueData Catalog, allowing you to create a unified

metadata repository across various services

Amazon EMR managed service, hadoop framework, big data
Provides a managed Hadoop framework to process vast amounts of data across dynamically scalable Amazon EC2 instances. Supports: Apache Spark, HBase, Presto, and Flink.

Use cases: log analysis, web indexing, ETL, machine learning, financial analysis, scientific simulation, and bioinformatics.

Amazon CloudSearch managed service, search
Managed service to set up, manage, and scale a search solution for your website or application. Supported: 34 languages, highlighting, autocomplete and geospatial search.

Amazon Elasticsearch Service elasticsearch
Deploy, secure, operate, and scale Elasticsearch to search, analyze, and visualize data in real-time.

  • Offers integrations with open-source tools like Kibana and Logstash
  • Integrates with VPC, KMS, Firehose, Lamda, IAM, Cognito, CloudWatch etc

Use cases: log analytics, full-text search, application monitoring, and clickstream analytics

Amazon Kinesis real-time streaming data analysis
Collect, process, and analyze real-time streaming data.

Use cases: Ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications.

Kinesis Data Firehose, Kinesis Data Analytics, Kinesis Data Streams, and Kinesis Video Streams

  • Amazon Kinesis Data Firehose managed service, ETL service


Reliably load streaming data into data stores and analytics tools.

  • Capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk
  • Transformations: Batch, compress, transform, encrypt or convert to columnar formats like Apache Parquet and Apache ORC
  • Amazon Kinesis Data Analytics managed service, streaming data analysis

    • Analyze streaming data
    • SQL queries on streaming data
  • Amazon Kinesis Data Streams (KDS) managed service, real-time streaming data analysis


Continuously capture data GB/s from hundreds of thousands of sources.

Use cases: real-time dashboards, real-time anomaly detection, dynamic pricing, and more.

  • Amazon Kinesis Video Streams managed service, video streaming Securely stream video from millions of connected devices to AWS for analytics, machine learning (ML), playback, and other processing.

    • Stores, encrypts, and indexes video data in your streams
    • Playback for live and on-demand viewing
    • Integrates with Amazon Recognition Video, libraries for ML frameworks such

    as Apache MxNet, TensorFlow, and OpenCV

    Use cases: applications that take advantage of video streaming, computer vision, video analytics

Amazon Redshift data warehouse
Data warehouse to analyze all your data across your data warehouse and data lake.

  • Run queries across petabytes of data in Redshift data warehouse, and exabytes of data in Amazon S3 data lake.

Amazon QuickSight managed service, business intelligence, interactive dashboard
Business intelligence (BI) service to create and publish interactive dashboards accessible from browsers and mobile devices.

  • Embed dashboards into your applications.

AWS Data Pipeline managed service, data processing
Reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals.

  • Create complex data processing workloads
  • Supported services include: S3, RDS, DynamoDB, EMR
  • Move and process data that was previously locked up in on-premises data silos.

AWS Glue fully managed service, extract, transform, load
ETL service to prepare and load their data for analytics.

  • Point Glue to your data stored on AWS, Glue discovers your data and stores

associated metadata (e.g. table definition and schema) in the AWS Glue Data Catalog which is immediately searchable, queryable, and available for ETL.

AWS Lake Formation managed service, data lake
Set up a secure data lake in days.

  • Collects and catalogs data from databases and object storage, moves the data

into your new Amazon S3 data lake, cleans and classifies data using machine learning algorithms, and secures access to your sensitive data.

  • A data lake is a centralized, curated, and secured repository that stores

all your data, both in its original form and prepared for analysis.

Amazon Managed Streaming for Kafka (MSK) fully managed service, apache kafka
Build and run applications that use Apache Kafka to process streaming data.

  • Automatically provisions and runs your Apache Kafka clusters
  • Secures your Apache Kafka cluster by encrypting data at rest
  • Apache Kafka is an open-source platform for building real-time streaming data

pipelines and applications.

Use cases: Use Apache Kafka APIs to populate data lakes, stream changes to and from databases, and power machine learning and analytics applications.

Application Integration

AWS Step Functions serverless, workflow
Coordinate multiple AWS services into serverless workflows so you can build and update apps quickly.

  • Design and run workflows that stitch together services such as AWS Lambda

and Amazon ECS into feature-rich applications.

Amazon MQ manages service, message broker, apache activemq
For Apache ActiveMQ. Makes it easy to set up and operate message brokers in the cloud.

  • Uses industry-standard APIs and protocols for messaging, including JMS, NMS,

AMQP, STOMP, MQTT, and WebSocket.

  • Message brokers allow different software systems–often using different

programming languages, and on different platforms–to communicate and exchange information.

Amazon Amazon Simple Queue Service (Amazon SQS) fully managed, message queue
Message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications.

  • Standard queue - Maximum throughput, best-effort ordering, and at-least-once delivery.
  • SQS FIFO queue - designed for exactly once delivery, in the exact order messages are sent.

Amazon Simple Notification Service (Amazon SNS) fully managed, pub/sub messaging
Pub/sub messaging service that enables you to decouple microservices, distributed systems, and serverless applications.

  • high-throughput, push-based, many-to-many messaging
  • Supported subscriber endpoints: Amazon SQS queues, AWS Lambda functions, and HTTP/S webhooks.
  • Supported message types: mobile push, SMS, and email.

Amazon Simple Workflow (Amazon SWF) fully managed, workflow, state tracker
Build, run, and scale background jobs that have parallel or sequential steps.

If your application’s steps take more than 500 milliseconds to complete, you need to track the state of processing. If you need to recover or retry if a task fails, Amazon SWF can help you.

AR and VR

Amazon Sumerian virtual reality, augmented reality, 3D
Create and run virtual reality (VR), augmented reality (AR), and 3D applications.

  • Build highly immersive and interactive scenes.
  • Supported hardware include: Oculus Go, Oculus Rift, HTC Vive, HTC Vive Pro,

Google Daydream, and Lenovo Mirage as well as Android and iOS mobile devices.

Use cases: virtual classroom, virtual tours, interactive 3D applications, designing, animating_

AWS Cost Management

AWS Cost Explorer cost report
Visualize, understand, and manage your AWS costs and usage over time.

Use cases: Create custom reports (including charts and tabular data) to analyze cost and usage data, both at a high level (e.g., total costs and usage across all accounts) and for highly-specific requests (e.g., m2.2xlarge costs within account Y that are tagged “project: secretProject”).

AWS Budgets budget alert
Set custom budgets that alert you when your costs or usage exceed (or are forecasted to exceed) your budgeted amount.

  • Track budgets monthly, quarterly, or yearly as well as customized the start and end dates.
  • Alerts via email and/or Amazon Simple Notification Service (SNS) topic
  • Set RI utilization or coverage targets for EC2, RDS, Redshift, and ElastiCache reservations

AWS Cost & Usage Report cost report
Single location for accessing comprehensive information about your AWS costs and usage.

Use case: List AWS usage for each service category used by an account and its IAM users in hourly or daily line items.

Reserved Instance (RI) Reporting

  • AWS Cost Explorer, RI utilization report - visualize aggregate or particular RI data.
  • AWS Cost & Usage Report - Most detailed RI info available.
  • AWS Budgets - Set custom RI utilization target, receive alerts when utilization drops below

Blockchain

Amazon Managed Blockchain fully managed
Create and manage scalable blockchain networks using the popular open source frameworks Hyperledger Fabric and Ethereum.

Business Applications

Alexa for Business
Enables organizations and employees to use Alexa to get more work done.

Amazon WorkDocs fully managed, documents, comments
Secure enterprise storage and sharing service with strong administrative controls and feedback capabilities that improve user productivity.

Amazon WorkMail managed, email & calender
Secure, managed business email and calendar service with support for existing desktop and mobile email client applications.

Amazon Chime video conferencing, chat
Communications service you can use for online meetings, video conferencing, calls, chat, and to share content, both inside and outside your organization.

Compute

Amazon Elastic Compute Cloud (Amazon EC2)
Web service that provides secure, resizable compute capacity in the cloud. It is designed to make webscale computing easier for developers.

Amazon EC2 Auto Scaling
Automatically add or remove EC2 instances according to conditions you define.

Amazon Elastic Container Registry (Amazon ECR) fully-managed, docker registry
Makes it easy for developers to store, manage, and deploy Docker container images.

Amazon Elastic Container Service (Amazon ECS) is a highly scalable, highperformance container orchestration service that supports Docker containers and allows you to easily run and scale containerized applications on AWS.

Amazon Elastic Container Service for Kubernetes (Amazon EKS) makes it easy to deploy, manage, and scale containerized applications using Kubernetes on AWS.

Amazon Lightsail easily launch virtual private servers
Designed to be the easiest way to launch and manage a virtual private server with AWS. Lightsail plans include everything you need to jumpstart your project – a virtual machine, SSD- based storage, data transfer, DNS management, and a static IP address – for a low, predictable price.

AWS Batch batch computing jobs
Enables developers, scientists, and engineers to easily and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch dynamically provisions the optimal quantity and type of compute resources (e.g., CPU or memory-optimized instances) based on the volume and specific resource requirements of the batch jobs submitted.

AWS Elastic Beanstalk is an easy-to-use service for deploying and scaling web applications and services developed with Java, .NET, PHP, Node.js, Python, Ruby, Go, and Docker on familiar servers such as Apache, Nginx, Passenger, and Internet Information Services (IIS).

AWS Fargate is a compute engine for Amazon ECS that allows you to run containers without having to manage servers or clusters.

AWS Lambda lets you run code without provisioning or managing servers. You pay only for the compute time you consume—there is no charge when your code is not running.

The AWS Serverless Application Repository
Quickly deploy code samples, components, and complete applications for common use cases such as web and mobile back-ends, event and data processing, logging, monitoring, IoT, and more. Each application is packaged with an AWS Serverless Application Model (SAM) template that defines the AWS resources used.

AWS Outposts
Bring native AWS services, infrastructure, and operating models to virtually any data center, co-location space, or on-premises facility. You can use the same APIs, the same tools, the same hardware, and the same functionality across on-premises and the cloud to deliver a truly consistent hybrid experience. Outposts can be used to support workloads that need to remain on-premises due to low latency or local data processing needs.

Amazon Timestream is a fast, scalable, fully managed time series database service for IoT and operational applications that makes it easy to store and analyze trillions of events per day at 1/10th the cost of relational databases.

Amazon DocumentDB (with MongoDB compatibility) fully managed
Fast, scalable, highly available, and fully managed document database service that supports MongoDB workloads.

Desktop and App Streaming

Amazon WorkSpaces fully managed, desktop
Cloud desktop service. You can use Amazon WorkSpaces to provision either Windows or Linux desktops in just a few minutes and quickly scale to provide thousands of desktops to workers across the globe.

Amazon AppStream 2.0 fully managed, application streaming
Application streaming service. You centrally manage your desktop applications on AppStream 2.0 and securely deliver them to any computer.

Developer Tools

AWS CodeCommit fully managed, git
Fully-managed source control service that hosts secure Git-based repositories.

CodeBuild

CodeDeploy

CodePipeline

AWS CodeStar
Enables you to quickly develop, build, and deploy applications on AWS. AWS CodeStar provides a unified user interface, enabling you to easily manage your software development activities in one place. With AWS CodeStar, you can set up your entire continuous delivery toolchain in minutes, allowing you to start releasing code faster.

Amazon Corretto Java Development Kit
No-cost, multiplatform, production-ready distribution of the Open Java Development Kit (OpenJDK). Corretto comes with long-term support that will include performance enhancements and security fixes.

AWS Cloud9 IDE
Cloud-based integrated development environment (IDE)

AWS X-Ray monitor, distributed applications
Helps developers analyze and debug distributed applications in production or under development, such as those built using a microservices architecture.

Game Tech

Amazon GameLift managed, deploy game servers
Managed service for deploying, operating, and scaling dedicated game servers for session-based multiplayer games.

Amazon Lumberyard 3D game engine
Free, cross-platform, 3D game engine for you to create the highest-quality games, connect your games to the vast compute and storage of the AWS Cloud, and engage fans on Twitch.

Internet of Things (IoT)

AWS IoT Core managed
Cloud service that lets connected devices easily and securely interact with cloud applications and other devices.

Amazon FreeRTOS (a:FreeRTOS) OS for microcontrollers
Operating system for microcontrollers that makes small, low-power edge devices easy to program, deploy, secure, connect, and manage.

AWS IoT Greengrass
Seamlessly extends AWS to devices so they can act locally on the data they generate, while still using the cloud for management, analytics, and durable storage. With AWS IoT Greengrass, connected devices can run AWS Lambda functions, execute predictions based on machine learning models, keep device data in sync, and communicate with other devices securely – even when not connected to the Internet.

AWS IoT 1-Click IoT, trigger Lambda
ervice that enables simple devices to trigger AWS Lambda functions that can execute an action.

AWS IoT Analytics fully-managed <br/?Service that makes it easy to run and operationalize sophisticated analytics on massive volumes of IoT data

The AWS IoT Button is a programmable button based on the Amazon Dash Button hardware. This simple Wi-Fi device is easy to configure, and it’s designed for developers to get started with AWS IoT Core, AWS Lambda, Amazon DynamoDB, Amazon SNS, and many other Amazon Web Services without writing device-specific code.

AWS IoT Device Defender is a fully managed service that helps you secure your fleet of IoT devices. AWS IoT Device Defender continuously audits your IoT configurations to make sure that they aren’t deviating from security best practices.

Machine Learning###

Amazon SageMaker fully-managed, machine learning
Machine learning platform that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale.

Amazon Comprehend natural language processing (NLP)
Natural language processing (NLP) service that uses machine learning to find insights and relationships in text. No machine learning experience required.

Amazon Lex speech to text
Service for building conversational interfaces into any application using voice and text. Lex provides the advanced deep learning functionalities of automatic speech recognition (ASR) for converting speech to text, and natural language understanding (NLU) to recognize the intent of the text.

Amazon Polly text to speech
Service that turns text into lifelike speech. Polly lets you create applications that talk

Amazon Rekognition image analysis
A service that makes it easy to add image analysis to your applications. With Rekognition, you can detect objects, scenes, and faces in images.

Amazon Translate language text translation
Neural machine translation service that delivers fast, high-quality, and affordable language translation.

Amazon Transcribe speech to text, development
Automatic speech recognition (ASR) service that makes it easy for developers to add speech-to-text capability to their applications.

Amazon Elastic Inference allows you to attach low-cost GPU-powered acceleration to Amazon EC2 and Amazon SageMaker instances to reduce the cost of running deep learning inference by up to 75%. Amazon Elastic Inference supports TensorFlow, Apache MXNet, and ONNX models, with more frameworks coming soon.

Amazon Forecast fully managed, prediction
Fully managed service that uses machine learning to deliver highly accurate forecasts.

Amazon Textract optical character recognition
Service that automatically extracts text and data from scanned documents. Amazon Textract goes beyond simple optical character recognition (OCR) to also identify the contents of fields in forms and information stored in tables

Amazon Personalize is a machine learning service that makes it easy for developers to create individualized recommendations for customers using their applications.

References


Written byChinomso IkwuagwuExcélsior

Limited conversations with distributed systems.

Modifying legacy applications using domain driven design (DDD)

Gherkin Best Practices

Code Review Best Practices

Hacking Cypress in 9 minutes

Some common mistakes when developing java web applications

How to make a Spring Boot application production ready

SQL JOINS - A Refresher

Add Elasticsearch to Spring Boot Application

Add entities/tables to an existing Jhipster based project

CSS 3 Media Queries - All over again

Maven Dependency Convergence - quick reference

Amazon SNS Quick Reference

AWS API Gateway Quick Reference

Amazon SQS Quick Reference

AWS API Gateway Quick Reference

AWS Lambda Quick Reference

Amazon DynamoDB - Quick Reference

Amazon Aurora

Amazon Relational Database Service

AWS Database Services

AWS Security Essentials

Amazon Virtual Private Cloud Connectivity Options

Summary of AWS Services

AWS Certified Solutions Architect - Quick Reference

AWS CloudFront FAQs - Curated

AWS VPC FAQs - Curated

AWS EC2 FAQs - Curated

AWS Achritect 5 - Architecting for Cost Optimization

AWS Achritect 4 - Architecting for Performance Efficiency

AWS Achritect - 6 - Passing the Certification Exam

AWS Achitect 3 - Architecting for Operational Excellence

AWS Achitect 2 - Architecting for Security

AWS Achitect 1 - Architecting for Reliability

Amazon DynamoDB Accelerator (DAX)

Questions and Answers - AWS Certified Cloud Architect Associate

Questions and Answers - AWS Certified Cloud Architect Associate

AWS Connectivity - PrivateLink, VPC-Peering, Transit-gateway and Direct-connect

AWS - VPC peering vs PrivateLink

Designing Low Latency Systems

AWS EFS vs FSx

AWS Regions, Availability Zones and Local Zones

AWS VPC Endpoints and VPC Endpoint Services (AWS Private Link)

AWS - IP Addresses

AWS Elastic Network Interfaces

AWS Titbits

Jenkins on AWS - Automation

Jenkins on AWS - Setup

Jenkins on AWS - Best practices

Introduction to CIDR Blocks

AWS Lamda - Limitations and Use Cases

AWS Certified Solutions Architect Associate - Part 10 - Services and design scenarios

AWS Certified Solutions Architect Associate - Part 9 - Databases

AWS Certified Solutions Architect Associate - Part - 8 Application deployment

AWS Certified Solutions Architect Associate - Part 7 - Autoscaling and virtual network services

AWS Certified Solutions Architect Associate - Part 6 - Identity and access management

AWS Certified Solutions Architect Associate - Part 5 - Compute services design

AWS Certified Solutions Architect Associate - Part 4 - Virtual Private Cloud

AWS Certified Solutions Architect Associate - Part 3 - Storage services

AWS Certified Solutions Architect Associate - Part 2 - Introduction to Security

AWS Certified Solutions Architect Associate - Part 1 - Key services relating to the Exam

AWS Certifications - Part 1 - Certified solutions architect associate

AWS Virtual Private Cloud (VPC) Examples

Curated info on AWS Virtual Private Cloud (VPC)

Notes on Amazon Web Services 8 - Command Line Interface (CLI)

Notes on Amazon Web Services 7 - Elastic Beanstalk

Notes on Amazon Web Services 6 - Developer, Media, Migration, Productivity, IoT and Gaming

Notes on Amazon Web Services 5 - Security, Identity and Compliance

Notes on Amazon Web Services 4 - Analytics and Machine Learning

Notes on Amazon Web Services 3 - Managment Tools, App Integration and Customer Engagement

Notes on Amazon Web Services 2 - Storages databases compute and content delivery

Notes on Amazon Web Services 1 - Introduction

AWS Auto Scaling - All you need to know

AWS Load Balancers - How they work and differences between them

AWS EC2 Instance Types - Curated

Amazon Web Services - Identity and Access Management Primer

Amazon Web Services - Create IAM User

Preparing Jenkins after Installation

Jenkins titbits, and then some

Docker Titbits

How to Add Chat Functionality to a Maven Java Web App

Packer - an introduction

Terraform - an introduction

Versioning REST Resources with Spring Data REST

Installing and running Jenkins in Docker

Automate deployment of Jenkins to AWS - Part 2 - Full automation - Single EC2 instance

Automate deployment of Jenkins to AWS - Part 1 - Semi automation - Single EC2 instance

Introduction to Jenkins

Software Engineers Reference - Dictionary, Encyclopedia or Wiki - For Software Engineers