AWS

Certified

Tasks and triggers that integrate Amazon Web Services with Kestra workflows, spanning storage (S3, DynamoDB), analytics (Athena, EMR, Glue), messaging and streaming (SNS, SQS, Kinesis, EventBridge), compute (Lambda, CLI), infrastructure (CloudFormation, ECR), monitoring (CloudWatch), and authentication (EKS tokens).
Authenticate every task and trigger with static credentials (`accessKeyId` and `secretKeyId`, optionally a `sessionToken`), by assuming an IAM role through `stsRoleArn`, or by relying on the default AWS credentials provider chain when none are set. Set `region` for the target service, and override `endpointOverride` with `compatibilityMode` enabled to reach S3-compatible storage backends.

AWS S3

Tasks that manage Amazon Simple Storage Service (S3) buckets and objects.

AWS SNS

Tasks that publish notifications to Amazon Simple Notification Service (SNS) topics for pub/sub fanout or SMS, email, Lambda, and SQS targets, with support for custom message attributes.

AWS CloudFormation

Tasks that create, update, or delete AWS CloudFormation stacks and optionally wait for stack operations to finish, returning stack outputs for downstream use.

AWS Authentication

Tasks that generate authentication material for AWS services, such as short-lived tokens to access Amazon EKS clusters.

AWS Eventbridge

Tasks that put events on Amazon EventBridge buses with custom detail payloads so routing rules can fan them out to downstream AWS or SaaS targets.

AWS SQS

Tasks that publish to or consume from Amazon Simple Queue Service (SQS), including polling and real-time triggers.

AWS ECR

Tasks that fetch an Amazon ECR authorization token for Docker or OCI registry logins, useful before building or pulling images in workflows.

AWS Glue

Tasks that control AWS Glue jobs: start runs with arguments, monitor their status, stop executions, and fetch job metadata to orchestrate serverless Spark ETL pipelines.

AWS EMR

Tasks that orchestrate Amazon EMR and EMR Serverless workloads: create or delete clusters, submit steps, start job runs, and optionally wait for completion so Spark or Hadoop pipelines can be managed from Kestra.

AWS Kinesis

Tasks that write batches of records to Amazon Kinesis Data Streams with partition keys for high-throughput, real-time ingestion pipelines.

AWS Athena

Tasks that run Amazon Athena SQL queries against data in S3 or federated sources, writing results to an S3 output location and optionally fetching rows.

AWS Dynamodb

Tasks that read and write Amazon DynamoDB tables: put, get, or delete individual items and run query or scan operations with expression attributes.

AWS Lambda

Tasks that invoke AWS Lambda functions with optional JSON payloads, capture response bodies or logs, and emit metrics about execution time and payload size for serverless workflows.

AWS CLI

Tasks that run AWS CLI commands (inside a container by default), reuse Kestra credentials and environment variables, and capture stdout or files produced by the CLI.