Skip to content

Add all remaining aws package permissions to the Federated Identity CFT - #7637

Open
seanrathier wants to merge 9 commits into
mainfrom
seanrathier/federated-identity-aws-remaining
Open

Add all remaining aws package permissions to the Federated Identity CFT#7637
seanrathier wants to merge 9 commits into
mainfrom
seanrathier/federated-identity-aws-remaining

Conversation

@seanrathier

@seanrathier seanrathier commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds all AWS integration permissions to the federated identity CloudFormation template, enabling zero-creds STS AssumeRole+ExternalID auth across the entire aws package.

Paired integrations PR: elastic/integrations#20527

Part of ingest-dev#8802

Policies added

Resource Permissions Integration
ElasticAwsConfig config:DescribeConfigRules, config:GetComplianceDetailsByConfigRule config
ElasticAwsInspector inspector2:ListFindings inspector
ElasticAwsSecurityHub securityhub:GetFindings, securityhub:GetInsights securityhub
ElasticAwsCloudwatchLogs logs:DescribeLogGroups, logs:FilterLogEvents cloudwatch/ec2/elb/lambda logs
ElasticAwsMetrics cloudwatch:ListMetrics, cloudwatch:GetMetricData, tag:GetResources, ec2:DescribeRegions all aws/metrics metricsets
ElasticAwsHealth health:DescribeEvents, health:DescribeEventDetails, health:DescribeAffectedEntities awshealth
ElasticAwsBilling ce:GetCostAndUsage billing
ElasticAwsDynamoDB dynamodb:ListTables, dynamodb:DescribeTable dynamodb
ElasticAwsEBS ec2:DescribeVolumes ebs
ElasticAwsEC2 ec2:DescribeInstances, ec2:DescribeInstanceStatus ec2
ElasticAwsECS ecs:ListClusters, ecs:DescribeClusters, ecs:ListServices, ecs:DescribeServices ecs
ElasticAwsELB elasticloadbalancing:DescribeLoadBalancers, ...DescribeTargetGroups, ...DescribeTargetHealth elb
ElasticAwsLambda lambda:ListFunctions, lambda:GetFunction lambda
ElasticAwsRDS rds:DescribeDBInstances, rds:DescribeDBClusters, rds:ListTagsForResource rds
ElasticAwsSNS sns:ListTopics, sns:GetTopicAttributes sns
ElasticAwsSQS sqs:ListQueues, sqs:GetQueueAttributes sqs
ElasticAwsTransitGateway ec2:DescribeTransitGateways, ec2:DescribeTransitGatewayAttachments transitgateway

E2E test plan

  1. Deploy this CFT (or update an existing federated-identity stack)
  2. Validate per integration that no AccessDeniedException appears in agent logs for any listed action
  3. Confirm Fleet shows no DEGRADED status for Config, Inspector, SecurityHub, CloudWatch, and a sampling of metrics data streams
  4. Regression: existing GuardDuty policies using the same role must continue collecting data

seanrathier and others added 6 commits July 21, 2026 16:13
Introduces federated-identity-aws.yml — a single CFT with one Enable*
boolean parameter per AWS integration. CloudFormation Conditions attach
only the IAM policies needed for the selected data streams, keeping the
role minimal. Transport-layer policies (S3/SQS, CloudWatch Logs, Metrics)
are auto-derived so users never need to think about them.

Adds the template to publish_cft.sh so it is uploaded to S3 alongside
the existing cloud-connectors templates.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…nally

Drops the 24 Enable* parameters and all CloudFormation Conditions in
favor of a single static read-only role. Every IAM policy needed by the
agentless-enabled AWS policy templates is always attached, so Kibana
only needs to pass ElasticResourceId in the quick-create URL and users
never have to update the stack when they add integrations later.

Policies are grouped into four inline policy resources (transport,
metrics, security findings, service inventory) plus the GuardDuty
managed policy. Trust policy, ExternalId derivation, and outputs are
unchanged.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Extends the federated identity role to cover CSPM, Cloud Asset
Inventory, and KSPM-EKS: attaches the SecurityAudit managed policy and
adds an ElasticSecurityPosture inline policy with the supplemental
config, organizations, access-analyzer, account, cross-account
sts:AssumeRole, and EKS read permissions declared in the per-package
IaC patches of elastic/integrations#20240.

CNVM is deliberately excluded: its scan operations (snapshot
create/delete, RunInstances/TerminateInstances, iam:PassRole) require
write access, and this role stays read-only. CNVM keeps its dedicated
template.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Cross-checked every inline action against the provider_permissions
declarations in elastic/integrations#19405 (the AWS package's
per-datastream permission manifest) and added the missing actions the
agentless data streams require at runtime:

- ec2:DescribeInstanceStatus (ec2_metrics)
- ecs:DescribeClusters (ecs_metrics)
- elasticloadbalancing:DescribeTargetHealth (elb_metrics)
- lambda:GetFunction (lambda)
- rds:DescribeDBClusters (rds)
- health:DescribeAffectedEntities (awshealth)
- securityhub:BatchGetSecurityControls, GetInsightResults
  (securityhub_findings_full_posture, securityhub_insights)

securityhub:ListInsights, declared by #19405, is NOT added: cfn-lint
confirms no such IAM action exists — listing insights is
securityhub:GetInsights, which was already granted.

Also corrects the Config grant: the aws.config data stream polls rule
compliance (DescribeConfigRules, DescribeComplianceByConfigRule,
GetComplianceDetailsByConfigRule), not resource inventory; the
inventory-style Config reads moved to the SecurityPosturePolicy with
the rest of the Asset Inventory permission set.

Actions not declared by #19405 are retained when another primary source
documents them (e.g. iam:ListAccountAliases in the package README);
services whose policy templates are not agentless-enabled (apigateway,
natgateway, vpn, emr, kafka, kinesis, redshift, s3_storage_lens) stay
out of scope.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Replace the all-at-once grant (five inline policies + SecurityAudit
covering every agentless-enabled AWS integration upfront) with an
incremental model: the template carries only the permissions of
integrations that are actually federated, one block per integration,
mirroring the provider_permissions declared in that integration's
package manifest in elastic/integrations. Never grant ahead of a
declaration.

The baseline is GuardDuty only — the single integration federated in
production today. Its AmazonGuardDutyReadOnlyAccess grant is carried
over verbatim from the shipped cloud-connectors-guardduty template,
pre-dating provider_permissions; it converts to a mirrored block when
the aws package gains declarations.

Per-integration additions land as separate PRs stacked on this one,
each paired with the elastic/integrations PR that declares the
permissions it mirrors.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Adds 15 inline IAM policies to the federated identity template covering
all remaining aws package integrations: inspector, securityhub, cloudwatch
logs, shared metrics base (cloudwatch:ListMetrics, GetMetricData,
tag:GetResources, ec2:DescribeRegions), awshealth, billing, dynamodb,
ebs, ec2, ecs, elb, lambda, rds, sns, sqs, and transitgateway.

Paired integrations PR: elastic/integrations#20526

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@mergify

mergify Bot commented Aug 4, 2026

Copy link
Copy Markdown
Contributor

This pull request does not have a backport label. Could you fix it @seanrathier? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

  • backport-v./d./d./d is the label to automatically backport to the 8./d branch. /d is the digit
  • backport-active-all is the label that automatically backports to all active branches.
  • backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
  • backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@seanrathier seanrathier added backport-skip Team:Security-Cloud Services Security Data Experience - Cloud Services team. labels Aug 4, 2026
@seanrathier
seanrathier marked this pull request as ready for review August 4, 2026 18:36
@seanrathier
seanrathier requested a review from a team as a code owner August 4, 2026 18:36
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
seanrathier added a commit to seanrathier/integrations that referenced this pull request Aug 4, 2026
The Identity Federation quick-create link now targets
cloudformation-federated-identity-aws-9.4.0.yml, published by
cloudbeat's publish_cft.sh when elastic/cloudbeat#7637 merges. Until
that publish runs, this URL 404s — cloudbeat#7637 must merge first.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Consolidates the grants previously split across the standalone CSPM and
Cloud Asset Inventory remote-role templates into the single combined CFT.
SecurityAudit covers both cloud_security_posture and cloud_asset_inventory;
the intent is for this template to replace the separate per-product CFTs.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@@ -0,0 +1,337 @@
AWSTemplateFormatVersion: "2010-09-09"

Description: 'Creates an IAM Role for Elastic Federated Identity (Cloud Connectors). Grants read-only permissions for all Elastic AWS integrations that support Federated Identity: the aws package integrations (GuardDuty, Inspector, Config, CloudWatch, and metrics services), Cloud Security Posture Management (cloud_security_posture), and Cloud Asset Inventory (cloud_asset_inventory).'

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Description: 'Creates an IAM Role for Elastic Federated Identity (Cloud Connectors). Grants read-only permissions for all Elastic AWS integrations that support Federated Identity: the aws package integrations (GuardDuty, Inspector, Config, CloudWatch, and metrics services), Cloud Security Posture Management (cloud_security_posture), and Cloud Asset Inventory (cloud_asset_inventory).'
Description: 'Creates an IAM Role for Elastic Identity Federation. Grants read-only permissions for all Elastic AWS integrations that support Identity Federation: the AWS package integrations (GuardDuty, Inspector, Config, CloudWatch, and metrics services)'

@jeniawhite jeniawhite left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar to PR: elastic/integrations#19405.
I assume that there is some overlap between the roles and the permissions (the roles probably include some of the permissions), but this shouldn't be a problem. Cloudbeat wise it looks fine, but would be great if we could get a review from the integration stakeholders as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport-skip Team:Security-Cloud Services Security Data Experience - Cloud Services team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants