As a user, I want to automatically deploy all web analytics components

[jordanpadams]

Checked for duplicates

No - I haven't checked

🧑‍🔬 User Persona(s)

CloudOps Engineer

💪 Motivation

...so that I can run the web analytics system in Prod

📖 Additional Details

Not sure how we want to do this. The architecture is very simple, so not sure if we should redeploy these things when we need them or always have them running or what:

• AOSS - assume this is already deployed
• S3 bucket
• EC2

Will try to throw together an architecture diagram. See wiki for more details.

Acceptance Criteria

Given a Terraform configuration for web analytics components
When I apply the configuration to a target environment (Dev, Test, or Prod)
Then I expect all components (AOSS, S3, EC2/Logstash) to be deployed and operational

⚙️ Engineering Details

Dev Environment Checklist

• Run terraform plan against Dev environment and verify no unexpected changes
• Apply terraform to Dev — confirm AOSS domain, S3 bucket, and EC2 instance are created
• Verify Logstash on EC2 starts and connects to AOSS endpoint
• Confirm S3 bucket permissions allow Logstash to read log files
• Ingest sample log data and verify records appear in OpenSearch Dev index
• Verify OpenSearch index template (ecs-8.17-custom-template.json) is applied correctly

Test Environment Checklist

• Run terraform plan against Test environment and verify no unexpected changes
• Apply terraform to Test — confirm AOSS domain, S3 bucket, and EC2 instance are created
• Verify Logstash on EC2 starts and connects to AOSS endpoint
• Confirm S3 bucket permissions allow Logstash to read log files
• Ingest sample log data and verify records appear in OpenSearch Test index
• Verify OpenSearch index template is applied correctly
• Run integration tests against Test environment: python -m unittest tests.test_logstash_integration

Pre-Prod Gate (complete Dev + Test checklists before proceeding)

• Dev checklist fully complete
• Test checklist fully complete
• Deployment runbook reviewed and approved by team

🎉 I&T

No response