Search for Well Architected Advice
< All Topics
Print

Enforce data retention policies

Implementing effective data retention policies is crucial for managing data lifecycle and minimizing costs related to storage and resource management. By controlling data retention, organizations can ensure compliance while systematically identifying and terminating resources that are no longer necessary.

Best Practices

  • Establish Clear Data Retention Policies: Define data retention policies in accordance with regulatory and organizational requirements. Communicate these policies to all stakeholders to ensure compliance and consistent practices across teams.
  • Regularly Audit Resources: Conduct regular audits to identify unused or orphaned resources. Implement automated tagging of resources to track usage patterns effectively, thereby enabling timely decommissioning.

Supporting Questions

  • How frequently are data retention policies reviewed and updated in your organization?
  • What processes are in place to ensure orphaned resources are identified and removed promptly?

Roles and Responsibilities

  • Data Steward: Responsible for defining and overseeing implementation of data retention policies within the organization.
  • DevOps Engineer: Monitors resource usage and implements automation to shut down or delete unnecessary resources according to defined policies.

Artifacts

  • Data Retention Policy Document: A formal document that outlines the organization’s guidelines and protocols regarding the duration and manner in which data is retained and discarded.
  • Resource Audit Report: A report generated from periodic audits detailing resource utilization, highlighting orphaned resources that could be terminated.

Cloud Services

AWS

  • AWS Data Lifecycle Manager: Automates the creation, retention, and deletion of EBS snapshots, ensuring that data management aligns with retention policies.
  • AWS S3 Object Lifecycle Management: Enables automatic transition of objects between different storage classes and can delete objects after a specified duration, supporting data retention efforts.

Question: How do you decommission resources?
Pillar: Cost Optimization (Code: COST)

Table of Contents