AWS data architect

- Design and implement a scalable data hub solution on AWS, adhering to best practices for data ingestion, transformation, storage, and access management. - Define data models, lineage documentation, and quality standards for the DataHub. - Select suitable AWS services based on data volume, access patterns, and performance needs. - Come up with designs that are prepared for AI/ML applications in subsequent phases. - Create and construct data pipelines to extract, transform, and load data from various sources into the DataHub using AWS Glue, AWS Batch, or custom ETL methodologies. - Implement data cleansing and normalization practices to secure data integrity. - Manage schedules for data ingestion and establish error handling protocols. - Develop data governance frameworks, including data quality assessments, lineage tracking, and data retention policies. - Establish data access controls and security measures to safeguard sensitive information within the DataHub using IAM roles and policies. - Create data catalogs and metadata management frameworks to enhance data discoverability for business users and analysts. - Design and build data views and dashboards utilizing Power BI for extensive data exploration and visualization. - Formulate data warehouses and data marts that align with business requirements. - Monitor the performance of data pipelines, overall data quality, and system health, addressing issues proactively. - Optimize storage and processing expenditures by using AWS cost management features. - Develop necessary governance, security, and monitoring systems to facilitate efficient data exchange with internal applications, external vendors, partners, and SaaS providers. - Establish intake processes, service level agreements (SLAs), and usage protocols for internal and external data producers and consumers.