GCP Data Analyst

Data Analyst - Cloud Migration

Remote

4 +months

Video

Role Responsibilities

Here are key job responsibilities for a Data Analyst supporting a legacy-to-GCP data migration project:

Migration Planning & Assessment

• Data Inventory & Audit: Identify and catalog all legacy data sources, including databases, data warehouses, files, and systems
• Data Quality Assessment: Evaluate source data quality, identify gaps, inconsistencies, and anomalies
• Migration Scope Definition: Help determine which data systems and datasets will be migrated vs. decommissioned
• Impact Analysis: Document dependencies and identify systems/applications relying on legacy data

Data Mapping & Transformation

• Schema Mapping: Map legacy database schemas to GCP target structures (BigQuery, Cloud SQL, etc.)
• Data Transformation Logic: Define and document ETL/ELT rules and data transformation requirements
• Data Lineage Documentation: Track data flow from source systems through transformation to GCP targets
• Validation Rules: Create data quality checks and reconciliation processes

GCP Platform Support

• GCP Architecture Familiarization: Learn GCP services relevant to migration (BigQuery, Dataflow, Pub/Sub, etc.)
• Data Model Design: Collaborate on designing optimal data structures in GCP for performance and scalability
• Tool & Script Development: Support creation of migration scripts and testing frameworks
• Performance Optimization: Analyze and optimize query performance in BigQuery and other GCP services

Testing & Validation

• Test Data Preparation: Create representative test datasets for UAT and validation
• Migration Testing: Execute test migrations and validate data accuracy and completeness
• Reconciliation: Compare source and target data to ensure successful migration with zero data loss
• Performance Benchmarking: Track migration performance metrics and identify bottlenecks

Stakeholder Engagement

• Requirements Gathering: Interview business users and data owners to understand data needs
• Documentation: Create comprehensive migration runbooks and data dictionaries
• Training Support: Help prepare documentation for post-migration data access and usage
• Change Management: Communicate timelines, impacts, and new processes to stakeholders

Post-Migration Support

• Data Validation: Perform comprehensive post-migration quality checks
• Performance Monitoring: Monitor GCP resource utilization and query performance
• Issue Resolution: Troubleshoot data discrepancies and resolve migration issues
• Documentation Updates: Maintain accurate documentation of migrated data assets