Data Automation Engineer

Benefits:

• Competitive salary

Location
100% Remote
Must work Central Time Zone hours

Experience Level
Senior Level (12 or more years of data engineering experience)

Role Overview
The Data Automation Engineer is responsible for designing, building, and optimizing scalable data ingestion and automation pipelines supporting product telemetry and enterprise business data. This role operates in a fast-paced, delivery-focused environment and requires deep hands-on expertise across modern data stack technologies. The position emphasizes rapid prototyping, production-grade pipeline development, and automation for analytics and downstream consumption in SaaS environments.

Key Responsibilities

Data Ingestion & Pipeline Development

• Design and build end-to-end data ingestion pipelines from source systems into Snowflake
• Ingest data from product telemetry and observability platforms
• Ingest data from enterprise business systems including CRM, ERP, financial, consumption, and renewal platforms
• Develop ingestion solutions using Python, bulk APIs, and object storage-based lakehouse architectures
• Implement streaming and distributed processing using Kafka, Spark, or similar frameworks

Data Processing & Optimization

• Apply advanced SQL transformations within Snowflake to produce analytics-ready datasets
• Optimize ingestion performance for high-volume, large-scale datasets
• Implement incremental loading, change data capture, micro-batching, and API rate-limit handling
• Ensure pipelines are scalable, efficient, resilient, and production-ready

Automation, DevOps & Reliability

• Implement CI/CD pipelines and DevOps best practices for data workflows
• Automate deployments, versioning, and environment management
• Build observability, monitoring, and alerting into ingestion pipelines
• Monitor, troubleshoot, and optimize pipeline performance and reliability
• Ensure data freshness, accuracy, and consistency across systems

Collaboration & Rapid Prototyping

• Partner with data analysts, subject matter experts, and platform teams to deliver ingestion solutions
• Translate evolving business and product requirements into working data pipelines
• Support data exploration and analytics initiatives with fast iteration cycles

Required Qualifications

• 12 or more years of hands-on experience in data engineering and data automation
• Strong expertise in Python, including production-grade pipeline development
• Strong expertise in Snowflake for data ingestion, transformation, and performance optimization
• Strong SQL skills with experience supporting analytical workloads
• Proven experience with Kafka, Spark, or similar distributed or streaming frameworks
• Experience working with AWS and S3 or equivalent object storage and lakehouse architectures
• Deep understanding of change data capture, incremental loading, micro-batching, and API rate limiting
• Experience implementing CI/CD and DevOps practices for data pipelines
• Experience supporting high-volume SaaS or telemetry-driven data environments
• Ability to pass hands-on SQL and Python coding assessments

Preferred Qualifications

• Experience with dbt for data modeling and transformation
• Experience with open-source ingestion frameworks or connectors
• Exposure to event-driven or telemetry-heavy architectures
• Experience supporting enterprise-scale data platforms

Core Skills & Attributes

• Strong problem-solving and performance optimization mindset
• Ability to work independently in fast-paced, iterative environments
• High attention to data quality, reliability, and scalability
• Strong collaboration and communication skills across technical teams
• Focus on building durable, production-grade data automation solutions

This is a remote position.