Director, Data Engineering (IM-012)

New York, New York, United StatesOnsiteFull TimeDirector$131,997–$131,997 /yrPosted 2 months agoVisa sponsorship available

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Role summary

Affinity Solutions is seeking a Director, Data Engineering to lead architecture and design decisions for their Core Data Asset Maintenance and Data Product development. This role requires a Master's degree in Computer Science or Information Technology with 2 years of experience. The Director will leverage advanced technologies including Snowflake Data Cleanrooms, Databricks, Apache Kafka, and AWS services to transform purchase signals into actionable insights. Responsibilities include designing data pipelines, ensuring data availability through SLAs, and architecting monitoring solutions, utilizing big data technologies, distributed systems, and CI/CD practices.

Affinity Solutions (Affinity) is the leading consumer purchase insights company. We provide a complete view of U.S. and U.K. consumer spending, across and between brands, via exclusive access to fully permissioned data from over 100 million consumers. Our proprietary AI technology, Comet™, transforms these purchase signals into actionable insights for business and marketing leaders to drive optimal outcomes and build lasting customer relationships. Visit www.affinitysolutions.com to discover how we’re shaping the future of consumer purchase insights.
We are seeking a Director, Data Engineering with
Master’s degree in in Computer Science, Information Technology with 2 years of experience; Lead architecture and design decisions for Marketing Solutions' Core Data Asset Maintenance and Data Product development using advanced technologies including Snowflake Data Cleanrooms, Databricks, and Apache Kafka, with experience in Python, SQL, PySpark, Snowpark, Jinja SQL, and AWS EMR. Provide technical input and decide for all components of the data infrastructure, using AWS technologies (S3 data lake, Lambda, Glue, Airflow), Apache Hive, Amazon Redshift, Workflow Orchestration using Airflow for system design. Design and architect pipelines and data ingestion and transformation, requiring advanced skills in big data technologies including Apache Spark, distributed systems, and performance optimization using Bash scripting, and CI/CD pipelines with Jenkins. Define SLAs for data availability and architect automated monitoring solutions, utilizing experience in DevOps tools, CloudWatch, and incident response frameworks.
Skills: Snowflake Data Cleanrooms, Databricks, Apache Kafka, Python, SQL, PySpark, Snowpark, Jinja SQL, AWS EMR, S3 data lake, Lambda, Glue, Airflow, Apache Hive, Amazon Redshift, Workflow Orchestration using Airflow.
Send resume to Affinity Solutions, Inc, 112 WEST 34TH STREET, 18TH Floor, New York, NY 10120.
Salary: $131,997.00
Work Hours: 40 hours/week, Monday to Friday, 9:00am – 5:00pm

Ready to apply?

You'll be redirected to Affinity Solutions's application page.