Senior Data Engineer (Databricks)

Role: Senior Data Engineer
Location:
3 days in midtown NYC
Core Stack:
Databricks, Spark, Python, SQL, Akkio AI
Technical Requirements

• Experience: 6+ years in Data/Platform Engineering (AdTech, Identity, or MarTech preferred).
• Architecture: Proven expertise building and maintaining Databricks Medallion (Bronze/Silver/Gold) architectures.
• Identity & Data: Experience with Identity Graphs, HHID/MAID/IP resolution, and complex join logic.
• Integrations: Hands-on experience managing third-party data pipelines (e.g., DeepSync, Experian, FreeWheel).
• Tooling: High proficiency in SQL and Python.

AI & Prompt Engineering Skills

• AI Implementation: Practical experience with AI/ML platforms or AI-enabled analytics tools (Akkio preferred).
• Prompt Design: Ability to design, test, and refine prompts for structured data analysis and decision support.
• Model Optimization: Understanding how schema design and feature engineering impact AI model performance.
• Operationalization: Ability to translate business questions into effective AI-driven data assets.

Preferred Qualifications

• Familiarity with identity vendors (DeepSync, Experian).
• Experience with cloud-scale cost optimization.
• Background in productionizing ML/AI workflows in governed environments.

\*\*We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, color, ethnic origin, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.\*\*