Datasys Consulting and Software Inc. Verified
IT Services, Consulting, Software Development
Data Engineer
New York, New York, United StatesHybridFull TimePosted 1 month agoVisa sponsorship available
Compensation estimateAI
See base, equity, bonus, and total comp estimates for this role — free, no credit card.
Sign up to see compensation estimateJ
OB DESCRIPTION:
Title: Data Engineer
Location: New York (Hybrid)
We are seeking an experienced Data Engineer to design and maintain scalable data pipelines in Databricks. The role involves end-to-end ownership of data workflows, from ingestion to production, ensuring performance, quality, and reliability.
Responsibilities:
- Build and optimize pipelines in Databricks (PySpark, SQL, Delta Lake).
- Ingest data from databases, APIs, PDFs, Excel, flat files, and web scraping.
- Implement data quality checks, validation, and testing frameworks.
- Deploy, monitor, and optimize pipelines in Databricks/AWS.
- Collaborate with data science/analytics teams and document data processes.
Qualifications :
- 8+ years of Data Engineering experience.
- Hands-on expertise in Databricks (PySpark, SQL, Delta Lake).
- Strong experience with structured & unstructured data.
- Knowledge of data quality/testing tools (Great Expectations, Deequ, dbt tests).
- Proven ability to optimize large-scale Spark/Databricks workloads.
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid
