Data Engineer
Role summary
We are seeking a Data Engineer to design, develop, and maintain data pipelines and architectures. This role involves integrating diverse data sources, optimizing storage, and facilitating analysis using cutting-edge tools. The ideal candidate will thrive in a fast-paced environment, transforming complex data into actionable insights to empower data-driven decision-making across the organization. This is an opportunity to join a forward-thinking analytics team and shape the future of data-driven innovation.
Job Overview
We are seeking a dynamic and innovative Data Engineer to join our forward-thinking analytics team. In this role, you will be at the forefront of designing, developing, and maintaining robust data pipelines and architectures that empower data-driven decision-making across the organization. Your expertise will enable seamless integration of diverse data sources, optimize data storage solutions, and facilitate insightful analysis through cutting-edge tools and technologies. If you thrive in a fast-paced environment and are passionate about transforming complex data into actionable insights, this opportunity is perfect for you!
Duties
- Design, develop, and implement scalable data pipelines using ETL (Extract, Transform, Load) processes to support analytics and reporting needs.
- Build and maintain data warehouses and data lakes utilizing platforms such as Azure Data Lake, Hadoop, and Apache Hive to ensure efficient storage and retrieval of large datasets.
- Collaborate with cross-functional teams to gather requirements, translate business needs into technical solutions, and ensure data quality and integrity.
- Develop and optimize SQL queries for database management on systems like Microsoft SQL Server, Oracle, and other relational databases.
- Utilize programming languages such as Python, Java, Bash (Unix shell), Shell Scripting, and VBA to automate workflows and enhance data processing capabilities.
- Integrate various tools like Informatica, Talend, Looker, and RESTful APIs to streamline data ingestion and visualization processes.
- Participate in Agile development cycles to continuously improve data infrastructure, support model training initiatives, and implement analytics solutions that drive strategic insights.
Qualifications
- Proven experience with cloud platforms such as AWS or Azure Data Lake for scalable data storage solutions.
- Strong proficiency in SQL programming along with experience working with Microsoft SQL Server, Oracle databases, or similar systems.
- Hands-on knowledge of Big Data technologies including Hadoop ecosystem components like Spark and Apache Hive.
- Familiarity with ETL tools such as Informatica or Talend for efficient data integration workflows.
- Programming expertise in Python and Java; experience with Bash scripting or Shell scripting for automation tasks.
- Understanding of Data Warehouse architecture principles including database design and linked data concepts.
- Experience working within Agile methodologies to deliver iterative improvements in data infrastructure projects.
- Knowledge of analytics tools such as Looker for creating dashboards and visualizations to communicate insights effectively.
- Ability to analyze complex datasets, identify patterns, and contribute to model training efforts for predictive analytics applications. Join us in shaping the future of data-driven innovation! We’re committed to fostering a vibrant environment where your skills can thrive while making a meaningful impact through transformative analytics solutions.
Pay: $112,893.09 - $135,957.27 per year
Benefits:
- 401(k)
- Dental insurance
- Health insurance
- Health savings account
- Life insurance
- Vision insurance
Work Location: In person
Similar roles
- Senior Data EngineerExperion Technologies · Plano, Texas, United States · Hybrid
- Lead Data EngineerSmart IT Frame LLC · Los Angeles, California, United States · Hybrid
Principal Data EngineerRS21: A Data Science and Visualization Company · United States · Remote
Senior Data EngineerRaag Solutions · Bellevue, Washington, United States · Onsite- Lead Data EngineerRetail Insight Ltd · Illinois, United States · Hybrid