Data Engineer

<Overview>
Ignite your passion for data and innovation as a Data Engineer, where you'll play a pivotal role in designing, building, and maintaining robust data pipelines and architectures. This dynamic position offers the opportunity to work with cutting-edge technologies, transforming raw data into actionable insights that drive strategic decision-making. Join a forward-thinking team committed to leveraging data to unlock new possibilities and foster business growth.

<Responsibilities>

• Develop, implement, and optimize scalable ETL (Extract, Transform, Load) processes to ensure efficient data flow across diverse systems.
• Design and maintain comprehensive data warehouses and data lakes utilizing platforms such as Azure Data Lake and Hadoop ecosystems.
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions using SQL, Python, Java, and shell scripting.
• Manage big data tools including Apache Hive, Spark, and Informatica to process large datasets with speed and accuracy.
• Build and maintain RESTful APIs for seamless data integration between internal systems and external sources.
• Conduct database design activities ensuring optimal schema structures in Microsoft SQL Server, Oracle, or similar environments.
• Support model training and analytics initiatives by providing clean, well-organized datasets and insights.
• Participate actively in Agile development cycles to deliver iterative improvements rapidly while maintaining high quality standards.

<Requirements>

• Proven experience working with cloud platforms such as AWS or Azure, particularly in managing data services like Azure Data Lake or related offerings.
• Strong programming skills in Python, Java, Bash (Unix shell), or shell scripting for automation and data processing tasks.
• Extensive knowledge of big data technologies including Hadoop, Spark, Apache Hive, and related tools.
• Hands-on experience with ETL tools such as Talend or Informatica for efficient data pipeline development.
• Proficiency in SQL across multiple database systems including Microsoft SQL Server, Oracle, and familiarity with database design principles.
• Experience working with Data Warehouse architectures for large-scale data storage solutions.
• Familiarity with Looker or similar analytics platforms for reporting and visualization purposes.
• Knowledge of Linked Data concepts and integration techniques to connect diverse datasets seamlessly.
• Ability to analyze complex datasets critically, supporting analysis skills that inform strategic decisions.
• Understanding of RESTful API development for system integrations.
• Experience with model training processes within a data science context is a plus.
• Strong communication skills to collaborate effectively within Agile teams and document technical solutions clearly. Join us to harness the power of big data technologies—empowering organizations through innovative solutions that turn complex information into clear insights!

Pay: $15.00 - $20.00 per hour

Work Location: In person