Data Engineer 3
Role summary
BLOC Resources is seeking a Data Engineer 3 with 5-10 years of experience to design, build, and optimize scalable data solutions. This role focuses on data modeling, pipeline development, and leveraging big data technologies. The engineer will work with relational and NoSQL databases, cloud platforms (specifically Azure), and programming languages like SQL and Python. Key responsibilities include developing data pipelines, designing data models, supporting big data and advanced analytics initiatives, ensuring data quality, and collaborating within Agile teams. The position requires a Bachelor's degree in a related field and proven experience in data engineering and analytics solutions.
Position Overview
BLOC Resources is seeking a highly skilled and experienced Data Engineer 3 to design, build, and optimize scalable data solutions that support enterprise analytics, reporting, and business intelligence initiatives.
This role is ideal for a data professional with 5–10 years of experience working in a software engineering or data engineering capacity, with deep expertise in data modeling, data pipelines, and big data technologies. The Data Engineer will play a critical role in transforming raw data into structured, high-quality datasets that drive informed decision-making across the organization.
The ideal candidate will have hands-on experience working with relational databases, NoSQL systems, and modern cloud-based data platforms, along with strong proficiency in SQL, Python, and distributed data processing frameworks. This position requires the ability to work across multiple data sources, implement robust data pipelines, and ensure data integrity, accessibility, and performance.
Key Responsibilities
The Data Engineer 3 will be responsible for designing, developing, and maintaining enterprise data solutions, including:
*Data Engineering & Pipeline Development*
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing
- Build and manage Databricks pipelines to ingest, transform, and deliver data from multiple sources
- Combine raw data from various systems into clean, consistent, and machine-readable formats
*Data Modeling & Architecture*
- Design and implement data models, schemas, and database structures that support analytics and application requirements
- Normalize and optimize databases to improve performance, scalability, and data integrity
- Work with both relational (SQL-based) and NoSQL/data lake architectures
*Big Data & Advanced Analytics Support*
- Develop and support solutions using big data technologies such as Hadoop, Hive, and Spark
- Enable analytics and reporting by constructing datasets optimized for business intelligence and machine learning
- Support development of statistical models and AI/ML solutions using tools such as Python or R
*Cloud Data Engineering*
- Design and implement data solutions using Microsoft Azure cloud technologies, including:
- Azure Data Lake
- Azure Data Factory
- Azure Databricks
- Azure Synapse
- Azure Key Vault
- Power BI
- Ensure secure, scalable, and high-performance cloud-based data environments
*Data Integration & APIs*
- Develop solutions for data sourcing, enrichment, and delivery using APIs and web services
- Integrate data across internal and external systems to support enterprise analytics needs
*Data Quality & Governance*
- Implement and maintain data quality frameworks and validation processes
- Ensure data accuracy, consistency, and compliance with organizational standards
- Support governance initiatives and best practices for data management
*Design, Testing & Deployment*
- Create functional and technical design documentation for data engineering solutions
- Design, test, deploy, and support data systems across the full development lifecycle
- Utilize CI/CD pipelines and DevOps practices to ensure efficient delivery and deployment
*Collaboration & Agile Delivery*
- Work within Agile teams to deliver high-quality data solutions
- Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions
- Participate in continuous improvement initiatives and technology adoption
Technical Skills, Knowledge & Competencies
- Advanced proficiency in SQL and data modeling techniques
- Strong experience with Spark, Hive, Airflow, and Databricks
- Expertise in relational databases (Oracle, SQL Server) and NoSQL/data lake environments
- Proficiency in Python and/or R for data processing and analytics
- Experience with MSBI tools (SSIS, SSAS), Informatica, Oracle GoldenGate
- Hands-on experience with Azure data platforms and cloud-based tools
- Familiarity with data quality tools and governance frameworks
- Experience with containerization technologies such as Docker and OpenShift
- Knowledge of DevOps, CI/CD pipelines, and Agile methodologies
- Strong analytical, problem-solving, and system design skills
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field
- 5–10 years of experience in data engineering, data architecture, or software engineering
- 5+ years of experience designing and delivering data engineering and analytics solutions using on-premise tools (SQL, Oracle, MSBI, Informatica, etc.)
- 3+ years of experience working with Azure cloud-based data technologies
- Proven experience building and maintaining data pipelines and large-scale data systems
- Strong understanding of data structures, database design, and distributed systems
Preferred Qualifications
- Experience with AI/ML model development and deployment
- Experience working with real-time data streaming frameworks
- Familiarity with enterprise data governance and compliance environments
- Certifications in Azure, Databricks, or data engineering technologies
- Experience in large-scale enterprise or utility environments
Physical Requirements
- Primarily office-based role with standard computer usage
- Ability to work extended hours as needed to meet project deadlines
Job Title: Data Engineer 3
Company: BLOC Resources
Location: 3535 Colonnade Parkway, Birmingham, AL 35243
Pay Rate: $56.00-$58.00/hour
Position Overview
BLOC Resources is seeking a highly skilled and experienced Data Engineer 3 to design, build, and optimize scalable data solutions that support enterprise analytics, reporting, and business intelligence initiatives.
This role is ideal for a data professional with 5–10 years of experience working in a software engineering or data engineering capacity, with deep expertise in data modeling, data pipelines, and big data technologies. The Data Engineer will play a critical role in transforming raw data into structured, high-quality datasets that drive informed decision-making across the organization.
The ideal candidate will have hands-on experience working with relational databases, NoSQL systems, and modern cloud-based data platforms, along with strong proficiency in SQL, Python, and distributed data processing frameworks. This position requires the ability to work across multiple data sources, implement robust data pipelines, and ensure data integrity, accessibility, and performance.
Key Responsibilities
The Data Engineer 3 will be responsible for designing, developing, and maintaining enterprise data solutions, including:
*Data Engineering & Pipeline Development*
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing
- Build and manage Databricks pipelines to ingest, transform, and deliver data from multiple sources
- Combine raw data from various systems into clean, consistent, and machine-readable formats
*Data Modeling & Architecture*
- Design and implement data models, schemas, and database structures that support analytics and application requirements
- Normalize and optimize databases to improve performance, scalability, and data integrity
- Work with both relational (SQL-based) and NoSQL/data lake architectures
*Big Data & Advanced Analytics Support*
- Develop and support solutions using big data technologies such as Hadoop, Hive, and Spark
- Enable analytics and reporting by constructing datasets optimized for business intelligence and machine learning
- Support development of statistical models and AI/ML solutions using tools such as Python or R
*Cloud Data Engineering*
- Design and implement data solutions using Microsoft Azure cloud technologies, including:
- Azure Data Lake
- Azure Data Factory
- Azure Databricks
- Azure Synapse
- Azure Key Vault
- Power BI
- Ensure secure, scalable, and high-performance cloud-based data environments
*Data Integration & APIs*
- Develop solutions for data sourcing, enrichment, and delivery using APIs and web services
- Integrate data across internal and external systems to support enterprise analytics needs
*Data Quality & Governance*
- Implement and maintain data quality frameworks and validation processes
- Ensure data accuracy, consistency, and compliance with organizational standards
- Support governance initiatives and best practices for data management
*Design, Testing & Deployment*
- Create functional and technical design documentation for data engineering solutions
- Design, test, deploy, and support data systems across the full development lifecycle
- Utilize CI/CD pipelines and DevOps practices to ensure efficient delivery and deployment
*Collaboration & Agile Delivery*
- Work within Agile teams to deliver high-quality data solutions
- Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions
- Participate in continuous improvement initiatives and technology adoption
Technical Skills, Knowledge & Competencies
- Advanced proficiency in SQL and data modeling techniques
- Strong experience with Spark, Hive, Airflow, and Databricks
- Expertise in relational databases (Oracle, SQL Server) and NoSQL/data lake environments
- Proficiency in Python and/or R for data processing and analytics
- Experience with MSBI tools (SSIS, SSAS), Informatica, Oracle GoldenGate
- Hands-on experience with Azure data platforms and cloud-based tools
- Familiarity with data quality tools and governance frameworks
- Experience with containerization technologies such as Docker and OpenShift
- Knowledge of DevOps, CI/CD pipelines, and Agile methodologies
- Strong analytical, problem-solving, and system design skills
Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field
- 5–10 years of experience in data engineering, data architecture, or software engineering
- 5+ years of experience designing and delivering data engineering and analytics solutions using on-premise tools (SQL, Oracle, MSBI, Informatica, etc.)
- 3+ years of experience working with Azure cloud-based data technologies
- Proven experience building and maintaining data pipelines and large-scale data systems
- Strong understanding of data structures, database design, and distributed systems
Preferred Qualifications
- Experience with AI/ML model development and deployment
- Experience working with real-time data streaming frameworks
- Familiarity with enterprise data governance and compliance environments
- Certifications in Azure, Databricks, or data engineering technologies
- Experience in large-scale enterprise or utility environments
Physical Requirements
- Primarily office-based role with standard computer usage
- Ability to work extended hours as needed to meet project deadlines
Compensation & Benefits
Pay Rate: $56.00-$58.00/hour
Additional benefits of working through BLOC Resources include:
- Dedicated contractor support, onboarding assistance, and ongoing recruiter engagement
- Hands-on experience with enterprise-level data engineering and analytics platforms
- Exposure to large-scale infrastructure, cloud transformation, and data modernization initiatives
- Opportunity for contract extension or long-term placement based on performance
- Ongoing support from BLOC Resources’ recruiting and operations teams
- Opportunity to collaborate with experienced data professionals, engineers, and business leaders
