Data Engineer

About The Company
DiversityJobs is a leading organization committed to fostering an inclusive and equitable work environment. We prioritize safety, inclusion, and excellence in all our operations, ensuring that our workforce reflects the diverse communities we serve. As part of our mission, we aim to attract talented professionals who are passionate about making a difference and driving innovation across various industries. With a focus on continuous growth and development, DiversityJobs provides resources and opportunities that empower employees to reach their full potential. Our commitment to diversity and inclusion is embedded in our culture, enabling us to build a dynamic and collaborative workplace where everyone feels valued and respected.
About The Role
We are seeking a highly skilled Data & AI Lead to join our team at DiversityJobs. In this pivotal role, you will spearhead our efforts to transform data assets into real-time enterprise solutions, positioning us as a forward-thinking AI company. You will be responsible for designing and implementing advanced data streaming solutions, developing robust data pipelines, and managing large-scale data warehouses that support business intelligence and analytics. This position offers the opportunity to work remotely within the United States, collaborating with cross-functional teams to deliver innovative data solutions that enhance operational efficiency and decision-making capabilities. The ideal candidate will have a strong background in data engineering, cloud technologies, and machine learning, with a passion for leveraging data to drive strategic initiatives.
Qualifications
The ideal candidate will possess a minimum of 6 years of experience in software engineering, data engineering, or relevant fields. Proficiency in programming languages such as Python, SQL, and Java is essential. A solid understanding of data warehousing concepts, including dimensional modeling and star schema, is required. Experience with ETL processes and cloud-based solutions is necessary, along with familiarity with database management systems like SQL and NoSQL, as well as modern lakehouse technologies such as Apache Iceberg, Delta Lake, and Apache Trino. Candidates should have hands-on experience with data streaming platforms including Apache Kafka, AWS Kinesis, Apache Flink, and Apache Spark. Strong problem-solving skills, excellent communication, and the ability to adapt to rapidly changing environments are critical. Preferred qualifications include a bachelor’s degree or higher in Computer Science or a related field, experience with Agile methodologies, and familiarity with cloud platforms and open-source data tools.
Responsibilities
As a Data & AI Lead, your responsibilities will include designing and implementing real-time data streaming solutions to process large volumes of data efficiently. You will develop and maintain scalable data pipelines for both real-time and batch processing, ensuring seamless data extraction, transformation, and loading (ETL) processes across systems. Managing large-scale data warehouses will be a key focus, enabling quick data access for analytics and business intelligence. You will work closely with data scientists, analysts, and stakeholders to understand data requirements and deliver tailored data solutions. Monitoring and troubleshooting data pipelines to ensure high performance, reliability, and security will be part of your daily tasks. Additionally, you will lead efforts to incorporate data security standards, stay updated on industry trends, and write well-documented, efficient code with comprehensive testing. Leading the integration of data engineering solutions into production environments, overseeing solution design, development, testing, and deployment, will also be central to your role.
Benefits
DiversityJobs offers a comprehensive benefits package designed to support the well-being and professional growth of our employees. Our benefits include an industry-leading 401(k) plan and a renowned Railroad Retirement program. We provide a variety of healthcare options covering medical, dental, vision, telemedicine, mental health, and wellness support for employees and their dependents, including domestic partners. Health savings accounts (HSAs) with employer contributions, life and disability insurance, and family benefits such as parental leave, pediatric and family support, adoption and surrogacy reimbursement, and dependent care accounts are also available. Employees gain access to discounts on travel, gym memberships, counseling services, and wellness programs. Our incentive compensation program offers annual bonuses, and we maintain generous leave policies to promote work-life balance. For more details, please visit our Benefits page.
Equal Opportunity
DiversityJobs is an Equal Opportunity Employer. We are committed to creating an inclusive environment where all employees and applicants are treated with respect and fairness regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic. We believe that diversity enhances our ability to innovate and succeed, and we encourage individuals from all backgrounds to apply and contribute to our mission of fostering a culture of inclusion and excellence.