Management Consulting

Data Engineer

RemoteRemoteFull Time$125,000–$135,000 /yrPosted 17 days agoHidden Gem · Himalayas

Is this role right for you?

Upload your resume and get a skill-by-skill breakdown — see exactly where you match, where you're close, and what to highlight. Not a mystery percentage.

Get a tailored resume highlighting what this role needs.

Required skills

Data Engineer
Minuteman project
enterprise data environment
data infrastructure
data systems
ETL processes
Databricks
Python
Spark
Scala

Nice to have

Advana
War Data Platform
APIs
Machine Learning models
Generative AI
Palantir Foundry applications

Role summary

The National Guard Bureau (NGB) is seeking an experienced Data Engineer for the Minuteman project team. This role involves designing, developing, and maintaining the enterprise data environment within the Department of War's (DoW) central analytics platform. Responsibilities include creating end-to-end data pipelines using ETL processes and technologies like Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL. The engineer will work with cross-functional teams to define data requirements, design optimal data models and architectures, and ensure efficient data processing and analysis. Key tasks involve data cleansing, integration, quality assurance, leveraging big data technologies, and troubleshooting complex data challenges while adhering to data governance policies.

Data EngineerWe need an experienced Data Engineer at the National Guard Bureau (NGB). The NGB is the link between the Army and Air National Guard and the Department of War (DoW). You will support operations on the Minuteman project team, which manages the NGB's enterprise data environment within the DoW's central analytics platform, and plays a crucial role in designing, developing, and maintaining the Minuteman Community Space's data infrastructure and systems. In this role, you will design and implement end-to-end data pipelines using ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL, working closely with cross-functional teams to understand data requirements and design optimal data models and architectures that ensure efficient data processing and analysis. This is a full-time opportunity. We can offer a competitive salary, and a comprehensive benefits package.RESPONSIBILITIES

Designs, develops, and implements end to end data pipelines utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL.

Works closely with cross functional teams to understand data requirements and design optimal data models and architectures.

Creates and optimizes data pipelines from scratch, ensuring scalability, reliability, and high performance processing.

Performs data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.

Leverages big data technologies to efficiently process and analyze large datasets.

Collaborates with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision making processes.

Troubleshoots data related problems and provides innovative solutions to complex data challenges.

Implements and enforces data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.

REQUIRED QUALIFICATIONS

Three (3) to ten (10) years of directly related experience

3+ years of experience as a Data Engineer

Proficiency in ETL processes and firsthand experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks

Experience working with large datasets and leveraging big data technologies to process and analyze data efficiently

Understanding of data modeling/visualization, database design principles, and data governance practices

PREFERRED QUALIFICATIONS

Experience with the Department of War (DoW) mission and associated datasets

Previous experience with Advana or the War Data Platform

Experience with APIs

Experience with Machine Learning models and/or Generative AI

Experience building within Palantir Foundry applications, including Workshop, Ontology Manager, and Gaia

EDUCATION
B.A./B.S. or M.A./M.S. in a related field
LOCATION
Remote
CLEARANCE

Active Secret security clearance

U.S. citizenship is required since this role supports the U.S. Federal government

CLIENT
OUSD Personnel & Readiness (P&R), Minuteman project team
WORK HOURS
40 hours per week. 8 hours per day
EMPLOYMENT CLASSIFICATION
Employment Classification Eligibility — W2
COMPENSATION

Salary range: $125,000 - $135,000

Benefits: Benefits package includes options for health, dental, and vision insurance coverage; 401k contribution options

West 4th Strategy is an Equal Opportunity (EEO) employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, gender, sexual orientation, ancestry, national origin, age, marital status, mental disability, physical disability, medical condition, pregnancy, political affiliation, military or veteran status, or any other basis prohibited by federal or state law.Other Considerations: applicants will be subject to a background investigation. Individual’s primary workstation is located in an office area. The noise level in this environment is low to moderate. Regularly required to sit for extended periods up to 80% of the time; frequently required to move about to access file cabinets and use office equipment such as PC, copier, fax, telephone, cell phone, etc. Occasionally required to reach overhead, bend, and lift objects of up to 10 lbs. Specific vision abilities required by this job include the use of computer monitor screens up to 80% of the time.
Originally posted on Himalayas

Ready to apply?

You'll be redirected to West 4th Strategy's application page.

Data Engineer

Is this role right for you?

Required skills

Nice to have

Role summary

Similar roles

See how RiseMe works