Engineer, Data Engineering
Role summary
Pilot Company is seeking a Data Engineering professional to provide technical expertise for the development and modification of data engineering processes and jobs supporting their Big Data infrastructure. This role involves collaborating with AI teams and business stakeholders to understand data needs, troubleshooting complex data issues within SLAs, and maintaining code according to best practices. The position requires strong SQL and Python skills, with a Bachelor's degree and at least one year of experience. Preferred qualifications include knowledge of relational databases, cloud platforms like AWS, and Apache Spark. The role emphasizes analytical problem-solving, clear communication, and adaptability in a dynamic environment.
Company Description
Pilot Company is an industry-leading network of travel centers with more than 30,000 team members and over 750 retail and fueling locations in 44 states and six Canadian provinces. Our energy and logistics division serves as a top supplier of fuel, employing one of the largest tanker fleets and providing critical services to oil operations in our nation's busiest basins. Pilot Company supports a growing portfolio of brands with expertise in supply chain and retail operations, logistics and transportation, technology and digital innovation, construction, maintenance, human resources, finance, sales and marketing.
Founded in 1958 by Jim A. Haslam II and currently led by CEO Adam Wright, our founding values, people-first culture and commitment to giving back remains true to us today. Whether we are serving guests, a fellow team member, or a trucking company, we are dedicated to fueling people and keeping North America moving.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or any other characteristic protected under applicable federal, state, or local law.
Military encouraged to apply.
Job Description
The purpose of this job is to provide technical expertise for research, development and modification of data engineering processes and jobs in support of a Big Data infrastructure for Pilot Company.
- Research, develop, document, and modify Data Engineering processes and jobs per data architecture and modeling requirements; collaborate with AI team members such as Business Analysts, Data Scientists, and Analytics Engineers.
- Collaborate with business stakeholders to understand data needs including data velocity, veracity, and access patterns
- Troubleshoot complex, escalated issues including connection, failed jobs, application errors, server alerts and space thresholds within predefined service level agreements (SLAs)
- Proactively maintain and tune all code according to internally documented Data Engineering standards and best practices; Generate appropriate documentation for all new development and modifications of the Data Lake processes and jobs
- Model behaviors that support the company’s common purpose; ensure guests and team members are supported at the highest level
- Ensure all activities are in compliance with rules, regulations, policies, and procedures
Qualifications
- SQL knowledge and skills required
- Python knowledge and skills required
- Knowledge of Relational Databases like Oracle, Postgres or SQL Server preferred
- Experience with Apache Spark preferred
- Knowledge of Amazon Web Services (AWS) or similar Cloud Big Data platform preferred
- Excellent analytical skills and the ability to identify solutions to complex data problems
- Excellent written and verbal communication skills; Willingness to learn and embrace new technologies; Ability to work successfully in a fast-paced and dynamic environment
- Strong organizational skills with attention to detail; Ability to communicate and interact effectively with different teams to complete projects
- Self-motivated with ability to work both independently and within teams in order to meet deadlines, goals, and objectives
- Travel required less than 10%; General office work requiring sitting or standing for long periods of time; Able to lift up to 30 lbs.
- Able to work evenings, weekends and odd hours as needed
- Bachelor's Degree or Equivalent Education required
- Master's Degree or Equivalent Experience preferred
- At least 1 Year Experience
Additional Information
