IT Consultant IV, Solutions - Data Engineer
Role summary
Seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines in a Microsoft Azure environment. Responsibilities include leveraging Azure Databricks, PySpark, SQL, and Informatica Intelligent Cloud Services (IICS) to transform data, ensuring performance, reliability, and security. The role also involves customer support, application support, solution design, requirements translation, and vendor evaluation. This position requires a Bachelor's degree or equivalent experience in IT consulting or a related field, with a minimum of six years of experience. Preferred qualifications include experience in software testing, application development, and specific data engineering tools.
Job Summary:
We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines within our Microsoft Azure ecosystem. You will leverage Azure Databricks, PySpark, SQL and Informatica Intelligent Cloud Services (IICS) to transform raw data into actionable insights, ensuring high performance, data reliability, and security.
In addition to the responsibilities listed below, this position is responsible for providing support for customers (users), and assigned applications and/or information systems, including software implementation, integration, configuration, and testing. Additional responsibilities also include supporting solution design, researching how to help translate requirements into workable technical solutions, and supporting the evaluation of third-party vendors as directed.
Essential Responsibilities:
- Completes work assignments and supports business-specific projects by applying expertise in subject area; supporting the development of work plans to meet business priorities and deadlines; ensuring team follows all procedures and policies; coordinating and assigning resources to accomplish priorities and deadlines; collaborating cross-functionally to make effective business decisions; solving complex problems; escalating high priority issues or risks, as appropriate; and recognizing and capitalizing on improvement opportunities.
- Practices self-development and promotes learning in others by proactively providing information, resources, advice, and expertise with coworkers and customers; building relationships with cross-functional stakeholders; influencing others through technical explanations and examples; adapting to competing demands and new responsibilities; listening and responding to, seeking, and addressing performance feedback; providing feedback to others and managers; creating and executing plans to capitalize on strengths and develop weaknesses; supporting team collaboration; and adapting to and learning from change, difficulties, and feedback.
- Develops requirements for complex process or system solutions within assigned business domain(s) by interfacing stakeholders and appropriate IT teams (for example, Solutions Delivery, Infrastructure, Enterprise Architecture) and leading junior team members in the development process as appropriate.
- Leverages multiple business requirements gathering methodologies to identify business, functional, and non-functional requirements (for example, SMART) across multiple business domains.
- Develops and documents comprehensive business cases to assess the costs, benefits, ROI, and Total Cost of Ownership (TCO) of proposed solutions.
- Provides insight and supports the evolution of applications, systems, and/or processes to a desired future state by maintaining a comprehensive understanding of how current processes impact business operations across multiple domains.
- Maps current state against future state processes.
- Identifies the impact of requirements on upstream and downstream solution components.
- Provides recommendations to management and business stakeholders on how to integrate requirements with current systems and business processes across regions or domains.
- Identifies and validates value gaps and opportunities for process enhancements or efficiencies.
- Supports solution design by providing insight at design sessions with IT teams to help translate requirements into workable business solutions.
- Identifies and recommends additional data and/or services needed to address key business issues related to process or solutions design.
- Participates in evaluating third-party vendors as directed.
- Supports continuous process improvement by participating in the development, implementation, and maintenance of standardized tools, templates, and processes across multiple business domains.
- Recommends regional and/or national process improvements which align with sustainable best practices, and the strategic and tactical goals of the business.
Knowledge, Skills and Abilities: (Core)
- Ambiguity/Uncertainty Management
- Attention to Detail
- Business Knowledge
- Communication
- Critical Thinking
- Cross-Group Collaboration
- Decision Making
- Dependability
- Diversity, Equity, and Inclusion Support
- Drives Results
- Facilitation Skills
- Health Care Industry
- Influencing Others
- Integrity
- Learning Agility
- Organizational Savvy
- Problem Solving
- Short- and Long-term Learning & Recall
- Teamwork
- Topic-Specific Communication
Knowledge, Skills and Abilities: (Functional)
- Software Development Life Cycle
- Analytical Skills
- Business Case Development
- Business Planning
- Business Process Improvement
- Client Focus
- Crisis Incident Management
- Debugging and Troubleshooting
- Demonstrating Personal Flexibility
- Managing Diverse Relationships
- Model Development
- Negotiation
- Organizational Skills
- Prioritization
- Process Validation
- Project Management
- Relationship Building
- Requirements Elicitation & Analysis
- Technical Documentation
- Vendor Management
Minimum Qualifications:
- Bachelors degree in Business Administration, Computer Science, CIS or related field and a Minimum of Six (6) years experience in IT consulting, business analysis, or a related field. Additional equivalent work experience may be substituted for the degree requirement.
Preferred Qualifications:
- Two (2) years experience in software or system testing across multiple IT environments.
- Two (2) years software or application development experience.
- 5+ years of experience as a Data Engineer
- Strong Python and SQL skills
- Hands-on experience with PySpark, Azure, and Databricks
- Proven experience building ETL pipelines
PrimaryLocation : California,Pleasanton,Pleasanton Tech Cntr Building A
HoursPerWeek : 40
Shift : Day
Workdays : Mon, Tue, Wed, Thu, Fri
WorkingHoursStart : 08:00 AM
WorkingHoursEnd : 05:00 PM
Job Schedule : Full-time
Job Type : Standard
Employee Status : Regular
Employee Group/Union Affiliation : NUE-IT-01|NUE|Non Union Employee
Job Level : Individual Contributor
Job Category : Information Technology
Department : KPIT ADMIN - DA ADMIN - 9601
Travel : Yes, 5 % of the Time
Kaiser Permanente is an equal opportunity employer committed to fair, respectful, and inclusive workplaces. Applicants will be considered for employment without regard to race, religion, sex, age, national origin, disability, veteran status, or any other protected characteristic or status.