
Technology Lead - AWS Data Engineer
Required skills
- AWS Athena
- Scala
- Apache Spark
- AWS data lake architectures
- performance tuning
- distributed data processing
- ETL/ELT pipelines
- SQL
- data modeling
- AWS S3
Nice to have
- Spark Core
- Spark SQL
- data quality checks
- validation frameworks
- monitoring solutions
- APIs
Role summary
Infosys is seeking an experienced Data Engineer with 6+ years of experience in building scalable data platforms and ETL pipelines. The role requires strong hands-on expertise in AWS Athena, Scala, and Apache Spark, with experience designing and optimizing large-scale data processing solutions in AWS environments. Key responsibilities include developing and managing data lake solutions, optimizing Athena queries and Spark jobs, implementing data quality checks, and integrating data from various sources. Experience with AWS services like S3, Glue, and EMR, along with SQL and data modeling skills, is essential. The position is based in Burnaby, BC.
Job Description
Infosys is seeking an experienced Data Engineer with 6+ years of experience in building scalable data platforms and ETL pipelines. The ideal candidate should have strong hands-on expertise in AWS Athena, Scala, and Apache Spark, with experience designing and optimizing large-scale data processing solutions in AWS environments. Experience with AWS data lake architectures, performance tuning, and distributed data processing is essential. The requirements align with enterprise data engineering practices found in internal data engineering profiles and job descriptions.
Required Qualifications
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
- At least 4 years of Information Technology experience
- Candidate must be located within commuting distance of Burnaby, BC or be willing to relocate to one of these areas. This position may require travel.
Preferred Qualifications
- Design, develop, and maintain scalable ETL/ELT pipelines using Scala and Apache Spark.
- Build and optimize data processing workflows for large-scale structured and semi-structured datasets.
- Develop and manage data lake solutions using AWS S3, Athena, Glue, and EMR.
- Optimize Athena queries, partitions, and data storage formats to improve performance and reduce costs.
- Implement data quality checks, validation frameworks, and monitoring solutions.
- Integrate data from multiple sources including databases, APIs, streaming platforms, and flat files.
- Collaborate with Data Architects, Analysts, and Business Stakeholders to deliver data solutions.
- Tune Spark jobs by optimizing joins, partitioning, caching, and shuffle operations.
- Support CI/CD deployments, release management, and production issue resolution.
- Participate in Agile ceremonies, code reviews, and technical design discussions.
- At least 6 years of experience in Data Engineering.
- Strong hands-on experience with AWS Athena.
- Strong development experience in Scala.
- Expertise in Apache Spark (Spark Core, Spark SQL).
- Experience with AWS services such as S3, Glue, EMR, IAM, CloudWatch.
- Strong SQL and data modeling skills.
- Experience building and maintaining ETL/ELT pipelines.
- Good understanding of distributed data processing and performance tuning.
- Experience with Git and CI/CD practices.
Estimated annual compensation range for the candidate based in the below location will be:
British Columbia - $ 90450 to $ 136500
Additional Required Qualifications
• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.• Candidates authorized to work for any employer in Canada without employer based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role at this time.
EEO/About Us
About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.
EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.
Sample Infosys interview questions
- 1
Design a food delivery system like DoorDash.
system designmedium - 2
Aggressive Cows Maximize the minimum distance between aggressive cows in stalls. Input: stalls = [0,4,3,7,10,9], cows = 3 Output: 4 Explanation: Placing the cows at positions 0, 4, and 10 yields a maximum possible minimum distance of 4 between any two cows.
codingmedium - 3
Palindrome After Deleting One Character Determine if a string can be a palindrome after deleting at most one character. Input: s = "abc" Output: FALSE Explanation: Deleting any single character leaves either "ab", "bc", or "ac", none of which result in a valid palindrome.
codingmedium - 4
Encode and Decode Strings Encode a list of strings into a single string and decode it back. Input: strs = ["","hello",""] Output: ["","hello",""] Explanation: Prepends chunk lengths and a delimiter (e.g., "0#5#hello0#") to safely encode and perfectly restore empty strings.
codingmedium - 5
Implement a Trie Implement a Trie for prefix matching. Input: insert("hello"), startsWith("hel") Output: TRUE Explanation: Traverses the Trie nodes to confirm that the prefix "hel" actively exists within the inserted word "hello".
codingmedium
Get started to unlock a personalized interview prep pack for this role.
Similar roles
AWS Java Full Stack ArchitectInfosys · Reston, VA · Onsite
AI ArchitectInfosys · United States · Onsite
Technology Strategy, Disputes & Transactions - Associate Attorney - JuniorAshurst Perkins Coie · New York, CA · Hybrid
VP HR Operations & TechnologyPresbyterian Healthcare Services · United States · Onsite
Equipment Finance Senior Account Executive - TechnologyM&T Bank · Remote · Remote
Technology Partner, ListingsTMX Group · Toronto, ON · Hybrid
