Senior Developer – Data Platform Engineering Consultant

Here's a brief overview of the tasks and responsibilities you'll be able to:

• Design, develop, and maintain robust, performant, and scalable data pipelines on AWS, Snowflake, and Apache NiFi;
• Implement highly available and automated data ingestion and exposure processes;
• Participate in the evolution of the data platform, including the automation of the infrastructure via Terraform;
• Contribute to data transformation models and processes, including DataOps best practices;
• Support the definition and implementation of data development, security, and governance standards;
• Coach team members and share technical expertise, including NiFi, Cloud, IaC, and DevOps practices;
• Collaborate in an Agile framework (Scrum / Kanban) and actively participate in team ceremonies;
• Perform code reviews, optimize performance, and support releases;
• Document solutions and ensure continuous technology monitoring.

The profile we are looking for is as follows:

• Have a bachelor's degree in computer science, software engineering, computer engineering, or related field;
• Have an AWS Certified Developer certification (required);
• Have a minimum of five (5) years of experience in developing data platforms in large enterprises;
• Have significant experience in building large-scale data solutions;
• Demonstrate experience with Data Vault 2.0;
• Have experience with analytic data modeling;
• Have demonstrated experience in Agile (SAFe, Scrum, Kanban);
• Advanced experience with DevOps tools:
• Bitbucket, GitHub, GitHub Actions, Jenkins, Vault, Docker, Containerization, CI/CD, automation;
• Experience with Snowflake: performance, ingestion, virtual warehouse, Streams & Tasks;
• Demonstrate knowledge of DBT (SQL-oriented data transformations);
• Have knowledge of serverless and data frameworks (Airflow, Dagster, Spark, etc.);
• Have in-depth knowledge of Terraform (IaC) to deploy cloud infrastructure;
• Demonstrated expertise on AWS (EC2, S3, Lambda, IAM, CloudWatch, Step Functions, Glue, etc.);
• Have strong coding, code review, documentation and testing practices;
• Demonstrate excellent Python skills for development and automation;
• Have a mastery of Apache NiFi: flow design, optimization, monitoring, troubleshooting;
• Have a strong understanding of CI/CD concepts, automated testing, application security;
• Be familiar with Kafka and event architectures.