Senior Python Platform Engineer, ETL & Messaging Systems
Role summary
Business Integration Partners (BIP) is seeking a Senior Python Platform Engineer to design and build high-performance data processing and messaging systems in a distributed enterprise environment. This role focuses on concurrent and asynchronous Python development, large-scale ETL pipelines, and event-driven architectures using modern messaging systems like Kafka or AMPS. The ideal candidate will have 7+ years of Python experience, deep expertise in concurrency models, and hands-on experience with ETL and pub/sub systems. Responsibilities include developing scalable Python applications, implementing ETL pipelines, designing messaging architectures, and contributing to system design and collaboration within large engineering teams. The position is hybrid with a salary range of $140,000 - $200,000 annually.
Company Overview:
Business Integration Partners (BIP) is Europe’s fastest growing digital consulting company and is on track to reach the Top 20 globally by 2030. With a growing presence across the United States—including New York, Charlotte, Chicago, and Houston—BIP operates at the intersection of business strategy, technology, and data to deliver impactful solutions for clients.
With more than 6,000 professionals worldwide, BIP partners with organizations across Financial Services, Insurance, Payments, and other industries. Our capabilities span Data & AI, Cybersecurity, Risk & Compliance, Digital Transformation, and Change Management. We combine deep industry expertise with engineering excellence to help clients modernize platforms, unlock data insights, and drive innovation.
As part of our continued expansion in the United States, BIP is strengthening its Capital Markets technology practice. Our teams work closely with trading, risk, and front-office technology organizations to modernize critical platforms, enhance analytics capabilities, and support complex financial product ecosystems.
Position Overview:
We are seeking a Senior Python Platform Engineer to design and build high-performance data processing and messaging systems within a distributed enterprise environment.
This role is heavily focused on concurrent and asynchronous Python development, large-scale ETL pipelines, and event-driven architectures using modern messaging systems.
The ideal candidate brings deep expertise in Python concurrency models (threading & async), strong experience working with large datasets, and hands-on experience designing pub/sub and message bus systems (Kafka/AMPS preferred). This role requires strong ownership, problem-solving ability, and the ability to operate effectively in fast-paced, collaborative engineering environments.
Key Responsibilities:
Python Engineering & Concurrency
- Develop high-performance Python applications leveraging threading, multiprocessing, and async programming.
- Build scalable services using FastAPI and modern Python frameworks.
- Apply strong object-oriented design principles to develop clean, maintainable code.
ETL & Data Processing
- Design and implement large-scale ETL pipelines handling high-volume datasets.
- Optimize data workflows for performance, scalability, and reliability.
- Analyze bottlenecks and implement improvements for data throughput and processing efficiency.
Messaging & Event-Driven Systems
- Design and implement pub/sub architectures and message bus systems.
- Work with Kafka, AMPS, or similar streaming/messaging platforms.
- Build resilient, event-driven services supporting distributed systems.
System Design & Architecture
- Break down complex technical problems into scalable, modular solutions.
- Collaborate on system design across multi-repo, distributed codebases.
- Contribute to architectural decisions around performance, scalability, and system reliability.
Collaboration & Delivery
- Work within large, collaborative engineering teams using shared repositories (e.g., VS Code environments).
- Partner with cross-functional teams to deliver high-quality solutions.
- Participate in Agile development processes and contribute to continuous improvement.
Required Qualifications:
- 7+ years of professional Python development experience.
- Strong expertise in:
- Threading and concurrent programming
- Asynchronous programming (async/await)
- FastAPI or similar frameworks
- Object-oriented design
- Hands-on experience building and optimizing ETL pipelines with large datasets.
- Experience with pub/sub systems and message bus architectures.
- Strong experience with Kafka, AMPS, or similar messaging technologies.
- Experience working in large engineering teams with shared multi-repo codebases.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
Non-Technical Requirements:
- Self-starter with the ability to break down complex problems and drive solutions independently.
- Highly adaptable to shifting priorities and fast-paced environments.
- Strong sense of ownership and commitment to high-quality delivery.
- Proactive mindset with a focus on continuous improvement and reliability.
Preferred Qualifications:
- Experience in financial services or capital markets environments.
- Familiarity with distributed systems and high-throughput architectures.
- Experience with performance tuning and system optimization at scale.
- Exposure to cloud platforms (AWS, Azure, or GCP).
\*\*The base salary range for this role is $140,000 - $200,000, with flexibility for exceptional candidates\*\*
Benefits:
- Choice of medical, dental, vision insurance.
- Voluntary benefits.
- Short- and long-term disability.
- HSA and FSAs.
- Matching 401k.
- Discretionary performance bonus.
- Employee referral bonus.
- Employee assistance program.
- 11 public holidays.
- 20 days PTO.
- 7 Sick Days.
- PTO buy and sell program.
- Volunteer days.
- Paid parental leave.
- Remote/hybrid work environment support.
For more information about BIP US, visit https://www.bip-group.com/en-us/.
Equal Employment Opportunity:
It is BIP US Consulting policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship, or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.
BIP US provides a reasonable range of compensation for our roles. Actual compensation is influenced by a wide array of factors including but not limited to skill set, education, level of experience, and knowledge.