Luxoft Verified
IT Services, Software Development, Technology Consulting, Digital Transformation
Senior Data Engineer (Python Required)
Alpharetta, Georgia, United StatesOnsiteFull TimeSeniorPosted 2 months agoVisa sponsorship available
Compensation estimateAI
See base, equity, bonus, and total comp estimates for this role — free, no credit card.
Sign up to see compensation estimateDescription:
- Provide software engineering in support of development to production of AI business cases. This role involves development and analytics of scalable solutions taking proof of concept to production. This position required someone who is a self-starter, self-sufficient with an open mindset and eager to learn.
Responsibilities:
- Data Ingestion & Processing Architecture
- Multiple high‑velocity data sources, including:
- Event Hub from Postgres
- Data pushed to Snowflake
- Additional events across various internal systems
- Heavy use of:
- Kubernetes for scalable processing
- Databricks / Spark for distributed compute
- Snowflake for storage and downstream analytics
Mandatory Skills Description:
- 5+ Years of Python Development (primary)
- FastAPI (service/API development)
- Databricks Experience REQUIRED
- Azure (core cloud environment)
- Snowflake Experience REQUIRED
- AKS Experience REQUIRED
Nice-to-Have Skills Description:
- Hands‑On LLM Integration:
- Experience integrating LLMs into applications
- RAG pipelines
- Experience running high‑scale workloads in K8s
- Data Engineering & Distributed Computing:
- Spark / Databricks
- Experience handling:
- Very large datasets
- Complex pipelines
- High message volume
- Mixed batch + streaming data flows
- Designing & maintaining table schemas
- Working with Snowflake
- Database & Data Handling:
- Strong SQL + data manipulation skills
- Experience integrating multiple data sources
- Comfort navigating event‑streaming ecosystems