We are looking for a Data Engineer with strong hands‑on experience in Python, FastAPI, and Azure‑based data platforms to design and build scalable, cloud‑native data pipelines supporting analytics, AI/ML, and GenAI use cases .
Key Responsibilities
Build and maintain cloud‑native data pipelines on Microsoft Azure
Develop ETL/ELT workflows using Python, Azure Data Factory (ADF), Databricks (PySpark)
Build and maintain REST APIs using FastAPI for data and AI/ML consumption
Design and optimize SQL Server data models for analytics and performance
Prepare datasets for GenAI, ML training, embeddings, and vector workflows
Work with Azure AI Search for search, semantic search, and vector search use cases
Integrate data across Cosmos DB, Data Lake, Blob Storage
Ensure data quality, security, logging, monitoring, and CI/CD best practices
Collaborate with Data Scientists, GenAI Engineers, and product teams
Required Skills
Python (Data Engineering & Backend)
FastAPI / REST API development
Azure Data Factory (ADF)
Azure Databricks (PySpark preferred)
Azure Data Lake / Blob Storage
SQL Server (advanced SQL & optimization)
Azure Cosmos DB (Core SQL API, NoSQL data modeling)
Azure AI Search (indexes, indexers, skillsets, vector & semantic search)
Git / Version Control