Vacancy description
infovision inc.
India, Pune
Data Engineer with SQL in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time
Role Overview
Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products.
Key Responsibilities
Data Pipeline Development
Implement robust, scalable data pipelines using Microsoft Azure and Databricks stack
Build reusable data pipeline components and frameworks
Design and optimize data workflows for performance and reliability
Monitor pipeline health and implement automated alerting
Database Architecture
Design relational and non-relational database schemas
MongoDB: schema design, aggregation pipelines, indexing, sharding, replica sets, performance tuning
Azure Cosmos DB: multi-model access, partitioning, consistency levels, throughput management (RU/s), global distribution
Azure Cosmos DB Gremlin API: graph data modeling, traversals, vertex/edge design, relationship analytics
API Development
Build RESTful APIs using FastAPI with async endpoint design
Implement Pydantic models, middleware, dependency injection, background tasks
Generate and maintain auto-generated OpenAPI/Swagger documentation
Configure Azure API Management (APIM) for API gateway and security
Project & Stakeholder Management
Collect progress updates from squads regularly
Consolidate updates into weekly project status reports
Develop L3-level project plans with task details, milestones, dependencies
Participate in early-stage design and feature definition
Communicate complex data insights to non-technical stakeholders
Collaboration & Integration
Work across multiple engineering teams on prototype integration
Support integration of proven prototypes into core intelligence products
Strong team collaboration and cross-functional communication
Knowledge sharing and documentation
Required Experience:
Data Engineering & Databases
Preferred Experience
Databricks Delta Lake experience
Azure Synapse Analytics
Python for data engineering
Spark SQL optimization
Real-time data streaming
Data governance and metadata management
Agile/Scrum development model
CI/CD pipeline experience
Similar vacancies
PKO BP
... preparing data for prescriptive and predictive modeling. Data engineers also develop data set processes for data modeling, mining, and production, integrate new data management technologies and software engineering tools into existing structures, and collaborate with data scientists and analysts to ensure data accuracy and ...
India, Pune
$11 USD
... Ventures, the VC of the world's largest automotive company, and 4DX Ventures, a leading early-stage investor in Africa. Zeno is seeking a highly skilled and hands-on Data Engineer to design, build, and scale our global data ecosystem. Sitting within our core Global Insights Node , this role is not a traditional corporate dashboard-building ...
India, Bengaluru
Dun & Bradstreet
... Bachelor's degree (preferably in Computer Science, Mathematics, Data Science, or a related field). - 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted ...
India, Rāniganj
BlackBox
... and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you! In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. ...
India, Mumbai
PayPay India
... Minimum 7 years as a Data Engineer or similar role. Hands-on experience with Databricks, Delta Lake, Spark, and Scala. Proven ability to design, build, and operate Data Lakes or Data Warehouses. Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect). Familiarity with Change Data Capture tools (Canal, Debezium, ...
India, Gurugram
Andor Tech
... Contact: View phone number on https://jobeax.com/link/8om4ubga9gvjbUNE #Hiring #DataEngineer #SeniorDataEngineer #AzureDatabricks #Databricks #PySpark #PythonDeveloper #AzureCloud #DataEngineering #BigData #ADF #ADLS #SQL #BangaloreJobs #TechHiring #AndorTech #HiringNow #DataPlatform #CloudEngineering #CareerOpportunity
India, Bengaluru
monk's hill ventures
... real-time decisioning. Solid engineering foundation with 5+ years of relevant experience in data engineering and/or distributed systems. Hands-on work building data pipelines (batch and/or streaming) using at least one distributed framework (e.g., Comfortable with SQL and a transformation framework (e.g., Familiarity with ...
India, Bengaluru
Appsierra Group
... AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 years of experience in data engineering. - Proficient in AWS S3, Glue, Lambda, ...
India, Pune
Azilen Technologies
... scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing - 2+ years of hands-on experience with SSAS Tabular Models - Experience designing data ...
India, Ahmedabad
Auriga IT
... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...
India, Jaipur
altysys
... (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) Skills: - Kubernetes exposure - Experience with multiple cloud platforms (AWS, Azure, GCP)
India, Gurugram
Straive
... Copilot with prompt engineering to increase engineering velocity. Enforce data governance, risk management policies, and regulatory compliance standards across all data platforms. Preferred Candidate Profile Work Experience: 8+ years in large-scale application development with 5+ years in a Python and PySpark Data Engineering ...
India, Pune
ShrinQ Consulting Group Inc
... understood with data Compile and analyze data related to business' issues Develop clear visualizations to convey complicated data in a straightforward fashion Qualifications - Bachelor's or Master's degree in Statistics or Applied Mathematics or equivalent experience - 1 - 2 years' Data Analysis experience - Proficient in SQL
India, India
Artech Infosystems Private Limited
Rs 8 - 18 lakhs p.a.
... reusable, scalable, and maintainable Python code. Write complex and optimized SQL queries , stored procedures, joins, subqueries, and CTEs. Work with relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server . Develop and integrate REST APIs and backend services. Troubleshoot application and database-related issues ...
India, Chennai
Artech Infosystems Private Limited
Rs 8 - 18 lakhs p.a.
... reusable, scalable, and maintainable Python code. Write complex and optimized SQL queries , stored procedures, joins, subqueries, and CTEs. Work with relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server . Develop and integrate REST APIs and backend services. Troubleshoot application and database-related issues ...
India, Bengaluru
JP Morgan Chase & Co.
... technical skills in data profiling, analysis, and data management using modern tools and environments (Python, R, SQL, Spark, cloud platforms) Understanding of data lineage concepts and experience with lineage analysis, metadata management, and data cataloging Excellent communication skills with the ability to convey complex ...
India, Bengaluru
... requirements Experience: 8+ years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: ...
India, Bengaluru
Two Circles
... Snowflake ~ SQL - Experience - 8+ years of software engineering experience with a strong data focus, including designing, building, and operating production data systems in fast-paced environments. - Demonstrated experience providing technical leadership within an engineering team, including guiding technical direction, ...
India, Hyderabad
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
India, Bengaluru