Data Engineer with SQL in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Senior Data Engineer – Data Pipelines & Cloud Databases Location: Pune | Experience: 4+ years | Type: Full-Time Role Overview Design, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products. Key Responsibilities
Data Pipeline Development Implement robust, scalable data pipelines using Microsoft Azure and Databricks stack Build reusable data pipeline components and frameworks Design and optimize data workflows for performance and reliability Monitor pipeline health and implement automated alerting Database Architecture Design relational and non-relational database schemas MongoDB: schema design, aggregation pipelines, indexing, sharding, replica sets, performance tuning Azure Cosmos DB: multi-model access, partitioning, consistency levels, throughput management (RU/s), global distribution Azure Cosmos DB Gremlin API: graph data modeling, traversals, vertex/edge design, relationship analytics API Development Build RESTful APIs using FastAPI with async endpoint design Implement Pydantic models, middleware, dependency injection, background tasks Generate and maintain auto-generated OpenAPI/Swagger documentation Configure Azure API Management (APIM) for API gateway and security Project & Stakeholder Management Collect progress updates from squads regularly Consolidate updates into weekly project status reports Develop L3-level project plans with task details, milestones, dependencies Participate in early-stage design and feature definition Communicate complex data insights to non-technical stakeholders Collaboration & Integration Work across multiple engineering teams on prototype integration Support integration of proven prototypes into core intelligence products Strong team collaboration and cross-functional communication Knowledge sharing and documentation Required Experience: Data Engineering & Databases
4+ years data engineering or data platform experience
API & Backend Development FastAPI proficiency: async endpoints, Pydantic models, middleware, dependency injection Background tasks and job scheduling RESTful API design and best practices OpenAPI/Swagger documentation Cloud Platform Azure fundamentals and hands-on experience Azure Data Factory or Databricks for ETL/ELT Azure Cosmos DB multi-region setup Azure API Management (APIM) configuration Data Pipeline Skills ETL/ELT pipeline design and development Data quality validation and monitoring Schema design for analytics and reporting Performance optimization and scalability
Preferred Experience Databricks Delta Lake experience Azure Synapse Analytics Python for data engineering Spark SQL optimization Real-time data streaming Data governance and metadata management Agile/Scrum development model CI/CD pipeline experience
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
... global projects. - Degree in Engineering, Computer Science, Information Technology, Data Science, or a related discipline. Formal training or certification in Data provisioning will be preferred. Experience: · 5+ years of rich experience with Data provisioning within Supply Chain . (prior experience collaborating with global ...
Role :Lead Engineer - Conversion/Migration Skills - Mandatory-SQL Server, ETL/Data Migration Skills - Good to have -SSIS, Azure Data Factory Work location: Kochi/Trivandrum Total Experience: 6-9 years Strong hands-on expertise in SQL Server (T-SQL) and relational database design, with solid experience in data migration ...
... ETL processes for batch and streaming analytics requirements. Optimize and troubleshoot distributed systems for ingestion, storage, and processing. Collaborate with data engineers, analysts, and platform engineers to align solutions with business needs. Ensure data security, integrity, and compliance throughout the infrastructure. ...
Data Engineer III/ IV - IN (Operation/ Supports) Work Location - Remote Work From Home Shift: Rotation Shifts (24/7) Experience: 7-12 years The Data engineer is responsible for managing and operating upon Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI/Tableau. The engineer will work closely with the customer ...
... Shishir's team, Data analytics CoE head. Someone that can help with the reporting needs, need resource who can support here. Require more data visualization, know data engineering as well. -SQL Tableau -SQL - Need to create data for powerBI and tableua, done in SQL - BCG Data Lake is entirely snowflake - Write SQL queries in ...
... integrate data solutions into the overall architecture. Previous experience in Data Engineering, we're looking for around 3-7 years worth of experience. Strong SQL skills and experience working with relational databases such as Snowflake, PostgreSQL, or MySQL. Experience building and maintaining data pipelines and ETL workflows ...
... looking for Strong experience as a Data Engineer in Azure environments Hands-on with tools such as Azure Data Factory, Azure Databricks, Synapse or similar Solid SQL and data transformation experience Experience building ETL/ELT pipelines for analytics workloads Understanding of data modelling and working with BI teams Experience ...
... processes. The assigned offshore team shall consist of two (2) MDM Data Engineers with complementary technical expertise, working under the direction of the onshore data architecture lead. Both engineers shall possess strong Snowflake and Python data engineering experience. At least one (1) engineer shall possess senior-level ...
... Feature Store for Data Science implementations Overall experience of 0-2 yrs. in Advanced Analytics/ Business Intelligence/Data Warehousing Strong Background in Data Transformation Skills – SQL (Mandatory) & Python . Able to understand and align to long term vision of team A phenomenal work environment with massive ownership ...
... product functionalities within established SLAs. Manage and complete requests from internal Data teams that require client outreach and/or action to resolve data verification issues. Investigate client reported bugs and data processing issues, and triage with Engineering & Product when needed. Partner with Account Managers, ...
... dashboards. - Expert-level proficiency in SQL , including complex queries, joins, aggregations, subqueries, and data manipulation. - Strong understanding of data preparation, data modelling, reporting, and visualisation principles. - Experience working with financial, operational, risk, or business performance data. - ...
... Informatica driven environment Ability to use SQL to analyze data Bachelor's degree related to Information Systems, Business or other relevant academic discipline with a minimum 4 years job experience in IT or process area(s) Required Experience: - 5+ years as a data or systems analyst with a specialization in data warehousing ...
We are looking for an experienced Test Engineer with hands-on experience in the semiconductor domain and ATE (Automated Test Equipment) . The ideal candidate should have experience in ATE test program development, silicon validation, device characterization, hardware debugging, and wafer/final testing. Experience with Teradyne, ...
... (must have): Strong Azure or AWS knowledge Strong working knowledge on Data Science, Artificial Intelligence, Machine Learning Secondary Skills (good to have): SQL, Python Professional Attributes: Strong analytical and problem-solving abilities Ownership mindset with a focus on quality and scalability Additional Details ...
... opportunities, and business insights. Create dashboards, visualizations, and reports that communicate insights effectively to technical and non-technical stakeholders. Data Engineering & Solution Delivery Collaborate with data engineering teams to establish scalable data pipelines and AI-ready data platforms. Ensure data quality, ...
... development including sourcing, dataset curation, feature engineering, model training, model tuning, and offline & online experimentation Strong programming skills with minimum 3-6 years of experience in Python Experience working with databases and expert knowledge of SQL Proficiency in statistical ML algorithms and statistics ...
... Storytelling- translate technical findings into clear, actionable recommendations for non-technical stakeholders, including senior leadership. 3-4 years of experience in data science, analytics, or a related quantitative role, ideally handling large, real-world datasets. - Strong hands-on skills in Python and SQL, with solid fundamentals ...
... of experience in data analytics or a related field Strong hands-on experience with: SQL Python Power BI and/or Tableau Solid understanding of data modeling, data cleaning, and transformation techniques Experience working with structured and unstructured datasets Familiarity with statistical analysis and data visualization ...
... team drives competitive advantage by providing the best-in-class data, analytics, and insights for the Kmart Group. By using the latest cloud platforms tools, data engineering practices, and data science methods, the team is paving the way for a data culture within the organization, which leads to improved sales, cost savings, ...