4,051 big data developer jobs in India.

We are looking for a Data Engineer to join our team and play a key role in building, optimizing, and managing data pipelines. You will work closely with Data Analysts and Business Functions to ensure seamless data processing, reporting, and dashboarding. Our tech stack includes BigQuery, Snowflake, Airflow, Stitch/Fivetran, ...

... Should have good understanding of stored procedures, joins, CTE, temp table, sub query, functions, index, SQL profiler and performance tuning.- Provide support on Database backup, shrink DB & Stats.- Provide support, guidance, and collaborate with Application Developers to implement database design & solutions.- Good hands-on ...

... Spark/PySpark.- Build and manage data workflows using Azure Data Factory, Azure Databricks, and Synapse Analytics.- Design and implement ETL/ELT processes for data ingestion and transformation.- Integrate data from multiple sources and ensure reliable data movement across platforms.- Optimize data processing jobs, queries, ...

... Certified Professional or similar certifications. Machine Learning: Knowledge of machine learning concepts and experience with popular ML libraries. Knowledge of big data processing (e.g., Spark, Hadoop, Hive, Kafka) Data Orchestration: Apache Airflow. Knowledge of CI/CD pipelines and DevOps practices in a cloud environment. ...

... for batch and real-time data processing. Build and optimize ETL/ELT workflows to collect, transform, and load data from multiple sources. Develop and maintain data models, data warehouses, and data lakes. Ensure data quality, consistency, accuracy, and reliability across data pipelines. Optimize data processing workflows ...

... debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, and production deployments. Understanding of Medallion Architecture, data modeling, data quality, and ...

... Software Engineering / Data Engineering Fundamentals Basic software design principals Unit testing Version control High performance code to work at sc Skillset: Data Analyst Exp: 5+ Yrs Location : PAN India SQL DDL and DML skills on structured and non-structured data base Python- Coding for data parsing, manipulation, aggregation ...

... containers as well as GCP suite, terraform kubernetes, cloud functions You understand standard ETL patterns, modern data warehousing ideas such as data mesh or data vaulting, and data quality practices regarding test driven design and data observability. You are passionate about all things data: Big data, small data, moving ...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming ...

... legal entity. You will be part of a world-class Data Engineering team, where you will: inform Data Science and Analytics Platform teams partner closely with data consumers and producers to ensure quality and usefulness of data assets You will be involved in strategizing measurement, collecting data, and generating insights. ...

... including HDFS, Hive, Spark, and Impala. Experience building and supporting Data Lakes, Data Warehouses, and Enterprise Data Platforms. Strong experience in data modelling, source-to-target mappings, data transformation, and data integration. Knowledge of data quality, data governance, metadata management, and data security ...

... Overview :We are looking for a proactive Data Support Engineer to join our data engineering team. The role involves supporting, monitoring, and troubleshooting data pipelines and ETL processes, ensuring data reliability and smooth operations across Snowflake-based data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities ...

... continuous improvement of operational processes. Skills and Experience: 3-4 years of progressive experience in data engineering, with expert-level mastery of Azure Data Factory, SQL, and cloud data platforms (Azure and/or GCP). - Proven expertise in designing, optimizing, and managing large-scale, production-grade data pipelines, ...

... pipelines to ingest, transform, and validate data from marketplace, inventory, and sales sources Build and maintain SQL data lake storage so historical and change data stays available for analysis Automate recurring data jobs (e.g., via Rundeck) and monitor them for failures and data anomalies Use AI tools to accelerate pipeline ...

... rings using graph databases 4-8 years of hands-on big data engineering experience (batch and streaming) on the cloud, ideally AWS - Deep experience with the data lake stack: EMR, Spark, S3, Athena, and modern warehouses/lakehouses such as ClickHouse, Databricks, or Snowflake - Production experience with pipeline orchestration ...

Design and implement data pipelines for supply chain data (e.g., inventory, shipping, procurement). - Develop and maintain data warehouses and data lakes. - Ensure data quality, integrity, and security. - Develop data models and algorithms for predictive analytics (e.g., Implement data visualization tools (e.g., Tableau, ...

... CGPA 7.0+. - Self-taught developers with solid portfolios are also encouraged to apply. Technical skills - Strong knowledge of Python. - Strong knowledge of data structures and algorithms. - Strong understanding of SQL and relational data concepts. - Familiarity with Git. - Eagerness to learn Databricks, Power BI, and ...

... containers as well as GCP suite, terraform kubernetes, cloud functions You understand standard ETL patterns, modern data warehousing ideas such as data mesh or data vaulting, and data quality practices regarding test driven design and data observability. You are passionate about all things data: Big data, small data, moving ...

... transformation, and loading (ETL) of data. Your responsibilities will include: - Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. - Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions. ...

Job Description: IF interested, please fill this form: - - 5+ years of experience combined in programming, small to large-scale applications, frontend and backend engineering, test-driven development, microservices and architecture design principles - Must have experience on AI/ML implementation such as: Langchain,