Data Engineer with SQL in India, India is listed on Jobeax. Browse 30,000+ vacancies available.
JOB DESCRIPTION
Must Needed Skills: Apache Airflow, Python, PySpark , Hive(Trino), SQL and Snowflake
Develop and maintain data pipelines, ELT processes, and workflow orchestration using Apache Airflow, Python, PySpark , Hive(Trino) and Snowflake to ensure the efficient and reliable delivery of data. Design and implement custom connectors to facilitate the ingestion of diverse data sources into our platform, including structured and unstructured data from various document formats . Collaborate closely with cross-functional teams to gather requirements, understand data needs, and translate them into technical solutions. Design and implement data CI/CD pipelines to enable automated and efficient data integration, transformation, and deployment processes. Monitor and troubleshoot data pipelines, proactively identifying and resolving issues related to data ingestion, transformation, and loading. Conduct data validation and testing to ensure the accuracy, consistency, and compliance of data. Stay up-to-date with emerging technologies and best practices in data engineering. Document data workflows, processes, and technical specifications to facilitate knowledge sharing and ensure data governance.
... and development Data quality validation and monitoring Schema design for analytics and reporting Performance optimization and scalability Preferred Experience Databricks Delta Lake experience Azure Synapse Analytics Python for data engineering Spark SQL optimization Real-time data streaming Data governance and metadata management ...
... Bachelor's degree (preferably in Computer Science, Mathematics, Data Science, or a related field). - 3-6 years of overall experience in software development and data analysis. - Hands-on experience in Python for application development. - Strong proficiency in SQL for data analysis and query generation. - Experience with hosted ...
... and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you! In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. ...
... Minimum 7 years as a Data Engineer or similar role. Hands-on experience with Databricks, Delta Lake, Spark, and Scala. Proven ability to design, build, and operate Data Lakes or Data Warehouses. Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect). Familiarity with Change Data Capture tools (Canal, Debezium, ...
... real-time decisioning. Solid engineering foundation with 5+ years of relevant experience in data engineering and/or distributed systems. Hands-on work building data pipelines (batch and/or streaming) using at least one distributed framework (e.g., Comfortable with SQL and a transformation framework (e.g., Familiarity with ...
... AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 years of experience in data engineering. - Proficient in AWS S3, Glue, Lambda, ...
... scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing - 2+ years of hands-on experience with SSAS Tabular Models - Experience designing data ...
... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...
... Copilot with prompt engineering to increase engineering velocity. Enforce data governance, risk management policies, and regulatory compliance standards across all data platforms. Preferred Candidate Profile Work Experience: 8+ years in large-scale application development with 5+ years in a Python and PySpark Data Engineering ...
... understood with data Compile and analyze data related to business' issues Develop clear visualizations to convey complicated data in a straightforward fashion Qualifications - Bachelor's or Master's degree in Statistics or Applied Mathematics or equivalent experience - 1 - 2 years' Data Analysis experience - Proficient in SQL
... reusable, scalable, and maintainable Python code. Write complex and optimized SQL queries , stored procedures, joins, subqueries, and CTEs. Work with relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server . Develop and integrate REST APIs and backend services. Troubleshoot application and database-related issues ...
... reusable, scalable, and maintainable Python code. Write complex and optimized SQL queries , stored procedures, joins, subqueries, and CTEs. Work with relational databases such as PostgreSQL, MySQL, Oracle, or SQL Server . Develop and integrate REST APIs and backend services. Troubleshoot application and database-related issues ...
... expectations are met through disciplined implementation (access controls, lineage, and quality standards) 5+ years building and operating production data pipelines (data engineering—not primarily BI/analytics or data science) - Strong SQL plus strong data modeling skills (dimensional and/or lakehouse modeling) - Hands-on Databricks ...
... validation, batch pipelines, reconciliation, production support, and audit-ready https://jobeax.com/link/0tczEVIPDdr4h8mr Have :- Strong experience developing data integration, ETL/ELT, batch processing, and scheduled data delivery solutions.- Proficiency in SQL and experience working with enterprise data sources, file-based ...
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
... global projects. - Degree in Engineering, Computer Science, Information Technology, Data Science, or a related discipline. Formal training or certification in Data provisioning will be preferred. Experience: · 5+ years of rich experience with Data provisioning within Supply Chain . (prior experience collaborating with global ...
Role :Lead Engineer - Conversion/Migration Skills - Mandatory-SQL Server, ETL/Data Migration Skills - Good to have -SSIS, Azure Data Factory Work location: Kochi/Trivandrum Total Experience: 6-9 years Strong hands-on expertise in SQL Server (T-SQL) and relational database design, with solid experience in data migration ...
... Feature Store for Data Science implementations Overall experience of 0-2 yrs. in Advanced Analytics/ Business Intelligence/Data Warehousing Strong Background in Data Transformation Skills – SQL (Mandatory) & Python . Able to understand and align to long term vision of team A phenomenal work environment with massive ownership ...