Back to list

Vacancy description

Senior Data Engineer - Python/SQL in Calcutta, भारत

Good Co

Calcutta, भारत

Job Summary : We are looking for an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines, data platforms and cloud-based data infrastructure. The ideal candidate should have strong expertise in data engineering, ETL/ELT processes, big data technologies, cloud platforms and data https://jobeax.com/link/17NlwZ4oSJJaCzVO Responsibilities : - Design, develop and maintain scalable data pipelines and ETL/ELT workflows.- Build and optimize data processing frameworks for structured and unstructured data.- Develop data integration solutions across multiple internal and external systems.- Work with large datasets using distributed computing technologies.- Design and maintain data warehouses, data lakes and lakehouse architectures.- Implement batch and real-time data processing pipelines.- Optimize data storage, processing performance and query execution.- Collaborate with Data Scientists, AI Engineers, Business Analysts and Software Engineers.- Ensure data quality, governance, security and compliance.- Implement automated data pipeline monitoring and error-handling mechanisms.- Manage cloud-based data infrastructure and deployment workflows.- Support AI/ML teams by providing reliable, high-quality data https://jobeax.com/link/2rj5p3MqDPmMPA0i Technical Skills : - Programming : Python, SQL, PySpark, Scala- Big Data Technologies : Apache Spark, Hadoop, Kafka- ETL/ELT Tools : Apache Airflow, dbt, Informatica- Cloud Platforms : AWS, Microsoft Azure, GCP- Data Warehousing : Snowflake, Amazon Redshift, Google BigQuery, Azure Synapse- Databases : PostgreSQL, MySQL, MongoDB- Data Lakes : Delta Lake, Apache Iceberg, AWS S3- Data Processing : Batch Processing, Stream Processing, Real-Time Analytics- DevOps & Deployment : Docker, Kubernetes, CI/CD, Terraform- Data Governance : Data Quality, Data Lineage, Metadata ManagementExperience & Qualifications : - 6 - 11 years of overall experience in Data Engineering or related fields.- Minimum 4 - 5 years of hands-on experience in data engineering.- Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering or a related https://jobeax.com/link/kfLTLT6enIMYonWk Certifications : - AWS Certified Data Engineer - Associate- Google Professional Data Engineer- Microsoft Certified : Fabric Data Engineer Associate- Snowflake SnowPro Core Certification- Databricks Certified Data Engineer Associate (ref:hirist.tech)

Similar vacancies

More like this role

... Description :We are looking for an experienced Data Engineer with strong hands-on expertise in Python, SQL, and AWS to design, develop, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate should have experience in data warehousing, data modeling, ETL/ELT processes, and cloud data https://jobeax.com/link/pmORyJVXuVyEZiH5 ...

Hyderabad, भारत

... Design and implement automated data quality checks and validation frameworks.- Perform data profiling, anomaly detection, and root cause analysis using Python and SQL.- Integrate data quality processes into ETL/ELT pipelines using PySpark and Databricks.- Monitor and resolve data quality issues across Azure/AWS-based data platforms.- ...

Pune, भारत

Youth4 Talent Solutions and Services

Senior Data Engineer - Python/Big Data

... Define baselines and benchmarks to define the success and failure of marketing campaignsKey Skills :- Proficiency in Python and SQL- Thorough understanding of SQL/NOSQL databases such as Snowflake, Google Big Query, PostgreSQL, MongoDB, Amazon Redshift, MYSQL- Proficiency in developing dashboards, reports using Data Visualization/BI ...

Bangalore, भारत

  • Full-time
... issues promptly - Address technical concerns or questions raised by users - Ensure a seamless user experience by managing disruptions effectively What you need - SQL - Python - Troubleshooting - Linux - MongoDB - PHP Good to have - Shell scripting - https://jobeax.com/link/JSd7UYCSg572jJDY - Java - JavaScript Job details - ...

Bombay, भारत

... Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, ...

Chennai, भारत

... Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, ...

Thiruvananthapuram, भारत

TekPioneers - A TekGence Company

Senior Python Engineer - Data Pipelines - Hybrid

  • Hybrid
  • Full-time
... engineering standards; mentor junior engineers; liaise with business stakeholders. Qualifications - 8–12 years of software engineering, 5–6+ years building production data pipelines in Python. - Expert modern Python (3.10+), typing, asyncio/concurrency, pandas/Polars, PyArrow, PySpark/Dask/Ray. - Strong SQL and data modeling; Snowflake, ...

Hyderabad, भारत

  • Full-time
... efficient data engineering solutions using our platform Cognite Data Fusion.- Drive and manage integrations, extractions, data modeling, and analysis using Cognite data connectors and SQL, Python/Java and Rest APIs.- Create custom data models for data discovery, mapping, and cleansing.- Collaborate with data scientists, project ...

Bangalore, भारत

GANIT BUSINESS SOLUTIONS PRIVATE LIMITED

Ganit - Senior Data Engineer - Python/Spark

  • On-site
... with a proven track record in complex pipeline development and cloud-based data migration projects.- Education: Bachelors or higher degree in Computer Science, Data Engineering, or a related field.Skills:- Proficiency in Spark, SQL, Python, and other relevant data processing technologies.- Expertise in on-premises to cloud ...

Gurgaon, भारत

We are looking for an experienced Data Engineer with strong expertise in SQL Server, data integration, and structured data https://jobeax.com/link/SIEkrz4VgCkhRIDm role will focus primarily on building, supporting, and troubleshooting reliable data loads and integrations, including ServiceNow extracts and future data solutions ...

Ernakulam, भारत