Back to list

Vacancy description

Senior Data Engineer - Python/SQL in Calcutta, भारत

Good Co

Calcutta, भारत

Job Summary : We are looking for an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines, data platforms and cloud-based data infrastructure. The ideal candidate should have strong expertise in data engineering, ETL/ELT processes, big data technologies, cloud platforms and data https://jobeax.com/link/17NlwZ4oSJJaCzVO Responsibilities : - Design, develop and maintain scalable data pipelines and ETL/ELT workflows.- Build and optimize data processing frameworks for structured and unstructured data.- Develop data integration solutions across multiple internal and external systems.- Work with large datasets using distributed computing technologies.- Design and maintain data warehouses, data lakes and lakehouse architectures.- Implement batch and real-time data processing pipelines.- Optimize data storage, processing performance and query execution.- Collaborate with Data Scientists, AI Engineers, Business Analysts and Software Engineers.- Ensure data quality, governance, security and compliance.- Implement automated data pipeline monitoring and error-handling mechanisms.- Manage cloud-based data infrastructure and deployment workflows.- Support AI/ML teams by providing reliable, high-quality data https://jobeax.com/link/2rj5p3MqDPmMPA0i Technical Skills : - Programming : Python, SQL, PySpark, Scala- Big Data Technologies : Apache Spark, Hadoop, Kafka- ETL/ELT Tools : Apache Airflow, dbt, Informatica- Cloud Platforms : AWS, Microsoft Azure, GCP- Data Warehousing : Snowflake, Amazon Redshift, Google BigQuery, Azure Synapse- Databases : PostgreSQL, MySQL, MongoDB- Data Lakes : Delta Lake, Apache Iceberg, AWS S3- Data Processing : Batch Processing, Stream Processing, Real-Time Analytics- DevOps & Deployment : Docker, Kubernetes, CI/CD, Terraform- Data Governance : Data Quality, Data Lineage, Metadata ManagementExperience & Qualifications : - 6 - 11 years of overall experience in Data Engineering or related fields.- Minimum 4 - 5 years of hands-on experience in data engineering.- Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering or a related https://jobeax.com/link/kfLTLT6enIMYonWk Certifications : - AWS Certified Data Engineer - Associate- Google Professional Data Engineer- Microsoft Certified : Fabric Data Engineer Associate- Snowflake SnowPro Core Certification- Databricks Certified Data Engineer Associate (ref:hirist.tech)

Similar vacancies

More like this role

... Design and implement automated data quality checks and validation frameworks.- Perform data profiling, anomaly detection, and root cause analysis using Python and SQL.- Integrate data quality processes into ETL/ELT pipelines using PySpark and Databricks.- Monitor and resolve data quality issues across Azure/AWS-based data platforms.- ...

Pune, भारत

Youth4 Talent Solutions and Services

Senior Data Engineer - Python/Big Data

... Define baselines and benchmarks to define the success and failure of marketing campaignsKey Skills :- Proficiency in Python and SQL- Thorough understanding of SQL/NOSQL databases such as Snowflake, Google Big Query, PostgreSQL, MongoDB, Amazon Redshift, MYSQL- Proficiency in developing dashboards, reports using Data Visualization/BI ...

Bangalore, भारत

  • Full-time

€40 EUR

Senior Data Engineer (DBT, AWS, SQL) Join us as a Senior Data Engineer and play a pivotal role in building and scaling modern data platforms that enable data-driven decision-making across the organization. What will you do? - Design, develop, and maintain scalable data pipelines using dbt, SQL, AWS services i.e S3, Redshift, ...

Bangalore, भारत

... Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, ...

Thiruvananthapuram, भारत

TekPioneers - A TekGence Company

Senior Python Engineer - Data Pipelines - Hybrid

  • Hybrid
  • Full-time
... engineering standards; mentor junior engineers; liaise with business stakeholders. Qualifications - 8–12 years of software engineering, 5–6+ years building production data pipelines in Python. - Expert modern Python (3.10+), typing, asyncio/concurrency, pandas/Polars, PyArrow, PySpark/Dask/Ray. - Strong SQL and data modeling; Snowflake, ...

Hyderabad, भारत

  • Full-time
... efficient data engineering solutions using our platform Cognite Data Fusion.- Drive and manage integrations, extractions, data modeling, and analysis using Cognite data connectors and SQL, Python/Java and Rest APIs.- Create custom data models for data discovery, mapping, and cleansing.- Collaborate with data scientists, project ...

Bangalore, भारत

GANIT BUSINESS SOLUTIONS PRIVATE LIMITED

Ganit - Senior Data Engineer - Python/Spark

  • On-site
... with a proven track record in complex pipeline development and cloud-based data migration projects.- Education: Bachelors or higher degree in Computer Science, Data Engineering, or a related field.Skills:- Proficiency in Spark, SQL, Python, and other relevant data processing technologies.- Expertise in on-premises to cloud ...

Gurgaon, भारत

We are looking for an experienced Data Engineer with strong expertise in SQL Server, data integration, and structured data https://jobeax.com/link/SIEkrz4VgCkhRIDm role will focus primarily on building, supporting, and troubleshooting reliable data loads and integrations, including ServiceNow extracts and future data solutions ...

Ernakulam, भारत

BNP Paribas India Solutions Pvt. Ltd.

BNP Paribas ISPL - Senior Data Engineer - Python

... technology ecosystem and provides end-to-end technology platform that enables the bank's anti-money-laundering (AML) https://jobeax.com/link/8PycUj1GMlj0NwXn a Senior Data Engineer you will design, build and operate high-performance, Python services that ingest, enrich, analyze and surface AML-relevant https://jobeax.com/link/VqRHKsBGCmTUM5K6 ...

Chennai, भारत

  • IT

$80 USD

... Catalog, Workflows, Photon, cluster/SQL-warehouse sizing, Databricks Asset Bundles. Databricks Data Engineer Associate/Professional certification is a plus. • Azure data stack: ADLS Gen2, Azure Data Factory, Azure Key Vault, Entra ID service principals, Azure DevOps or GitHub Actions for deployment. • AWS depth: Glue (Python-shell ...

Hyderabad, भारत