Back to list

Vacancy description

Data Engineer-PL in India, भारत

Iassess Consultants

Rs 30 - 45 lakhs p.a.

India, भारत

Job Description

Strong SQL and Python.
Data modelling, warehousing concepts, partitions, clustering, indexing, optimisation.
ETL/ELT pipeline design and production support.
Batch and streaming pipeline fundamentals.
Orchestration using Airflow, Composer, Control-M, ADF, dbt, or equivalent.
Big data processing using Spark, PySpark, Beam, Dataflow, Dataproc, Databricks, EMR, or equivalent.
Cloud storage and data lake concepts.
Data quality, reconciliation, schema validation, lineage, monitoring, and alerting.
CI/CD for data pipelines and code versioning.
Ability to explain scale scenarios, not just tool definitions.

Generic Skills (Must Have)
Python and advanced SQL.
Data quality checks, reconciliation, alerting, retries, and backfills.
Production pipeline monitoring and troubleshooting.

GCP Skills (Must Have)
Mandatory: BigQuery: datasets, tables, views, partitioning, clustering, SQL optimisation, cost awareness.
Option 1: Dataflow / Apache Beam or equivalent streaming/batch framework.
Option 2: Dataproc / PySpark or strong Spark experience.
Pub/Sub or equivalent event streaming.
Cloud Composer / Airflow DAG development.

Nice to have (Trainable)
Dataform, dbt, CI/CD for data.
BigQuery ML.
Dataflow templates.
Looker / LookML basics.

Similar vacancies

More like this role

  • IT
... practice and events that explore new and emerging technologies Required qualifications, capabilities, and skills - Formal training or certification on software engineering concepts and 8+ years applied experience - Experience designing and implementing data pipelines in a cloud environment is required. (E.g. Apache Ni Fi / ...

Bangalore, भारत

Jobgether

Data Engineer

  • Remote
  • Full-time
... work opportunity based in India. - Opportunity to contribute to the development and evolution of a global data engineering platform. - Exposure to enterprise data integration technologies, including Oracle Data Integrator, MuleSoft, and Oracle GoldenGate. - Opportunity to work on complex data engineering challenges and ...

भारत

  • On-site
  • Data Analytics
... solve complex technical problems through sound and methodical troubleshooting (flow failures, delegation and app performance, DAX/query performance).- Microsoft PL-400 (Power Platform Developer Associate) and/or PL-300 (Power BI Data Analyst Associate) certification highly desired.- Hands-on experience migrating legacy automations ...

Bangalore, भारत

  • Full-time
  • Accounting
Senior engineering role at Rntbci PL in Chennai. Needs a CA. What you'll do - Responsible to follow Costing guide line and Ref. data & support to Update CGL - Visit Supplier and collect Required Costing information’s and identify opportunities for the cost reduction improvements - Support Digital Transformation of Process ...

Chennai, भारत

  • Remote
  • Hybrid
  • IT
... Citi’s Corporate Tax platform. - Write and optimize Oracle SQL and PL/SQL queries, stored procedures, and tables for tax processing and reporting. - Package application services into containers and deploy them to Kubernetes and OpenShift environments. - Develop Python, Shell, and SQL automation scripts for data validation ...

Pune, भारत

  • Full-time
  • IT
... requirements - Develop custom forms, reports, interfaces, workflows, and extensions using Oracle tools such as PL/SQL, Oracle Forms, Oracle Reports, OAF (Oracle Application Framework) - Create and modify Oracle ERP APIs, web services, and integrations to support seamless data flow between Oracle ERP and third-party systems ...

Hyderabad, भारत

  • Full-time
... adoption. Required qualifications 1. 3+ years in automation, software, or solutions engineering 2. Hands on experience with Microsoft Copilot Studio and Power Platform (Power Automate, Power Apps, Dataverse) 3. Working knowledge of generative AI concepts: LLMs, prompt engineering, grounding/RAG, and agent limitations 4. ...

Bangalore, भारत

Growel Softech Pvt. Ltd.

Avaloq Developer - PL-SQL

  • Hybrid
Avaloq DeveloperLocation : PuneExp : 5 - 12 yearsKey Responsibilities:- Engineer and customize Avaloq core banking modules to meet evolving business requirements, ensuring seamless integration with existing financial systems.- Develop and optimize complex PL/SQL packages and procedures within Oracle databases to ensure ...

Pune, भारत

  • Full-time
... architecture, data engineering, or enterprise data platforms, with substantial hands-on experience in Snowflake. - Strong expertise in Technology Architecture and Data Architecture, including solution design, data modeling, integration, and implementation of scalable enterprise platforms. - Strong hands-on experience with Snowflake ...

Hyderabad, भारत

  • Full-time
  • Data Analytics
  • Business Intelligence
Job Description Job Summary We are seeking an experienced Data & BI Engineer (7-9 years) with strong expertise in SQL Server, Azure Data Factory (ADF), and Power BI . The role involves designing and developing scalable data solutions, building ETL pipelines, writing complex sql queries, optimizing databases, and delivering ...

Chennai, भारत