We are looking for an experienced Data Engineer with strong expertise in GCP, BigQuery, Python, and SQL to design, develop, and maintain scalable data pipelines.
Experience: 6+ Years Role: Data Engineer Cloud Platform: Google Cloud Platform (GCP)
Key Skills Required:
Strong Python and Advanced SQL
Google BigQuery – Data Modelling, Partitioning, Clustering and SQL Optimisation
Dataflow / Apache Beam or Dataproc / Spark / PySpark
ETL/ELT Pipeline Development
Apache Airflow / Cloud Composer – DAG Development
Pub/Sub or Event Streaming
Data Quality, Reconciliation and Pipeline Monitoring
Production Troubleshooting and Performance Optimisation
Additional Skills: Dataform, dbt, BigQuery ML, Looker, Terraform and CI/CD.
Important: Hands-on experience with BigQuery, Spark/Dataflow/Dataproc and Airflow/Cloud Composer is required.
... experience in data engineering or analytics engineering in a private, public, government or military environment. - Hands-on experience with SQL and relational databases, plus Python and PySpark for data processing and transformation. - Experience with Databricks and Lakehouse/Medallion architecture, and with AWS data services ...
Senior data science role at Standard & Poors South Asia Services in Gurugram, Hyderabad and 2 more cities. What you'll do - Develop strong subject-matter expertise across assigned reference-data domains - Perform detailed root-cause analysis across source/vendor data, business rules, mastering/linking logic and downstream ...
Mid-level data science role at Caterpillar in Bengaluru. Needs 3+ years. What you'll do - Exposure in Automotive / Manufacturing industry - Directing the data gathering, data mining, and data processing processes in huge volume; creating appropriate data models - Exploring, promoting, and implementing semantic data capabilities ...
... performance or data quality issues to senior engineers. - Document datasets, experiments, and observations to support reproducibility. - Collaborate with AI/ML engineers, learning and applying engineering best practices. What you’ll need to succeed • Minimum 1 year of experience in data science, machine learning, or a related ...
... Technical & Data Skills · Strong SQL and data analysis/profiling skills — ability to query, manipulate, and validate complex datasets · Good understanding of databases, data structures, and data flows · Experience with Reference Data Management (RDM), Master Data Management (MDM), and/or Data Governance · Understanding ...
... investment, analytics, and platform use cases. The team partners across engineering, product, data specialists, and data consumers, with a focus on making high-quality data reliably and efficiently available. Your role and impact As a Data Engineer, you will build and support enterprise data pipelines and data platforms that enable ...
... enterprise data modeling and metadata standards, best practices, and design patterns.- Partner with data engineering teams to ensure data models align with ETL/data pipelines, lineage, and performance requirements.- Develop and maintain data documentation, including data dictionaries, business glossary entries, and data catalog ...
... Query, etc.- Proficient in at least one programming language used in data engineering, such as Python (or Scala/Rust/Java).- Has strong execution knowledge of Data Modeling (star schema, snowflake schema, fact vs dimension tables).- Proficient in Spark and related applications like Databricks, GCP DataProc, AWS Glue, EMR, ...
Hyderabad, भारत
View vacancy
NTT DATA INFORMATION PROCESSING SERVICES PRIVATE L
... troubleshooting.- Strong SQL is essential, incremental loading, watermarks and SCD Type 1 / Type 2.- You should understand Lakehouse, Warehouse, OneLake, shortcuts, Dataflows Gen2, metadata-driven pipelines, audit / error handling and DevQAProd deployments.- Power BI skills should include semantic modelling, Direct Lake, DirectQuery, ...
... Statistics or Mathematics. • Experience with anomaly detection, forecasting or clustering techniques. • Experience with large-scale event, behavioral or time-series data. • Exposure to cloud data platforms (AWS, GCP or Azure) or big data tools such as Spark. • Experience in a client-facing analytics, consulting or SaaS product ...