We are looking for an experienced Data Engineer with strong expertise in GCP, BigQuery, Python, and SQL to design, develop, and maintain scalable data pipelines.
Experience: 6+ Years Role: Data Engineer Cloud Platform: Google Cloud Platform (GCP)
Key Skills Required:
Strong Python and Advanced SQL
Google BigQuery – Data Modelling, Partitioning, Clustering and SQL Optimisation
Dataflow / Apache Beam or Dataproc / Spark / PySpark
ETL/ELT Pipeline Development
Apache Airflow / Cloud Composer – DAG Development
Pub/Sub or Event Streaming
Data Quality, Reconciliation and Pipeline Monitoring
Production Troubleshooting and Performance Optimisation
Additional Skills: Dataform, dbt, BigQuery ML, Looker, Terraform and CI/CD.
Important: Hands-on experience with BigQuery, Spark/Dataflow/Dataproc and Airflow/Cloud Composer is required.
... experience in data engineering or analytics engineering in a private, public, government or military environment. - Hands-on experience with SQL and relational databases, plus Python and PySpark for data processing and transformation. - Experience with Databricks and Lakehouse/Medallion architecture, and with AWS data services ...
... 3-Month Lead Generation Training Program. During the training you will learn B2B lead generation online research LinkedIn outreach email campaigns and prospect database management. You will work on identifying potential customers researching companies connecting with decision-makers and supporting the global business growth ...
... data engineering or a related field. - Strong programming skills in languages such as Python. - Proficiency in SQL and working knowledge of relational and NoSQL databases. - Familiarity with cloud platforms like AWS Azure or GCP. - Knowledge of data modelling concepts and experience in designing and optimising data schemas. ...
... (Azure AI, GCP), model evaluation metrics, and basic MLOps concepts (model versioning, monitoring). • Experience working with structured and semi-structured data and feature engineering. • Hands-on experience with AI coding assistants (e.g. Claude Code, GitHub Copilot, Cursor) for AI-assisted development. What we can offer ...
... enterprise data modeling and metadata standards, best practices, and design patterns.- Partner with data engineering teams to ensure data models align with ETL/data pipelines, lineage, and performance requirements.- Develop and maintain data documentation, including data dictionaries, business glossary entries, and data catalog ...
... Query, etc.- Proficient in at least one programming language used in data engineering, such as Python (or Scala/Rust/Java).- Has strong execution knowledge of Data Modeling (star schema, snowflake schema, fact vs dimension tables).- Proficient in Spark and related applications like Databricks, GCP DataProc, AWS Glue, EMR, ...
Hyderabad, भारत
View vacancy
NTT DATA INFORMATION PROCESSING SERVICES PRIVATE L
... troubleshooting.- Strong SQL is essential, incremental loading, watermarks and SCD Type 1 / Type 2.- You should understand Lakehouse, Warehouse, OneLake, shortcuts, Dataflows Gen2, metadata-driven pipelines, audit / error handling and DevQAProd deployments.- Power BI skills should include semantic modelling, Direct Lake, DirectQuery, ...
... Statistics or Mathematics. • Experience with anomaly detection, forecasting or clustering techniques. • Experience with large-scale event, behavioral or time-series data. • Exposure to cloud data platforms (AWS, GCP or Azure) or big data tools such as Spark. • Experience in a client-facing analytics, consulting or SaaS product ...
... enterprise data modeling and metadata standards, best practices, and design patterns.- Partner with data engineering teams to ensure data models align with ETL/data pipelines, lineage, and performance requirements.- Develop and maintain data documentation, including data dictionaries, business glossary entries, and data catalog ...
... opportunities.- Collaborate with data engineers and technical teams to ensure accurate implementation of business requirements.- Perform data validation, troubleshoot data-related issues, and ensure data accuracy and consistency.- Work with Databricks at a foundational level, including notebooks, data processing concepts, and data ...