Vacancy description

Data Engineer in Bangalore, भारत

Vrinda International

  • Full-timeStandard weekly hours

Rs 15 - 22 lakhs p.a.

Bangalore, भारत

Data Engineer

Summary

We are seeking an experienced Data Engineer to architect, build, and maintain scalable data infrastructure within the IT Services sector. In this pivotal role, you will drive the design of robust data warehousing solutions and ensure seamless data modeling to support critical business analytics. Your expertise will be essential in managing cloud-native data pipelines, overseeing high-quality data migration strategies, and optimizing large-scale processing workflows. This position offers the opportunity to leverage cutting-edge Google Cloud technologies to transform raw data into actionable insights, directly contributing to the organization's data-driven decision-making capabilities and operational efficiency.

Responsibilities

  • Design and implement comprehensive data warehousing architectures and advanced data modeling strategies to meet evolving business needs.
  • Develop and maintain efficient version control workflows using Git and GitHub, integrating continuous integration and continuous deployment (CI/CD) pipelines for automated testing and deployment.
  • Construct and optimize complex data processing pipelines utilizing Google Dataflow and Apache Beam for real-time and batch data transformation.
  • Establish rigorous data quality frameworks and lead strategic cloud migration initiatives to ensure data integrity and security during transitions.
  • Manage and scale data storage and processing environments using BigQuery and Dataproc, ensuring high performance and cost-effectiveness.
  • Orchestrate scheduled workflows and dependency management through Cloud Composer (Apache Airflow) to guarantee reliable data delivery.
  • Implement event-driven data ingestion and storage solutions leveraging Pub/Sub and Cloud Storage to handle high-volume data streams.

Requirements

Requirements:

  • Experience: A minimum of 15 to 20 years of professional experience in data engineering and related fields.
  • Core Competencies: Proven expertise in Data Warehousing and sophisticated Data Modeling techniques.
  • Version Control & DevOps: Strong proficiency with Git/GitHub and the implementation of CI/CD practices.
  • Big Data Processing: Hands-on experience with Google Dataflow and Apache Beam for scalable data processing.
  • Data Governance: Demonstrated ability in ensuring Data Quality standards and executing successful Cloud Migration projects.
  • Cloud Technologies: In-depth knowledge of Google BigQuery and Dataproc for analytics and processing.
  • Workflow Orchestration: Skilled in utilizing Cloud Composer (Apache Airflow) for workflow management.
  • Messaging & Storage: Familiarity with Pub/Sub and Cloud Storage for data ingestion and archival.

Similar vacancies

More like this role

... We’re confident enough to move fast and talented enough not to break things. Are you a Data Engineer looking to make a real impact? We are looking for a founding Data Engineer to architect the modern data stack that powers our Customer Success organization. In this role, you will move beyond simple data maintenance to design ...

Bangalore, भारत

Vrinda International

Data Engineer

  • Full-time

Rs 12 - 14 lakhs p.a.

Summary We are seeking an experienced Data Engineer to join our IT Services division. In this pivotal role, you will design, build, and maintain robust data pipelines that facilitate seamless information flow across our Salesforce ecosystem and data warehouse. You will be instrumental in ensuring data integrity, optimizing ...

Pune, भारत

Talent Join

Data Engineer

  • Full-time
Role Overview We are looking for a skilled Data Engineer with strong analytical, data interpretation, and problem-solving abilities. The ideal candidate will have hands-on experience with SQL, Python, Excel, and data visualization tools to analyze large datasets and generate meaningful business insights. Key Responsibilities ...

Hyderabad, भारत

Turgon AI

Data Engineer

  • Full-time

$1.5 USD

... About the Role As a Data Engineer, you will be responsible for designing, building, and maintaining robust and scalable data pipelines. You will work with large datasets, ensuring data quality, and enabling data-driven decision-making across the organization. This role requires a strong understanding of data warehousing concepts, ...

Delhi, भारत

  • On-site
  • Full-time
... channels. This initiative requires a robust on-premises data infrastructure to support distributed computing, large-scale data ingestion, and advanced analytics. The Data Engineer will be responsible for building and maintaining resilient pipelines and data systems that feed into MMO models, ensuring data quality, governance, and ...

Hyderabad, भारत

About the Job Position : Role : Data Engineer - Databricks & PySparkExperience : 3 - 6 yearsLocation : Gurgaon, IndiaWork Mode : Work from Office (Mon - Fri)Shift : 2 : 00 PM - 11 : 00 PM ISTMantriAI is hiring for a leading global analytics and advisory firm, helping banks and financial institutions drive revenue growth, ...

Gurgaon, भारत

  • Full-time
... choice. Data Engineer POSITION PURPOSE: As a Data Engineer, you are developing and operating reliable data pipelines that enable timely access to high-quality data assets. You are part of a dynamic team of technical experts, working hand-in-hand with subject matter experts, data product managers, semantic experts and data ...

Bangalore, भारत

... documentation. Skills Must have 5+ years' experience as a Data Engineer, ideally in a large corporate environment PySpark experience In-depth knowledge of SQL and data modelling/data processing Strong experience working with Microsoft Azure Develop and maintain data pipelines using Databricks Experience with visualisation tools ...

Pune, भारत

IntegriChain

Data Engineer

  • Remote
  • Hybrid
  • Full-time
... or follow us on LinkedIn . Job Description Your mission at IntegriChain: The mission of the Data Engineer is to design, build, and maintain scalable, reliable data pipelines and warehouse models that turn complex life science and healthcare data into clean, trusted datasets that power analytics and decision-making. What ...

Pune, भारत

  • Full-time
... scalability, and reliability. - Ensure data security and compliance by managing secrets and sensitive information using AWS Secrets Manager. - Monitor and troubleshoot data pipelines to ensure smooth operation and timely data delivery." - "Proven experience as a Data/Integration Engineer or in a similar role. - Strong knowledge of ...

Bangalore, भारत

  • Full-time
... SQL databases, REST APIs, data lakes, and other structured and unstructured data sources. - Knowledge of data integration and transformation techniques for engineering and operational data. Facilities Engineering Data Services & Workflows - Support functional testing and unit testing of data pipelines, models, and data ...

Bangalore, भारत