Vacancy description
Augusta Infotech
Bangalore, भारत
Key Responsibilities : - Design, develop, and maintain scalable and reliable data pipelines on GCP.- Build and manage enterprise-grade data warehouses and analytical solutions using BigQuery.- Develop robust data models and transformation workflows using dbt.- Design and implement efficient ETL/ELT pipelines for structured and semi-structured data.- Optimize BigQuery queries, data models, and workloads for performance, scalability, and cost efficiency.- Work with large datasets and apply Big Data engineering principles to ensure reliable data processing.- Develop reusable data engineering frameworks and best practices across projects.- Implement data quality checks, validation, monitoring, and error-handling mechanisms.- Use Git for version control and follow modern software engineering and CI/CD practices.- Collaborate with data analysts, data scientists, product teams, and other engineering stakeholders to deliver reliable data solutions.- Contribute to data governance, security, documentation, and overall data platform https://jobeax.com/link/3xbFxX8WP3q0lvhS Technical Skills : - 7+ years of experience in Data Engineering or a related field.- Strong hands-on experience with Google Cloud Platform (GCP).- Strong expertise in BigQuery and cloud data warehousing.- Advanced SQL skills, including query optimization and complex data transformations.- Hands-on experience with dbt for data modeling and transformation.- Strong understanding of ETL/ELT pipelines and modern data engineering architecture.- Good understanding of Big Data concepts, distributed data processing, and scalable data platforms.- Experience with Git/version control and software development best https://jobeax.com/link/pr2MNp8S3ReG2Vnw to Have : - Experience with Apache Pinot or other real-time OLAP databases.- Hands-on experience with streaming technologies such as Google Pub/Sub, Apache Kafka, or similar platforms.- Exposure to real-time data processing and streaming pipelines.- Knowledge of data governance, data quality, security, and metadata management.- Experience with cloud-native data engineering and CI/CD https://jobeax.com/link/n702ZGttRFQk9ztb Profile : - Strong problem-solving and analytical skills with the ability to work with large and complex datasets.- Experience designing scalable and production-grade data solutions.- Strong understanding of data architecture and modern cloud data platforms.- Ability to independently own data engineering projects and collaborate effectively with cross-functional teams.- Strong communication and stakeholder-management skills. (ref:hirist.tech)