Senior Data Engineer - AWS in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Job Title: Senior Data Engineer At Ganit , we are not just data geeks – we are a family of scientists, refiners, and artisans. Our mission is to bridge the gap between intelligence and action, translating data into valuable insights and strategies. We work with businesses to create state-of-the-art solutions that push the boundaries of data science. Incorporated in 2017, Ganit was founded by professionals with vast experience in consulting, analytics, marketing, merchandise, operations, and https://jobeax.com/link/mYvMZkpRFRzMWb6X company culture revolves around maximizing decision velocity and minimizing decision risk for enterprises ambitious enough to make data their voice. Data Engineering Excellence : Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion. Cloud Data Migration Leadership : Lead cloud migration projects, developing scalable Spark pipelines. Implement Bronze, Silver, and gold tables for scalable data systems. Optimize Spark code to ensure efficient cloud migration. Data Modeling : Develop and maintain data models with strong governance practices. Data Cataloging & Quality : Implement cataloging strategies with Unity Catalog to maintain high-quality data. Lead the design and implementation of Delta Live Tables (DLT) pipelines for secure, tamper-resistant data management. Collaborate with clients to optimize cloud migrations and ensure best practices in design and governance.
Experience : Minimum 6 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects. Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field. Skills : Proficiency in Spark, SQL, Python, and other relevant data processing technologies. Expertise in on-premises to cloud Spark code optimization and Medallion Architecture. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus).
... Responsibilities Develop, test, and maintain scalable Python applications. Work with large datasets to extract, transform, and analyze data. Build and optimize data pipelines and workflows. Perform data cleaning, validation, and preprocessing. Collaborate with cross-functional teams including data analysts and engineers. ...
Hello, We are hiring for 'Data Engineer with Java' for Pune Location. Exp :5+Years Loc : Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills: Data Engineering Airflow Data Build Tool(DBT) Java ETL/ELT Pipeline CI/CD SQL NOTE: We are looking for Immediate joiners(notice period ...
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
... years of professional experience in data engineering, with a focus on data modelling and transformation. Programming: Strong proficiency in SQL and Python for data processing and pipeline development. Data Platforms: Hands-on experience with Snowflake, dbt, and modern cloud data warehouses. Data Modelling: Deep experience ...
... architecture, establish engineering best practices, and mentor other engineers. The role requires strong experience designing, building, and operating large-scale data pipelines and distributed data systems. Our technology stack includes AWS services, Airflow, Snowflake, MS SQL Server, and .NET. We are looking for someone who ...
... Services, WPF, https://jobeax.com/link/NY9VLwPeZTLjA7wT, Entity Framework, Dapper Web Technologies: REST API, SOAP Services, ASPX, HTML, CSS, JavaScript, JSON, XML Databases: Microsoft SQL Server, PostgreSQL Net otherwise, should be very strong in .NET. Net AWS Cloud Services: AWS EC2, ECS, S3, RDS, Lambda, API Gateway, CloudWatch, ...
Senior DevOps Engineer As a Senior DevOps Engineer - Observability Platform , you will be responsible for building and maintaining scalable, reliable infrastructure and deployment pipelines with a strong emphasis on observability - metrics, logs, and traces - across systems running on Kubernetes and Azure. You will work ...
... perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. SIEM SOAR/Platform Engineer The ideal candidate will have extensive experience with Palo Alto Cortex XSOAR (formerly Demisto) and a strong background in security automation and orchestration. ...
... companies that need to ship enterprise integrations at scale. We're reimagining integrations with AI agents that work like business consultants and integration engineers, building them 10x faster, in hours instead of days. The payoff: integrations stop being a bottleneck that costs you deals and burns margin, and become a growth ...
... optimize cloud costs while maintaining system performance and reliability.- Infrastructure Management : Manage our multi-environment infrastructure deployed in AWS cloud, comprising Dockerized microservices in AWS ECS & various data stores and queueing technologies.- Automation : Leverage modern solutions like Terraform ...
... interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. Don’t miss the rocket ship—join Prophecy and build the next data revolution. This is a high-impact opportunity to be a senior DevOps engineer in a fast-growing startup, based in Prophecy’s India engineering center. You will ...
Role - DevOps Engineer Location - Chennai Mode - Work from office Experience - 5+ Years Employment - Full-time Industries - Banking, Payments, FinTech, IT Products Note: Candidates having experience with US banking sector with US payment domains are preferred. About the role - We are looking for a Senior DevOps Engineer ...
... etc. Be a keen learner and enthusiastic about developing software. Experience with prompt engineering, chain-of-thought, retrieval augmented generation, vector databases and preferably llm agents. Experience with Cloud infrastructure and platforms (Azure, AWS) Experience using tools to deploy models into the production environment ...
... implementations aligned with client goals Technical Implementation NET Core with authentication, authorization, and middleware Work with Entity Framework Core for database operations, migrations, and query optimization Manage PostgreSQL and AWS RDS databases for high-availability applications Implement and maintain messaging ...
Job description Job Description (JD) - Senior Associate DevOps Assistant (Grade 2) The Senior Associate DevOps Assistant (Grade 2) supports the DevOps team in automating, streamlining, and enhancing the development and deployment pipelines. This role involves assisting in managing infrastructure, automating software deployment, ...
Job Summary/Objective The Senior Systems Engineer is a hands-on infrastructure role responsible for the design, administration, and continuous improvement of OEC's corporate IT environment. Scope spans Windows Server, Microsoft 365 and Entra ID, identity and access management, and endpoint management, with active expansion ...
... key role in delivering datacenter transformation projects, infrastructure modernization programs, platform consolidations, and operational improvements. The Senior Virtualization Engineer partners with architects, project managers, support teams, vendors, and business stakeholders to deliver reliable and cost-effective ...
... data that powers Blackbaud Data Intelligence and Advanced analytics products. The data managed by the team supports data science, data enrichment, research and data analysis as well as making data operationally able to be consumed by Blackbaud's products and services. As a Senior Data Engineer, you will take responsibility ...
... Experience with data quality tooling (SODA, Collibra, or similar) Exposure to cloud platforms (Azure, AWS, or GCP) Experience in a regulated or enterprise-scale data environment Prior experience mentoring or leading a small pod of engineers EXPERIENCE - 8+ years in data engineering, with at least 4+ years focused on Snowflake ...