... consumption. WIP combines query execution, dynamic access control (RLS, CLS, ABAC), and API-driven architecture to power dashboards, applications, and AI-driven data interactions. Operating at the intersection of big data, cloud, security, and platform engineering, we are building a future-ready analytics platform that supports ...
... capacity planning, cost optimization, and performance tuning. - Leverage and manage AWS services like Bedrock, Sagemaker, S3, Redshift, Athena, Kinesis, Lambda, Data Lake etc. - Implement data pipelines using best practices in data modeling, ETL/ELT processes by leveraging AWS technologies and big data tools. - Build data ...
... Senior Data Engineer with strong expertise in Databricks, Apache Airflow, SQL, and Python to design and optimize data pipelines, ETL workflows, and cloud-based data solutions. The ideal candidate will have deep experience in big data processing, cloud-based analytics, and automation to drive efficient and scalable data engineering ...
... Ability to guide and mentor other team members. - Strong stakeholder engagement and influencing skills. - Pragmatic and collaborative team player. - Experience with Databricks, data pipelines, and CI/CD. - Proficiency in Python, SQL, and big data technologies in cloud environments. - Pragmatic and collaborative team player.
... Senior Data Engineer with strong expertise in Databricks, Apache Airflow, SQL, and Python to design and optimize data pipelines, ETL workflows, and cloud-based data solutions. The ideal candidate will have deep experience in big data processing, cloud-based analytics, and automation to drive efficient and scalable data engineering ...
... Design and develop batch and real-time data pipelines on GCP.- Build scalable ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer.- Ingest data from databases, APIs, files, SaaS applications, and streaming sources.- Design and optimize BigQuery datasets, tables, partitioning, and clustering.- Develop data transformations ...
... execution. Lead the development and enhancement of data-heavy modules across ad serving, analytics, and reporting systems. Design, optimize, and maintain scalable data pipelines using a mix of SQL , NoSQL and Big Data tools. Work with streaming platforms like Apache Kafka and Flink for real-time data processing. Ensure data ...
... Fintech & Product Advisory - Advise Product, Engineering, and Growth teams on compliant data usage (e.g. KYC, AML, transaction monitoring), Support cross-border data transfer mechanisms Data Subject Rights & Governance - Oversee handling of Data Subject Access Requests (DSARs), consent management, and data lifecycle policies, ...
... Tekion connects the entire spectrum of the automotive retail ecosystem through one seamless platform. The transformative platform uses cutting-edge technology, big data, machine learning, and AI to seamlessly bring together OEMs, retailers/dealers and consumers. With its highly configurable integration and greater customer ...
... Tekion connects the entire spectrum of the automotive retail ecosystem through one seamless platform. The transformative platform uses cutting-edge technology, big data, machine learning, and AI to seamlessly bring together OEMs, retailers/dealers and consumers. With its highly configurable integration and greater customer ...
... Ansible, and Infrastructure as Code (IaC). - Good understanding of SQL/NoSQL databases, Snowflake, and cloud data platforms. - Knowledge of Python, PySpark, ETL, or data engineering is highly desirable. - Familiarity with Agile development practices and DevOps methodologies. Preferred Qualifications: - Experience with Big Data ...
... Tekion connects the entire spectrum of the automotive retail ecosystem through one seamless platform. The transformative platform uses cutting-edge technology, big data, machine learning, and AI to seamlessly bring together OEMs, retailers/dealers and consumers. With its highly configurable integration and greater customer ...
Maxgen Technologies Pvt ltd is an it company based in Ahmedabad Gujarat .Engineering and IT freshers will get data analyst internship and power bi program. What Services we are offering Online or offline program. live project in internship. hybrid mode internship. college project for interns.
Job Role: Senior Data Engineer- Implementation & Modernization Location: Experience: 8+ Years The Data Engineer is responsible for building and optimizing high-performance, large-scaled data solutions on modern cloud platforms. This role focuses on developing Senior Data Engineer- Implementation & Modernization The Data ...
... integration, primarily using Azure Databricks , Azure Data Lake , and Microsoft Purview . Pipeline Development – Design, build, and deploy robust ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform, and curate governance and operational metadata from multiple sources landed in Databricks. Granular Data ...
... in end-to-end data transformation and pipeline development Detailed Job Description Mandatory Technical Skills: Snowflake Data Warehouse Python Scripting DBT (Data Build Tool) Apache Airflow Advanced SQL End-to-End ETL/ELT & Data Pipeline Development Key Requirements Strong hands-on experience in Snowflake data warehousing ...
... exposure to these technologies. ⚠️ If Databricks is not a core part of your recent hands-on experience, this role may not be the right fit. Job Title: Senior Data Engineer Specialization: Data Engineering | Databricks | Lakehouse | Data Platforms | AI-Ready Data Experience: 5+ Years Location: BNG | HYD | PUN | MUM | GGN ...
... and led by seasoned leaders who know how to build enduring companies. Trusted by brands like Instacart, Western Union, NBCUniversal, ZocDoc, and Sephora, we’re big enough to matter, small enough for you to make a real impact. If you’re excited by the grit of building, rapid learning, and shaping the future of customer growth, ...