... in end-to-end data transformation and pipeline development Detailed Job Description Mandatory Technical Skills: Snowflake Data Warehouse Python Scripting DBT (Data Build Tool) Apache Airflow Advanced SQL End-to-End ETL/ELT & Data Pipeline Development Key Requirements Strong hands-on experience in Snowflake data warehousing ...
... platform capabilities, including APIs, data services, and integrations, while working within Agile and DevOps methodologies. - Document solution architecture, data lineage, business logic, KPI definitions, and operational procedures to support long-term maintainability and governance. Bachelor's degree in computer science, ...
... exposure to these technologies. ⚠️ If Databricks is not a core part of your recent hands-on experience, this role may not be the right fit. Job Title: Senior Data Engineer Specialization: Data Engineering | Databricks | Lakehouse | Data Platforms | AI-Ready Data Experience: 5+ Years Location: BNG | HYD | PUN | MUM | GGN ...
... degree in an analytical field (e. g. Computer Science, Engineering, Mathematics, Statistics, Operations Research, Management Science). 3+ years of experience with data analysis and metrics development. - 3+ years of experience analyzing and interpreting data, drawing conclusions, defining recommended actions, and reporting results ...
... . Good team player . Interest in technologies and innovation . Knowledge of formalisation and communication tools (MS Office - MS SharePoint) . Knowledge of statistical and datamining techniques (SAS, SPSS, VBA, ACCES) or SQL database languages . Proficient in English . Perfectly at ease in a multi-cultural environment
... and maintain scalable data pipelines for data processing and transformation Build and manage workflow orchestration using Apache Airflow Develop and maintain data models and transformations using dbt Work with BigQuery or similar cloud data warehouses for data storage and querying Manage and interact with cloud object storage ...
... quality, and observability. Build data pipelines: Develop robust batch and streaming pipelines (Kafka/Kinesis) to ingest, transform, and enrich large-scale event data (impressions, clicks, conversions, costs, identity signals). - Create data aggregates & marts: Data modeling & contracts: Define schemas, data contracts, and ...
DATA ENGINEER EXPERIENCE - 5-8 yrs WORK MODE - HYBRID Data Pipeline Development : Design, build, and optimize scalable ETL/ELT pipelines to process and transform data from various sources into Snowflake. Data Modeling : Build and maintain data models within Snowflake for optimized querying and reporting. Cloud Infrastructure ...
Opportunity Overview We are looking for a Data Engineer to build and optimize scalable data pipelines and analytical datasets on our AWS-based lakehouse platform. You will work with Apache Iceberg, AWS Glue, Athena, dbt, and Airflow to support reliable and efficient data processing for analytics and operational use cases. ...
... intelligent conversational interfaces. Role Overview: Position: Generative AI Chatbot & Azure Open AI with LLM and RAG Experience Required: 5+ years in GEN AI (Data Science) Location: Gurgaon /Bangalore /Hyderabad /Pune Employment Type: Permanent Notice Period: Preferred Immediate joiners Key Responsibilities: Design and ...
... growth and innovation. Bachelor's or Master's degree in Computer Science , Engineering, Data Science or a related field. 10+ years of hands-on experience in data engineering, with at least 5 years in a people management role leading data platform or data infrastructure teams. Deep expertise in data warehousing, data modeling ...
... especially in post-trade clearing and settlement Experience with any data profiling/data discovery/data quality tool Education/Certification: Bachelor's degree in an appropriate area of specialization (Computer Science or Information Systems) Data management and data architecture related certifications (i.e. TOGAF) is a plus
... accountable for delivering exceptional results. Perform development work and technical support related to our data transformation and ETL jobs in support of a global data warehouse. Development of new ETL/data transformation jobs, using PySpark and IBM DataStage in AWS. Enhancement and support on existing ETL/data transformation ...
We are hiring for Senior Data Engineer (MS Fabric & Telecom) Work location: Bangalore, Karnataka, India Experince: 8 to 10 years Notice: Imdiate to 30 days only Role Overview As a Senior Data Engineer, you will be at the forefront of our data transformation, specifically architecting and building the next generation of ...
Pro Arch is seeking a Senior Data Engineer with 3-5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, ...
... age AWS stack (S3, EMR, Redshift) or traditional BI & DW with interest in data mining and ability to sieve emerging patterns and trends from large amount of data. Data Engineer should have strong experience with all standard data warehousing technical components (e.g. ETL, Reporting, and Data Modeling), infrastructure ...
... to conceptualize and deliver on ambiguous projects with specific revenue potential e.g. help place a new energy facility in the London market with placement data Bachelor's/Master's degree in Computer Science/Statistics/Mathematics/Economics/ Engineering discipline - 10-12 years of experience in BI and reporting – should ...
... learning systems Research and implement appropriate ML algorithms and tools Develop machine learning applications according to requirements Select appropriate datasets and data representation methods • Run machine learning tests and experiments Perform statistical analysis and fine-tuning using test results Train and retrain ...
... using Python. Strong proficiency in Python and object-orientated programming. Familiarity with RESTful API design and implementation. Experience with relational databases such as MySQL, PostgreSQL. Experience with version control systems such as Git. Familiarity with Docker for containerisation. Experience with microservices ...