... disruptions of the future. We are looking forward to hire Azure Data Lake (ADL) Professionals in the following areas : Role - Azure Data Engineer Azure Data Lake, Data Factory, Pipelines, Synapse (mandatory) SQL, Python, PySpark / Spark-SQL Web tech, relational DBs, data warehousing, ETL design Microsoft Certified Data Engineer ...
Qualification : BE/B.Tech/M.Tech - Computer/IT Experience : 3 to 5 Years Roles & Responsibilities: - Create and manage data pipeline architecture for data ingestion, pipeline setup and data curation - Experience working with and creating cloud data solutions - Assemble large, complex data sets that meet functional/non-functional ...
Hi All, W are hiring Data Engineers, 4-9 years experience with below mandatory Skills . Job Location : Pan India ( Tech M Location) Azure Databricks, ETL, Pyspark & SQL, Medallion architecture Informatica knowledge. Fact & dimension table Medallion architecture Data bricks certification preferable ADF, Databricks, Pyspark, ...
... techniques. 5+ years' experience as a data engineer in complex data ecosystem. - Extensive experience working in an agile environment. - Experience with cloud data platforms like AWS Redshift, Databricks. - Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global ...
... and build scalable data processing systems. The ideal candidate should have hands-on experience working with large datasets, distributed computing, and modern data architectures. Key Responsibilities Design, develop, and maintain big data pipelines using Hadoop and Spark Build scalable data processing frameworks using Scala ...
... pipeline technologies such as Fivetran, dbt, https://jobeax.com/link/lh3BWW9lS62jmZgP with front-end development frameworks, ideally React; familiarity with Angular is also beneficial. Strong working knowledge of the Snowflake data platform. Experience in budgeting and resource allocation for data engineering projects.
Key Responsibilities: Design and implement ELT processes for diverse data sources, including RDBMS, NoSQL databases, and data warehouses Develop and maintain scalable data pipelines for batch and stream processing using JVM-based languages and frameworks Collaborate with cross-functional teams to integrate diverse data ...
... to connect various data sources.- Schedule and monitor workflows using Apache Airflow to ensure timely data processing and delivery.- Troubleshoot and resolve data issues as they arise, ensuring data quality and integrity throughout the pipeline.- Document ETL processes, data models, and architecture to maintain clear and ...
... Generative AI to design, build, and deploy scalable data-driven solutions. The ideal candidate will work closely with business and engineering teams to transform data into actionable insights and production-grade AI systems. Key Responsibilities Data Science & Analytics Analyze large, complex datasets to identify trends, patterns, ...
... daysMandatory Skills : - Python- PySpark- SQL- Oracle EBS- Databricks / Azure Data Factory (ADF)Key Responsibilities : - Design and develop scalable data pipelines using Databricks and PySpark.- Develop and optimize complex SQL queries and data processing workflows.- Work with Oracle EBS data structures and support data integration ...
... EMR, and other AWS services.- Develop PySpark-based data processing applications for large-scale distributed data workloads.- Write optimized SQL queries for data transformation, analysis, and reporting requirements.- Implement data ingestion frameworks to process data from databases, APIs, files, applications, and other ...
... in Data Science, Computer Science, Statistics, Business Analytics, or related field, or equivalent experience Business Acumen, Collaboration, Communication, Data Analysis, Data-Driven Business Intelligence, Data Visualization, Market/Industry Dynamics, Relationship Management, Statistics, Story Telling _____________________________________________________________________________________________________ ...
... the ability to articulate complex technical strategies to non-technical stakeholders and C-suite executives.- Proven ability to lead large-scale technical projects, managing stakeholder expectations while maintaining rigorous delivery timelines.- A minimum of 15 to 20 years of experience in data engineering and architectural ...
... ETL Tool ONLY amongst Talend Datastage Informatica ISS Cloud version Data Fusion Data Flow Data Proc Mandatory SQL PLSQL Scripting Experience Expert in Python Data Flow Pubsub Big Query CICD Must have good Experienceknowledge on GCP components like GCS BigQuery AirFlow Cloud SQL PubSubKafka DataFlow and Google Cloud SDK ...
... As part of our expanding GenAI & Data Engineering initiatives, we're looking for a Data Engineer to join our team in Pune and work on enterprise-scale GenAI projects, including clients in regulated industries (Pharma, Life Sciences, Banking). Design, build, and maintain scalable data pipelines supporting AI and GenAI use ...
... complex and large-scale datasets. Strong experience in data analysis, data profiling, reconciliation, and Data Quality (DQ) validation. Ability to explore large datasets and translate analysis into clear findings, recommendations, and actionable insights. Experience working with large volumes of data and understanding of performance ...
... Glue, Lambda, Step Functions, and Apache Spark . Develop and optimize data lake and data warehouse architectures using AWS S3, Redshift, and Athena . Implement data ingestion, transformation, and storage solutions using AWS Glue, Kinesis, and Kafka . Work with structured and unstructured data to develop efficient data pipelines ...
... Work as an Individual Contributor on new and existing projects with a positive, problem-solving https://jobeax.com/link/rCyzW0NBvdP0uFXm Candidate :- Strong Data Scientist / AI Engineer / Generative AI Engineer profile.- 3+ years of hands-on experience in Data Science, Artificial Intelligence, Machine Learning, Deep Learning, ...
... experience with modern data stack tools (dbt, Looker, etc.) • Machine learning infrastructure and MLOps architecture expertise • Contributions to open-source data infrastructure projects • Published technical articles, conference talks, or thought leadership in data platforms • Expert knowledge of data privacy frameworks ...
... large-scale data processing and integration.- Develop automation and data processing scripts using Python or Scala.- Work with structured and semi-structured data from multiple data sources.- Implement and support data orchestration, data quality, and data governance processes.- Integrate streaming data sources and technologies ...