Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Data Engineering Minimum 5 ...
... bridge high-level data strategy with hands-on engineering. The role will own the design, architecture, governance, and technical direction of enterprise-grade data platforms using modern cloud and distributed-computing technologies. The ideal candidate will bring deep experience in Azure data architecture, Databricks/Snowflake, ...
... data lineage. Optimize table structures and query patterns for fast, cost-efficient access by AI systems generating SQL from natural language. Mentor junior Data Engineers on pipeline design patterns, code review standards, and operational best practices. Bachelor's degree 3+ years of data engineering experience. Experience ...
... Qualifications Educational qualifications & Experience: Bachelor's degree in computer science, Information Security, or related field. 10–12 years of experience in data loss prevention, data discovery/classification, and database/data security. Experience with DSPM tools and integration in hybrid environments. Familiarity with ...
... in Databricks and modern data engineering architecture.- Hands - on experience with Microsoft Fabric and modern analytics platforms.- Strong understanding of Data Lakes, Lakehouse and Data Warehouse architectures.- Expertise in PySpark and scalable distributed data processing.- Experience designing GenAI, LLM and RAG - ...
... Performance Tuning Spark Performance Optimization Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field. - 2–3 years of experience in Data Engineering, NLP Engineering, or AI Data Processing. - Experience working with large-scale datasets and distributed computing frameworks.
... disruptions of the future. We are looking forward to hire Azure Data Lake (ADL) Professionals in the following areas : Role - Azure Data Engineer Azure Data Lake, Data Factory, Pipelines, Synapse (mandatory) SQL, Python, PySpark / Spark-SQL Web tech, relational DBs, data warehousing, ETL design Microsoft Certified Data Engineer ...
... You'll work at the intersection of engineering and real business impact, turning raw data into something reliable, fast, and meaningful. Key Responsibilities: Data Architecture and Design: Design scalable, reliable, and secure data solutions that meet real business needs Develop data models, data flows, and integration architectures ...
... pipeline performance and cost: right-size compute clusters, implement incremental processing, manage storage lifecycle. Qualifications and experience - 5–8 years of data engineering experience, with at least 2 years on Databricks or equivalent Spark-based platforms. - Strong proficiency in Python, SQL, PySpark, and Delta Live ...
Maxgen Technologies Pvt ltd is an it company based in Ahmedabad Gujarat .Engineering and IT freshers will get data analyst internship and power bi program. What Services we are offering Online or offline program. live project in internship. hybrid mode internship. college project for interns.
... on developing Senior Data Engineer- Implementation & Modernization The Data Engineer is responsible for building and optimizing high-performance, large-scaled data solutions on modern cloud platforms. This role focuses on developing data engineering pipelines, working closely with the Cloud Solution Architects who defines ...
... – Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues. Bachelor’s degree in computer science, Engineering, Information Systems, or related field - 6+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake - Proficiency in PySpark, ...
... Expertise in developing data transformation pipelines using DBT . Experience building and maintaining workflows using Apache Airflow . Proficiency in Python for data engineering and automation. Experience designing, developing, and supporting end-to-end data pipelines . Strong understanding of data modelling, data quality, ...
... self-service analytics. - Collaborate with Product, Engineering, Operations, and business stakeholders to define, implement, and maintain meaningful KPIs, metrics, and data products that support decision-making. - Build and execute large-scale data migration solutions for transferring historical and operational data from source systems ...
Senior Data Engineer - Databricks | PySpark | dbt | Lakehouse Engineering ⚠️ This is NOT a typical Data Engineering position. We are looking for a hands-on Senior Data Engineer with strong, production-grade Databricks experience - someone who has actually built and optimized Lakehouse/Medallion architectures, PySpark & ...
... degree in an analytical field (e. g. Computer Science, Engineering, Mathematics, Statistics, Operations Research, Management Science). 3+ years of experience with data analysis and metrics development. - 3+ years of experience analyzing and interpreting data, drawing conclusions, defining recommended actions, and reporting results ...
Key Responsibilities : Work in an Agile/SCRUM environment with a seasoned data engineering team. Design, develop, test, and debug large-scale data infrastructure. Build and migrate to a modern Data Lake & ETL infrastructure . Develop data APIs and delivery services for operational and analytical applications. Drive automation ...
... . Good team player . Interest in technologies and innovation . Knowledge of formalisation and communication tools (MS Office - MS SharePoint) . Knowledge of statistical and datamining techniques (SAS, SPSS, VBA, ACCES) or SQL database languages . Proficient in English . Perfectly at ease in a multi-cultural environment
... ETL/ELT patterns for efficient data ingestion and processing Apply advanced SQL for data querying, transformation, and analysis Collaborate with analytics and engineering teams to support data-driven decision making Ensure data quality, reliability, and performance across data pipelines Apply analytics engineering best practices ...
... including event-driven designs. - Proficiency in one or more languages used for data engineering (Python, Java, Scala, or Go). - Experience with distributed data processing (Spark, Flink, or equivalent) and performance tuning at scale. - Experience with AWS data services and cloud-native patterns (S3, Glue/EMR, Athena, ...