Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Data Engineering Minimum 5 ...
... data architecture, cloud platform design, or equivalent data-platform architecture.- Distributed Computing: 10+ years of experience working with distributed data processing or modern cloud data platforms, with strong hands-on exposure to Databricks, Spark, Snowflake, or equivalent technologies.- Data Architecture: Strong ...
... Kinesis, FireHose, Lambda, and IAM roles and permissions Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases) Experience with dbt (data build tool) for transformation layer management and semantic modeling. Familiarity with data lakehouse ...
... constructive feedback. Ensure continuous professional development of team members. Qualifications Educational qualifications & Experience: Bachelor's degree in computer science, Information Security, or related field. 10–12 years of experience in data loss prevention, data discovery/classification, and database/data security. ...
Data & AI ArchitectLocation: Hyderabad / Bangalore / PuneKey Technologies:Databricks | Microsoft Fabric | GenAI | LLM | RAG | PySpark | Data Lake | Lakehouse | Data Warehouse | Data ModellingRole Overview :We are looking for an experienced Data & AI Architect to design and lead enterprise - scale Data and AI architectures. ...
... Performance Tuning Spark Performance Optimization Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field. - 2–3 years of experience in Data Engineering, NLP Engineering, or AI Data Processing. - Experience working with large-scale datasets and distributed computing frameworks.
... disruptions of the future. We are looking forward to hire Azure Data Lake (ADL) Professionals in the following areas : Role - Azure Data Engineer Azure Data Lake, Data Factory, Pipelines, Synapse (mandatory) SQL, Python, PySpark / Spark-SQL Web tech, relational DBs, data warehousing, ETL design Microsoft Certified Data Engineer ...
... Integration: Build and manage data pipelines to ingest data from various sources, including third-party and RESTful APIs. Build ETL/ELT processes using ADF, Fabric Data Flows , and Notebooks. Embed MDM solutions into pipelines, ensuring seamless data sync across systems. Data Storage and Management: Design and implement data ...
... financial services. - Experience with Azure Data Factory, Azure Blob Storage, and Azure Functions. - Familiarity with document processing pipelines (PDF parsing, OCR, text extraction). - Bachelor’s degree in computer science, engineering, or equivalent. - Detail-oriented with strong debugging and problem-solving skills.
Maxgen Technologies Pvt ltd is an it company based in Ahmedabad Gujarat .Engineering and IT freshers will get data analyst internship and power bi program. What Services we are offering Online or offline program. live project in internship. hybrid mode internship. college project for interns.
... Automate data workflows and pipeline operations using orchestration and scheduling tools Monitor pipeline health, proactively identify issues, and troubleshoot data quality or performance problems Optimize data processing workloads for performance, reliability, and cost efficiency Bachelor's degree in Computer Science, Engineering, ...
... quickly. Collaboration – Work closely with the lead engineer, QA, and reporting teams to validate metrics and resolve data quality issues. Bachelor’s degree in computer science, Engineering, Information Systems, or related field - 6+ years of hands-on data engineering experience, with Azure Databricks and Azure Data Lake - ...
... in end-to-end data transformation and pipeline development Detailed Job Description Mandatory Technical Skills: Snowflake Data Warehouse Python Scripting DBT (Data Build Tool) Apache Airflow Advanced SQL End-to-End ETL/ELT & Data Pipeline Development Key Requirements Strong hands-on experience in Snowflake data warehousing ...
... platform capabilities, including APIs, data services, and integrations, while working within Agile and DevOps methodologies. - Document solution architecture, data lineage, business logic, KPI definitions, and operational procedures to support long-term maintainability and governance. Bachelor's degree in computer science, ...
... exposure to these technologies. ⚠️ If Databricks is not a core part of your recent hands-on experience, this role may not be the right fit. Job Title: Senior Data Engineer Specialization: Data Engineering | Databricks | Lakehouse | Data Platforms | AI-Ready Data Experience: 5+ Years Location: BNG | HYD | PUN | MUM | GGN ...
... degree in an analytical field (e. g. Computer Science, Engineering, Mathematics, Statistics, Operations Research, Management Science). 3+ years of experience with data analysis and metrics development. - 3+ years of experience analyzing and interpreting data, drawing conclusions, defining recommended actions, and reporting results ...
... . Good team player . Interest in technologies and innovation . Knowledge of formalisation and communication tools (MS Office - MS SharePoint) . Knowledge of statistical and datamining techniques (SAS, SPSS, VBA, ACCES) or SQL database languages . Proficient in English . Perfectly at ease in a multi-cultural environment
... and maintain scalable data pipelines for data processing and transformation Build and manage workflow orchestration using Apache Airflow Develop and maintain data models and transformations using dbt Work with BigQuery or similar cloud data warehouses for data storage and querying Manage and interact with cloud object storage ...
... quality, and observability. Build data pipelines: Develop robust batch and streaming pipelines (Kafka/Kinesis) to ingest, transform, and enrich large-scale event data (impressions, clicks, conversions, costs, identity signals). - Create data aggregates & marts: Data modeling & contracts: Define schemas, data contracts, and ...