... analysis.- Develop data engineering solutions using Python.- Optimize ETL processes for performance, scalability, and reliability.- Monitor and troubleshoot data pipelines and resolve data quality issues.- Implement best practices for data modeling, database design, and data governance.- Collaborate with data scientists, ...
... daysMandatory Skills : - Python- PySpark- SQL- Oracle EBS- Databricks / Azure Data Factory (ADF)Key Responsibilities : - Design and develop scalable data pipelines using Databricks and PySpark.- Develop and optimize complex SQL queries and data processing workflows.- Work with Oracle EBS data structures and support data integration ...
... end-to-end scheduled and event-driven data workflows using AWS Step Functions and AWS Glue Workflows.4. Data Warehousing & Operational Databases : - Enterprise Data Warehousing : Own the architecture, data modeling, and performance tuning in Snowflake to support downstream BI, connected-fleet dashboards, and data science ...
... and translate them into technical data solutions. Ensure data integrity, security, and governance across multiple data sources. Optimize query performance and database architecture for efficiency and scalability. Lead troubleshooting and debugging efforts for data-related issues. Document data workflows, architectures, and ...
... migrations to Databricks from Hadoop ecosystems, Data Warehouses (Teradata, DataStage, Netezza, Ab Initio), ETL engines (Informatica), SAS, SQL, DW, Cloud-based Data platforms like Redshift, Snowflake, EMR, etc.5. Design, Build and Optimize Data Pipelines : - The Databricks implementation will be best in class, with flexibility ...
... Install, configure, and update database software and tools - Monitor and optimize database performance and capacity - Perform backup and recovery operations- Ensure database security and compliance with policies and standards - Diagnose and resolve database issues and errors - Support database development and testing activities ...
Responsibilities : - Development and enhancement of Data Security Products (SASE)- Participate in a complete development life cycle starting with understanding various functional requirements, refine functional specification and develop for high throughput/ low latency requirements.- Influencing the features and direction ...
... organizations unlock the full value of their data. Together, we’re delivering the data infrastructure layer that helps organizations move, transform, and trust their data — from the moment data moves, through every transformation, to the context teams and AI systems rely on. Fivetran helps organizations automate data movement across ...
... Deployment) for automated deployment and testing of data solutions. Collaborate with cross-functional teams to understand data requirements and deliver high-quality data products. Ensure data quality, reliability, and security within the data ecosystem. Skills Required: AWS certification . Proficiency in AWS Big Data Services ...
... Partner with business stakeholders, product managers, and engineering teams to understand business use cases and constraints.- Design and document end-to-end data, aligned with enterprise standards for :1. Data mesh and domain-oriented data products2. DataOps, MLOps, and emerging AgentOps practices3. AI-aligned data patterns ...
... data processing solutions using frameworks such as Apache Beam (Data Flow) and Kafka. Work with GCP services like BigQuery, Dataflow, and Spanner to optimize data pipelines and workflows. Design and model data structures for efficient data storage and retrieval. Oversee ETL processes to ensure seamless data extraction, ...
... https://jobeax.com/link/0a2QmNkVhUZFALjk Candidate will have :- Experience with Agentic AI, Generative AI, LLMs, and prompt engineering.- Experience with big data technology stack (Hadoop, Spark, HDFS, EMR, Glue).- Experience with AWS, Azure or GCP.- Experience with Databricks/SageMaker/DataRobot, MLFlow or other ML and ...
... and forecasting solutions. Perform data cleaning, preprocessing, and feature engineering. Build and optimize data pipelines using Python and SQL. Analyze large datasets to identify trends and business insights. Support model deployment, testing, and performance monitoring. Create dashboards, reports, and data visualizations. ...
... implementation, deployment, and operation. Experience designing large-scale data platforms, data warehouses, or distributed data systems. Deep understanding of database architecture, data modeling, query optimization, indexing, partitioning, and storage systems. Experience with cloud data infrastructure and databases, including ...
... EMR, and other AWS services.- Develop PySpark-based data processing applications for large-scale distributed data workloads.- Write optimized SQL queries for data transformation, analysis, and reporting requirements.- Implement data ingestion frameworks to process data from databases, APIs, files, applications, and other ...
... in Data Science, Computer Science, Statistics, Business Analytics, or related field, or equivalent experience Business Acumen, Collaboration, Communication, Data Analysis, Data-Driven Business Intelligence, Data Visualization, Market/Industry Dynamics, Relationship Management, Statistics, Story Telling _____________________________________________________________________________________________________ ...
... product stack, customer excellence and trust of an established bank. To work on implementing data modeling solutions To design data flow and structure to reduce data redundancy and improving data movement among systems defining a data lineage To work in the Azure Data Warehouse To work with large data volume of data integration ...
... metrics. Manage incoming data requests from global regulators, ensuring data is provided quickly and accurately. Identify trends and anomalies using advanced data analysis techniques and tools. Support financial crime investigations by providing insights from complex datasets. Maintain documentation on the compliance data ...