... processing jobs, queries, and pipelines for performance and scalability.- Perform data validation, quality checks, and troubleshooting of pipeline failures.- Monitor data pipelines and resolve issues across development and production environments.- Collaborate with data scientists, analysts, and technology teams to deliver ...
... services. Ensure quality, security, observability, and CI/CD. Collaborate closely with customer teams, product, UX, data, and architecture. Prepare Gen AI-compatible datasets: manage vector embeddings, index with Databricks Vector Search, and use Feature Store with ML flow. Package and deploy pipelines using Databricks Asset Bundles ...
... Develop and maintain data models, data warehouses, and data lakes. Ensure data quality, consistency, accuracy, and reliability across data pipelines. Optimize data processing workflows for performance, scalability, and cost efficiency. Work with large and complex datasets from multiple sources. Collaborate with Data Scientists ...
... debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, and production deployments. Understanding of Medallion Architecture, data modeling, data quality, and ...
... cross-organizational and cross-divisional projects automating our data value chain processes Promoting technical best practices throughout the data organization Design data architecture that is simple and maintainable while enabling Data Analysts, Data Scientists, and stakeholders to efficiently work with data. Mentor data team members ...
... with data scientists and analysts to understand data needs and provide necessary data solutions. Monitor and optimize data pipelines for performance and reliability. Professional & Technical Skills: Must To Have Skills: Proficiency in Python (Programming Language). Strong understanding of data structures and algorithms. Experience ...
... language development experience. - Knowledge of advanced level capabilities in SQL and relational databases experience. - Solid working knowledge of ETL (ELT), Data modeling, DataQuality, and Data Visualization/Dashboarding. - Experience with data processing performance tuning and optimization. - Experience with logging specifications ...
... Support Engineer to join our data engineering team. The role involves supporting, monitoring, and troubleshooting data pipelines and ETL processes, ensuring data reliability and smooth operations across Snowflake-based data https://jobeax.com/link/tlplQAnK5B36KMXq Responsibilities :- Monitor and support daily data pipeline ...
... are looking for a Senior Data Engineer , based out of Gurgaon/Bangalore who will: Design, develop, and optimize enterprise ETL/ELT pipelines utilizing Azure Data Factory, Azure Data Lake Storage, and advanced serverless technologies—ensuring cross-platform scalability, security, and reliability. Implement highly efficient, ...
Design and implement data pipelines for supply chain data (e.g., inventory, shipping, procurement). - Develop and maintain data warehouses and data lakes. - Ensure data quality, integrity, and security. - Develop data models and algorithms for predictive analytics (e.g., Implement data visualization tools (e.g., Tableau, ...
... data engineering, data analysis, or data science-oriented work based on skills and project needs. Gather and support delivery work - Work on real-world projects with guidance from experienced developers and analysts. - Support data science tasks such as exploratory analysis, feature preparation, hypothesis testing, and pattern ...
... cross-organizational and cross-divisional projects automating our data value chain processes Promoting technical best practices throughout the data organization Design data architecture that is simple and maintainable while enabling Data Analysts, Data Scientists, and stakeholders to efficiently work with data. Mentor data team members ...
... sources Build and maintain SQL data lake storage so historical and change data stays available for analysis Automate recurring data jobs (e.g., via Rundeck) and monitor them for failures and data anomalies Use AI tools to accelerate pipeline development, script writing, and troubleshooting, and look for opportunities to automate ...
... extraction, transformation, and loading (ETL) of data. Your responsibilities will include: - Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms. - Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval ...
... foundational models and APIs (e.g. OpenAI, Claude, LangChain, Spring AI, etc.) - Experience of MCP server implementation - Demonstrated strong team leadership and ability in written and oral communication skills, along with strong presentation skills. Ability to determine the information and communication needs of the stakeholders ...
... data architecture principles and best practices for data quality assurance. Familiarity with cloud-based data platforms and distributed computing frameworks. Ability to troubleshoot complex data issues and optimize data workflows for performance. Experience working with diverse data sources and formats to support data integration. ...
... Rotational Night Shifts Perks & Benefits Both-way cab facility (Up to 25 km) Attractive Variable Pay Corporate Benefits Excellent Career Growth Opportunities Work with a leading global organization Interview Process : Virtual Interview Easy Selection Process Spot Offer for Selected Candidates Immediate Joining Opportunities ...
... behind your own feature. Ability to debug across the browser, network, and service boundary. Sound problem-solving and data structures fundamentals. Accountability for code you did not write by hand, including code produced with AI assistance. Preferred Experience Experience with micro-frontend architecture, module federation, ...
... corporation that provides IT Consulting & Staffing services. Our services are used by world's largest consulting & fortune 500 companies worldwide. 4Ci in affiliation with its Indian subsidiary (CFACT India) has set up its second offshore recruiting center in India. We have a need to hire several individuals for this facility. Our ...
... for a self-driven Recruiter who can deliver consistent results. The ideal candidate will have strong sourcing skills and deep knowledge of filtering and recruiting talent across SFDC, SAP, Oracle, Full Stack, and Database technologies is preferred. This role requires a long-term commitment and a results-oriented mindset. ...