... robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data into trusted curated (silver) and analytics-ready (gold) data layers. Apply schema evolution and data versioning to support agile data development. Platform Integration & Data Ingestion: Connect and ingest data from enterprise ...
... hands-on experience in data science.- Strong proficiency in Python and libraries such as NumPy, pandas, scikit-learn, TensorFlow/PyTorch.- Expertise in SQL for data extraction, transformation, and analysis.- Proven experience with PySpark or distributed data processing frameworks.- Deep understanding of machine learning and ...
... Kinesis.- Modern Data Stack : Design and scale a unified Lakehouse/Warehouse (e.g., Databricks, Snowflake) to handle both streaming telemetry and complex enterprise data (ERP, CRM, MES).- Data Pipelines : Build automated, resilient ETL/ELT workflows using tools like Apache Airflow, dbt, and PySpark to ensure high data quality ...
... strategies. Develop and maintain systems using Python, SQL, PySpark, and Django for front-end development. Work directly with clients and end-users and address their data needs Utilize databases and tools including and not limited to, Postgres, Redshift, Airflow, and MongoDB to support our data ecosystem. Leverage AI frameworks ...
... in shared data. Lead data governance and compliance activities - Support the implementation of data governance policies, standards, and practices across the data platform. - Maintain metadata, data lineage, and business classifications — working with tooling such as Microsoft Purview to ensure the data catalogue is accurate ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
Role: Senior Data Scientist Responsible for designing, developing, testing and deploying ML models that can leverage multiple signal sources, to build a personalized user experience Work closely with the business stakeholders to identify the potential Data science applications Contribute by doing opportunity analysis, building ...
... requirements and technical execution, ensuring high-quality solution delivery Mentor junior scientists on coding standards, experimental design, and model ethics Audit data quality and process integrity across the entire modelling lifecycle Mentor and guide junior data scientist Stay updated with the latest trends in data science ...
... (completed or semi-qualified ) will be an added advantage. - Familiarity with ERP systems such as Oracle, NetSuite, or similar platforms. - Strong proficiency in MS Excel, including pivot tables and advanced data handling. - Exposure to NetSuite would be beneficial for improving financial reporting processes. High attention to ...
... more project and delivery focused environment. To be successful as a Data Analyst, you should have experience with: Assimilating and analysing large / complex datasets, while able to demonstrate numeracy and an excellent eye for detail, especially financial and project data Ability / instinct to intuit & address data anomalies, ...
... build, and optimize high-throughput data pipelines using Python, R, and PostgreSQL to handle market and execution data. - Build and manage robust, scheduled data workflows using tools like Airflow/Dagster to ensure 24/7 data availability for global markets. - Monitor pipeline health, debug data discrepancies in logs, and ...
... Excel reports and maintaining documents • Coordination with vendors and internal departments Requirements: • Graduate or diploma holder • Good knowledge of MS Excel, email and data entry • Good communication and follow-up skills • Freshers and experienced candidates may apply Job Requirements: Data Entry, ERP, MS Excel, ...
... documentation for data enablement & quality processes. - Liaise closely with Labcorp Data Insight colleagues to ensure feedback loops are in place around any data issues. - Assist in the development and implementation of Data Quality initiatives, including data quality checks, data cleaning, data enrichment, and normalization ...
... helping enterprises solve complex data, AI and cloud transformation challenges. Founded in 1991, Impetus has grown into a global engineering organization serving data-driven enterprises and Fortune 100/500 clients. Its capabilities span cloud engineering, data engineering, enterprise AI, application modernization, DevOps and ...
... algorithm design.- Familiarity with cloud-based solutions (AWS Sagemaker, GCP AI Platform, or similar).Soft Skills :- Strong analytical and problem-solving mindset.- Excellent communication skills to articulate data-driven insights.- A passion for innovation and staying up-to-date with the latest trends in AI/ML.Global Recognitions ...
... our clients receive seamless, optimized, and secure cloud https://jobeax.com/link/f7cnnjsAzvrL3710 Leadership :- Deep technical understanding of any cloud or data platform (Azure, AWS, Google Cloud, Snowflake, Databricks).- Hands on experience with & Operational Excellence :- Establish, track, and report on client-facing ...
... secure and high performance data platforms and architectures Lead the development of batch and real time data processing solutions using modern cloud and big data technologies Define data engineering standards best practices and governance frameworks Drive architectural decisions for data lakes lakehouses data warehouses ...
Must-Have Skills :- 9+ years of relevant experience in Data Engineering and project delivery.- Strong expertise in Big Data concepts and cloud implementation projects.- Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).- Excellent hands-on experience with Python, PySpark, and ...