... age AWS stack (S3, EMR, Redshift) or traditional BI & DW with interest in data mining and ability to sieve emerging patterns and trends from large amount of data. Data Engineer should have strong experience with all standard data warehousing technical components (e.g. ETL, Reporting, and Data Modeling), infrastructure ...
Databricks Engineer Location - Remote Data & AI Platform Engineering (Databricks-Centric): Design, implement, and optimize end-to-end data pipelines on Databricks, following the Medallion Architecture principles. Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake to transform raw (bronze) data ...
... transformation, and loading of data from a wide variety of data sources using Pyspark, SQL and AWS big data-technologies - Build analytics tools that use the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics - Manipulate data at scale: ...
... software design and development using at least one high level language. . 3+ years of hands-on Python experience with strong proficiency in pandas, numpy, and data pipeline development. Experience with real-time or streaming data processing is Integration of Python with KDB+/q will be an added advantage. training on KDB+/q ...
... redefine the future of how work gets done. Senior Data Engineer At Snowflake, we are building the future of the data-driven enterprise. We are looking for a Senior Data Engineer who brings deep technical craft, strong ownership instincts, and the ability to operate across the full data lifecycle — from raw ingestion to production-ready ...
... documentation carrying the quality bar between reviews. Stack: Python, PostgreSQL, Django, server-rendered frontend (htmx). What You Will Own Core Responsibilities / Engineering Focus Deep third-party data ingestion Build reliable ingestion pipelines for external data sources Account for silently dropped webhooks through reconciliation ...
... AWS cloud services like Glue, Athena etc. Bachelor's or Master's degree in Computer Science/Information Systems. At least 4+ years of experience in building data flow and data management on a modern big data tech stack. Strong experience in using ETL frameworks (e. g., Airflow, Jenkins) to build and deploy production-quality ...
Role Description For Data engineers Experience 4 to 12 years Mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL Knowledge Mandatory to have knowledge on any ETL Tool ONLY amongst Talend Datastage Informatica ISS Cloud version Data Fusion Data Flow Data Proc Mandatory SQL PLSQL Scripting Experience ...
... using the following software/tools :Experience with big data: Hadoop, Map Reduce, Hive, Spark, Kafka, Airflow etc - Experience with relational SQL and NoSQL databases: MySQL, Postgres, MongoDB, HBase, Cassandra etc - Experience with cloud Data platform: AWS, Azure-HDInsight's, GCP, CDP - Experience with real-time data ...
Overview Sr Data Engineer Position Summary We are looking for a self-sufficient BI Analyst / Data Engineer to join a small, high-impact analytics team. In this role you will own the full lifecycle of business intelligence delivery—from building and maintaining ETL pipelines in AWS to designing interactive dashboards in ...
... Engineering, Data Science, or related field. - 8+ years of experience in data engineering and architecture, with a proven track record of leading large-scale data initiatives. - Deep expertise in Python, PySpark. - Strong hands-on experience with Databricks (Spark, Delta Lake, Workflows) - Strong experience with AWS (S3, ...
... platforms, particularly AWS (EC2, RDS, Lambda, S3, CloudWatch) - this is a major plus as we're actively migrating our infrastructure Microsoft Fabric and Azure data platform technologies Power BI for data visualization and business intelligence Playwright or similar end-to-end testing frameworks Redis caching strategies and ...
IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build data pipelines and enable ML models for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all https://jobeax.com/link/82DbHMskdU4qETkp businesses. The ...
... Costco Wholesale. Data Engineer The Data Engineer is responsible for developing data pipelines and/or data integrations of for Costco’s enterprise certified data sets that are used for business critical data consumption use cases (i.e. Reporting, Data Science/Machine Learning, Data APIs, etc.). The Data Engineer will partner ...
... write-back and the ledger reconciliation). Large-scale data / ETL engineering; SQL Server; performance tuning, Graph / vector stores, record linkage; graph and vector databases; SQL Server (incl. large-scale data engineering Nice-to-have. Experience in Legal or party data at scale. Experience. Data migration experience, Min 2 years ...
... university degree in Computer Science, Data Engineering, Information Systems, Software Engineering or a related field. Several years of experience in data engineering, analytics engineering or modern cloud-based data platforms. Strong expertise in Snowflake or comparable cloud data platforms. Strong SQL and data modelling ...
The Team: The Data Engineering team expands and optimizes our data pipeline architecture, working collaboratively with cross-functional teams to build scalable data systems that support next-generation products and analytics initiative. As a Senior Database Engineer, you will directly contribute to the company's data platform, ...
... database systems. Familiarity with public cloud platforms such as GCP, AWS, or Azure Understands Agile principles and methodologies. Strong understanding of database architecture Experience in database design and implementation Knowledge of database backup and recovery procedures Familiarity with database security best ...
... Microservices. - 2+ years of experience with CI/CD pipelines and DevOps practices. - 1+ years of experience using monitoring and code quality tools such as SonarQube, Datadog, AppDynamics, CloudWatch, etc. - 1–2 years of experience leveraging AI-assisted software development tools in day-to-day engineering activities. - AWS Certification ...
... regions. 3+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines - Experience with SQL Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions - Experience with non-relational databases / data stores ...