... efficiently: spatial indexing (R-tree / GiST), optimised spatial joins, partitioning, query-plan diagnosis, and geometry simplification - to control runtime and cost.- Big-data and pipeline fluency: Advanced SQL plus distributed processing for large spatial workloads (Spark or Dask), and building reliable, repeatable data pipelines.- ...
Company : Very big MNCRole : GCP Data EngineerExperience : 8 - 15 yrsNotice Period : 30 daysLocation : PAN INDIATech Stack :- GCP data engineer- Pyspark- Dataflow- Dataproc- BigQuery- AirflowKey Responsibilities :- Design, develop, and optimize endtoend data pipelines using PySpark, Dataflow, and Dataproc- Implement data ingestion, ...
... Balance client delivery with pursuit and capability commitments in a lean, growth-stage team. SKILLS AND ATTRIBUTES FOR SUCCESS - Consulting judgement: structures ambiguous problems, forms hypotheses, makes evidence-based recommendations and knows when to escalate. - Dual capability: can lead both a learning design conversation ...
... Azure Data Factory (ADF) solutions, leveraging knowledge of Databricks . Design, develop, and maintain data pipelines. Work on data ingestion frameworks and data transformation frameworks . Utilize expertise in the Azure platform, Big Data, and Cloud technologies . Implement and manage data solutions using Snowflake . ...
... hands-on expertise in Databricks, PySpark, Python, SQL, and big data processing . The ideal candidate will have proven experience designing and developing scalable data ingestion pipelines, analytical data models, and high-performance data solutions. Experience with Microsoft Fabric, Azure Data Factory, DataOps practices, and ...
... Science, Engineering, or a related field. - Over 5 years of software development experience, with at least 2 years in a technical leadership role overseeing data engineering or data platform teams. - Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka. - Experience ...
... https://jobeax.com/link/qD1PXku8V3HtzrrZ :- Experience: 5+ years in data engineering, with deep data warehousing exposure at scale.- SQL and BigQuery: Expert-level SQL; hands-on BigQuery optimization (partitioning, clustering, slots, cost).- Data Modelling: Programming: Production-grade Python; PySpark on Dataproc (or Databricks/EMR equivalents).- ...
... similar programming languages.- Expert-level experience with big data technologies such as Hadoop, Spark, Hive, Delta Lake, Iceberg, HBase.- Advanced knowledge of data governance, data quality management, metadata management, data lineage, master data management.- Advanced understanding of data security principles, encryption, ...
... debugging, and system diagnostics - Familiarity with cloud-based infrastructure (e.g., AWS, Azure, GCP). - Experience with APIs, web technologies, networking and databases (e.g., SQL). - Working knowledge of the architecture and tools relevant to implementation of Jamf products. - Basic scripting or coding knowledge (e.g., ...
... programming skills in Python, R or similar languages. - Experience with biological/clinical datasets and computational analysis. - Understanding of statistics, databases, data pipelines and biological data interpretation. - Familiarity with genomics, transcriptomics, proteomics, metabolomics or other omics data is an advantage. ...
...Job Title: Spanish Teacher (PYP, MYP, DP) Location: Bloomingdale International School Reports To: Head of School (HOS) Job Summary: The Spanish Teacher will be responsible for delivering engaging and effective Spanish language instruction across the Primary...
8+ years of hands-on experience in data architecture or data engineering, including at least 4 years focused on the Microsoft/Azure data ecosystem - 3+ years of hands-on experience with Power BI semantic model design, including Tabular models, DAX, and dataset performance tuning - 1+ years of hands-on experience with Microsoft ...
... experience in the Big Data Ecosystem. Design, implement, and optimize highly performant data pipelines using Spark, Scala/Java, and Hive on platforms like Cloudera Data Platform (CDP) or other Hadoop echo systems. Take complete ownership of complex data engineering projects within the big data ecosystem, covering the entire lifecycle ...
... maintaining CI/CD pipelines.- Strong working experience with OpenShift.- Understanding of Kubernetes and container technologies.- Experience with Hadoop ecosystem / Big Data platforms.- Good knowledge of Linux/Unix environments.- Experience with scripting/automation such as Shell/Bash, Python, or similar.- Experience with Git ...
... and contribute to strategic decisions on platform evolution, including generative AI integration and event-driven systems. Data Science and Machine Learning - Data Science and Machine Learning - Python Database - Database Programming - SQL Big Data - Big Data - Pyspark Data & AI - Data Engineering - Data Quality & Validation ...