75 Remote spark jobs in India.

... microservices in distributed systems - Proven experience designing and operating large-scale, data-intensive systems involving batch and stream processing (e.g., Spark, Kafka, Airflow or similar) - Deep understanding of system design fundamentals including scalability, fault tolerance, data consistency, and performance optimization ...

... and operating batch and streaming data pipelines - Developing high‑throughput, low‑latency data processing systems - Working within the Databricks and Apache Spark ecosystem to support large‑scale data workloads - Building and maintaining cloud‑native data solutions on AWS - Using dbt for data transformation, modelling, ...

... databases. Desirable: - Databricks Platform: Experience with Databricks for big data processing and machine learning. - Distributed Computing: Experience with Spark or other distributed computing frameworks. - AutoML Tools: Understanding of tools like AWS Sagemaker, Databricks AutoML and IBM AutoAI. - Telematics Data Analytics: ...

... Engineer Senior Consultant to join our team in Bangalore, Karntaka (IN-KA), India (IN). Cloud Data Engineer with 5 to 10 years exp Strong hands-on experience in Spark + Scala Experience with AWS Glue Working knowledge of Snowflake Strong SQL and coding fundamentals Experience in data migration projects Exposure to on-prem ...

... Access to resources, tools and talent to help your content stand out Be part of a brand that celebrates originality, energy, and connection Competitive salary If you're someone who's constantly creating, scrolling, filming and dreaming of what's next—we're ready to meet you. Apply now and bring your creative spark to life.

... microservices in distributed systems - Proven experience designing and operating large-scale, data-intensive systems involving batch and stream processing (e.g., Spark, Kafka, Airflow or similar) - Deep understanding of system design fundamentals including scalability, fault tolerance, data consistency, and performance optimization ...

... reached production or client delivery - Sound statistical modeling (survey stats, causal inference, experimental design, propensity/uplift) - comfortable in a Spark / Snowflake environment - Strong Python (pandas, scikit-learn, statsmodels) and SQL against large databases - Degree in a quantitative field (Statistics, Data ...

... Certified Data Engineer – Associate, AWS Certified Machine Learning, or AWS Certified Solutions Architect. Strong hands-on experience with Databricks and the Spark/Delta Lake ecosystem. Working knowledge of Anthropic's Claude and the broader LLM/agentic-AI landscape — practical experience building with the Claude API, prompt ...

... including partitioning, clustering, and time-series queries; - Hands-on experience with Cloud Composer (Apache Airflow) ; - Working knowledge of Dataproc (Apache Spark) ; - Experience with Git for versioning and collaboration; - Familiarity with REST APIs ; - Familiarity with GCP technologies including Cloud Storage, Pub/Sub, ...

... development workflows and engineering toolsets - 1.5+ years of experience with Golang - 1.5+ years of experience with Protobuf - 1.5+ years of experience with Apache Spark (mainly PySpark) - Exposure to Airflow, Elasticsearch, Kafka, Parquet #LI-FS1 A note on AI in our process: Abnormal AI uses AI-assisted tools to help our recruiting ...

... (minimum 3 years in Microsoft technologies). - Strong expertise in Microsoft Fabric, Azure Synapse Analytics, Databricks, Power BI. - Proficiency in SQL, T-SQL, Spark SQL, Python/Scala, DAX, Power Query (M). - Experience with real-time streaming (Event Hubs/Kafka) and batch processing. - In addition, specific skills/experience ...

Data Engineer – Databricks Experience: 7+ Years Work Mode: Remote Shift Timing: 12:30 PM to 9:30 PM IST ~ Databricks, Pyspark, Python, SQL, Microsoft Fabric, Azure Data Factory, DataOps practices, and performance optimization We are looking for experienced Data Engineers with strong hands-on expertise in Databricks, PySpark, ...

... like data migration, data lake/data warehouse build, data engineering, data science projects. Hands-on experience in modern cloud data stack (e.g., Databricks, Spark, Python, AWS, Azure, GCP, etc.) Hands-on knowledge of implementation of PM tools and techniques (like Jira, Trello, Zoho projects, Redmine) Experience in managing ...

... understanding of Fabric's end-to-end analytics architecture. Extensive experience with Databricks for building scalable, high-performance data solutions using PySpark, Delta Lake, Unity Catalog, Databricks Workflows, and Structured Streaming. Design, develop, and optimize robust ETL/ELT pipelines to ingest, transform, and ...

... efficiency. - Experience with cloud platforms (AWS, Azure, or GCP) and MLOps for scalable AI deployments. - Proficiency in working with big data technologies (Spark, Hadoop, SQL, NoSQL databases). - Strong problem-solving skills with the ability to translate business challenges into AI-driven solutions. - Knowledge of healthcare ...

... Meta Ads Manager (App Promotion campaigns, AAA/Advantage+, custom and lookalike audiences) and TikTok Ads Manager (App Install objectives, Smart+ campaigns, Spark Ads). - Proven ability to write ad copy and produce creatives and videos yourself — this is a maker role, not a coordinator role. - Demonstrable track record ...

... plus. Knowledge of UNIX development environment and associated tools. Experience in other languages such as Python is a plus. Experience in BigData (Hadoop / Spark / Hive) is a plus. Familiarity with foundational AI concepts and practical experience applying AI-powered coding generation (e.g., OpenAI Codex, GitHub Copilot, ...

... efficiency. - Experience with cloud platforms (AWS, Azure, or GCP) and MLOps for scalable AI deployments. - Proficiency in working with big data technologies (Spark, Hadoop, SQL, NoSQL databases). - Strong problem-solving skills with the ability to translate business challenges into AI-driven solutions. - Knowledge of healthcare ...

... succeed in this role you must have experience in the following: Hands-on experience in Java designing and operating ETL pipelines using tools such as Airflow, Spark, Apache Beam, or AWS Glue. Strong understanding of relational databases, data model design and good knowledge of SQL Strong working knowledge of modern analytical ...

... future of innovation but also your own career path. Join us and start shaping your future today! Mission Statement: Our mission is to fuel today's innovations and spark tomorrow's creativity. Together, we embrace a growth mindset, empower one another, and collaborate to achieve our shared goals. Every day, we live by our values ...