2,458 big data jobs in India.

• Remote

10k - 33k

... or Azure environments Python & scripting for automation and data processing Data streaming technologies (Kafka, Spark, Flink) Big Data platforms (Snowflake, Databricks, Hadoop, Teradata) Exposure to AI/ML and advanced analytics Experience with NoSQL databases Ability to design scalable and maintainable data architectures. ...

Company : Very big MNCRole : GCP Data EngineerExperience : 8 - 15 yrsNotice Period : 30 daysLocation : PAN INDIATech Stack :- GCP data engineer- Pyspark- Dataflow- Dataproc- BigQuery- AirflowKey Responsibilities :- Design, develop, and optimize endtoend data pipelines using PySpark, Dataflow, and Dataproc- Implement data ingestion, ...

• Remote
• Contract

... efficiently: spatial indexing (R-tree / GiST), optimised spatial joins, partitioning, query-plan diagnosis, and geometry simplification - to control runtime and cost.- Big-data and pipeline fluency: Advanced SQL plus distributed processing for large spatial workloads (Spark or Dask), and building reliable, repeatable data pipelines.- ...

... you like to innovate and simplify If yes, then you may be a great fit to join the Machine Learning team for International Consumer Businesses. Machine Learning, Big Data and related quantitative sciences have been strategic to Amazon from the early years. Amazon has been a pioneer in areas such as recommendation engines, ...

... microservices using Django.- Design and implement scalable and secure APIs.- Integrate Azure Cloud services for application deployment and management.- Utilize Azure Databricks for big data processing and analytics.- Implement data processing pipelines using PySpark.- Collaborate with front-end developers, product managers, and ...

... Science, Engineering, or a related field.​ - Over 5 years of software development experience, with at least 2 years in a technical leadership role overseeing data engineering or data platform teams.​ - Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka.​ - Experience ...

Job Description: As a Lead Big Data Developer , you will drive technical excellence across the Airbus Skywise ecosystem (built on the Big Data Apache Spark framework/Lightweight architecture). You will be responsible for defining technical standards, establishing best practices, and enforcing 'Golden Rules' across the codebase. ...

... TensorFlow, PyTorch, Scikit-learn, XGBoost, etc).- Solid understanding of deep learning, NLP, computer vision, recommender systems or generative AI.- Knowledge of big data technologies (Spark, Hadoop) and cloud platforms (AWS, GCP, Azure).- Familiarity with MLOps tools (MLflow, Kubeflow, Airflow, Docker, Kubernetes).- Experience ...

... working with big data and ETL development 3-5 years of experience in big data analytics technologies like Spark/Spark streaming, , Kafka streaming, Elasticsearch, Bigquery etc. Extensive years of experience in RDMBS/ NoSQL databases, Enterprise Messaging Application (Kafka) and Big data (Spark) Hands-on experience in designing ...

• Hybrid

... Knowledge of process simulation, optimization, or operations research methods. - Exposure to big data frameworks (Spark, Databricks) for handling large-scale event data. - Ability to actively engage in professional communities and forums to share insights and collaborate on advancements in data science and analytics. - Experience ...

... Experience with containerization technologies (e.g., Docker, Kubernetes) - Experience with CI/CD pipelines and DevOps methodologies. - ETL or ELT: Azure Data Factory, Databricks, Synapse, dbt (any two – Mandatory). Data Warehousing: Azure SQL Server/Redshift/Big Query/Databricks/Snowflake (Anyone - Mandatory). Data Visualization: ...

• Full-time

... frameworks for building scalable data pipelines. Understanding of Big Data architectures, data storage, and data processing concepts. Familiarity with cloud-native data storage solutions such as S3, Blob Storage, BigQuery, or Redshift. Experience with data orchestration tools like Apache Airflow or similar. Knowledge of data ...

• Remote

Tiger Analytics is a fast-growing AI and advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and Big Data. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. We are working to build one of the ...

... consulting and technology https://jobeax.com/link/TpxqtJEXT9DMtOII a laggard in analytical maturity, the Pharma industry had been facing challenges to adapt to a Big Data https://jobeax.com/link/tMHdCUO15sfZQRWH saw that the products offered by technology companies were too rigid and generic to handle novel https://jobeax.com/link/liejRWNsfOC9BlfN ...

... workflows Strong analytical problem solving and debugging skills Additional Responsibilities: Experience with cloud platforms AWS Azure or GCP Familiarity with big data technologies Spark Hadoop Exposure to workflow schedulers Airflow Prefect Cron Knowledge of CI CD pipelines and version control Git Understanding of data governance ...

... proficiency in Python, Python-spark, shell scripting and SQL, with hands-on experience in building large-scale ETL/ELT pipelines Good to have exposure in the Big Data Ecosystem like Hive, Spark and HDFS Good to have exposure with modern data stack components (Airflow, Iceberg). Strong understanding of APIs, microservices, ...

... Familiarity with big data tools (Spark, Dask, etc.) and version control (Git). - Cloud & Deployment: Demonstrated expertise with Azure cloud services for end-toend data solutions. This includes Azure Machine Learning (for model development and deployment), Azure Data Factory (ETL/ELT pipelines), Azure Databricks (data processing), ...

... Warehouse Architecture Data Lake vs. Data Warehouse Star Schema Snowflake Schema Fact & Dimension Modeling Slowly Changing Dimensions (SCD) Partitioning & Clustering Data Layer Design Data Transformation & Aggregation Data Quality & Governance Big Data & Open-Source Technologies Experience with one or more of the following: Apache ...

• Hybrid
• On-site

... transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies u2022 Develop, maintain and optimize ETLs to increase data accuracy, data stability, data availability and pipeline performance u2022 Strong knowledge in the Big data tools such as AWS Redshift, Hadoop, map reduce etc. ...

Job Responsibilities :- Hands on (Full Stack) SaaS application design and development concentrating on Artificial intelligence using big data technologies.- Facilitate solution efficiencies, scalability and technology stack leadership.- Ensure fool proof and robust applications through unit tests and other quality control ...