2,048 pyspark developer jobs in India.

... stakeholders to ensure reliable, high-quality data across our https://jobeax.com/link/Ss9gtuI3ubgFfQht :- Design and develop robust ETL/ELT pipelines using PySpark and SQL for large-scale data processing.- Build, manage, and optimise data workflows on Databricks, including notebooks, jobs, and cluster configurations.- ...

Data Scientist - Agentic AI Developer Req number: R8813 Employment type: Full time Worksite flexibility: Remote Who we are CAI is a global services firm with over 9000 associates worldwide and a yearly revenue of $1.3 billion. We have over 40 years of excellence in uniting talent and technology to power the possible for ...

... platforms, AI solutions and enterprise software for clients across India, the USA, the UK, the Middle East and Singapore. The Role We’re looking for a Databricks Developer with 2-4 years of experience, who has worked with advertising and campaign data. You will build and maintain the pipelines that bring in data from Meta and ...

Role : Azure Data EngineerExperience : 5.5 - 8.5 YearsMandatory Skills : - Python- PySpark- Databricks- Azure Services - ADLS, Azure Data Factory (ADF), Azure Databricks (ADB)- Advanced SQLKey Responsibilities : - Design, develop, and maintain scalable ETL/ELT data pipelines.- Ensure data quality, reliability, and timely ...

... help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Risk Consulting – SQL & ETL Developer - Staff: At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your ...

... monitoring, reconciliation, and anomaly detection capabilities. Leadership & Mentorship - Establish development standards and governance policies. - Mentor ETL Developers and ETL Analysts. - Participate in hiring, technical assessments, and onboarding. Additional Technical Skills (Senior ETL Developer) Required - 7+ years of ...

... Ensure to complete the assigned development tasks within the deadlines Work in compliance with coding standards and best practices Provide assistance to Junior Developers when needed. Perform code reviews and recommend improvements. Review business requirements and recommend changes to develop reliable applications. Develop ...

... and Apache Spark.- Build and optimize ETL/ELT workflows for processing structured and semi-structured data.- Develop data transformation logic using Python, PySpark, and SQL.- Implement data ingestion, cleansing, transformation, and integration processes.- Work with the Lakehouse architecture and Delta Lake for reliable ...

Job Description We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

Job Description Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team. As a Data Engineer III - Databricks, Pyspark, Python, AWS at JPMorgan Chase within the Commercial & Investment Bank, you'll serve as a seasoned member of an agile team to design and deliver trusted data ...

... resources. - A degree in computer science or a similar field, with between 3-7 years of practical experience. - At least 1-3 years of hands-on experience as a developer/designer, specifically with Databricks PySpark and Azure Synapse. - Strong ability to solve complex problems at scale. - Experience in integrating systems ...

Job Opening : Python / PySpark DeveloperExperience : 6 - 9 YearsLocation : Pune | Chennai | BengaluruKey Skills : - Strong hands-on experience in Python- Strong expertise in PySpark- Excellent knowledge of SQL- Experience in data processing, transformation and large-scale datasets- Good understanding of data pipelines and ...

Job Title: AWS Big Data Engineer About the Role: We are looking for a highly skilled AWS Big Data Engineer with extensive experience in PySpark, SQL, Spark, and Airflow. The ideal candidate will have a strong background in coding and a deep understanding of big data technologies. You will be responsible for designing, developing, ...

... database-based processing into Databricks. - Perform unit testing and source-to-target data reconciliation for migrated pipelines. - Investigate and resolve data, SQL, PySpark and pipeline execution issues. - Support integration testing, regression testing, UAT and production validation. - Work with senior developers and technical ...

... Factory, and Azure Functions.- 5+ years of hands-on experience with Azure and Big Data technologies, including Fabric, Databricks, Python, SQL, ADLS/Blob Storage, PySpark, and Spark SQL.- 3+ years of experience working with RDBMS technologies.- Proficiency with developer tools such as Azure DevOps, Git, and Visual Studio Team ...

... automated unit/integration tests, code reviews, and CI/CD to promote changes safely across environments. - Develop transformations on Databricks using Python/PySpark and Spark SQL; optimize jobs for performance and cost (partitioning, file sizing, caching, tuning). - Write and optimize complex SQL for analysis, transformations, ...

... Texas, Galaxy is building a multi-gigawatt pipeline of more than 5.7 GW of potential capacity, positioning it among the largest and fastest-growing data center developers in North America. The Company is headquartered in New York City, with offices across North America, Europe, the Middle East, and Asia. Additional information ...

Who We Are: Headquartered in New York City, Take-Two Interactive Software, Inc. is a leading developer, publisher, and marketer of interactive entertainment for consumers around the globe. We develop and publish products principally through Rockstar Games, 2K, and Zynga. Our strategy is to create hit entertainment experiences, ...

... generative AI into core workflows (responsibly) to improve speed and quality of delivery, including accelerating prototyping and experimentation; improving developer productivity (code generation/refactoring with strong review and testing discipline); producing high-quality model documentation and artifacts (assumptions, ...

Key Responsibilities :- Design, develop, and maintain scalable ETL pipelines using PySpark.- Build robust data ingestion frameworks for processing data from multiple source systems.- Develop efficient batch and near real-time data processing workflows.- Perform data extraction, transformation, cleansing, validation, and ...