Data Engineer - Python/PySpark/AWS in Chennai, India - Jobeax
Vacancy description
Data Engineer - Python/PySpark/AWS in Chennai, भारत
Sysmind Tech PVT LTD
Chennai, भारत
Role : Data Engineer Location : ChennaiExperience : 5+ yearsInterview : FridayMust-Have Skills : - Python- PySpark- AWS- SQL- Azure Data Factory (ADF)- dbtKey Responsibilities : - Develop and maintain data pipelines and ETL/ELT processes.- Build data solutions using Python and PySpark.- Work with AWS cloud services for data processing and storage.- Write and optimize SQL queries.- Develop and manage pipelines using ADF.- Build and maintain data transformation workflows using dbt.- Troubleshoot data pipeline and production https://jobeax.com/link/sYU6QJAlyRIwLEOw Candidate : - 5+ years of hands-on experience across Python, PySpark, AWS, SQL, ADF, and dbt. (ref:hirist.tech)
... :- 8+ years of experience in Data Engineering, Big Data, or related technologies.- Strong hands-on experience with Azure Databricks.- Excellent knowledge of PySpark and Apache Spark.- Strong programming experience in Python.- Strong experience developing ETL/ELT data pipelines.- Hands-on experience with Azure Data Lake ...
... data processing applications using Python and PySpark to handle large-scale datasets. - Integrate and manage various AWS data services to support cloud-based data operations and storage requirements. - Create and optimize SQL queries for data extraction, manipulation, and reporting within complex database environments. ...
... 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.- Strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.- Strong expertise in SQL, data warehousing, and database technologies, ...
... Experience : - 6 - 12 years of relevant professional experience, including strong hands-on experience in Azure Data Engineering.- Strong proficiency in Azure Databricks, Python, PySpark and SQL.- Experience with Azure Data Lake Storage (ADLS).- Hands-on experience with Azure Data Factory (ADF) or Databricks Workflows.- ...
Job Title : Azure Data Engineer (Pyspark, Databricks, Delta lake)We are looking for a Data Engineer with 8 - 10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data https://jobeax.com/link/v8qrFLRTZgSSorDg Skills : - Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake- Azure ...
... https://jobeax.com/link/HwwG40NHoRUUleVl with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.Hands-on experience in work with bigdata platforms and related programming languages (https://jobeax.com/link/UVPpUiV6Uuv02TIK, Python, PySpark, GIT, Jenkins).Behavioral Competencies : Business Acumens ...
... looking for a Data Engineer with excellent SQL skills and advanced Python and PySpark along with other required skillsets.- 5 - 7 years of experience as a Data Engineer with extensive working experience using PySpark, Advanced SQL, Snowflake, complex understanding of SQL and Skills, Spark, Snowflake, Glue and Airflow.- AWS ...
... a highly skilled and experienced Senior Data Engineer (AWS/Databricks) with 5+ years of hands-on experience in designing, developing, and optimizing scalable data engineering solutions. The ideal candidate should have strong expertise in Python, SQL, PySpark, AWS, Databricks, ETL/ELT pipelines, and cloud-based data platforms ...
... experienced Data Engineer with strong hands-on expertise in Python, SQL, Spark/PySpark, and geospatial data processing to build and maintain scalable, production-grade data pipelines. The ideal candidate should have experience working with geospatial/spatial data such as latitude/longitude coordinates, GPS/location data, maps, spatial ...
... Responsibilities : - Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.- Build and orchestrate complex, parameterized data pipelines using Azure Data Factory (ADF).- Develop and implement end-to-end data engineering solutions using Azure Data Lakehouse and Medallion Architecture.- ...