Back to list

Vacancy description

Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) - Tieto Tech Consulting (m/f/d) in Bangalore, भारत

Tietoevry

Bangalore, भारत

Required Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
  • 5+ years of IT experience with5+ years in Data Engineering and Big Data development.
  • Strong hands-on experience with PySpark and Spark-based data processing.
  • Experience developing data pipelines on Cloudera Data Platform (CDP) .
  • Strong knowledge of Apache Iceberg table architecture and data lake concepts.
  • Experience designing and managing workflows using Apache Airflow .
  • Experience with SQL and data modeling techniques.
  • Strong understanding of ETL/ELT development and data transformation frameworks.
  • Experience working with large-scale structured and unstructured datasets.
  • Knowledge of Git, CI/CD pipelines, and DevOps practices.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent communication and collaboration skills.

 

Preferred Qualifications

  • Experience with AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch .
  • Experience building cloud-native data lake and Lakehouse solutions.
  • Strong knowledge of data partitioning, performance tuning, and query optimization.
  • Experience with Kafka or event-driven data processing frameworks.
  • Experience with Java or Python application development.
  • Experience implementing data quality, metadata, and data governance solutions.
  • Healthcare, Medicaid, Claims Processing, or Insurance industry experience.
  • Experience working in Agile development environments.
  • AWS Certification and/or Cloudera Certification preferred.
  • Experience supporting large-scale cloud migration and modernization initiatives.

 

Role Level: Senior Developer / Lead Developer

Experience: 5+ years overall with strong expertise in PySpark, Cloudera CDP, Apache Iceberg, Airflow, and AWS Data Engineering.

At Tieto, we believe in the power of diversity, equity, and inclusion. We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation. Our commitment to openness, trust, and diversity is at the heart of our mission to create digital futures that benefit businesses, societies, and humanity.
Diversity, equity and inclusion | Sustainability | Tieto

Stay alert to recruitment scams:
• Tieto only communicates via @tieto.com email addresses.
• We never ask candidates to pay fees or share financial details during recruitment.
• If you receive a suspicious message claiming to be from Tieto, don't respond — verify it via our official careers site.
• For more information visit  Important Advisory Regarding Recruitment Fraud | Tieto Blog

Similar vacancies

More like this role

... https://jobeax.com/link/qVQYcn8zRo6FsrUo Qualifications:- 8+ years of experience in Data Engineering and Big Data technologies.- Strong expertise in NiFi, Spark/PySpark, Hive SQL, Python, and Airflow.- Good understanding of Hadoop, HDFS, distributed data processing, and ETL best practices.- Hands-on experience with Cloudera Data Engineering (CDE) or similar ...

Pune, भारत

  • Full-time
  • IT
... scalable data pipelines (Python, PySpark) - Work with modern data lakehouse/warehouse tech (Iceberg, Delta Lake, Snowflake, Databricks) - Orchestrate workflows (Airflow) and optimize big data frameworks What you need - Python - ETL - Spark - Snowflake - Databricks - Airflow Good to have - AWS - GCP - Azure - Docker - Kubernetes ...

Bangalore, भारत

TekPioneers - A TekGence Company

Senior Python Engineer - Data Pipelines - Hybrid

  • Hybrid
  • Full-time
... (3.10+), typing, asyncio/concurrency, pandas/Polars, PyArrow, PySpark/Dask/Ray. - Strong SQL and data modeling; Snowflake, Redshift, Iceberg/Delta, dbt. - Strong AWS: Lambda, Step Functions, S3, Glue, EMR, IAM, CloudWatch; IaC (CDK/Terraform). - pytest, packaging (uv/Poetry), CI/CD. - Strongly preferred: RAG, AWS Bedrock, ...

Hyderabad, भारत

  • Full-time
  • Data Analytics
... Analyst or in a similar role, preferably in financial services, regulatory reporting, or liquidity risk. - Demonstrated expertise with Hadoop, Spark including PySpark and Scala Spark, Kafka, and cloud-based data platforms such as AWS S3 and Databricks. - Experience with data modeling tools and techniques. - Experience with ...

Pune, भारत

Match Me Resume Match | Citi

Big Data pyspark developer

  • Full-time
... recommend solutions and improvements - Conduct testing and debugging, utilize script tools, and write basic code for design specifications What you need - Spark - AWS - Data modelling - Hadoop - Kafka - Databricks Good to have - Machine learning - Python - R - Scala Job details - Location: Pune - Experience: 3–5 years - Education: ...

Pune, भारत

BE | BTech | MCA | OR equivalent degree in Computer Science, IT or a related field candidates having 5 to 10 years of experience in Python, PySpark, SQL Unix + Big Data (Hadoop + Hive), Airflow, Datawarehousing, Data https://jobeax.com/link/jJwPeXOR5xzgNWwu skills :- Strong hands-on experience in Python Development.- Extensive ...

Chennai, भारत

... workflows.- Support AI/ML teams by providing reliable, high-quality data https://jobeax.com/link/2rj5p3MqDPmMPA0i Technical Skills : - Programming : Python, SQL, PySpark, Scala- Big Data Technologies : Apache Spark, Hadoop, Kafka- ETL/ELT Tools : Apache Airflow, dbt, Informatica- Cloud Platforms : AWS, Microsoft Azure, GCP- ...

Calcutta, भारत

Schneider Electric

Data Engineer II

  • Full-time

€40 EUR

... reliability, and operational excellence. - Apache Iceberg and Lakehouse concepts - Strong analytical and problem-solving skills. - GitHub and CI/CD practices - AWS Glue, S3, and Redshift - Python, Spark, and PySpark - dbt and SQL - Apache Airflow What's In It For Me? - Work with modern cloud and data technologies. - Gain ...

Bangalore, भारत

  • On-site
  • Full-time
... independently and engage effectively with both technical and non-technical stakeholders. - Master’s degree in Data Science or a related field. - Experience with Airflow or other orchestration tools. - Hands-on experience with Cursor, Copilot, or similar AI-powered developer tools. [{"name": "full_time", "text": "Full time", ...

Hyderabad, भारत

  • IT

$80 USD

... greatness. To learn more about Zenoti visit: What you'll do • Design, build, and operate batch and incremental ETL/ELT pipelines in Python (Glue Python-shell, PySpark, AWS Batch/Docker, Lambda). • Model curated and Iceberg tables; write and tune Trino/Athena SQL; own partitioning, compaction, and cost/performance of the lake. ...

Hyderabad, भारत