Back to list

Vacancy description

Infosys - Senior Data Engineer - Python/Big Data in Chennai, भारत

Infosys Limited

Chennai, भारत

Role Overview:We are looking for a highly skilled Data Engineer with expertise in designing, developing, and optimizing enterprise-scale data platforms and pipelines. The ideal candidate should possess strong experience across data engineering, cloud-native architectures, modern data platforms, streaming technologies, and AI-ready data https://jobeax.com/link/QPjeTv1S6Xr8pRox with exposure to AI, Generative AI, DataOps, MLOps, Lakehouse architectures, and Real-Time Analytics will be highly https://jobeax.com/link/evc6pNVFUYDlaokF Responsibilities:Data Platform Engineering:- Design, develop, and maintain scalable data pipelines for batch and real-time processing.- Build enterprise-grade data platforms supporting analytics, AI, and business intelligence workloads.- Develop reusable ingestion, transformation, and orchestration frameworks.- Implement scalable ETL/ELT solutions across structured and unstructured data https://jobeax.com/link/EN6tBqe2LE3cdAWw Architecture & Modeling:- Design modern Lakehouse and Data Mesh architectures.- Build optimized data models supporting reporting, analytics, and machine learning.- Establish enterprise data standards, governance, and lineage frameworks.- Ensure data quality, consistency, and regulatory https://jobeax.com/link/1HSyAodGvLloxXIX Data Engineering:- Build cloud-native data platforms on AWS, Azure, or GCP.- Design scalable solutions leveraging managed data services.- Optimize performance, reliability, and cost efficiency of cloud data workloads.- Implement Infrastructure as Code and automated deployment pipelines.Real-Time Data Engineering:- Build event-driven architectures and streaming data solutions.- Develop real-time ingestion and processing pipelines.- Implement high-throughput and low-latency data processing https://jobeax.com/link/DIxXaYzRLEYqOGxl & GenAI Data Foundation:- Build AI-ready data ecosystems supporting machine learning and Generative AI workloads.- Engineer pipelines for feature stores, vector databases, and RAG architectures.- Enable enterprise-scale data preparation for AI/ML models.- Collaborate with AI Engineers and Data Scientists for model https://jobeax.com/link/Dygd37fUSEJgKfAc Excellence:- Drive best practices for DataOps, DevOps, CI/CD, testing, and observability.- Participate in architecture reviews and technical design discussions.- Contribute to reusable assets, accelerators, and intellectual property development.- Mentor junior engineers and support technical leadership https://jobeax.com/link/GTNZKF2kxpVUFhTn Technical Skills:Data Engineering:- Python, PySpark, SQL (Advanced), Data Modeling, ETL/ELT Development, Data Warehousing ConceptsBig Data Technologies:- Apache Spark, Databricks, Hadoop Ecosystem, Delta Lake, Apache Iceberg, Apache HudiData Integration & Streaming:- Apache Kafka, Apache Flink, Apache Airflow, Azure Data Factory, AWS Glue, Stream Processing FrameworksCloud Platforms:- Azure (Data Factory, Synapse, Data Lake, Fabric, Databricks), AWS (S3, Glue, EMR, Redshift, Kinesis, Lambda), GCP (BigQuery, Dataflow, Dataproc, Pub/Sub)Databases:- PostgreSQL, SQL Server, Oracle, MongoDB, Cassandra, SnowflakeDataOps & DevOps:- Git, CI/CD Pipelines, Jenkins, GitHub Actions, Terraform, Docker, KubernetesPreferred Skills:- Generative AI, LLMs, RAG, Vector Databases (Pinecone, Milvus, Weaviate), MLOps, Data Governance, MDM, Data Quality Frameworks, Knowledge Graphs, Agentic AI Data PlatformsEducational Qualification:- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, Information Technology, or related https://jobeax.com/link/2JA23nUePcfj0EfQ Profile:- Strong coding and problem-solving skills.- Deep understanding of distributed data systems.- Passionate about building large-scale data platforms.- Ability to work independently and thrive in ambiguous environments.- Experience working in Agile and cloud-native engineering teams.- Demonstrate innovation, ownership, and engineering https://jobeax.com/link/KFwMdL5FaLcda2N3 Metrics:- Scalable and reliable data platform delivery.- Data quality and governance compliance.- Performance optimization and cost efficiency improvements.- Contribution to reusable frameworks, accelerators, and IP.- Enablement of Analytics, AI, and GenAI use cases.- Technical leadership and mentorship impact. (ref:hirist.tech)

Loading similar vacancies…