Vacancy description
MaimsD Technology
India
Big Data Engineer - Python/Spark in work from home, India is listed on Jobeax. Browse 30,000+ vacancies available.
Job Summary :In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world https://jobeax.com/link/JC3CtKQ32o6HlxfT Responsibilities :- Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.- Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.- Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.- Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.- Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.- Enforce data quality, security, and governance standards across all solutions.- Document solutions and communicate complex technical concepts effectively, both in writing and https://jobeax.com/link/2luqtWY4b55DMQvB Skills and Qualifications :- Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.- Advanced proficiency in Python for data processing, automation, and integration.- Deep understanding of relational and NoSQL databases, including optimization and management techniques.- Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).- Strong foundation in data modeling, ETL processes, and data warehousing principles.- Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.- Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work https://jobeax.com/link/TcYMIwwXyQaLOZSp Qualifications :- Prior experience in fast-paced or startup-like environments supporting global teams.- Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).- Familiarity with machine learning operations and data science workflows is a plus. (ref:hirist.tech)
Similar vacancies
Vensure Employer Solutions
... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...
India, Thiruvananthapuram
Mastercard
... Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain. Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or object ...
India, Pune
altysys
... Hadoop ecosystem for data processing - Solve real-world engineering problems related to data infrastructure - Collaborate with cross-functional teams to deliver data-driven solutions - Ensure data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong ...
India, Gurugram
About the Role : We are looking for a Big Data Engineer to design, build, and operate large-scale data pipelines and analytical infrastructure that transform high-volume raw data into reliable, query-ready datasets for analytics, reporting, and data-driven https://jobeax.com/link/HouIpt6AtbK1KWOU data platform ingests and ...
India, Gurugram
Recruitment Room
$ 62400 p.a.
... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...
India
Recruitment Room
$ 62400 p.a.
... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...
India
ShrinQ Consulting Group Inc
The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day issues that our business faces, which can be better ...
India, India
Publicis Sapient
20k
... and adoption of emerging technologies including GenAI-enabled data engineering solutions. Your Skills & Experience: 8+ years of IT experience, with 5+ years in data engineering, big data, or related technologies. Proven experience leading the design and delivery of enterprise-scale data engineering solutions. Strong hands-on ...
India, Bengaluru
... to 6 years of experience in the field of data engineering - Graduate degree or higher with courses in programming, data analytics - Good programming skill in Python/scala or any scripting language - Good knowledge of SQL is a required - Basic knowledge and understanding of big data - Experience in Azure - Excellent written ...
India, Bengaluru
anrgi tech
... Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud Professional Data Engineer) - Relevant data engineering or big data certifications Soft Skills ...
India, Pune
Weekday AI
... 3+ years of professional experience in Data Engineering, Big Data, Analytics Engineering, or a related field. - Strong hands-on programming experience with Python for data processing, automation, and pipeline development. - Strong expertise in Apache Spark , particularly PySpark and/or Spark SQL. - Deep working knowledge ...
India, Mumbai
Sigmoid
... complex data sets from a variety of sources - Experience with Hadoop, Spark, or similar stack a must - Experience with functional and object-oriented programming, Python or Scala a must - Ability to collaborate with a diverse set of engineers, data scientists and product managers - Experience in agile methodology Development ...
India, Bengaluru
Auriga IT
... Responsibilities Develop, test, and maintain scalable Python applications. Work with large datasets to extract, transform, and analyze data. Build and optimize data pipelines and workflows. Perform data cleaning, validation, and preprocessing. Collaborate with cross-functional teams including data analysts and engineers. ...
India, Jaipur
Funic Tech
Role: Senior Data EngineerExperience: 7+ YearsLocation: PuneJoining: Immediate to 30 Days' Notice PeriodRole Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate ...
India, Pune
SHIMENTO INDIA LLP
Hiring : Senior Data Engineer | 6+ https://jobeax.com/link/elpmNuUlUrtRmNOJ : https://jobeax.com/link/TEtw0SgP3UR1RgAh : Senior Data https://jobeax.com/link/gTHUyXDKJ42uWexF are looking for a highly skilled Senior Data Engineer with strong expertise in Data Architecture, System Design, Python, and SQL to design, build, ...
India, Bengaluru
Airbus pioneers
... Support / Customer Experience : Minimum 3 years in a customer-facing support or service role (specifically working with European customers). Technical Skills Big Data & Frameworks: Strong hands-on experience with Apache Spark, PySpark (Mandatory), and Spark SQL. Lightweight Data Processing: Practical experience with lightweight ...
India, Bengaluru
48k SGD - 84k SGD / year
... expertise in Python and SQL, along with experience in cloud platforms (AWS, GCP, or Azure) and containerization (Docker, Kubernetes) - Experience with real-time data processing, anomaly detection, and time-series forecasting in production - Experience working with large datasets and big data technologies like Spark and Kafka ...
India, Mumbai
Accenture
... Azure, or GCP for data engineering workflows. Strong proficiency in PySpark, Spark, or similar frameworks for building scalable data pipelines. Understanding of Big Data architectures, data storage, and data processing concepts. Familiarity with cloud-native data storage solutions such as S3, Blob Storage, BigQuery, or Redshift. ...
India, Bengaluru
artech l.l.c.
... Time Series Forecasting techniques and real-world demand planning use cases. - Hands-on experience with Databricks , including Spark, notebooks, and distributed data processing. - Practical exposure to Machine Learning and Deep Learning model development and deployment. - Experience working with large, complex datasets in ...
India, Bengaluru