Vacancy description
MaimsD Technology
India
Big Data Engineer - Python/Spark in work from home, India is listed on Jobeax. Browse 30,000+ vacancies available.
Job Summary :In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world https://jobeax.com/link/JC3CtKQ32o6HlxfT Responsibilities :- Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.- Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.- Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.- Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.- Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.- Enforce data quality, security, and governance standards across all solutions.- Document solutions and communicate complex technical concepts effectively, both in writing and https://jobeax.com/link/2luqtWY4b55DMQvB Skills and Qualifications :- Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.- Advanced proficiency in Python for data processing, automation, and integration.- Deep understanding of relational and NoSQL databases, including optimization and management techniques.- Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).- Strong foundation in data modeling, ETL processes, and data warehousing principles.- Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.- Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work https://jobeax.com/link/TcYMIwwXyQaLOZSp Qualifications :- Prior experience in fast-paced or startup-like environments supporting global teams.- Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).- Familiarity with machine learning operations and data science workflows is a plus. (ref:hirist.tech)
Similar vacancies
Vensure Employer Solutions
... you an all-around data enthusiast with a knack for ETL We're hiring Data Engineers to help build and optimize the foundational architecture of our product's data. We've built a strong data engineering team to date, but have a lot of work ahead of us, Migrating from relational databases to a streaming and big data architecture, ...
India, Thiruvananthapuram
Mastercard
... Big Data repositories and enforce standards and principles in the Big Data space. The candidate will be part of an exciting, fast paced environment developing Data Engineering solutions in the data and analytics domain. Develop high quality, secure and scalable data pipelines using spark, Scala/ python on Hadoop or object ...
India, Pune
standard chartered india
... Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field. 10+ years of experience in data engineering Strong proficiency in Python, Python-spark, shell scripting and SQL, with hands-on experience in building large-scale ETL/ELT pipelines Good to have exposure in the Big Data Ecosystem like ...
India, Bengaluru
mindbrain
... Layer Design Data Transformation & Aggregation Data Quality & Governance Big Data & Open-Source Technologies Experience with one or more of the following: Apache Spark PySpark / Python Spark / Scala Apache Hadoop Apache Beam Apache Airflow dbt DevOps & Engineering Practices Git / GitHub CI/CD Docker Version Control Code Reviews ...
India, Gurugram
... knowledge in the Big data tools such as AWS Redshift, Hadoop, map reduce etc. u2022 Having knowledge in tools like Airflow, AWS Glue, S3, AWS EMR, Streaming data pipelines, Kafka/Kinesis is desirable u2022 Assists in solving data engineering challenges by analyzing data issues and applying simple solutions, working under ...
India, Bengaluru
altysys
... Hadoop ecosystem for data processing - Solve real-world engineering problems related to data infrastructure - Collaborate with cross-functional teams to deliver data-driven solutions - Ensure data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong ...
India, Gurugram
Recruitment Room
$ 62400 p.a.
... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...
India
Recruitment Room
$ 62400 p.a.
... build, and maintain scalable data pipelines and architectures for large-scale data environments. - Translate business and technical requirements into reliable data engineering solutions. - Develop data integration, transformation, and processing workflows using Python and appropriate big data technologies. - Build, manage, ...
India
Mouri Tech (P) Ltd
... Analytics- Azure Data Lake Storage Gen2 (ADLS Gen2)- Azure SQL Database, Azure Blob Storage, Azure Key Vault, Azure Monitor / Log Analytics. 2. Programming & Databases :- SQL (Advanced)- Python- PySpark- Spark SQL, T-SQL.3. Big Data Technologies :- Apache Spark- Delta Lake- Data Lake Architecture- Data Warehousing Concepts.4. ...
India, Hyderabad
Publicis Sapient
20k
... and adoption of emerging technologies including GenAI-enabled data engineering solutions. Your Skills & Experience: 8+ years of IT experience, with 5+ years in data engineering, big data, or related technologies. Proven experience leading the design and delivery of enterprise-scale data engineering solutions. Strong hands-on ...
India, Bengaluru
... to 6 years of experience in the field of data engineering - Graduate degree or higher with courses in programming, data analytics - Good programming skill in Python/scala or any scripting language - Good knowledge of SQL is a required - Basic knowledge and understanding of big data - Experience in Azure - Excellent written ...
India, Bengaluru
hireflex
... Familiarity with big data tools (Spark, Dask, etc.) and version control (Git). - Cloud & Deployment: Demonstrated expertise with Azure cloud services for end-toend data solutions. This includes Azure Machine Learning (for model development and deployment), Azure Data Factory (ETL/ELT pipelines), Azure Databricks (data processing), ...
India, Rāniganj
anrgi tech
... Engineer Professional Additional Certifications (Preferred) - Databricks Certified Associate Developer for Apache Spark - Cloud platform certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Cloud Professional Data Engineer) - Relevant data engineering or big data certifications Soft Skills ...
India, Pune
Path Mentors Staffing Solution
... data https://jobeax.com/link/Gpaa4oyRTNYXQU0V Stack & Requirements : - Strong proficiency in Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts ...
India, Bengaluru
Sigmoid
... complex data sets from a variety of sources - Experience with Hadoop, Spark, or similar stack a must - Experience with functional and object-oriented programming, Python or Scala a must - Ability to collaborate with a diverse set of engineers, data scientists and product managers - Experience in agile methodology Development ...
India, Bengaluru
Auriga IT
... Responsibilities Develop, test, and maintain scalable Python applications. Work with large datasets to extract, transform, and analyze data. Build and optimize data pipelines and workflows. Perform data cleaning, validation, and preprocessing. Collaborate with cross-functional teams including data analysts and engineers. ...
India, Jaipur
Funic Tech
Role: Senior Data EngineerExperience: 7+ YearsLocation: PuneJoining: Immediate to 30 Days' Notice PeriodRole Summary:We are looking for a skilled Sr. Data Engineer with strong expertise in Python and cloud-native technologies to design, develop, and maintain scalable data pipelines and distributed systems. The ideal candidate ...
India, Pune
SHIMENTO INDIA LLP
Hiring : Senior Data Engineer | 6+ https://jobeax.com/link/elpmNuUlUrtRmNOJ : https://jobeax.com/link/TEtw0SgP3UR1RgAh : Senior Data https://jobeax.com/link/gTHUyXDKJ42uWexF are looking for a highly skilled Senior Data Engineer with strong expertise in Data Architecture, System Design, Python, and SQL to design, build, ...
India, Bengaluru
Airbus pioneers
... Support / Customer Experience : Minimum 3 years in a customer-facing support or service role (specifically working with European customers). Technical Skills Big Data & Frameworks: Strong hands-on experience with Apache Spark, PySpark (Mandatory), and Spark SQL. Lightweight Data Processing: Practical experience with lightweight ...
India, Bengaluru