Data Scientist/Python Developer in Bengaluru, India - Jobeax
Vacancy description
Data Scientist/Python Developer in Bengaluru, India
Luxoft
India, Bengaluru
Data Scientist/Python Developer in Bengaluru, India is listed on Jobeax. Browse 30,000+ vacancies available.
Project Description: We've been engaged by an Investment Banking client in the FM potfolio . PTS app is an inhouse build system which is silver source of all settlement information originated from GPTM. PTS app is in CDP (Cloudera data platform) platform which bag data ecosystem. It will be migrated to a different datacentre and CDP will be decommissioned . Hence PTS application, we need to rewrite code approx. 40% to rebuild from scratch like develop data ingestion framework, extraction frame work and migration of existing components to new data centre from west to East.
Responsibilities: Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Hadoop technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Work with project team including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. Work with data and analytics experts to strive for greater functionality in our data systems.
Mandatory Skills Description:
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related technical field
8+ years of experience in data engineering (or equivalent hands on experience with large scale data platforms)
Strong programming skills in Python for data processing, automation, and tooling
Hands on experience with Minio, Iceberg and DuckDB for large scale data processing
Advanced SQL skills, including complex queries, performance tuning, and working with large relational datasets
Experience building and maintaining ETL/ELT pipelines and working with structured and semi structured data
Understanding of data modelling concepts (e.g. relational, dimensional, and/or big data modelling)
Strong understanding of DevOps/CI/CD concepts and tooling (e.g. Docker, Kubernetes, Git)
Nice-to-Have Skills Description: Experience of Unix/Linux environments is plus Experience of Agile/Scrum development methodologies is a plus Be nice, respectful, able to work in a team Willingness to learn
... business, IT, and data engineering. Preferred Qualifications: Experience with other visualization tools (Tableau, Qlik) in addition to Power BI. Knowledge of Python for advanced data analysis and automation. Familiarity with Azure Synapse, AWS Redshift, or Google BigQuery. Experience with data governance, quality, and compliance ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... Strong communication skills. - Attention to detail and accuracy. Nice to Have - Experience working with SaaS products or mobile applications. - Knowledge of Python or R for data analysis. - Experience with A/B testing and experimentation. - Experience with attribution and conversion tracking. - Understanding of digital ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, ...
... understand data requirements and deliver solutions. Identifying opportunities for process improvements based on data analysis. Assisting in the development of data models and algorithms to enhance business decision-making. Skills and Qualifications Proficiency in data analysis tools such as Python, R, or SQL. Experience ...
... pipelines using Python and Airflow, ensuring efficient data flow and transformation for analytical and operational purposes.- Utilize AWS services, including S3 for data storage, Glue and EMR for data processing, and orchestrate data workflows that are scalable, reliable, and secure.- Implement real-time data processing solutions ...
... field. - 8-15 years of experience in data analysis or a similar role. - Proficiency in Databricks and Spark for big data processing. - Strong SQL skills for data querying and manipulation. - Experience with data visualization tools like Tableau or Power BI. - Knowledge of Python or R for data analysis and scripting. - ...
... proficiency in Python , practical cloud experience with AWS , and database engineering in MongoDB . Good to Know Skills: Kubernetes and containerization concepts (Docker). Infrastructure deployment with modern CI/CD frameworks . Relational database querying with PL/SQL . Exposure to AI Best Practices and modern developer tooling
... maintain scalable big data pipelines and architectures to support robust data solutions.- Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.- Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.- ...
Description We are looking for a skilled Python Developer to join our team in India. The ideal candidate will have extensive experience in developing high-quality web applications and will be responsible for the full software development lifecycle. Responsibilities Develop, test, and maintain scalable web applications using ...
... development queries and concerns. Analyze and resolve development issues accurately. Skills Must have we are looking for 8+yrs exp candidates only 1 Strong Python development experience (data engineering and automation) 2 Data Analytics and Data Engineering concepts 3 Apache Airflow DAG development and orchestration 4 ...
We are looking for a Python Developer with exposure to Business Intelligence (Power BI/Tableau) to join our team. You will focus on building Python-based data pipelines, automation scripts, and analytical solutions, creating dashboards and visualizations. Experience: 3+ years Number of Positions: 1 Location: Indore (Hybrid) ...
Location Pune / Bangalore Experience 7 to 12 Years Job Summary We are seeking a highly skilled Python Engineer with hands-on experience in Ansible automation , REST API development/integration , and scripting for enterprise applications. The ideal candidate will be responsible for developing automation solutions, integrating ...
Project Overview I am looking for an experienced developer to build a robust, automated trading system that utilizes real-time data from the National Stock Exchange (NSE) . The goal is to develop a system capable of fetching live market data, processing it through custom strategy logic, and executing orders via a broker's ...
... a must Good hands-on software development experience with proven working experience in Python development ~ Expert in Python, with knowledge of at least one Python web framework (such as Django, Flask) Familiarity with some ORM (Object Relational Mapper) libraries Able to integrate multiple data sources and databases into ...
... cross-functional teams. Application Development: – Design, develop, and maintain high-quality Python-based applications. – Data Processing and Analysis: - Work with large datasets and perform data analysis using Python libraries. - Develop scripts for data extraction, transformation, and loading (ETL) processes. - Implement data visualization ...
... https://jobeax.com/link/6WcBICn0LM558SP0 with TailwindCSS or Material UI. Implement and optimize real-time features using WebSockets, Redis, etc. Handle high concurrency environments and database transaction safety. Design and enforce coding standards, modular structure, and reusable components. Participate in DevOps processes—Dockerization, CI/CD ...
... failures and performance issues Collaborate with data analysts data scientists and business teams to understand data requirements Implement best practices for data security governance and compliance Maintain technical documentation for ETL workflows and data models Technical Requirements: Strong proficiency in Python data ...