172 big data python jobs in Chennai, India.

Rs 22 - 60 lakhs p.a.

... field. - 8-15 years of experience in data analysis or a similar role. - Proficiency in Databricks and Spark for big data processing. - Strong SQL skills for data querying and manipulation. - Experience with data visualization tools like Tableau or Power BI. - Knowledge of Python or R for data analysis and scripting. - ...

• Hybrid

... learning, statistical modeling, and process-mining algorithms to large, multi-source enterprise datasets. - Strong programming proficiency in Python, SQL, and data-modeling techniques for event data. - Experience in process data model design, development, and deployment, including creation of reusable data schemas and pipelines ...

• Full-time

... RDS, Redshift Experience with stream-processing systems: Experience with object-oriented/object-function scripting languages: Python, Java, etc. Knowledge of data pipelines and workflow management tools like Airflow Hiring #SeniorDataEngineer #BigData #ChennaiJobs #ETL #AWS #SQL #DataPipelines #DataEngineering #Python #Java ...

• Hybrid

... scalable solutions Generate actionable insights through data analysis and modeling Deploy, monitor, and improve model performance Qualifications - Bachelor's/Master's in Computer Science, Data Science, Engineering, or related field - 3–8 years of relevant experience Skills: data scientist,genai,python,sql,pyspark,aiml,ml

... translate stakeholder needs into clear, testable requirements and communicate effectively with technical teams. Strong SQL skills and experience working with large datasets. Familiarity with modern data environments and tooling (e.g., Databricks, ETL/ELT concepts, Azure, ADF, Python). Experience with governed data environments ...

... in driving value for our customers by building data solutions. You'll be carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, as well as carrying out data extractions, transforming data to make it usable to data analysts and scientists, and loading data into data platforms. ...

Role Overview:Seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Real-Time Data Processing, Lakehouse Architecture, and AI-driven solutions. The role involves designing, developing, and supporting scalable data platforms and streaming pipelines, leveraging modern Databricks capabilities such ...

Lead Data Engineer

• Hybrid

Role Overview : We are seeking a seasoned Data Engineering professional to spearhead our data architecture initiatives and drive the evolution of our analytical ecosystem. In this role, you will be responsible for designing robust data models and optimizing our Snowflake-based data warehousing environment to support complex ...

• Hybrid

... across the data space. 3+ years of experience designing and building scalable distributed data pipelines and dimensional data models - 3+ years of experience in Python and SQL - Experience using Databricks platform and PySpark is a must. - Extensive experience of Microsoft Azure data services – Data Factory, ADLS gen2, Event ...

... using Python and PySpark to ingest data from files, APIs, RDBMS, NoSQL, and message queues into AWS data stores Develop and optimize PySpark jobs for large-scale data processing, transformation, and aggregation on AWS EMR or Databricks Build and manage AWS-native data workflows using S3, Glue, Lambda, Redshift, and Step Functions; ...

• Hybrid

$100 USD

... Anthropic, Google) into production. We use n8n and Python as our primary tools, but what matters is your ability to leverage whichever tools the problem calls for.- Data Foundations : Strong understanding of modern data architecture: relational databases, data lakes, and cloud warehouses (e.g., Snowflake), including data modeling, ...

... to leadership- Align practice goals with overall company strategyJob Summary : - 16+ years of experience in Data & Analytics / Data Engineering / Enterprise Data Management- Proven experience in leading large teams and managing P&L- Strong understanding of cloud data platforms (Azure, AWS, GCP) and modern data architectures- ...

Description : EXP : 8+yrsLocation : ChennaiRole : Technical Architect Job Summary : We are looking for an experienced Snowflake & Data Warehouse Architect to design and optimize scalable cloud-based data warehouse solutions. The candidate should have strong expertise in Snowflake, modern data warehousing principles, ELT ...

... enterprise applications and data consumption.- Develop business logic, service models, validations, and custom handlers using SAP CAP.- Design and implement data models using CDS (Core Data Services).- Work with SAP HANA Cloud for database design, development, optimization, and data persistence.- Integrate SAP and non-SAP ...

• Hybrid

... for AI model training, validation, and inference. Design and optimize data pipelines supporting AI and machine learning workflows. Perform feature engineering, data transformation, cleansing, and validation activities. Utilize Python, SQL, NumPy, Pandas, and related libraries to process and analyze large-scale datasets. Deploy ...

... in Payments or Cards Domain testing ( Manual Or Automation ) – Minimum of 5 years Experience in Agile methodology is a Plus Working Knowledge of at least one Database (Oracle/MS SQL), Handson experience in API testing and tools like SOAP UI, Postman is pre-requisite Skillful in XML/XSD and SQL language (required) Proficiency ...

• Remote
• Hybrid
• On-site

... processes Monitor database performance, identify bottlenecks, and implement improvements Troubleshoot critical production issues under tight SLAs Automate routine database tasks using scripting (Shell/Python) Support database upgrades, patching, and migrations Collaborate with DevOps, application, and cloud teams Participate ...

... administer, and maintain MariaDB databases.- Perform database performance tuning, optimization, and capacity planning.- Configure and maintain high-availability database environments.- Manage database backup, restoration, and disaster recovery activities.- Troubleshoot database, replication, connectivity, and performance issues.- ...

• Full-time

... cross-functional teams. Application Development: – Design, develop, and maintain high-quality Python-based applications. – Data Processing and Analysis: - Work with large datasets and perform data analysis using Python libraries. - Develop scripts for data extraction, transformation, and loading (ETL) processes. - Implement data visualization ...