Data Engineer SQL - Flexible Working in Pune, India - Jobeax
Vacancy description
Data Engineer SQL - Flexible Working in Pune, India
Wolters Kluwer India Private Limited
India, Pune
Data Engineer SQL - Flexible Working in Pune, India is listed on Jobeax. Browse 30,000+ vacancies available.
Take your software engineering career to the next level as a Senior Product Software Data Engineer. You will play a key role in designing, developing, and troubleshooting software programs. Your technical skills and innovative mindset will contribute to the continuous improvement of our products, making a significant impact on user experience and satisfaction. Collaborate with cross-functional teams to review use cases and translate business requirements into scalable data solutions.
Design and develop highly optimized, reliable, and secure enterprise-level data pipelines for real-time and batch processing.
Analyze existing business processes, identify gaps, and recommend data-driven improvements.
Build modern real-time data solutions using Scala , Apache Spark , and Azure Databricks .
Partner with data scientists and business stakeholders to operationalize machine learning models.
Champion data governance, metadata management, and operational excellence across data platforms.
Ensure data quality and integrity by developing validation frameworks and monitoring mechanisms.
Software Engineering: The ability to design, develop, and maintain software systems and applications by applying principles and techniques of computer science, engineering, and mathematical analysis. This includes the capacity to understand user requirements, create and test the software, and resolve any software-related issues.
Software Development: The ability to design, write, test, and implement software programs, applications, and systems. This includes understanding various programming languages, software architecture, and software testing methods. It also involves problem- solving capabilities to fix software issues and improve functionality.
Analysis: The ability to examine complex situations or problems, break them down into smaller parts, and understand how these parts work together.
Testing: The skill of evaluating a system or process, often in software or product development. It involves the ability to identify problems, measure effectiveness, and ensure quality or functionality.
Agile: The ability to swiftly and effectively respond to changes, with an emphasis on continuous improvement and flexibility. In the context of project management, it denotes a methodology that promotes adaptive planning and encourages rapid and flexible responses to changes.
Source Code Repository: The ability to effectively use a source code repository, a file archive and web hosting facility where a large amount of source code, for software or for web pages, is kept, either publicly or privately. Relational Database: The ability to design, implement, and manipulate a relational database, a type of database that stores and organizes data in a structured way and where data is logically interrelated. This skill often requires proficiency in SQL, database management systems, and understanding of database design principles.
Documentation: The ability to create, manage, organize, and maintain important information and documents in various physical and digital formats. This skill may include preparing reports, managing files, storing data, and keeping records organized and updated for easy retrieval and understanding.
3+ years of overall experience in data engineering or related fields.
2+ years of experience building data pipelines for structured and unstructured data.
1+ years of experience with big data technologies including PySpark , Hadoop , Kafka , EventHub , and Stream Analytics .
1+ years of experience in relational and dimensional data modeling using SQL Server and data warehousing concepts.
Must have 2+ years of experience with T-SQL , stored procedures, and performance tuning.
2+ years of experience with Azure Data Factory , Azure Data Lake , Azure SQL DB , and Azure Synapse Analytics .
Good to have 2+ years of experience with Azure ML , Python , and Scala .
Good to have 2+ years of experience with Power BI and Azure Analysis Services .
Experience working with business stakeholders for requirements gathering and use case analysis.
Strong communication, collaboration, and creative problem-solving skills.
Bachelor's degree in computer science, Engineering, or equivalent practical experience.
Experience with Agile/Scrum methodologies and DevOps practices.
Azure Data Engineer Certification or equivalent is a strong advantage.
... Data Engineer to join our team and contribute to building and maintaining applications that power the Dun & Bradstreet Contact Pipeline. This role involves working closely with senior data engineers to optimize data ingestion processes, analyze performance bottlenecks, and implement improvements. You will also create metrics ...
... AWS Glue, Lambda, and DBT. Work with PySpark and SQL to transform and cleanse data. Configure and manage Airflow workflows and Amazon EMR clusters. Integrate data services with API Gateway and REST/Soap APIs. Required qualifications - 3 to 5 years of experience in data engineering. - Proficient in AWS S3, Glue, Lambda, ...
... Posted 2 weeks ago Job Be an early applicant About the job Job Purpose: Design and implement scalable data engineering and data warehouse solutions while managing data schemas, SQL query tuning, and code reviews. Who You Are: - 5+ years of experience in Data Engineering, with strong knowledge of Data Platforms and Data Warehousing ...
... teams including data analysts and engineers. Write reusable, efficient, and well-documented code. Integrate APIs and third-party services. Troubleshoot and debug data-related issues. Required Skills Strong proficiency in Python. Experience with data libraries like Pandas, NumPy. Hands-on experience with SQL and relational databases. ...
... data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python * SQL * AWS / Azure / GCP Preferred (Bonus) ...
... a related field (Master's degree preferred). Core Technical Skills: Python, PySpark, Databricks, Google ADK, LLMs, FastAPI, Spring Boot, Microservices, Kafka, SQL, Data Mesh, Starburst. Infrastructure and Cloud: Kubernetes, OpenShift, Docker, Cloud-Native Infrastructure, CI/CD pipelines. Industry Context: Data engineering ...
... and ELT pipelines while working with Data Analysts Design and implement scalable, automated processes for data extraction, processing, and analysis within a Data Mesh architecture Act as a subject matter expert for data technologies and solutions Improve efficiency in data ingestion, transformation, and reporting workflows ...
... Python, SQL, and Spark/PySpark.- Hands-on experience with Azure Data Factory, Azure Databricks, and/or Synapse Analytics.- Experience with ETL/ELT frameworks and data integration tools.- Good understanding of data engineering concepts and data pipeline architecture.- Experience with data transformation, processing, and optimization.- ...
... experience with Python, SQL, and PySpark. Strong understanding of unit testing, test automation, debugging, and code quality best practices. Good understanding of data engineering fundamentals and advanced concepts. Experience building scalable and fault-tolerant data pipelines. Strong knowledge of CI/CD, automated testing, ...
... Bachelor/Master's Degree with 4+ years of experience across Data Engineering (Data Pipelining, Warehousing, ETL Tools etc.) Extensive hands-on experience with data engineering techniques and Python & SQL Strong working knowledge of Snowflake, Airflow and dbt You are comfortable and have expertise in data engineering tooling ...
Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming ...
... business ROI narratives. Must be adept at building business cases, ROI calculators, and executive-level proposals tailored to each account's cloud spend and engineering maturity. - Strong collaboration with Sales Engineering, Customer Success, and Marketing to drive deals forward. Requires rigorous pipeline hygiene - accurate ...
... management, and customers. Whether it's a health care program or paid time off, our programs contribute to life beyond the job. We recognize the benefits of flexible, remote working arrangements for eligible roles and are committed to providing enriching careers, no matter the work arrangement. This position is eligible ...
... Analyst acclaimed technology leadership across our categories of products Continuous learning and development opportunities An innovative, inclusive, agile, flexible, and fun work environment Competitive global benefits program inclusive of pay + bonus incentive, and employee equity in the company A flexible work environment ...
... validation, batch pipelines, reconciliation, production support, and audit-ready https://jobeax.com/link/0tczEVIPDdr4h8mr Have :- Strong experience developing data integration, ETL/ELT, batch processing, and scheduled data delivery solutions.- Proficiency in SQL and experience working with enterprise data sources, file-based ...
... experience in Data Engineering.- Strong Python + SQL expertise.- Strong Data Architecture and System Design skills.- End-to-end production pipeline ownership.- Expert SQL including Window Functions, CTEs, CASE logic.- Strong experience with MySQL / PostgreSQL.- Experience designing Transaction / Fact Tables.- Strong data quality, ...
Location: Fully Remote - Open Worldwide Schedule: Flexible and autonomous, you pick the hours and days (including weekends if desired) micro1 is selecting expert Senior Software Engineers to support a customer's innovative project. In this role, you'll apply your expertise to help train next-generation AI systems. Your ...
... including: Project accounting Balance sheet substantiation and system to system reconciliations Financial Systems Support Successful delivery of Transformation & Re-engineering projects - Prepare, Review and post journal entries to record accrued expenses in the correct period, amortize prepaid expenses and fixed assets while maintaining ...
... highly preferred). Experience working in cross-functional and cross-Business-Group environments. Basic SQL knowledge. Basic ETL knowledge (Alteryx and/or KNIME). Basic Microsoft Power Automate skills. Basic Bosch Digital File Service knowledge. Understanding of data interfaces, data validation, and automation concepts.
... Good working knowledge of data mapping, source-to-target transformation logic, and reconciliation techniques for large datasets. Collaborate with application engineers, business analysts, and QA teams to implement conversion scope and cutover plans. Hands-on experience writing and optimizing SQL Server stored procedures, ...