We are seeking a Data Engineer to join our team. With expertise in big data solutions, cloud technologies, and data pipelines, you will help design and deploy scalable data architectures. Your experience will enable us to deliver high‑quality, cloud‑native data services for our clients.
Key responsibilities
Provide out‑of‑the‑box custom data solutions, pipelines, repairs, and reprocessing for analytics workloads.
Design and implement data models, ingestion pipelines, and data warehouses on AWS.
Collaborate with stakeholders to gather requirements and create architecture diagrams.
Develop and maintain large‑scale modules using Python, Spark, and SQL.
Lead the migration of on‑premises projects to cloud platforms.
Utilize Airflow, Docker, and Kubernetes for workflow orchestration and deployment.
Ensure data quality and security across all pipelines.
Document processes and maintain version control with Git.
Required qualifications
Bachelor’s degree in Computer Science (https://jobeax.com/link/2DENLGgQM7whDhaE)
Over 8.5 years of professional data engineering experience.
Proficient in Python, Spark, and AWS services (S3, Glue, Lambda, EMR).
Strong background in Big Data ecosystems (Hadoop, Hive, Kafka, Spark SQL).
Experience with data modeling, ETL, and data lake architecture.
Nice to have
Airflow certification or experience.
Knowledge of Docker, Kubernetes, and CI/CD pipelines.
... scalable data pipelines and third-party API integrations. - Work with business teams and analysts to interpret business rules and derive insights. - Implement data-quality processes, monitoring, and alerting to maintain accurate and available production data. - Analyze and troubleshoot data issues and assist with their resolution. ...
Baxter seeks a Data Engineer to develop and support ETL and data transformation jobs using PySpark and IBM DataStage in AWS. The role involves building new pipelines, enhancing existing systems, performing code reviews, and providing technical support for a global data warehouse. Responsibilities - Develop new ETL and data ...
... participate in design reviews, and help keep our schemas and contracts sane as the system grows What You'll Bring Must have - 1–3 years of professional software engineering experience, with meaningful exposure to data-intensive systems - Strong programming skills in Python, Java, or Scala, and the ability to write production-quality, ...
Amgen seeks a Level 4 Data Engineer in Hyderabad to design and build data solutions, ETL pipelines, and data governance frameworks. The role involves working with large datasets, cloud platforms, and AI technologies to deliver actionable insights for business decisions. Responsibilities - Design, develop, and maintain end-to-end ...
... execution hints to improve performance. - IBM DataStage experience preferred. - Able to write SQL code sufficient for most business requirements for pulling data from sources, applying rules to the data, and stocking target data - Proven track record in troubleshooting ETL jobs and addressing production issues like performance ...
... maintain scalable data engineering solutions.- Develop and manage ETL/ELT pipelines for data ingestion, transformation, and processing.- Work extensively with Databricks for data engineering and data processing requirements.- Develop and optimize data solutions using GCP BigQuery.- Develop data engineering solutions using ...
... experience with Hadoop / Big Data platforms.- Strong exposure to Big Data platform engineering and related technologies.- Experience working on/with complex data platforms and large-scale data environments.- The requirement is specifically for a Data Engineer / Big Data Engineer, not a generic application/development profile.- ...
... subordinate team members to meet established timelines. Requirements - 3–5 years of experience. - Knowledge of SQL and Python. - Experience or knowledge of data engineering, data modelling, ETL/ELT development, data pipelines, cloud data platforms, database management, data warehousing, and data lakes. - Knowledge of data analysis, ...
... and analytics. - Implement data quality checks, validation frameworks, monitoring, error handling, and pipeline performance improvements. - Collaborate with Data Analysts, Data Scientists, Product Teams, and Business Stakeholders to understand requirements and deliver scalable data solutions. - Follow data engineering ...
Amgen seeks a Level 4 Data Engineer to design, build, and maintain data solutions that drive business decisions. The role involves developing ETL pipelines, managing large datasets, implementing data governance, and collaborating across teams to deliver scalable data infrastructure. Responsibilities - Design, develop, and ...
... effective solutions - Ensure adherence to best practices related to data governance, quality, and security across all data pipelines - Automate and optimize data processing tasks to improve reliability and reduce manual intervention - Drive adoption of emerging big data technologies, cloud engineering, and automation practices ...