SSE Data Engineer
Position Description
We are looking for a Senior Software Engineer (SSE) – Data Engineer with strong expertise in Azure data engineering, cloud-based data platforms, and large-scale data processing. The ideal candidate should have hands-on experience designing, developing, and optimizing ETL/ELT pipelines, implementing data lake and data warehouse solutions, and working with Azure data services, Spark, PySpark, and SQL.
Your future duties and responsibilities
- Design, develop, and maintain scalable data engineering solutions using Microsoft Azure services.
- Build and optimize ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Develop distributed data processing solutions using Apache Spark, PySpark, and Python.
- Implement and manage data lake architectures using Azure Data Lake Storage (ADLS) Gen2.
- Write complex SQL queries and perform performance tuning for large-scale analytical workloads.
- Design and implement dimensional data models and data warehouse solutions.
- Develop and maintain batch and real-time data processing pipelines using Azure Event Hubs and Azure Functions.
- Work with modern data formats and lakehouse technologies, including Delta Lake, Apache Iceberg, and Apache Hudi.
- Implement data pipeline orchestration using Azure Data Factory, Apache Airflow, Databricks Workflows, or Microsoft Fabric pipelines.
- Follow DevOps practices, including version control, CI/CD, and Infrastructure as Code using Terraform or Bicep.
- Implement data governance, metadata management, monitoring, and security using Azure Monitor, Azure Key Vault, and Microsoft Purview.
- Collaborate with architects, business stakeholders, and cross-functional teams to deliver reliable and high-quality data solutions.
- Troubleshoot data pipeline issues, optimize performance, and ensure data quality, security, and reliability.
Required qualifications to be successful in this role
- 6–8 years of experience in Data Engineering and Data Warehousing, with strong hands-on technical expertise.
- Strong hands-on experience with Azure data services, including ADLS Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Event Hubs, and Azure Functions.
- Proficiency in SQL, query optimization, and performance tuning for large-scale analytical workloads.
- Strong experience with Python, PySpark, Apache Spark, and distributed data processing.
- Solid understanding of dimensional modeling, data warehousing concepts, data lake architectures, and lakehouse solutions.
- Experience designing, developing, and optimizing cloud-based ETL/ELT pipelines.
- Knowledge of modern table formats such as Delta Lake, Apache Iceberg, or Apache Hudi.
- Experience with pipeline orchestration tools such as Azure Data Factory, Apache Airflow, Databricks Workflows, or Microsoft Fabric pipelines.
- Familiarity with Git, CI/CD pipelines, DevOps practices, and Infrastructure as Code tools such as Terraform or Bicep.
- Knowledge of data governance, metadata management, data security, and monitoring practices.
- Strong analytical, problem-solving, communication, and stakeholder management skills.
**Preferred Skills**
- Microsoft Certified: Azure Data Engineer Associate or Microsoft Certified: Fabric Data Engineer Associate.
- Experience building real-time streaming and event-driven data processing solutions.
- Hands-on experience with Azure Databricks and lakehouse architectures.
- Exposure to machine learning data pipelines and MLOps frameworks.
- Experience with data cataloging, governance, and metadata management solutions.
Together, as owners, let’s turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…
You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.
Come join our team—one of the largest IT and business consulting services firms in the world.