Big Data Infrastructure Engineer

6 days ago


Chicago, Illinois, United States Sogeti Full time
Big Data Infrastructure Engineer Position

We are seeking a highly skilled Big Data Infrastructure Engineer to join our team at Sogeti USA. As a key member of our data engineering group, you will be responsible for designing and implementing scalable big data infrastructure on the Microsoft Azure platform.

About Sogeti
Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. With over 20,000 professionals in 15 countries, we offer cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world-class methodologies and the global delivery model, Rightshore.

Your Responsibilities
  • Design and implement scalable big data infrastructure on Azure using PySpark, SparkSQL, SQL, Databricks, and ADF.
  • Develop and maintain optimal big data infrastructure architecture to ensure high-quality data delivery.
  • Collaborate with cross-functional teams to identify opportunities for process improvements and automation.
  • Work closely with stakeholders to understand their data needs and provide solutions that meet those needs.

Requirements
  • 4+ years of experience in a Data Engineer role with a Graduate degree in Computer Science or related field.
  • Very good knowledge of PySpark, SparkSQL, SQL, Databricks, Azure/ADLS, Python, and ADF.
  • Strong working knowledge of data modeling, data quality, and data governance.
  • Excellent communication and collaboration skills.

Compensation and Benefits
  • $120,000 - $180,000 per year (estimated salary based on industry standards).
  • 401(k) Savings Plan with 150% match up to 6%.
  • Medical, Prescription, Dental, and Vision Coverage.
  • 100% Company-paid mobile phone plan.
  • Tuition Reimbursement.


  • Chicago, Illinois, United States Tekfortune Inc Full time

    Tekfortune is a fast-growing consulting firm that specializes in permanent, contract & project-based staffing services for world's leading organizations across various industries. In today's rapidly changing economic landscape, virtual recruiting and remote work are crucial for the future of employment. To address the active project demands and skills gaps,...


  • Chicago, Illinois, United States WEX, Inc. Full time

    About WEX, Inc.WEX, Inc. is a leading provider of business solutions for the automotive repair industry and other markets. Our sophisticated business solutions empower a diverse range of customers, generating rich and complex data that holds immense potential to drive value for our customers and the business.The Data TeamThe Data team at WEX, Inc. builds big...


  • Chicago, Illinois, United States WEX Full time

    Are you an experienced Software Engineer looking for a new challenge? Do you have a passion for data engineering and leadership? We are seeking a Senior Software Engineer to join our Data Engineering team at WEX.In this role, you will lead the technical architecture and development of WEX's Data Lake platform. You will work closely with cross-functional...


  • Chicago, Illinois, United States Capital One Full time

    About the JobJob Description:We are seeking an experienced Data Engineer Lead to join our team. As a key member of our engineering team, you will design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.Key responsibilities include:Collaborating with Agile teams to deliver robust cloud-based...


  • Chicago, Illinois, United States Capital One Full time

    Capital One is seeking a skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will have the opportunity to design, develop, and implement technical solutions in cloud-based data warehousing services such as Redshift and Snowflake.About the RoleThis is a challenging role that requires expertise in big data technologies, including...


  • Chicago, Illinois, United States Publicis Groupe Full time

    About the PositionWe are seeking a highly skilled Big Data Engineer to join our team and contribute to the development of cutting-edge artificial intelligence (AI) and machine learning (ML) applications. As a Big Data Engineer, you will play a key role in delivering scalable, high-performance systems using Spark, Scala, and other big data technologies.In...

  • Data Engineer

    4 weeks ago


    Chicago, Illinois, United States Merge Resources Ltd. Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Merge Resources Ltd. in a hybrid remote work arrangement. As a Senior Data Engineer, you will be responsible for creating and maintaining databases, data pipelines, and data warehouses. Your expertise in on-premise infrastructure and data engineering will ensure that data is...


  • Chicago, Illinois, United States Aloden, Inc. Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to join our team at Aloden, Inc. as a Senior Hadoop Developer with Python skills. This is a full-time opportunity to work on designing, developing, and maintaining data pipelines using Hadoop, Spark, and Python/Scala.The ideal candidate will have strong understanding of Big Data concepts and...


  • Chicago, Illinois, United States Anywhere Real Estate Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Anywhere Real Estate. As a Senior Data Engineer, you will be responsible for designing and developing high-performance data solutions that meet the needs of millions of agents, brokers, home buyers, and sellers.The ideal candidate will have 7+ years of...


  • Chicago, Illinois, United States Saxon Global, Inc. Full time

    Saxon Global, Inc. is one of the fastest growing companies in the US, providing enhanced IT consulting and engineering solution services for 16 years.About UsWe specialize in Business Intelligence, Mobility, Big Data & Cloud and provide IT tools and services to help organizations across industry verticals such as Financial Services, Retail, Telecom,...


  • Chicago, Illinois, United States WEX Full time

    About the RoleWe are seeking a highly skilled Senior Software Developer - Big Data to join our team. As a key member of our engineering organization, you will be responsible for designing, building, and maintaining large-scale big data systems and platforms that support our business operations.The ideal candidate will have a strong understanding of big data...


  • Chicago, Illinois, United States Mindlance Full time

    We are looking for a skilled Data Engineer to lead our big data initiatives in Chicago, IL. As a key member of our team, you will be responsible for architecting and implementing large-scale data systems using cutting-edge technologies.**Job Description:Technical Requirements:Expertise in Scala, Spark, AWS (Lambdas), and Python.Strong understanding of data...


  • Chicago, Illinois, United States Crowe Full time

    Data Engineer Senior Associate Job Description As a Data Engineer Senior Associate at Crowe, you will play a critical role in designing, developing, and maintaining critical infrastructure for analytical support and solution development across the organization. Your primary responsibilities will include:• Designing and developing advanced data pipelines...


  • Chicago, Illinois, United States Algobrain Full time

    Job OverviewAbout AlgobrainWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team and contribute to the development of scalable data pipelines in our enterprise analytical data environment, UDH.


  • Chicago, Illinois, United States NielsenIQ Full time

    Job OverviewNielsenIQ is seeking a Senior Data Engineer with hands-on experience in Python and Pyspark to support software development activities in an Agile environment. The ideal candidate will possess strong technical, analytical, and interpersonal skills.About NielsenIQNielsenIQ is the world's leading consumer intelligence company, delivering...


  • Chicago, Illinois, United States Amazon Full time

    About the RoleWe are seeking a talented Senior Data Engineer to join our Science Innovation team at Amazon. As a Senior Data Engineer, you will play a critical role in building scalable and robust data systems that will drive innovation and growth for Amazon Prime.Key Responsibilities- Design and implement large-scale data pipelines for machine learning...


  • Chicago, Illinois, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    **About Quanteam - North America (RAINBOW PARTNERS Group)**We are a leading technology partner in the banking industry, committed to delivering innovative solutions that drive business growth.In this role, you will have the opportunity to work on high-profile projects, collaborating with cross-functional teams to design and implement scalable data pipelines...


  • Chicago, Illinois, United States Epsilon Data Management, LLC Full time

    About EpsilonEpsilon Data Management, LLC is a global data, technology, and services company that powers the marketing and advertising ecosystem. With decades of experience, we provide marketers from leading brands with the data, technology, and services needed to engage consumers effectively.Job DescriptionWe are seeking an experienced Data Engineer Lead to...


  • Chicago, Illinois, United States DRW Full time

    We are looking for a highly skilled Senior Big Data Developer to join our team at DRW. As a Senior Big Data Developer, you will play a key role in designing and building an innovative data platform used by Traders, Quantitative Researchers, and Back-Office personnel to analyze financial markets, determine trading opportunities, establish new strategies, and...

  • Senior Data Engineer

    1 month ago


    Chicago, Illinois, United States Oak Street Health Full time

    Role OverviewOak Street Health is seeking a highly skilled Data Engineer to join our team. The ideal candidate will have extensive knowledge of modern programming languages, designing and developing data solutions, and experience with cloud orchestration and automation tools.Key ResponsibilitiesDesign and develop data solutions to consume data from multiple...