Principal Consultant-Senior Data Engineer

1 month ago

Chicago, United States Genpact Full time

With a startup spirit and 115,000 + curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create meaningful transformation that moves us forward in our pursuit of a world that works better for people.

Now, we’re calling upon the thinkers and doers, those with a natural curiosity and a hunger to keep learning, keep growing. People who thrive on fearlessly experimenting, seizing opportunities, and pushing boundaries to turn our vision into reality. And as you help us create a better world, we will help you build your own intellectual firepower.

Welcome to the relentless pursuit of better.

Inviting applications for the role of Principal Consultant-Senior Data Engineer

Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitoring for data pipelines, and automating repetitive data-oriented tasks.

Responsibilities

  • Automate data tasks on GCP.
  • Work with data domain owners, data scientists and other stakeholders to that data is consumed effectively on GCP.
  • Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP.
  • Measure and monitor the quality of data on GCP data platforms.
  • Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to incidents promptly to minimize downtime and data loss.
  • Develop automation scripts and tools to streamline data operations and make them scalable to ensure accommodate growing data volumes and user traffic.
  • Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance.
  • Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements.
  • Ensure data security and compliance with data protection regulations. Implement best practices for data access controls and encryption.
  • Collaborate with data engineers, data scientists, and software engineers to understand data requirements, troubleshoot issues, and support data-driven initiatives.
  • Continuously assess and improve data infrastructure and data processes to enhance reliability, efficiency, and performance.
  • Maintain clear and up-to-date documentation related to data systems, configurations, and standard operating procedures.

Qualifications we seek in you

Minimum Qualifications / Skills

  • Bachelor’s or master’s degree in computer science, Software Engineering, Data Science or related field, or equivalent practical experience

Preferred Qualifications/ Skills

  • Proficiency in data technologies, such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure).
  • Strong programming skills in languages like Python (numpy, pandas, pyspark), Java (Core Java, Spark with Java, functional interface, lambda, java collections), or Scala, with experience in automation and scripting.
  • Experience with containerization and orchestration tools like Docker and Kubernetes is a plus.
  • Experience with data governance(data plex), data security, and compliance best practices on GCP.
  • Solid understanding of software development methodologies and best practices, including version control (e.g., Git) and CI/CD pipelines.
  • Strong background in cloud computing and data-Intensive applications and services, with a focus on Google Cloud Platform.
  • Experience with data quality assurance and testing on GCP.
  • Proficiency with GCP data services (BigQuery; Dataflow; Data Fusion; Dataproc; Cloud Composer; Pub/Sub; Google Cloud Storage).
  • Strong understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc.
  • Knowledge of AI and ML tools is a plus.
  • Google Associate Cloud Engineer or Data Engineer certification is a plus.
  • Experience in data engineering or data science on GCP.

The approximate annual base compensation range for this position is [$65,000 to $75,000]. The actual offer, reflecting the total compensation package plus benefits, will be determined by a number of factors which include but are not limited to the applicant’s experience, knowledge, skills, and abilities; geographic location; and internal equity.

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. For more information, visit www.genpact.com . Follow us on Twitter, Facebook, LinkedIn, and YouTube.

Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.

  • Principal Consultant-Senior Data Engineer

    1 month ago

    Chicago, United States Genpact Full time

    With a startup spirit and 115,000 + curious and courageous minds, we have the expertise to go deep with the world’s biggest brands—and we have fun doing it! We dream in digital, dare in reality, and reinvent the ways companies work to make an impact far bigger than just our bottom line. We’re harnessing the power of technology and humanity to create...

  • Principal Data Consultant

    2 weeks ago

    Chicago, United States Origami Risk LLC Full time

    Overview: A Principal Data Consultant is a Principal Technical Consultant specializing in data conversions. The person in this role is responsible for working with the client and Origami implementation team to design, configure, and test the Origami platform to best fit the client needs. **Responsibilities**: - Configures the Origami platform to meet...

  • Principal, Data Architect

    3 weeks ago

    Chicago, Illinois, United States Selby Jennings Full time

    Selby Jennings has partnered with a leading clearing house that is looking for a Data Architect to join their team at the Principal level. This role is offered on a hybrid capacity out of Chicago or Dallas. The Principal, Data Architecture will have the following responsibilities:Design the data architecture of organization to support data driven...

  • Senior Principal, Management Consulting

    3 weeks ago

    Chicago, Illinois, United States Publicis Sapient Full time

    As a Senior Principal, you will actively participate in the growth and development of our Management Consulting practice at Publicis Sapient. Your role will focus on shaping goal-oriented Digital Business Transformations for our clients and delivering strategic advice in the early stages of these transformations. You will work in multidisciplinary teams...

  • Data Principal Consultant

    4 weeks ago

    Chicago, United States AHEAD Full time

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation. At AHEAD, we prioritize creating a culture of belonging, where all perspectives and voices are represented, valued, respected, and heard. We...

  • Data Principal Consultant

    2 weeks ago

    Chicago, United States Ahead Inc. Full time

    AHEAD builds platforms for digital business. By weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises deliver on the promise of digital transformation.AtAHEAD, we prioritize creating a culture of belonging,where all perspectives and voices are represented, valued, respected, and heard. We...

  • Principal, Data Architecture

    1 month ago

    Chicago, United States Request Technology, LLC Full time

    ***Hybrid, 3 days onsite, 2 days remote******We are unable to sponsor as this is a permanent full-time role***A prestigious company is looking for a Principal, Data Architecture. This principal will focus on data architecture and design to support all IT departments throughout the company. These responsibilities include design of data lakes, data warehouses,...

  • Principal, Data Architecture

    1 month ago

    Chicago, United States Request Technology, LLC Full time

    ***Hybrid, 3 days onsite, 2 days remote******We are unable to sponsor as this is a permanent full-time role***A prestigious company is looking for a Principal, Data Architecture. This principal will focus on data architecture and design to support all IT departments throughout the company. These responsibilities include design of data lakes, data warehouses,...

  • Sr. Data Engineer

    1 week ago

    Chicago, United States Wavicle Data Solutions Full time

    About the Role We are looking for a Senior Data Engineer with strong real-life experience in python development, including pySpark in an AWS Cloud environment. The ideal engineer will have experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis and Lambda in S3, Redshift, RDS, and MongoDB/DynamoDB ecosystems....

  • Senior Solutions Consultant @TradeBeyond

    3 weeks ago

    Chicago, Illinois, United States Technical Consultant Full time

    The Senior Solutions Consultant will partner with Tradebeyond retail clients' key business users and IT organizations to design, configure, test and implement value-added business solutions built on the Tradebeyond platform. You will understand the digital goals of some of retails biggest names, from the high level down to the minutiae. Effectively and...

  • Senior Data Science Consultant

    20 hours ago

    Chicago, United States Data Spree GmbH Full time

    84.51Share this job Chicago, IL, USA Maximise your chances of a successful application to this job by ensuring your CV and skills are a good match. Remote Role Highlights Python Data Science Data Analysis Data Governance Dimensionality Reduction Computer Science UX Full Stack QA AI Research SME Automation Mathematics Statistics Economics Information...

  • Principal Data Scientist

    1 month ago

    Chicago, United States Tiger Analytics Full time

    Tiger Analytics is looking for experienced Principal Data Scientist to join our fast-growing advanced analytics consulting firm. Our employees bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and...

  • Principal Data Scientist

    1 month ago

    Chicago, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is looking for experienced Principal Data Scientist to join our fast-growing advanced analytics consulting firm. Our employees bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data....

  • Principal Consultant-Senior Data Engineer SRE

    2 months ago

    Chicago, United States Genpact Full time

    Include optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency where applicable, maintaining and improving data security, proactive alerting, and monitoring for data pipelines, and automating repetitive data-oriented tasks.Responsibilities:• Automate data tasks on GCP.• Work with data domain owners, data...

  • Senior Databricks Consultant

    3 weeks ago

    Chicago, United States Paul Murphy Associates Full time

    Title: Senior Databricks ConsultantLocation: Chicago Hybrid 60604Contract: Long TermOur client is seeking a contract Senior Databricks Consultant, you are very experienced with Azure Databricks and managing complex regulated data from source to reporting from on-prem to cloud. You will also be comfortable working in a data mesh architecture with landing zone...

  • Senior Databricks Consultant

    3 weeks ago

    Chicago, United States Paul Murphy Associates Full time

    Title: Senior Databricks ConsultantLocation: Chicago Hybrid 60604Contract: Long TermOur client is seeking a contract Senior Databricks Consultant, you are very experienced with Azure Databricks and managing complex regulated data from source to reporting from on-prem to cloud. You will also be comfortable working in a data mesh architecture with landing zone...

  • Senior Data Engineer

    3 weeks ago

    Chicago, Illinois, United States Kamet Consulting Group Full time

    Position: Senior Data Engineer / Power BI Developer (Pharmaceutical and Medical Devices)Description:We are in search of a seasoned Data Engineer / Power BI Developer with expertise in creating analytics and dashboards in the life sciences or healthcare consulting field, located in CA, TX, IL, or PA (open to considering other areas for qualified individuals)....

  • Principal Engineer, Aviation

    3 weeks ago

    Chicago, Illinois, United States Jabil Circuit, Inc. Full time

    JOB SUMMARYThe Principal Engineer is an expert in a particular field of engineering or within a particular sector. This role is experienced with leading design teams through full product development and into production. A Principal Engineer will be expected to demonstrate a level of expertise in a particular area that matches or exceeds the expertise of our...

  • Senior Data Engineer

    3 weeks ago

    Chicago, United States InterEx Group Full time

    Senior Data Engineer - Consumer GoodsTech Stack: Senior Data Engineer, Python, Azure Data Warehouse, Azure Databricks, Azure Synapse, PowerBIWe have an opening for a Senior Data Engineer (Azure Databricks, Azure Synapse, PowerBI) to join a high-performing Data Team within an IT department of 1050 heads. As a Senior, you will have the opportunity to mentor a...

  • Senior Data Engineer

    3 weeks ago

    Chicago, United States InterEx Group Full time

    Senior Data Engineer - Consumer GoodsTech Stack: Senior Data Engineer, Python, Azure Data Warehouse, Azure Databricks, Azure Synapse, PowerBIWe have an opening for a Senior Data Engineer (Azure Databricks, Azure Synapse, PowerBI) to join a high-performing Data Team within an IT department of 1050 heads. As a Senior, you will have the opportunity to mentor a...