Big Data Architect

3 weeks ago


Chicago, United States NavitsPartners Full time

Job Description

Job Description

Position:

Big Data Architect Location:

Chicago, IL Duration:

1 Year Job Description: We are seeking a highly skilled Principal Consultant-Senior Data Engineer SRE (Site Reliability Engineer) to join our team in Chicago, IL. In this role, you will be responsible for designing, building, securing, and maintaining data infrastructure on Google Cloud Platform (GCP). You will play a critical role in optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency, and maintaining and improving data security. Responsibilities: Automate data tasks on GCP to streamline data operations and improve efficiency. Collaborate with data domain owners, data scientists, and stakeholders to ensure effective consumption of data on GCP. Design, build, secure, and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP. Measure and monitor the quality of data on GCP data platforms and implement robust monitoring and alerting systems to proactively identify and resolve issues. Develop automation scripts and tools to streamline data operations and make them scalable. Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance. Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements. Ensure data security and compliance with data protection regulations, implementing best practices for data access controls and encryption. Collaborate with data engineers, data scientists, and software engineers to troubleshoot issues and support data-driven initiatives. Continuously assess and improve data infrastructure and data processes to enhance reliability, efficiency, and performance. Maintain clear and up-to-date documentation related to data systems, configurations, and standard operating procedures. Qualifications: Minimum Qualifications / Skills: Bachelor’s or master’s degree in computer science, Software Engineering, Data Science, or related field, or equivalent practical experience. Preferred Qualifications/ Skills: Proficiency in data technologies such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure). Strong programming skills in languages like Python, Java, or Scala, with experience in automation and scripting. Experience with containerization and orchestration tools like Docker and Kubernetes. Experience with data governance, data security, and compliance best practices on GCP. Solid understanding of software development methodologies and best practices, including version control (e.g., Git) and CI/CD pipelines. Strong background in cloud computing and data-intensive applications and services, with a focus on Google Cloud Platform. Experience with data quality assurance and testing on GCP. Proficiency with GCP data services (BigQuery, Dataflow, Data Fusion, Dataproc, Cloud Composer, Pub/Sub, Google Cloud Storage). Strong understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc. Knowledge of AI and client tools is a plus. Google Associate Cloud Engineer or Data Engineer certification is a plus. Experience in data engineering or data science on GCP. ChatGPT can make mistakes

#J-18808-Ljbffr


  • Big Data Architect

    7 days ago


    Chicago, United States Insight Global Full time

    Title: Big Data Architect Location: Chicago, IL or NYC, NYShift: 1st, Monday-FridayPay: 160k-165k Daily Responsibilities: As an Enterprise Architect for Big Data, you play a critical role in shaping the organization’s data strategy, ensuring the accuracy, security, and accessibility of Big Data. Reporting to the Director of Enterprise Architecture, you...

  • Big Data Architect

    5 days ago


    Chicago, United States Insight Global Full time

    Title: Big Data Architect Location: Chicago, IL or NYC, NYShift: 1st, Monday-FridayPay: 160k-165k Daily Responsibilities: As an Enterprise Architect for Big Data, you play a critical role in shaping the organization's data strategy, ensuring the accuracy, security, and accessibility of Big Data. Reporting to the Director of Enterprise Architecture, you...


  • Chicago, United States Suntory Global Spirits Full time

    At Suntory Global Spirits, we craft spirits of the highest quality and deliver brilliant experiences to people around the world. Suntory Global Spirits has evolved into the world's third largest leading premium spirits company ... where each employee is treated like family and trusted with legacy. With our greatest assets - our premium spirits and our people...

  • Data Architect

    6 days ago


    Chicago, United States CyberTec Full time

    Job Title : Data Architect- Location: Chicago , IL Must live in Chicago and go downtown Job Type : 75% onsite Duration : 12 months Opening : 1 Opening ! Must have: - Data +Application Architect for MDM solution. - Design a Unique Guest ID real-time integration solution, with multiple data providers and multiple consumers. - Experience with MDM solutions and...

  • Big Data Engineer

    2 months ago


    Chicago, United States Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Big Data Engineer

    1 month ago


    Chicago, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Big Data Architect

    4 weeks ago


    Chicago, United States NavitsPartners Full time

    Job DescriptionJob DescriptionPosition: Big Data Architect Location: Chicago, ILDuration: 1 YearJob Description:We are seeking a highly skilled Principal Consultant-Senior Data Engineer SRE (Site Reliability Engineer) to join our team in Chicago, IL. In this role, you will be responsible for designing, building, securing, and maintaining data infrastructure...

  • Data Architect

    6 days ago


    Chicago, United States TechWish Full time

    Data Architect Must be local to Chicago very strong skills with Snowflake ****MUST HAVE VERY STRONG SNOWFLAKE Work on a Snowflake DW design and implementation. Design and deploy services to AWS using Terraform and Cloud formation stack. Design CICD pipelines for applications and deploy them. Design near real-time data pipelines using Kafka streaming...

  • Data Architect

    5 days ago


    Chicago, IL, United States Diverse Lynx Full time

    Role: Data Architect Position Type : Contract Contract Duration : 6+ months with possibility of extension Work Location : Chicago, IL ( Hybrid, onsite from day one) Primary Skills: AWS, Python, Spark, KAFKA Job Description: Strong expertise in Datawarehouse/data architecture domain. Strong experience with SQL and a good...


  • Chicago, United States NTT DATA Full time

    **Req ID**: 283299 We are currently seeking a Azure Kubernetes Services Data Developer - REMOTE or HYBRID to join our team in Chicago, Illinois (US-IL), United States (US). **Day to Day Responsibilities**: - Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed...

  • Data Architect

    7 days ago


    Chicago, United States ActiveCampaign Full time

    We are seeking an experienced Data Architect to guide the design, modeling, and implementation of our customer data platform. As a Data Architect, you can translate business requirements into data management and technology requirements, strategy, principles, and architectures. In this role you will play a pivotal role in implementing scalable and performant...


  • Chicago, IL, United States Ascendion Inc. Full time

    Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. We have a culture...


  • Chicago, IL, United States Ascendion Inc. Full time

    Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients. We have a culture...

  • Data Architect

    3 days ago


    Chicago, United States AgnesCole Consulting Full time

    Data Architect - SnowflakeOur client is a leading firm in Chicago dedicated to delivering innovative solutions and exceptional service. We are seeking a talented and experienced Data Architect with expertise in Snowflake to join their team in Chicago. If you are passionate about data, possess excellent data modelling skills, and thrive in a dynamic...

  • Data Architect

    2 days ago


    Chicago, United States AgnesCole Consulting Full time

    Data Architect - SnowflakeOur client is a leading firm in Chicago dedicated to delivering innovative solutions and exceptional service. We are seeking a talented and experienced Data Architect with expertise in Snowflake to join their team in Chicago. If you are passionate about data, possess excellent data modelling skills, and thrive in a dynamic...

  • Data Architect

    7 days ago


    Chicago, United States Staffingine LLC Full time

    Position:- Data Architect Location:- Chicago, IL Job description IoT Data Architect – Architecting, solution evaluation, testing, advisory as per Client's use cases. Ongoing optimization of current solution, evaluation, and recommendation for new services/products Understand functional and non-functional requirements Define and finalize high-level...

  • Data Architect

    7 days ago


    Chicago, United States Chicago Public Schools Full time

    Chicago Public Schools (CPS) is one of the largest school districts in the United States, serving over 320,000 students in 600+ schools and employing approximately 40,000 people, most of them teachers. CPS has set ambitious goals to ensure that every student, in every school and every neighborhood, has access to a world-class learning experience that...


  • Chicago, Illinois, United States United Airlines Full time

    There's never been a more exciting time to join United Airlines. We're on a path towards becoming the best airline in the history of aviation. Our shared purpose – Connecting People, Uniting the World – is about more than getting people from one place to another. It also means that as a global company that operates in hundreds of locations around the...

  • Lead Data Architect

    7 days ago


    Chicago, United States Northern Trust Full time

    About Northern Trust: Northern Trust, a Fortune 500 company, is a globally recognized, award-winning financial institution that has been in continuous operation since 1889. Northern Trust is proud to provide innovative financial services and guidance to the worlds most successful individuals, families, and institutions by remaining true to our enduring...


  • Chicago, United States Career Connections Inc. Full time

    Great new fulltime position open for an Enterprise Architect with strong Big Data experience! We are searching for someone to serve as the domain expert for Big Data, setting strategies, standards, best practices, etc. You will define patterns, builds reference models, and steward technology roadmaps to drive best practices, coach project delivery teams at...