Big Data Architect

2 weeks ago


Chicago, United States NavitsPartners Full time
Job DescriptionJob Description

Position: Big Data Architect
Location: Chicago, IL
Duration: 1 Year

Job Description:

We are seeking a highly skilled Principal Consultant-Senior Data Engineer SRE (Site Reliability Engineer) to join our team in Chicago, IL. In this role, you will be responsible for designing, building, securing, and maintaining data infrastructure on Google Cloud Platform (GCP). You will play a critical role in optimizing data pipelines, ensuring data integrity and consistency, enhancing system resiliency, and maintaining and improving data security.

Responsibilities:

  • Automate data tasks on GCP to streamline data operations and improve efficiency.
  • Collaborate with data domain owners, data scientists, and stakeholders to ensure effective consumption of data on GCP.
  • Design, build, secure, and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP.
  • Measure and monitor the quality of data on GCP data platforms and implement robust monitoring and alerting systems to proactively identify and resolve issues.
  • Develop automation scripts and tools to streamline data operations and make them scalable.
  • Optimize data systems to ensure efficient data processing, reduce latency, and improve overall system performance.
  • Collaborate with data and infrastructure teams to forecast data growth and plan for future capacity requirements.
  • Ensure data security and compliance with data protection regulations, implementing best practices for data access controls and encryption.
  • Collaborate with data engineers, data scientists, and software engineers to troubleshoot issues and support data-driven initiatives.
  • Continuously assess and improve data infrastructure and data processes to enhance reliability, efficiency, and performance.
  • Maintain clear and up-to-date documentation related to data systems, configurations, and standard operating procedures.

Qualifications:

Minimum Qualifications / Skills:

  • Bachelor’s or master’s degree in computer science, Software Engineering, Data Science, or related field, or equivalent practical experience.

Preferred Qualifications/ Skills:

  • Proficiency in data technologies such as relational databases, data warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure).
  • Strong programming skills in languages like Python, Java, or Scala, with experience in automation and scripting.
  • Experience with containerization and orchestration tools like Docker and Kubernetes.
  • Experience with data governance, data security, and compliance best practices on GCP.
  • Solid understanding of software development methodologies and best practices, including version control (e.g., Git) and CI/CD pipelines.
  • Strong background in cloud computing and data-intensive applications and services, with a focus on Google Cloud Platform.
  • Experience with data quality assurance and testing on GCP.
  • Proficiency with GCP data services (BigQuery, Dataflow, Data Fusion, Dataproc, Cloud Composer, Pub/Sub, Google Cloud Storage).
  • Strong understanding of logging and monitoring using tools such as Cloud Logging, ELK Stack, AppDynamics, New Relic, Splunk, etc.
  • Knowledge of AI and client tools is a plus.
  • Google Associate Cloud Engineer or Data Engineer certification is a plus.
  • Experience in data engineering or data science on GCP.

ChatGPT can make mistakes


  • Data Architect

    2 weeks ago


    Chicago, United States CyberTec Full time

    Job Title : Data Architect- Location: Chicago , IL Must live in Chicago and go downtown Job Type : 75% onsite Duration : 12 months Opening : 1 Opening ! Must have: - Data +Application Architect for MDM solution. - Design a Unique Guest ID real-time integration solution, with multiple data providers and multiple consumers. - Experience with MDM solutions and...

  • Big Data Engineer

    4 weeks ago


    Chicago, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Big Data Engineer

    1 month ago


    Chicago, United States Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Big Data Architect

    4 days ago


    Chicago, United States NavitsPartners Full time

    Job Description Job Description Position: Big Data Architect Location: Chicago, IL Duration: 1 Year Job Description: We are seeking a highly skilled Principal Consultant-Senior Data Engineer SRE (Site Reliability Engineer) to join our team in Chicago, IL. In this role, you will be responsible for designing, building, securing, and maintaining data...

  • Data Architect

    2 weeks ago


    Chicago, United States TechWish Full time

    Data Architect Must be local to Chicago very strong skills with Snowflake ****MUST HAVE VERY STRONG SNOWFLAKE Work on a Snowflake DW design and implementation. Design and deploy services to AWS using Terraform and Cloud formation stack. Design CICD pipelines for applications and deploy them. Design near real-time data pipelines using Kafka streaming...

  • Data Architect

    1 month ago


    Chicago, United States TD Synnex - SHI for Chicago Public Schools (Central Office) Full time

    Chicago Public Schools (CPS) is one of the largest school districts in the United States, serving over 320,000 students in 600+ schools and employing approximately 40,000 people, most of them teachers. CPS has set ambitious goals to ensure that every student, in every school and every neighborhood, has access to a world-class learning experience that...

  • Big Data Developer

    4 days ago


    Chicago, United States NEXT GEN IT INC Full time

    **Top Skills - Must Haves** - Hadoop - Sql - Spark - rest api - PHP (must have) - Python - Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL. Experience working with SPARK Structured steaming is ideal. - Data ingestion experience from message queue, file share, REST API, relational database, etc. and experience with data formats like json,...


  • Chicago, United States Infinite Computer Solutions Full time

    Job descriptionMSBI Expert having 5+ years of Experience in various data management projects like data migration, data warehousing and Business Intelligence. Must have handled data management project for complete SDLC life cycle 5+ years of Hands on experience in SSIS, SSRS and SSMS. Having very strong SQL Query and SSIS performance optimization skill...

  • Data Architect

    3 hours ago


    Chicago, United States AgnesCole Consulting Full time

    Data ArchitectA globally recognised client of our is looking for a Data architect to join their team. The Architect will be an experienced professional with exceptional leadership skills and a robust background in data architecture to drive the development of a self-sustainable BI platformThis is an excellent opportunity to make your mark on a globally...


  • Chicago, United States Bank of America Full time

    Job Description:At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day.One of the keys to driving Responsible Growth is being a great place to work for our...


  • Chicago, Illinois, United States Bank of America Full time

    Job Description:At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities and shareholders every day.One of the keys to driving Responsible Growth is being a great place to work for our...

  • Data Architect

    7 days ago


    Chicago, United States ActiveCampaign Full time

    We are seeking an experienced Data Architect to guide the design, modeling, and implementation of our customer data platform. As a Data Architect, you can translate business requirements into data management and technology requirements, strategy, principles, and architectures. In this role you will play a pivotal role in implementing scalable and performant...


  • Chicago, United States UX Hires Full time

    Senior Data ArchitectLocation: Hybrid Chicago Area. Work onsite 3-5 days a week.Our client, a leader in global market access, is looking for a Sr. Data Architect – Team Lead. Their ideal candidate will work with their enterprise architect to develop a program, run as process owner, and build/configure acquire tooling to support the program. Experience with...

  • Cloud Data Architect

    2 weeks ago


    Chicago, United States Tekfortune Inc Full time

    Role: Cloud Data Architect Job Location: Chicago, IL Mandatory required skills Strong Data Background Job Description ¿ Responsible for ensuring that the data management and governance frameworks are in place and adhered to ¿ Responsible for Architecting, designing and building out the AWS services ¿ Responsible for guiding and resolving issues with AWS...


  • chicago, United States United Airlines Full time

    There’s never been a more exciting time to join United Airlines. We’re on a path towards becoming the best airline in the history of aviation. And we’re growing – in the years ahead, we’ll hire tens of thousands of people across every area of the airline. Our careers include a competitive benefits package aimed at keeping you happy, healthy and...

  • Data Modeler

    4 weeks ago


    Chicago, Illinois, United States Cogent Data Solutions LLC Full time

    Job Description We are looking for a Data Modeler who will interact with data architects; database administrators; business analysts; product owners; report and application development teams; and data governance / data quality teams supporting a variety of modeling needs. If you are looking for a role developing and implementing data models we would love to...

  • Data Modeler

    1 month ago


    Chicago, United States Cogent Data Solutions LLC Full time

    Job Description We are looking for a Data Modeler who will interact with data architects; database administrators; business analysts; product owners; report and application development teams; and data governance / data quality teams supporting a variety of modeling needs. If you are looking for a role developing and implementing data models we would love to...

  • Data Modeler

    6 days ago


    Chicago, Illinois, United States Cogent Data Solutions LLC Full time

    Job Description We are looking for a Data Modeler who will interact with data architects; database administrators; business analysts; product owners; report and application development teams; and data governance / data quality teams supporting a variety of modeling needs. If you are looking for a role developing and implementing data models we would love to...

  • Data Modeler

    1 month ago


    Chicago, United States Cogent Data Solutions LLC Full time

    Job Description We are looking for a Data Modeler who will interact with data architects; database administrators; business analysts; product owners; report and application development teams; and data governance / data quality teams supporting a variety of modeling needs. If you are looking for a role developing and implementing data models we would love...


  • Chicago, United States Selby Jennings Full time

    Selby Jennings has partnered with a leading clearing house that is looking for a Data Architect to join their team at the Principal level. This role is offered on a hybrid capacity out of Chicago or Dallas.The Principal, Data Architecture will have the following responsibilities: Design the data architecture of organization to support data driven...