Data Architect for Cloud-based Data Lake

3 days ago


Houston, Texas, United States AEG Full time
Job Overview
AEG is seeking a highly skilled Data Architect for Cloud-based Data Lake to join our Research & Development team within Baseball Operations. The successful candidate will design and implement a cloud-based data architecture, utilizing their expertise in cloud platforms such as Azure, AWS, or GCP. This role requires experience with ETL processes, Apache Spark, and proficiency in Python, SQL, and relational database structures.

The ideal candidate will be able to work collaboratively with software developers to support the growth of our data architecture and provide efficient access to data at various stages of transformation. They will also participate in rotating on-call schedules to tend to any immediate issues with our architecture and data.

Responsibilities:
  • Design and implement a cloud-based data architecture using cloud platforms such as Azure, AWS, or GCP.
  • Leverage ETL processes to develop and maintain data processing pipelines that provide efficient access to data at various stages of transformation.
  • Integrate structured, semi-structured, and unstructured data sources, handling various formats including Parquet, JSON, and more.
  • Automate workflows and monitoring procedures to promote a maintainable infrastructure.
  • Write clean and iterative code and leverage continuous integration practices to deploy, support and operate data pipelines.
  • Interact with stakeholders internal to R&D (research analysts, application developers, ) and external to understand their needs from our architecture and data.


  • Houston, Texas, United States Houston Astros Full time

    About the TeamWe are a dynamic team of professionals who are passionate about leveraging technology to drive business success. As a Data Engineer, you will play a critical role in designing and implementing a cloud-based data architecture using cutting-edge technologies.Your Key Responsibilities:Design and implement a cloud-based data architecture using...


  • Houston, Texas, United States Smartbridge Full time

    **Job Title:** Cloud Data Architect for Business TransformationWe are seeking a highly skilled Cloud Data Architect to join our team at Smartbridge. As a key member of our data and analytics team, you will be responsible for designing and implementing cloud-based data solutions that drive business growth and transformation.


  • Houston, Texas, United States AHEAD USA Full time

    Senior Data Engineer Salary: $130,000 - $200,000 per yearAHEAD USA is a leading provider of digital transformation solutions. We are currently seeking an experienced Senior Data Engineer to join our dynamic project teams. As a key member of our team, you will be responsible for strategic planning and hands-on engineering of Big Data and cloud environments...


  • Houston, Texas, United States HCSS Employer, Inc. Full time

    HCS Employer, Inc. is a software company based in Sugar Land, Texas, providing innovative solutions for the construction industry to streamline their operations.We're looking for a highly skilled Senior Data Engineer with 5+ years of experience in data engineering to lead the design, development, and management of scalable data architectures and...

  • Data Engineer

    3 days ago


    Houston, Texas, United States Indotronix International Corporation Full time

    Indotronix International Corporation is seeking a highly skilled Data Engineer to join our team in Houston. This exciting opportunity allows you to work on various data-related projects, leveraging your expertise in cloud architecture and big data analytics.About the RoleWe are looking for an experienced professional with strong knowledge of Azure services,...

  • Data Architect

    3 days ago


    Houston, Texas, United States Mitchell Martin Full time

    Data Transformation in the Energy SectorAt Mitchell Martin, we're revolutionizing data utilization in the energy industry by creating a cutting-edge international data platform. As a Senior Data Engineer, you'll play a pivotal role in expanding our data ecosystem and promoting best practices in data engineering.This is an exciting opportunity to contribute...


  • Houston, Texas, United States Inficare Full time

    Job Title: Senior Cloud Data Architect for Databricks and AWS About the Role: As a seasoned Cloud Data Architect at Inficare, you will play a critical role in designing and implementing cutting-edge data solutions using Databricks and AWS. Your expertise will drive the development of our Central hub for data across multiple platforms, ensuring seamless...

  • Cloud Data Engineer

    2 days ago


    Houston, Texas, United States Mitchell Martin Full time

    Data Engineering RoleMitchell Martin is seeking a Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for expanding our data ecosystem and promoting best practices in data engineering.This is an exciting opportunity to contribute to innovative solutions in a fast-paced and collaborative environment....


  • Houston, Texas, United States Neudesic, an IBM Company Full time

    About Neudesic, an IBM CompanyDriven by a passion for technology and innovation, we deliver quality solutions that help our customers succeed. With decades of experience, proven frameworks, and a disciplined approach, we quickly deliver reliable, high-performing solutions that drive business growth.Our team is built on core values that define who we are:...

  • Data Architect

    3 weeks ago


    Houston, Texas, United States Saxon Global Full time

    Job DescriptionJob SummaryJob Title: Data ArchitectJob Type: Full-timeLocation: HoustonJob Category: EngineeringJob DescriptionSaxon Global is seeking a highly skilled Data Architect to join our team in Houston. As a Data Architect, you will be responsible for designing and implementing data pipelines using Azure Synapse Analytics or Data Bricks.You will...

  • Senior Data Architect

    3 weeks ago


    Houston, Texas, United States ShiftCode Analytics Full time

    Job Requirements:We are seeking a highly skilled Data Engineer with 12+ years of experience to join our team at ShiftCode Analytics.Key Responsibilities:Design and develop data pipelines and ETL processes using Python.Work on data lake implementation and maintenance.Ensure data quality and integrity throughout the data pipeline.Collaborate with...


  • Houston, Texas, United States The Dignify Solutions LLC Full time

    Senior Data Architect PositionThe Dignify Solutions LLC is seeking an experienced Senior Data Architect to lead the design and implementation of our data management systems. This is a critical role that requires a deep understanding of data modeling principles and practices.About the Job:Key Responsibilities:Develop and maintain data models that support...


  • Houston, Texas, United States HCL Technologies Full time

    Job Title: Senior Data Science ArchitectJob Summary:We are seeking a highly skilled Senior Data Science Architect to join our team at HCL Technologies. The successful candidate will be responsible for designing and architecting large-scale data science solutions, leveraging their expertise in machine learning, artificial intelligence, and cloud computing.Key...


  • Houston, Texas, United States Saxon Global Full time

    About the Role: Saxon Global seeks an accomplished Data Architect IV to join our team in Tulsa. This position offers a rewarding opportunity for an experienced professional with expertise in designing scalable real-time data solutions for Oil and Gas clients.Key Responsibilities:Design and implement data architectures that support real-time production, field...


  • Houston, Texas, United States ZipRecruiter Full time

    About the RoleAs a Senior Data Engineer at HCSS, you will work closely with cross-functional teams to ensure our data infrastructure supports analytics, reporting, and data-driven decision-making. You will architect and build data systems, integrate data from multiple sources, leverage cloud infrastructure, develop complex data models, ensure data...


  • Houston, Texas, United States Manpower Group Inc. Full time

    Job Title: Cloud Infrastructure ArchitectLocation: Houston, TXEstimated Salary: $140,000 - $200,000 per yearWe are seeking a skilled Cloud Infrastructure Architect to join our team in Houston, TX. As a Cloud Infrastructure Architect, you will be responsible for designing and developing cloud-based infrastructure to support machine learning operations.The...


  • Houston, Texas, United States Gulf States Toyota Full time

    Gulf States Toyota is seeking a highly skilled Data Engineer to join our Data Science and Analytics team. This is an excellent opportunity for a motivated individual to leverage their expertise in designing, implementing, and managing robust data platforms.About the RoleThe successful candidate will play a crucial role in architecting and implementing...


  • Houston, Texas, United States Saxon Global Full time

    Job Title: Data Architect IVJob Summary:We are seeking a highly experienced Real-Time Data Architect to join our team at Saxon Global. The ideal candidate will have robust experience in designing and implementing data-driven solutions for Oil and Gas clients, with a strong background in system integration, solution architecture, cloud computing, and business...

  • Cloud Data Engineer

    3 weeks ago


    Houston, Texas, United States FIRST SOFTSOLUTIONS INC Full time

    We are seeking a highly skilled Data Engineer to join our team at First Softsolutions Inc. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data structures, pipelines, and efficient ETL workflows to support our business applications.Key Responsibilities:Design and develop scalable data...


  • Houston, Texas, United States Neudesic, an IBM Company Full time

    About the RoleWe are seeking skilled Databricks Engineers to join our Data and AI Practice at Neudesic, an IBM Company. The ideal candidate will have extensive experience building scalable data pipelines and performing advanced analytics using Databricks. This role involves leveraging Apache Spark and Databricks to process and analyze large datasets,...