Cloud Data Infrastructure Engineer

3 days ago

Austin, Texas, United States AgileEngine Full time

**Job Description**

About AgileEngine

We are an award-winning custom software development company that helps companies across 15+ industries change the lives of millions.

This is a challenging environment where you will work with the best and be encouraged to learn and experiment every day. If you like working collaboratively with other engineers, architects, data scientists, analytics teams, and business product owners in an agile environment, this might be the perfect fit for you.

The Role

As our ideal candidate, you will architect, build, and support the operation of Cloud and On-Premises enterprise data infrastructure and tools. You will design and build robust, reusable, and scalable data-driven solutions and data pipeline frameworks to automate the ingestion, processing, and delivery of both structured and unstructured batch and real-time streaming data.

You will also build data APIs and data delivery services to support critical operational processes, analytical models, and machine learning applications. Additionally, you will assist in selecting and integrating data-related tools, frameworks, and applications required to expand platform capabilities.

Requirements
  • 4+ years of experience with Python or Java (Python preferably)
  • 4+ years of experience in building data lake, cloud data platform leveraging cloud (GCP/AWS) cloud native architecture, ETL/ELT, and data integration
  • Three years of development experience with cloud services (AWS, GCP, AZURE) utilizing various support tools (e.g., GCS, Dataproc, Cloud Dataflow, Airflow (Composer), Kafka, Cloud Pub/Sub)
  • Expertise in developing distributed data processing and Streaming frameworks and architectures (Apache Spark, Apache Beam, Apache Flink)
  • Experience with Snowflake is a must
  • In-depth knowledge of NoSQL database technologies (e.g., MongoDB, BigTable, DynamoDB)
  • Expertise in build and deployment tools - (Visual Studio, PyCharm, Git/Bitbucket/Bamboo, Maven, Jenkins, Nexus)
  • 4+ years of experience and expertise in database design techniques and philosophies (e.g., RDBMS, Document, Star Schema, Kimball Model)
  • 4 years of experience with integration and service frameworks (e.g., API Gateways, Apache Camel, Swagger API, Zookeeper, Kafka, messaging tools, microservices)
  • Expertise with containerized Microservices and REST/GraphQL-based API development
  • Experience leveraging continuous integration/development tools (e.g., Jenkins, Docker, Containers, OpenShift, Kubernetes, and container automation) in a Ci/CD pipeline
  • Advanced understanding of software development and research tools
  • Attention to detail and results-oriented, with a strong customer focus
  • Ability to work as part of a team and independently
  • Analytical and problem-solving skills
  • Problem-solving and technical communication skills
  • Ability to prioritize workload to meet tight deadlines
  • Should have working experience with wealth asset management projects
  • Upper-intermediate English level

  • Cloud Data Infrastructure Engineer

    4 weeks ago

    Austin, Texas, United States Paradromics, Inc. Full time

    Role OverviewA key role in our team, the Cloud Data Infrastructure Engineer will be responsible for developing and maintaining systems to automate and accelerate engineering and data science efforts. These systems span needs across hardware in the loop testing, data collection/curation, and data science pipelines.ResponsibilitiesAutomation and...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Austin, Texas, United States Microsoft Corporation Full time

    Job DescriptionMicrosoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft's expanding Cloud Infrastructure. We are responsible for powering Microsoft's "Intelligent Cloud" mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft's over 200 online businesses including Bing, MSN,...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Austin, Texas, United States MNTN Full time

    We are looking for a talented Cloud Infrastructure Engineer to join our DevOps team at MNTN. In this role, you will be responsible for designing and implementing scalable and secure cloud infrastructure using AWS.About the RoleAs a Cloud Infrastructure Engineer, you will play a key part in supporting the MNTN platform and collaborating with our Engineering...

  • Cloud Infrastructure Engineer

    4 days ago

    Austin, Texas, United States MNTN Full time

    About the Role:We are seeking an experienced Cloud Infrastructure Engineer to join our team at MNTN. As a key member of our DevOps team, you will play a vital role in designing, building, and maintaining our cloud infrastructure.Our ideal candidate will have a deep understanding of AWS services, including VPC, IAM, EC2, EKS, S3, and others. You will be...

  • Cloud Infrastructure Engineer

    1 week ago

    Austin, Texas, United States Overclock Labs Full time

    Cloud Infrastructure EngineerWant to shape the future of cloud computing?As a Cloud Infrastructure Engineer at Overclock Labs, you will be responsible for designing, deploying, and maintaining our decentralized cloud infrastructure.We are seeking an experienced engineer with a strong background in cloud infrastructure, containerization, and orchestration. If...

  • Cloud Infrastructure Engineer

    1 week ago

    Austin, Texas, United States Eliassen Group Full time

    About the RoleWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Eliassen Group. As a Senior AWS Developer, you will play a crucial role in our cloud transformation efforts, designing and deploying high-performing AWS infrastructure that supports scalable and secure applications.The ideal candidate will have advanced expertise...

  • Cloud Infrastructure Engineer

    1 week ago

    Austin, Texas, United States Crescens Full time

    About the Job: We are looking for a highly skilled Cloud Infrastructure Engineer to join our team at Crescens. As a Cloud Infrastructure Engineer, you will be responsible for designing, building, and maintaining scalable and secure cloud infrastructure on AWS. Your expertise in cloud computing, security, and compliance will be crucial in ensuring that our...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Austin, Texas, United States MNTN Full time

    About the RoleWe're seeking an experienced Cloud Infrastructure Engineer to join our DevOps team at MNTN. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining our cloud infrastructure on AWS.Key ResponsibilitiesDesign and implement scalable, secure, and high-performing cloud infrastructure on AWS.Develop...

  • Senior Cloud Data Engineer

    1 week ago

    Austin, Texas, United States Perfict Global, Inc. Full time

    We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Perfict Global, Inc. In this role, you will be responsible for designing and implementing cloud-based data engineering solutions and ensuring the smooth operation of our cloud infrastructure.About UsWe are a leading IT consulting services provider that focuses on delivering...

  • Cloud Infrastructure Engineer

    1 week ago

    Austin, Texas, United States Inficare Full time

    Job Title: Cloud Infrastructure EngineerWe are looking for a talented Cloud Infrastructure Engineer to join our team at Inficare in Austin, TX. As a key member of our cloud infrastructure team, you will be responsible for designing, building, and deploying scalable and secure cloud infrastructure on AWS. You will work closely with our development teams to...

  • Cloud Infrastructure Engineer

    3 days ago

    Austin, Texas, United States Tranzeal Full time

    Job Overview\ Tranzeal is seeking a skilled Cloud Infrastructure Engineer to join our team. In this role, you will be responsible for designing and building cloud-based infrastructure using AWS, GCP, and other technologies. You will work closely with our engineering team to develop and deploy scalable, secure, and highly available systems.\ About the Role:...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Austin, Texas, United States Overclock Labs Full time

    About the Role:As a Sr. DevOps Engineer at Overclock Labs, you will play a crucial part in managing and maintaining the network of compute providers. This is an excellent opportunity to expand your scope and contribute to the development of the Web 3.0 decentralized infrastructure of the future.Key Responsibilities:Build, configure, manage, and maintain...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Austin, Texas, United States Cognite Full time

    Job OverviewWe are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Cognite. As a key member of our infrastructure group, you will be responsible for designing, implementing, and maintaining our cloud infrastructure. This includes provisioning cloud resources with Terraform, supporting our service teams with CI/CD services, and...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Austin, Texas, United States Hill Country Project Management LLC Full time

    Job OverviewHill Country Project Management LLC is seeking a highly skilled Cloud Infrastructure Engineer to join our team. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing cloud-based infrastructure on AWS.Estimated Salary: $120,000 - $180,000 per yearWe are looking for a strong background in Agile...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Austin, Texas, United States AutoRABIT Holding Inc. Full time

    We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at AutoRABIT Holding Inc. This is a 100% remote job.As a key member of our engineering team, you will play a critical role in designing, implementing, and maintaining scalable, resilient, and secure infrastructure using AWS. You will work closely with cross-functional teams to...

  • Software Development Engineer

    1 week ago

    Austin, Texas, United States Cognite Full time

    About the RoleCognite is a global leader in industrial data fusion, and we're looking for a talented Software Development Engineer - Cloud Infrastructure to join our team. You will work alongside other engineers to develop robust infrastructure for deploying Cognite's products on multiple clouds, including Azure, Google Cloud, AWS, and OpenShift. Your focus...

  • Cloud Research Engineer

    1 week ago

    Austin, Texas, United States Emerald Cloud Lab Full time

    Job SummaryWe are seeking a skilled Cloud Research Engineer to join our team at Emerald Cloud Lab. As a key member of our engineering team, you will design and build distributed systems that support our cloud-based laboratory environment. Your expertise in Docker containers on AWS will be crucial in ensuring the scalability and performance of our...

  • Cloud Infrastructure Engineer

    6 days ago

    Austin, Texas, United States Hill Country Project Management LLC Full time

    Job Title: Cloud Infrastructure EngineerCompany Overview: Hill Country Project Management LLC is a leading provider of project management services in the Austin Metro Area.Estimated Salary: $85,000 - $110,000 per year.Job Description:We are seeking an experienced Cloud Infrastructure Engineer to join our team. The successful candidate will be responsible for...

  • Cloud Infrastructure Engineer

    1 week ago

    Austin, Texas, United States Tranzeal Full time

    Job Summary:We are seeking a seasoned Cloud Infrastructure Engineer to join our team at Tranzeal. As a key contributor to our cloud infrastructure team, you will be responsible for designing, building, and maintaining scalable and secure cloud infrastructure.About the Role:Design and implement cloud infrastructure using AWS, GCP, and other cloud...

  • Cloud Infrastructure Engineer

    4 days ago

    Austin, Texas, United States One Elite Staffing Full time

    About the RoleWe are looking for a skilled Cloud Infrastructure Engineer to join our team. The successful candidate will have experience working with cloud-based infrastructure, security, and compliance.This is a 12+ month onsite opportunity in Austin, TX with an estimated hourly pay of $75.00.Key ResponsibilitiesDesign, implement, and maintain cloud-based...