Cloud Data Engineer

4 days ago

Austin, Texas, United States Unreal Gigs Full time

Job Overview:

We are seeking a highly skilled Cloud Data Engineer to join our team at Unreal Gigs. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining cloud-based data infrastructures that support analytical and operational needs across the organization.

About the Role:

The ideal candidate will have strong experience with cloud data platforms (AWS, GCP, Azure) and data processing tools like Apache Spark, Apache Beam, or AWS Glue. You will collaborate with data scientists, analysts, and software engineers to build data pipelines and storage solutions that are secure, efficient, and scalable.

Key Responsibilities:

  1. Data Pipeline Design and Development: Create and manage scalable data pipelines that support ETL (Extract, Transform, Load) processes. Develop automated solutions to handle data ingestion, transformation, and integration in cloud platforms such as AWS, GCP, or Azure.
  2. Data Architecture and Maintenance: Architect and maintain cloud-based data storage solutions, such as data lakes and warehouses, ensuring they align with business needs and best practices. Optimize data structures for performance and reliability.
  3. Data Strategy and Solution Collaboration: Work closely with data scientists, business analysts, and application developers to understand data requirements and implement solutions that support analytics and machine learning models.
  4. Data Security and Compliance: Implement and monitor security measures that protect data privacy and comply with industry standards (e.g., GDPR, HIPAA). Manage data access controls and audit logs to safeguard sensitive information.
  5. Data Processing Workflow Optimization: Improve the performance of data processing workflows by optimizing resource allocation and parallel processing techniques. Reduce latency and enhance the scalability of data systems.
  6. Data Operation Automation and Streamlining: Develop automation scripts and tools using languages such as Python or Java to streamline data processes and reduce manual intervention. Contribute to the efficiency and reliability of data operations.
  7. Data Pipeline Monitoring and Troubleshooting: Use monitoring tools and techniques to ensure the health and performance of data pipelines. Identify and troubleshoot issues promptly to maintain smooth data flow and system uptime.

Requirements:

  • Cloud Data Expertise: Strong experience with cloud data platforms (AWS, GCP, Azure) and data processing tools like Apache Spark, Apache Beam, or AWS Glue. Proficient in building scalable data solutions.
  • Programming and Scripting: Proficiency in Python, Java, or Scala for data manipulation and pipeline automation. Can create scripts that handle data transformation and integration tasks.
  • ETL and Data Pipeline Management: Experience in developing and managing complex ETL workflows that handle large data volumes. Skilled at building data pipelines that support real-time and batch processing.
  • Data Security and Compliance Knowledge: Familiarity with implementing data security measures and ensuring compliance with industry standards. Can configure access controls and monitor data usage.
  • Collaboration and Problem-Solving: Strong ability to work with cross-functional teams and troubleshoot data-related issues. Can clearly communicate technical concepts and solutions.

Education and Certifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. Equivalent experience in data engineering and cloud environments may be considered.
  • Certifications such as Google Professional Data Engineer, AWS Certified Big Data – Specialty, or Microsoft Certified: Azure Data Engineer Associate are highly desirable.

Experience Requirements:

  • 5+ years of experience in data engineering, with at least 3+ years focusing on cloud-based data solutions.
  • Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow, Dataflow, Step Functions).
  • Familiarity with database technologies such as SQL, NoSQL, and data warehousing solutions (e.g., BigQuery, Redshift, Snowflake).

Estimated Salary:$180,000 - $220,000 per annum

  • Data Engineer for Cloud Data Ecosystem

    7 days ago

    Austin, Texas, United States The University of Texas at Austin Full time

    **Job Summary:**The University of Texas at Austin seeks a skilled Data Engineer to join our team and contribute to the development of a next-generation data ecosystem. This position is an exciting opportunity to work with a cross-campus team using the latest cloud technologies to build a scalable information infrastructure.**Company Overview:**The University...

  • Senior Cloud Data Engineer

    1 week ago

    Austin, Texas, United States Perfict Global, Inc. Full time

    About Us:Perfict Global is a leading IT consulting services provider that delivers innovative business workforce solutions to Fortune 500 companies.Our professionals combine the best technologies to manage clients' complex business and technology needs, participate in implementation activities, and collaborate to meet client demands.We offer excellent...

  • Cloud Data Infrastructure Engineer

    2 days ago

    Austin, Texas, United States Paradromics, Inc. Full time

    Role OverviewA key role in our team, the Cloud Data Infrastructure Engineer will be responsible for developing and maintaining systems to automate and accelerate engineering and data science efforts. These systems span needs across hardware in the loop testing, data collection/curation, and data science pipelines.ResponsibilitiesAutomation and...

  • Cloud Data Architect

    1 week ago

    Austin, Texas, United States Unreal Gigs Full time

    Job Title: Cloud Data ArchitectWe are seeking a skilled Cloud Data Architect to join our team at Unreal Gigs.About the Role:This is an exciting opportunity for an experienced data professional to lead the design and implementation of cloud-based data solutions. As a Cloud Data Architect, you will work closely with cross-functional teams to architect and...

  • Cloud Data Architect

    7 days ago

    Austin, Texas, United States BD Full time

    Job Opportunity: Software Test Architect at BDWe are the makers of possible at BD, a global medical technology company. Our Purpose is to advance the world of health, and it's a challenging yet rewarding goal. To achieve this, we need talented professionals like you to help us evolve and improve our Cloud Data & Analytics Platform.We're seeking an...

  • Senior Cloud Engineer

    2 days ago

    Austin, Texas, United States Apple Full time

    Job SummaryAs a Senior Cloud Engineer at Apple, you will play a critical role in designing and implementing scalable cloud solutions that meet the needs of our customers.We are looking for an experienced engineer who can architect and deliver cloud-based systems that are secure, reliable, and highly available.Design and implement cloud-based systems that...

  • Cloud Infrastructure Engineer

    6 days ago

    Austin, Texas, United States MNTN Full time

    We are looking for a talented Cloud Infrastructure Engineer to join our DevOps team at MNTN. In this role, you will be responsible for designing and implementing scalable and secure cloud infrastructure using AWS.About the RoleAs a Cloud Infrastructure Engineer, you will play a key part in supporting the MNTN platform and collaborating with our Engineering...

  • Data Engineering Specialist

    7 days ago

    Austin, Texas, United States Unreal Gigs Full time

    At Unreal Gigs, we're seeking a highly skilled Data Engineering Specialist to join our team. This exciting role offers the opportunity to work with cutting-edge data technologies and architect scalable pipelines that power advanced analytics and machine learning.About the RoleWe're looking for a talented individual who can design, develop, and optimize data...

  • Cloud Infrastructure Engineer

    2 days ago

    Austin, Texas, United States B12 Government Solutions Full time

    Job SummaryWe are seeking an experienced Cloud Infrastructure Engineer to join our team at B12 Government Solutions. This is a 10-month contract opportunity in Austin, TX, with a competitive salary of $180,000 - $200,000 per annum.About the RoleThe successful candidate will be responsible for designing and implementing scalable, robust systems on the AWS...

  • Hadoop Engineer and Data Scientist Support Specialist

    2 days ago

    Austin, Texas, United States Currency Cloud Full time

    Company OverviewVisa is a leading provider of payment and technology solutions, with over 259 billion payments transactions processed annually across 200 countries and territories. Our mission is to connect the world through innovative, convenient, reliable, and secure payments networks, enabling individuals, businesses, and economies to thrive.Job SummaryWe...

  • Cloud Platform Engineering Lead

    6 days ago

    Austin, Texas, United States Think Onward Full time

    We're seeking a highly skilled Cloud Platform Engineering Lead to join our team at ThinkOnward. As a key member of our engineering team, you will play a vital role in shaping the architecture and strategy for our cloud-based platform.About ThinkOnwardAt ThinkOnward, we're more than just a company - we're a global community of experts and problem solvers. Our...

  • Data Engineer for Hybrid Cloud Solutions

    7 days ago

    Austin, Texas, United States IT EBusiness Consulting Services, Inc Full time

    We are seeking a highly skilled Data Scientist/Quant to join our team at IT EBusiness Consulting Services, Inc in New York City or Austin, TX. As a Data Scientist/Quant, you will be responsible for implementing data on-boarding and database management, building and maintaining fundamental market models for supply and demand, and developing and deploying...

  • Cloud Software Development Engineer

    6 days ago

    Austin, Texas, United States IBM Full time

    At IBM, we're seeking a skilled Cloud Software Development Engineer to join our Product Engineering team.About the RoleThis is an exciting opportunity to work on our SaaS-based microservices that provide automated actions to manage performance while being efficient.As a Cloud Software Development Engineer, you'll be responsible for developing new features...

  • Cloud Infrastructure Engineer

    6 days ago

    Austin, Texas, United States Apple Full time

    Company OverviewApple's Applied Machine Learning team is renowned for building scalable data science applications. As a valued member of our team, you will work on high-impact projects that serve various Apple lines of business.Salary and BenefitsWe offer a competitive salary range of $120,000 - $180,000 per annum, depending on experience. Additional...

  • Cloud Engineering Specialist

    6 days ago

    Austin, Texas, United States Diverse Lynx Full time

    Job Description:Are you a seasoned professional looking for a new challenge? We are seeking a highly skilled Cloud Engineering Specialist to join our team at Diverse Lynx LLC in the United States.Salary: $140,000 - $170,000 per year (estimated), based on industry standards and location. Our salary range takes into account your level of experience, skills,...

  • Cloud Infrastructure Engineer

    2 days ago

    Austin, Texas, United States Overclock Labs Full time

    About the Role:As a Sr. DevOps Engineer at Overclock Labs, you will play a crucial part in managing and maintaining the network of compute providers. This is an excellent opportunity to expand your scope and contribute to the development of the Web 3.0 decentralized infrastructure of the future.Key Responsibilities:Build, configure, manage, and maintain...

  • Data Engineer, Global Demand Specialist

    7 days ago

    Austin, Texas, United States Amazon Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team at Amazon. As a Data Engineer, you will play a key role in building and maintaining our distributed system for collecting and processing log events from multiple sources.Key Responsibilities:Data Engineering: Design, implement, and automate deployment of our distributed system for...

  • Cloud Infrastructure Engineer

    6 days ago

    Austin, Texas, United States MNTN Full time

    About the RoleWe're seeking an experienced Cloud Infrastructure Engineer to join our DevOps team at MNTN. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and maintaining our cloud infrastructure on AWS.Key ResponsibilitiesDesign and implement scalable, secure, and high-performing cloud infrastructure on AWS.Develop...

  • Cloud Infrastructure Engineer

    7 days ago

    Austin, Texas, United States AutoRABIT Holding Inc. Full time

    We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at AutoRABIT Holding Inc. This is a 100% remote job.As a key member of our engineering team, you will play a critical role in designing, implementing, and maintaining scalable, resilient, and secure infrastructure using AWS. You will work closely with cross-functional teams to...

  • Snowflake Data Engineer Position with Advanced SQL Expertise

    6 days ago

    Austin, Texas, United States SysMind Tech Full time

    Job Title:Snowflake Data Engineer Position with Advanced SQL ExpertiseAbout the RoleWe are seeking an experienced Snowflake Data Engineer to join our team at SysMind Tech. The successful candidate will have a strong background in data engineering, advanced SQL skills, and experience with cloud computing.Key ResponsibilitiesDesign and implement...