Cloud Data Engineer

2 months ago

Austin, United States Unreal Gigs Full time

Are you passionate about building and optimizing data pipelines that drive data-driven decision-making in cloud environments? Do you have the technical expertise to design robust data architectures that manage large-scale data processing and ensure seamless data flow? If you're ready to harness the power of cloud technology to create scalable data solutions, our client has the ideal role for you. We're seeking a Cloud Data Engineer (aka The Data Pipeline Architect) to design, develop, and manage cloud-based data infrastructures that support analytical and operational needs across the organization.

As a Cloud Data Engineer at our client, you'll collaborate with data scientists, analysts, and software engineers to build data pipelines and storage solutions that are secure, efficient, and scalable. Your role will be vital in ensuring that data systems are optimized for performance and capable of supporting a range of data-driven initiatives.

Key Responsibilities:

  1. Design and Build Data Pipelines:
  • Create and manage scalable data pipelines that support ETL (Extract, Transform, Load) processes. You'll develop automated solutions to handle data ingestion, transformation, and integration in cloud platforms such as AWS, GCP, or Azure.
Develop and Maintain Data Architectures:
  • Architect and maintain cloud-based data storage solutions, such as data lakes and warehouses, ensuring they align with business needs and best practices. You'll optimize data structures for performance and reliability.
Collaborate on Data Strategy and Solutions:
  • Work closely with data scientists, business analysts, and application developers to understand data requirements and implement solutions that support analytics and machine learning models.
Ensure Data Security and Compliance:
  • Implement and monitor security measures that protect data privacy and comply with industry standards (e.g., GDPR, HIPAA). You'll manage data access controls and audit logs to safeguard sensitive information.
Optimize Data Processing Workflows:
  • Improve the performance of data processing workflows by optimizing resource allocation and parallel processing techniques. You'll work to reduce latency and enhance the scalability of data systems.
Automate and Streamline Data Operations:
  • Develop automation scripts and tools using languages such as Python or Java to streamline data processes and reduce manual intervention. You'll contribute to the efficiency and reliability of data operations.
Monitor and Troubleshoot Data Pipelines:
  • Use monitoring tools and techniques to ensure the health and performance of data pipelines. You'll identify and troubleshoot issues promptly to maintain smooth data flow and system uptime.
Requirements

Required Skills:
  • Cloud Data Expertise: Strong experience with cloud data platforms (AWS, GCP, Azure) and data processing tools like Apache Spark, Apache Beam, or AWS Glue. You're proficient in building scalable data solutions.
  • Programming and Scripting: Proficiency in Python, Java, or Scala for data manipulation and pipeline automation. You can create scripts that handle data transformation and integration tasks.
  • ETL and Data Pipeline Management: Experience in developing and managing complex ETL workflows that handle large data volumes. You're skilled at building data pipelines that support real-time and batch processing.
  • Data Security and Compliance Knowledge: Familiarity with implementing data security measures and ensuring compliance with industry standards. You can configure access controls and monitor data usage.
  • Collaboration and Problem-Solving: Strong ability to work with cross-functional teams and troubleshoot data-related issues. You can clearly communicate technical concepts and solutions.
Educational Requirements:
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. Equivalent experience in data engineering and cloud environments may be considered.
  • Certifications such as Google Professional Data Engineer, AWS Certified Big Data - Specialty, or Microsoft Certified: Azure Data Engineer Associate are highly desirable.
Experience Requirements:
  • 5+ years of experience in data engineering, with at least 3+ years focusing on cloud-based data solutions.
  • Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow, Dataflow, Step Functions).
  • Familiarity with database technologies such as SQL, NoSQL, and data warehousing solutions (e.g., BigQuery, Redshift, Snowflake).
Benefits
  • Health and Wellness: Comprehensive medical, dental, and vision insurance plans with low co-pays and premiums.
  • Paid Time Off: Competitive vacation, sick leave, and 20 paid holidays per year.
  • Work-Life Balance: Flexible work schedules and telecommuting options.
  • Professional Development: Opportunities for training, certification reimbursement, and career advancement programs.
  • Wellness Programs: Access to wellness programs, including gym memberships, health screenings, and mental health resources.
  • Life and Disability Insurance: Life insurance and short-term/long-term disability coverage.
  • Employee Assistance Program (EAP): Confidential counseling and support services for personal and professional challenges.
  • Tuition Reimbursement: Financial assistance for continuing education and professional development.
  • Community Engagement: Opportunities to participate in community service and volunteer activities.
  • Recognition Programs: Employee recognition programs to celebrate achievements and milestones.

  • Cloud Data Engineer

    3 days ago

    Austin, Texas, United States Futran Tech Solutions Pvt. Ltd. Full time

    Cloud Data EngineerWe are seeking a Cloud Data Engineer to join our team at Futran Tech Solutions Pvt. Ltd. in Austin, TX. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems on cloud platforms, particularly AWS. The ideal candidate should have expertise in big data...

  • Cloud Data Engineer

    2 weeks ago

    Austin, Texas, United States United Software Group Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at United Software Group. As a Cloud Data Engineer, you will be responsible for designing and implementing data solutions within the Azure ecosystem.The ideal candidate will have 5+ years of experience in Azure native services with good exposure to ADF,...

  • Cloud Data Engineer

    2 weeks ago

    Austin, Texas, United States United Software Group Full time

    United Software Group is seeking a skilled Cloud Data Engineer to design and build cloud-ready applications using Python, Kafka, Big Data, Spark, and dev/build tools like git, maven, and gradle. The ideal candidate will have expertise in integration patterns, integration technologies, and integration platforms.Key Responsibilities:• Designing and...

  • Cloud Data Engineer

    1 week ago

    Austin, Texas, United States Compu-Vision Consulting Full time

    Compu-Vision Consulting is seeking an experienced Cloud Data Engineer to join our team. This role requires a strong understanding of data modeling, integration, warehousing, governance, and security in cloud-based environments.The ideal candidate will have extensive experience with Snowflake architecture and its components, including databases, procedures,...

  • Cloud Research Engineer

    1 week ago

    Austin, Texas, United States Emerald Cloud Lab Full time

    Job SummaryWe are seeking a skilled Cloud Research Engineer to join our team at Emerald Cloud Lab. As a key member of our engineering team, you will design and build distributed systems that support our cloud-based laboratory environment. Your expertise in Docker containers on AWS will be crucial in ensuring the scalability and performance of our...

  • Cloud Data Engineer

    1 week ago

    Austin, Texas, United States Allied Consultants (Texas) Full time

    About the PositionWe are seeking a highly skilled Cloud Data Engineer to join our team at Allied Consultants in Austin, Texas. As a key member of our technical services team, you will be responsible for designing and implementing data warehousing solutions using Snowflake.The ideal candidate will have extensive experience with Snowflake architecture, data...

  • Senior Cloud Data Engineer

    1 week ago

    Austin, Texas, United States Perfict Global, Inc. Full time

    We are seeking a highly skilled Senior Cloud Data Engineer to join our team at Perfict Global, Inc. In this role, you will be responsible for designing and implementing cloud-based data engineering solutions and ensuring the smooth operation of our cloud infrastructure.About UsWe are a leading IT consulting services provider that focuses on delivering...

  • Cloud Data Engineer

    3 days ago

    Austin, Texas, United States Perfict Global, Inc. Full time

    About Perfict GlobalAs a leading IT consulting services provider, Perfict Global delivers innovative and successful business workforce solutions to Fortune 500 companies. Our team of trained professionals strives to bring together the best technologies available to manage clients' complex business and technology needs.We offer an excellent compensation...

  • Data Engineer

    1 week ago

    Austin, Texas, United States SysMind Tech Full time

    Job Title: Data Engineer - Cloud Computing ExpertAbout the Role:We are seeking a highly skilled Data Engineer with expertise in cloud computing to join our team at SysMind Tech. As a key member of our data engineering team, you will be responsible for designing and implementing scalable data architectures on Snowflake.Key Responsibilities:- Design and...

  • Cloud Native Data Engineering Lead

    1 week ago

    Austin, Texas, United States SysMind Tech Full time

    Job Summary:As a Cloud Native Data Engineering Lead at SysMind Tech, you will be responsible for leading the design and implementation of our cloud-native data engineering platform. You will collaborate with cross-functional teams to develop and maintain high-performance data pipelines using Python and SQL, and optimize data storage and processing for...

  • Staff Site Reliability Engineer

    3 weeks ago

    Austin, TX, United States Currency Cloud Full time

    Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Machine Learning Engineer

    4 weeks ago

    Austin, United States Currency Cloud Full time

    Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure...

  • Data Engineer for Cloud Data Ecosystem

    4 weeks ago

    Austin, Texas, United States The University of Texas at Austin Full time

    **Job Summary:**The University of Texas at Austin seeks a skilled Data Engineer to join our team and contribute to the development of a next-generation data ecosystem. This position is an exciting opportunity to work with a cross-campus team using the latest cloud technologies to build a scalable information infrastructure.**Company Overview:**The University...

  • Cloud Data Specialist

    1 week ago

    Austin, Texas, United States TalentBurst Full time

    TalentBurst is a leader in cloud data solutions. We are seeking an experienced Cloud Data Specialist to join our team. As a cloud data specialist, you will be responsible for designing and implementing secure and scalable cloud-based data solutions.The ideal candidate should have strong experience with AWS services and be able to collaborate with...

  • Senior Cloud Data Engineer

    4 weeks ago

    Austin, Texas, United States Perfict Global, Inc. Full time

    About Us:Perfict Global is a leading IT consulting services provider that delivers innovative business workforce solutions to Fortune 500 companies.Our professionals combine the best technologies to manage clients' complex business and technology needs, participate in implementation activities, and collaborate to meet client demands.We offer excellent...

  • Cloud Data Engineering Manager

    2 weeks ago

    Austin, Texas, United States Saxon Global Full time

    Job OverviewSaxon Global is seeking a talented Cloud Data Engineering Manager to join our team in Austin. As a key member of our data engineering and platform team, you will be responsible for driving the overall execution of our data technologies.We are looking for an experienced professional with a strong background in data modeling, Snowflake, and DBT....

  • Cloud Computing Platform Lead

    1 week ago

    Austin, Texas, United States Emerald Cloud Lab Full time

    About the RoleWe are seeking an experienced Cloud Computing Platform Lead to join our team at Emerald Cloud Lab. As a key member of our engineering team, you will be responsible for designing and building scalable deployment processes using Docker containers on AWS.In this role, you will work closely with our Scientific Development team to optimize data...

  • Cloud Data Infrastructure Engineer

    3 days ago

    Austin, Texas, United States AgileEngine Full time

    **Job Description**About AgileEngineWe are an award-winning custom software development company that helps companies across 15+ industries change the lives of millions.This is a challenging environment where you will work with the best and be encouraged to learn and experiment every day. If you like working collaboratively with other engineers, architects,...

  • Cloud Data Engineering Expert

    3 days ago

    Austin, Texas, United States Diverse Lynx Full time

    Job Title: Cloud Data Engineering Expert - Salary Range: $150,000 - $180,000 per year. Location: Austin, TX. This is a contract position. About the Job:This role involves designing and developing high-quality software solutions that meet the needs of our clients. You will be responsible for designing, developing, and delivering ETL pipelines using Snowflake...

  • Cloud Data Architect

    4 weeks ago

    Austin, Texas, United States Unreal Gigs Full time

    Job Title: Cloud Data ArchitectWe are seeking a skilled Cloud Data Architect to join our team at Unreal Gigs.About the Role:This is an exciting opportunity for an experienced data professional to lead the design and implementation of cloud-based data solutions. As a Cloud Data Architect, you will work closely with cross-functional teams to architect and...