Sr. Data Engineer

4 weeks ago

Hyderabad, Telangana, United States Randstad Enterprise Full time

The Randstad Offshore team is seeking an experienced Data Engineer with a passion for developing and implementing data solutions in Google Cloud Platform. The ideal candidate will have hands-on experience working with tools such as Cloud Composer (Apache Airflow), Cloud Storage, BigQuery, Cloud Functions and have experience with deploying batch and streaming pipelines.

The candidate must be inquisitive, detail oriented, and highly motivated for delivering high quality solutions. They must possess excellent communications skills, strong work ethic, and the ability to thrive in a fast paced, changing, high pressure environment.

Responsibilities:

  • Design, develop, and maintain data pipelines, to move and transform data from various sources (REST APIs, Emails, Flat files etc) into a unified data platform on BigQuery.
  • Build and maintain scalable data architecture and infrastructure that can handle large volumes of data with high velocity.
  • Implement reusable components around Data Quality and Data Standardization using BigQuery
  • Adheres to and advocates for software & data engineering best practices (eg technical design and review, unit testing, monitoring, alerting, source control, code review & documentation)
  • Deploys secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI/CD pipeline
  • Collaborate with business analysts, data scientists, data analysts, BI teams and business stakeholders to understand the data needs and provide solutions to enable them to access the data they require.
  • Monitor and troubleshoot data pipelines to ensure their reliability and performance.
  • Mentors and shares knowledge with the team to provide design reviews, discussions and prototypes
  • Work seamlessly in an agile development environment to prioritize tasks and deliver results. Qualifications:
    • Bachelor's degree in Computer Science, Computer Engineering, or a related field (BE/BTech)
    • 7+ years of experience within the field of Data Engineering
    • Experience in leading a team of 4 to 5 members
    • At least 3 years of experience working with Google Cloud Platform, BigQuery, Cloud Storage and Cloud Functions
    • At least 2 years of experience working with Cloud Composer (Apache Airflow)
    • At least 3 years of experience in Python
    • Strong experience in SQL and writing complex queries
    • Experience with Infrastructure management tools (Terraform etc)
    • Experience working with tools like Github, Gitlab, JIRA, Confluence and related tools
    • Excellent problem-solving skills, attention to detail and the ability to troubleshoot complex technical issues Tools: Google Cloud Platform, Cloud Composer (Apache Airflow), BigQuery, Python, SQL, Terraform, Cloud Storage

  • Data Engineer

    4 weeks ago

    Hyderabad, Telangana, United States Randstad Enterprise Full time

    The Randstad Offshore team is seeking Data Engineers with a passion for developing and implementing data solutions in Google Cloud Platform. The ideal candidate will have hands-on experience working with tools such as Cloud Composer (Apache Airflow), Cloud Storage, BigQuery, Cloud Functions and have experience with deploying batch and streaming pipelines. ...

  • Sr. Business Services specialist

    1 month ago

    Hyderabad, Telangana, United States Randstad Enterprise Full time

    Role: Senior Business Services Specialist, Source & Screen (RC/ Sourcing Admin) Location: Hyderabad, Telangana Employment: Full Time As a Sr. Business Services Specialist, you will contribute to a collaborative talent acquisition environment to ensure efficient delivery support for our internal clients/ customers, drive the processes that help us screen and...

  • Sr. Source and Screen specialist

    4 weeks ago

    Hyderabad, Telangana, United States Randstad Enterprise Full time

    Role: Senior Sourcing Recruiter, Source & Screen Location: Hyderabad, Telangana Employment: Full Time As a Senior Sourcing Recruiter, you will contribute to a collaborative talent acquisition environment to ensure efficient talent delivery to internal clients/ customers, drive the processes that help us find, hire and develop the best talent in the world....

  • Market Research Consultant

    1 day ago

    Hyderabad, Telangana, United States Randstad Enterprise Full time

    Role: Market Research Consultant EMEA Location: Hyderabad, Telangana Work Shift: Day Shift (09:00 am to 6:00 pm IST) expected to be flexible Employment: Full Time Job Purpose: As a Research Specialist you are to provide information for our clients and recruitment teams. This can include creating; targeted lists of companies, demographic data on candidates...

  • Sr. Data Engineer

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

    The Randstad Offshore team is seeking an experienced Data Engineer with a passion for developing and implementing data solutions in Google Cloud Platform. The ideal candidate will have hands-on experience working with tools such as Cloud Composer (Apache Airflow), Cloud Storage, BigQuery, Cloud Functions and have experience with deploying batch and streaming...

  • Data Engineer

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

    The Randstad Offshore team is seeking Data Engineers with a passion for developing and implementing data solutions in Google Cloud Platform. The ideal candidate will have hands-on experience working with tools such as Cloud Composer (Apache Airflow), Cloud Storage, BigQuery, Cloud Functions and have experience with deploying batch and streaming pipelines....

  • Sr. Business Services specialist

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

    Role: Senior Business Services Specialist, Source & Screen (RC/ Sourcing Admin) Location: Hyderabad, Telangana  Employment: Full Time  As a Sr. Business Services Specialist, you will contribute to a collaborative talent acquisition environment to ensure efficient delivery support for our internal clients/ customers, drive the processes that help us...

  • Sr. Source and Screen specialist

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

    Role: Senior Sourcing Recruiter, Source & Screen Location: Hyderabad, Telangana Employment: Full Time As a Senior Sourcing Recruiter, you will contribute to a collaborative talent acquisition environment to ensure efficient talent delivery to internal clients/ customers, drive the processes that help us find, hire and develop the best talent in the world....

  • Business Intelligence analyst

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

        Business Intelligence Analyst Randstad Sourceright   reports to   Global Business Intelligence Lead         about Randstad Sourceright Randstad Sourceright is a global talent leader, providing solutions and expertise that help companies position for growth, execute on strategy, and...

  • Business Intelligence Partner

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

        Business Intelligence Partner Randstad Sourceright   reports to   Global Business Intelligence Lead         about Randstad Sourceright Randstad Sourceright is a global talent leader, providing solutions and expertise that help companies position for growth, execute on strategy, and...

  • Business Intelligence Partner

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

    Group Objective   The mission of the business intelligence team is to create a data-driven culture which empowers leaders to integrate data into daily decisions and strategic planning. We aim to provide visibility, transparency, and guidance regarding the quantity and quality of results, activities, financial KPIs, and leading indicators to easily...

  • Business Intelligence Team Lead

    1 month ago

    Hyderabad, United States Randstad Enterprise Full time

    Business Intelligence Team Lead Randstad Sourceright   reports to   Business Intelligence Manager         about Randstad Sourceright Randstad Sourceright is a global talent leader, providing solutions and expertise that help companies position for growth, execute on strategy, and improve...