Senior Data Engineer

4 weeks ago


New York, United States Grid Dynamics Full time
Description Position at Grid Dynamics

 Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. On this project, we are working with bleeding-edge big data technologies to develop a high-performance data analytics platform, which handles petabytes of data. We are looking for an enthusiastic and technology-proficient Senior Data Engineer, who is eager to participate in design and implementation of a top-notch big data solution that will be deployed at a massive scale.  

Responsibilities :  

  • Build data pipelines to enable training of LLMs
  • Work with technical and non-technical stakeholders to collect requirements, integrate with data systems and deliver large-scale datasets
  • Operate in a complex multi-cloud data lakehouse, building end-to-end integrated workflows
  • Work with privacy, security, and other policy stakeholders to design, review and implement solutions to automate compliant ETL for downstream teams

Requirements :  

  • Strong understanding of machine learning principles, especially in the context of LLMs.
  • 5+ years of experience in big data engineering
  • Proficiency in Java, Scala, Spark
  • Proficiency in PySpark and Golang(preferred)
  • Experience building and leveraging large scale data infrastructure, map-reduce/hadoop , cloud-native deployments
  • Experience with alerting, monitoring and remediation automation in a large scale distributed environment
  • BS/BA or equivalent degree in computer science or similar (preferred)
What we offer:      
  • Opportunity to work on cutting-edge projects
  • Work with a highly motivated and dedicated team
  • Competitive salary
  • Flexible schedule
  • Full benefits including but not limited to medical, dental, vision
  • Corporate social events
  • Professional development opportunities
About Us:     Grid Dynamics (Nasdaq:GDYN) is a digital-native technology services provider that accelerates growth and bolsters competitive advantage for Fortune 1000 companies. Grid Dynamics provides digital transformation consulting and implementation services in omnichannel customer experience, big data analytics, search, artificial intelligence, cloud migration, and application modernization. Grid Dynamics achieves high speed-to-market, quality, and efficiency by using technology accelerators, an agile delivery culture, and its pool of global engineering talent. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the US, UK, Netherlands, Mexico, and Central and Eastern Europe.    To learn more about Grid Dynamics, please visit www.griddynamics.com. Follow us on FacebookTwitter, and LinkedIn.

  • New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...


  • New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Senior Data Engineer

    1 month ago


    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    1 month ago


    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    3 weeks ago


    New York, United States Stott and May Full time

    Senior Data EngineerFull-TimeHybrid (NYC)Base Salary - $140-170k DOEMy client is a pioneering company dedicated to leveraging cutting-edge technology to revolutionize the healthcare industry. Their focus is to develop innovative solutions aimed to improve consumer health outcomes through data-driven approaches. They are one of the leaders in shaping the...


  • New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...


  • New York, United States Analytic Recruiting Inc. Full time

    A well-known financial institution that has been around almost 100 years is seeking a Senior Data Engineer to join their team. The ideal candidate will be design and implement a data infrastructure and analytical toolset to support optimization activities of the Capital Markets groupSalary: Up to 150k base + 7% bonusLocation: New York, NY (3-4 days/week)Visa...

  • Senior Data Engineer

    1 month ago


    New York, United States Storm3 Full time

    ⚡ Senior Data Engineer Series B, Startup ️ New York (Hybrid) $200,000 + Significant Equity + BonusThe company is a leading provider of virtual care to help tackle substance use. ‍ Responsibilities:Develop and maintain data pipelines for extracting, transforming and loading data from various sources into our data warehouses using tools like dbt,...

  • Senior Data Engineer

    1 month ago


    New York, United States VeracityID Full time

    Job DescriptionJob DescriptionSalary: The roleVeracityID’s development team is looking for Senior Data Engineer with deep experience in building analytical solutions for distributed data environments. VeracityID is a cloud services firm specialising in near real-time fraud detection in the insurance industry.Its application suite employs multiple large...

  • Senior Data Engineer

    2 weeks ago


    New York, United States Big Cloud Full time

    Do you have experience with the Azure Cloud stack and Azure Synapse?Are you interested in working with stakeholders to solve complex data pipeline and cloud problems?Are you open and able to work on a full-time/perm/W2 contract basis?A leading tech consulting company is seeing huge market success working with East Coast finance companies, Bay Area AI...

  • Project Engineer

    1 week ago


    New York, United States Engineer Rec Full time

    Our client are seeking Project Engineers for multiple projects along the East Coast, USA. Are you a Project Engineer currently looking for a new challenge and experienced in supporting offshore wind projects? If so please read on. The Project Engineer has the skills and experience to take a leading role related to land and underground installation of high...

  • Senior Consultant

    1 month ago


    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization. You will be part of a highly collaborative...

  • Senior Consultant

    1 month ago


    New York, United States CTI DATA Full time

    We are looking for Data Architects and Senior Consulting Leaders with a strong background building modern data & analytics solutions. You must have a solid understanding of cloud data platforms and the data & analytics ecosystem, with hands-on experience across data engineering, data science and data visualization.You will be part of a highly collaborative...

  • Data Engineer

    2 months ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...


  • New York, United States Olsson Full time

    Olsson Senior Civil Engineer - Data Center Manhattan , Missouri Apply Now We are Olsson, a team-based, purpose-driven engineering and design firm. Our solutions improve communities and our people make it possible. Our most meaningful asset is our people, and we are dedicated to providing an environment where they can continue to learn, grow, and thrive. Our...


  • New York, United States Jane Street Full time

    About the Position We're looking for an experienced Senior Data Center Engineer to design, build, scale, and perform daily upkeep in our regional data and colocation centers. This is a hands-on position that will require a strong communicator with excellent people skills who can manage projects and take ownership. You will join an interdisciplinary team made...

  • Sr Data Engineer

    1 month ago


    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Sr Data Engineer

    1 month ago


    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Data Engineer

    2 weeks ago


    New York, United States HappyFunCorp Full time

    Job DescriptionJob DescriptionSenior Data Engineer - Remote - Contract*This position is 100% remote*HappyFunCorp helps businesses develop great products and deliver powerful technical solutions with a blend of deep engineering skills, human-focused design, and a culture that makes working with us enjoyable. We've partnered with startups, small and...

  • Senior Data Engineer

    2 weeks ago


    New York, United States Vertisystem Full time

    Only W2 Candidate required:MUST BE FULLY KNOWLEDGABLE IN PYTHON, SQL, AND ETL Min 7 years • Ability to work as part of a team, as well as work independently or with minimal direction. • Excellent written, presentation, and verbal communication skills. • Collaborate with data architects, modelers and IT team members on project goals.Summary: The main...