Data Infrastructure Specialist

3 days ago


New York, New York, United States TechnoGen Full time
Job Description:

As a Senior Data Engineer at TechnoGen, you will be part of our Data Infrastructure team, responsible for designing and maintaining tools and infrastructure to write, test, and schedule batch data pipelines. Your work will enable other developers, data scientists, and analysts to write high-performing pipelines that power data science, machine learning, and product development.

We primarily use Scala, Java, and Python programming languages and technologies like Hadoop, Spark, Airflow, Terraform, and Kubernetes, as well as GCP services like Dataproc, Dataflow, and BigQuery. Our goal is to build highly-performant systems that are maintainable and easy to understand by selecting and integrating with the best of current technologies.

You will have experience building data processing platforms, supporting them at scale, and collaborating with other teams that depend on them. Experience building applications and managing infrastructure using one of the major cloud providers is preferred but not required. We value curiosity, passion, responsibility, and generosity of spirit.

Required Skills:
  • Strong domain expertise and backend skills (working in Scala, Java and Python)
  • Strong leadership and communication skills
  • Experience collaborating with other engineers and product teams
  • Advantages and limitations of distributed systems
  • DevOps
  • Writing ETL pipelines
  • Building and monitoring cloud services (GCP services preferred) and infrastructure
  • Using or maintaining data processing environments like Hadoop, Spark, PySpark, and Dataflow

Estimated Salary: $120,000 - $180,000 per year.

  • New York, New York, United States BlackHawk Data Full time

    Job Title: Network Infrastructure SpecialistAbout the Role:We are seeking a highly skilled and experienced Network Engineer to join our team at BlackHawk Data. This is an exceptional opportunity for a motivated professional to design, deploy, and maintain cutting-edge network solutions.Key Responsibilities:


  • New York, New York, United States Memorial Sloan Full time

    Data Infrastructure Specialist Job Description:Memorial Sloan Kettering Cancer Center is looking for a skilled Data Infrastructure Specialist to help drive our data modernization journey. As a key member of our team, you will design, implement, and maintain data infrastructure solutions for a new hybrid and multi-cloud data ecosystem. Your Key...


  • New York, New York, United States Advance Datacom Communication Services, Inc. Full time

    We are looking for a highly skilled Data Communications Infrastructure Specialist to join our team at Advance Datacom Communication Services, Inc.About the RoleThis is a full-time position that requires strong analytical and problem-solving skills. As a Data Communications Infrastructure Specialist, you will be responsible for installing and terminating...


  • New York, New York, United States Oxford Knight Full time

    At Oxford Knight, we're at the forefront of algorithmic trading, seeking a skilled Data Infrastructure Specialist to join our team. This pioneering role offers the opportunity to design and implement a cutting-edge system for data management, storage, and exploration.About the Role:We're looking for someone with 2-6 years of experience in data...


  • New York, New York, United States Middesk Full time

    Data Infrastructure RoleWe're looking for a seasoned Business Data Infrastructure Specialist to join our Foundation team at Middesk. As a critical member of this team, you'll be responsible for designing and implementing scalable data pipelines, building reliable systems, and extending our web scraping capabilities. Your focus on data quality and scalability...


  • New York, New York, United States Resource Informatics Group Full time

    Job SummaryWe are seeking a highly skilled Data Storage Infrastructure Specialist to join our team at Resource Informatics Group. The successful candidate will design, implement, and maintain our storage infrastructure, working with Dell/EMC Isilon, ECS, PowerVault, and Pure Storage Flash Array or FlashBlade technologies.About the RoleThe Data Storage...


  • New York, New York, United States Prescient Full time

    Job OverviewAt Prescient, we are seeking a highly skilled Data Infrastructure Specialist to join our team. As a key member of our engineering group, you will play a critical role in designing, building, and maintaining our dark web and open-source data repositories, search applications, and APIs.ResponsibilitiesThe successful candidate will be responsible...


  • New York, New York, United States Fathom Full time

    About FathomFathom is a pioneering company in the field of medical data understanding and structuring using AI. Our mission begins by making sense of vast clinician notes contained within electronic health records. We aim to automate the translation of patient records into billing codes, reducing healthcare provider reimbursement costs and errors.Our deep...


  • New York, New York, United States Wynd Labs Full time

    We are at the forefront of developing a web-scale crawler and knowledge graph that allows ordinary people to participate in the process, and share in the benefits of AI development.As a High-Performance Data Infrastructure Specialist, you will play a crucial role in designing, implementing, and maintaining scalable, high-performance distributed systems to...


  • New York, New York, United States Alethea LLC Full time

    About AletheaAlethea LLC is a tech company founded in 2019, dedicated to detecting and mitigating disinformation and social media manipulation. Our mission is to provide clients with the tools they need to navigate the new digital reality.">Job DescriptionLeadership and Mentorship: Provide technical and career guidance to the data engineering team. Conduct...


  • New York, New York, United States VAST Data Full time

    Job DescriptionWe are seeking an experienced Head of Sales for Cloud Infrastructure to join our team at VAST Data. As a key member of our sales leadership team, you will be responsible for developing and executing sales strategies that drive revenue growth and expand our market presence in the cloud infrastructure space.About VAST DataVAST Data is a leading...


  • New York, New York, United States Amazon Full time

    Why This Role MattersAs a Sr. Business Intelligence Engineer, SMB Marketing Analytics, you will play a critical role in supporting the growth and success of Amazon's SMB Marketing Analytics team. By designing, building and maintaining enterprise-level analytics and data infrastructure, you will enable business leaders to make informed decisions and drive...


  • New York, New York, United States Fathom Full time

    Company OverviewFathom is a cutting-edge technology company that utilizes artificial intelligence to decipher and structure the world's vast medical data. Our mission begins by interpreting the terabytes of clinician notes within electronic health records of the world's largest healthcare systems. Our deep learning engine automates the translation of patient...


  • New York, New York, United States Uniswap Labs Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our dynamic data engineering team at Uniswap Labs. This role requires deep technical expertise, a passion for working with data, and strong analytical skills. The ideal candidate will be responsible for designing, implementing, and optimizing our data analytics infrastructure to...


  • New York, New York, United States Inizio Partners Full time

    Job OverviewInizio Partners is seeking a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and building scalable data infrastructure using Python. This is a great opportunity to work with a dynamic team and contribute to the growth of our company.Key Responsibilities Design and build scalable data...


  • New York, New York, United States Bloomberg Full time

    Scaling Financial Data Infrastructure with BloombergWe're looking for a talented software engineer to join our MSG Alerts team, where you'll play a key role in building a new, distributed, and scalable system for delivering real-time alerts to financial professionals. With millions of user-created rules and millions of emails per minute, this system must...


  • New York, New York, United States Ladgov Corporation Full time

    Job Title: IT Infrastructure SpecialistCompany OverviewLadgov Corporation is a dynamic organization that values innovation and excellence. Our team is committed to delivering cutting-edge solutions that meet the evolving needs of our clients.Estimated Salary$100,000 - $160,000 per year, based on experience and qualifications.Job DescriptionWe are seeking a...


  • New York, New York, United States Shaped Full time

    We are looking for a data engineer to design, build and optimize Shaped's real-time and batch streaming infrastructure. As one of Shaped's early employees, you will help shape the company's product, culture and vision.The ideal candidate should have skills in Python, Data Warehouses (such as Clickhouse, Snowflake, or BigQuery) and experience with batch and...


  • New York, New York, United States BlackHawk Data Full time

    Job Description: We are seeking a motivated Network Engineer with a passion for designing, deploying, and maintaining cutting-edge network solutions. The ideal candidate will have strong expertise in Cisco and Fortinet technologies, with a deep understanding of routing protocols including BGP, OSPF, and EIGRP.Responsibilities:Design and implement network...


  • New York, New York, United States VTS Full time

    Unlock Your Potential as an IT Infrastructure SpecialistVTS is a trailblazer in the commercial and residential real estate industry, revolutionizing leasing operations with its cutting-edge technology platform. As an IT Infrastructure Specialist, you will be part of a high-performing team that values innovation, growth, and customer satisfaction.About VTSWe...