Big Data Pipeline Architect

3 weeks ago


Raleigh, North Carolina, United States BitSight Technologies Full time

At Bitsight Technologies, we're committed to innovation and excellence in data engineering. As a Senior Data Engineer, you'll play a critical role in driving business impacts through data engineering challenges. Our team is passionate about leveraging data to make informed decisions, and we're looking for someone who shares our enthusiasm.

About the Role

You'll be responsible for designing and implementing scalable data pipelines and infrastructure, adding new sources, coding business rules, and producing new metrics that support data science and security research. You'll also create and implement code, along with unit/integration tests, and adhere to coding patterns, guidelines, styles, and best practices.

Requirements

The ideal candidate will have more than 5 years of experience as a Software/Data Engineer, with significant experience working on SaaS products. A strong academic background in a quantitative field (Computer Science, Engineering, or Applied Mathematics) is required. The candidate should be proficient in managing and developing scalable data pipelines and automation of data workflows using Python & Spark/Scala.

  • In-depth knowledge of AWS infrastructure and technology stacks for handling large datasets and table formats in a data lake environment
  • Experience in data models, data warehousing, building and optimizing ETL pipelines
  • Deep understanding and experience of orchestration tools, CI/CD paradigms, and SDLC best practices
  • Proven experience with SQL/NoSQL data warehouses
  • Skilled at optimizing large datasets and developing operational processes that improve data quality

The estimated salary range for this position is $140,000 to $160,000 annually.


  • Big Data Expert

    3 weeks ago


    Raleigh, North Carolina, United States SysMind Tech Full time

    Job Title: Senior Big Data EngineerEstimated Salary: $140,000 - $200,000 per year (based on location and experience)About the CompanySysMind Tech is a cutting-edge technology company that specializes in developing innovative solutions for big data processing and analytics. We are committed to delivering high-quality results and fostering a collaborative work...

  • Big Data Professional

    3 weeks ago


    Raleigh, North Carolina, United States SysMind Tech Full time

    Job Title: Big Data ProfessionalLocation: Raleigh, NC & NY (Onsite)Estimated Salary: $120,000 - $160,000 per yearCompany Overview: SysMind Tech is a cutting-edge technology company that delivers innovative big data solutions. Our team consists of seasoned professionals with extensive experience in various technologies and tools.Job Description: We are...


  • Raleigh, North Carolina, United States SysMind Tech Full time

    Job Description: SysMind Tech is seeking an experienced Big Data Engineer to join our team. The ideal candidate will have extensive knowledge of big data technologies, including Hadoop and AWS, and the ability to design, build, and maintain large-scale data processing systems.Responsibilities:* Design and develop high-performance big data pipelines using...

  • Senior Data Architect

    3 weeks ago


    Raleigh, North Carolina, United States Maxonic Full time

    About the Role:As a Senior Data Architect, you will play a critical role in designing and implementing our database architecture and data structures within our Salesforce and SAP ecosystem.You will work closely with various business and technical stakeholders like developers, architects, and analysts to deliver high-quality data solutions that support our...

  • Data Architect

    3 weeks ago


    Raleigh, North Carolina, United States Diverse Lynx Full time

    We are seeking a highly skilled Data Architect to join our team at Diverse Lynx LLC. As a key member of our data team, you will be responsible for designing and implementing complex data systems from the ground up.The successful candidate will have strong experience with programming languages such as Python, SQL & Spark, and will be able to build batch and...

  • Data Architect

    4 weeks ago


    Raleigh, North Carolina, United States SysMind Tech Full time

    Job Title: Senior Big Data EngineerEstimated Salary: $120,000 - $180,000 per year (based on location and experience)About the JobSysMind Tech is seeking a highly skilled Big Data Engineer to join our team in Raleigh, NC. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing...

  • Data Architect Lead

    2 weeks ago


    Raleigh, North Carolina, United States Diverse Lynx Full time

    About the RoleWe are seeking an experienced Data Architect Lead to join our team at Diverse Lynx LLC. As a key member of our organization, you will be responsible for designing and implementing complex data systems from the ground up.Key ResponsibilitiesCreate comprehensive documentation for design and processes to support ongoing maintenance and knowledge...

  • Cloud Data Architect

    3 weeks ago


    Raleigh, North Carolina, United States AA2IT Full time

    About the JobWe are looking for a talented Cloud Data Architect to join our team at AA2IT. In this role, you will design, implement, and optimize our database architecture and data structures within our Salesforce and SAP ecosystem.This is a 6-month contract opportunity located in Raleigh, NC, with a hybrid schedule, and potential to extend. You will work...


  • Raleigh, North Carolina, United States Infosys Full time

    About the RoleWe are seeking an experienced Data Engineering Architect to join our team. As a key member of our architecture team, you will be responsible for designing and implementing end-to-end enterprise data engineering solutions on Azure data platform.Key Responsibilities:Architecting and designing Enterprise data engineering solution on Azure data...

  • Cloud Data Architect

    3 weeks ago


    Raleigh, North Carolina, United States Cleo Full time

    Career Opportunities at CleoWe are seeking a Senior Data Engineer to join our team. As a member of our team, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure at Cleo.This role involves setting the strategy for data systems, collaborating closely with cross-functional teams, and ensuring the scalability,...


  • Raleigh, North Carolina, United States Bayone Full time

    About the Job: We are looking for a skilled Database Systems Developer to join our Global Digital Team at Bayone. As a key member of our team, you will be responsible for designing, implementing, and optimizing database architecture and data structures within our Salesforce and SAP ecosystem.Job Description: As a Database Systems Developer, you will work...


  • Raleigh, North Carolina, United States Kapital Data Corp Full time

    Kapital Data Corp is searching for a talented Data Integration Architect for Oracle Cloud. In this key role, you will design and implement efficient data integration solutions using Oracle Data Integrator (ODI) and other ETL tools.Responsibilities include:Evaluating system architectures and identifying areas for improvementDeveloping and implementing data...

  • Cloud Data Architect

    3 weeks ago


    Raleigh, North Carolina, United States Cox Communications Full time

    About the RoleCox Communications seeks a talented Cloud Data Architect to join our team and contribute to the development and implementation of robust data solutions.Key ResponsibilitiesImplement data lake, data warehousing, ETL, streaming, and data analytics solutions across GCP, AWS, and Azure platforms.Migrate data and processes from legacy on-premise...

  • Big Data Professional

    3 weeks ago


    Raleigh, North Carolina, United States SysMind Tech Full time

    About the Company: SysMind Tech is a leading technology company specializing in big data solutions. We help businesses make data-driven decisions by providing scalable and secure data platforms. Our team of experts has extensive experience in big data technologies and works closely with clients to understand their needs and deliver tailored solutions. About...


  • Raleigh, North Carolina, United States Evolent Health Full time

    Job DescriptionWe are seeking an experienced Software Engineering Manager to lead our team of software/data engineers in designing, building, integrating, and maintaining data pipelines to support healthcare data integration and operations. As a key member of our team, you will be responsible for managing data from various healthcare systems, ensuring data...


  • Raleigh, North Carolina, United States Slalom Consulting Full time

    At Slalom Consulting, we're passionate about helping our clients leverage their data to drive business growth and innovation. As a Senior Enterprise Data Solutions Architect, you'll play a key role in shaping the technical direction of our data and analytics initiatives.What You'll DoDesign and develop innovative solutions on cloud-based data platforms to...

  • Data Architect

    2 weeks ago


    Raleigh, North Carolina, United States ZipRecruiter Full time

    Job Title: Data Architect - IoT SolutionsJob Overview:This role offers an exciting opportunity to join our team as a Senior Backend Engineer focused on Telemetry Systems. With a strong background in software engineering and a passion for open-source technology, you will contribute to the development of cutting-edge telemetry solutions at Canonical.About the...

  • Software Architect

    2 weeks ago


    Raleigh, North Carolina, United States VAST Data Full time

    VAST Data is revolutionizing the data management landscape with its innovative platform. We're seeking a skilled Software Architect to lead our cloud infrastructure development, ensuring seamless scalability and performance.As a key member of our team, you'll design and implement robust software solutions, collaborating closely with cross-functional teams to...


  • Raleigh, North Carolina, United States Evolent Health Full time

    About Evolent HealthWe partner with health plans and providers to achieve better outcomes for people with complex and costly health conditions. Our mission is to connect the pieces of the fragmented healthcare system and ensure people get the same level of care and compassion we would want for our loved ones.Job DescriptionWe are seeking a talented Software...

  • Cloud Architect

    3 weeks ago


    Raleigh, North Carolina, United States American Board of Anesthesiology, Inc. Full time

    Job Description:A cloud architect position is available at the American Board of Anesthesiology, Inc. in Raleigh, NC. As a cloud architect, you will design, build, and maintain DevOps and CI/CD pipelines. Your expertise will drive the delivery of scalable, secure, and efficient applications while contributing to our organization's cloud migration and...