Senior Data Engineer

2 days ago

New York, New York, United States CDW Full time
Job Title: Senior Software Engineer II - Data

The Senior Software Engineer II - Data will play a pivotal role in building and operationalizing the minimally viable data necessary for the enterprise data and analytics initiatives following best practices. The bulk of the data engineer's work would be in building, managing, and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers like business/data analysts, data scientists, or any persona that needs curated data for data and analytics use cases across the enterprise.

Key Responsibilities:
  • Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
  • Interfaces with other technology teams to extract, transform, and load data from a wide variety of data sources using big data technologies and SQL.
  • Collaborates with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
  • Collaborates with other technology teams to help engineer data sets that data science teams use to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering, and machine learning.
  • Responsible for using innovative and modern tools, techniques, and architectures to partially or completely automate the most-common, repeatable, and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
  • Trains counterparts such as data scientists, data analysts, data consumers in data pipelines and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
  • Helps ensure compliance and governance during use of data.
  • Be curious and knowledgeable about new data management techniques and how to apply them to solve business problems.
Qualifications:
  • BS or MS degree in Computer Science or a related technical field.
  • 7+ years data application development experience.
  • Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub, and the supporting processes like Data Integration, Governance, Metadata Management.
  • Extensive experience with popular data processing languages including SQL, PL/SQL, Python, others for relational databases and on NoSQL/Hadoop oriented databases like MongoDB, Cassandra, others for non-relational databases.
  • Demonstrated ability to build rapport and maintain productive working relationships cross-departmentally and cross-functionally.
  • Demonstrated ability to coach and mentor others.
  • Excellent written and verbal communication skills with the ability to effectively interact with and present to all stakeholders including senior leadership.
  • Strong organizational, planning, and creative problem-solving skills with critical attention to detail.
  • Demonstrated success of facilitation and solutions implementation.
  • History of balancing competing priorities with the ability to adapt to the changing needs of the business while meeting deadlines.
Preferred Qualifications:
  • Extensive experience with Azure Data Factory.
  • Extensive experience working with cloud platform (at least one of Azure, AWS, GCP).
  • Experience with ETL Tools (SSIS, Informatica, Ab Initio, Talend), Python, Databricks, Microsoft SQL Server Platform (version 2012 or later), and/or working in an Agile environment.

  • Senior Engineer

    4 weeks ago

    New York, New York, United States Acquired Data Solutions Full time

    Job SummaryWe are seeking a highly skilled Senior Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesData Collection and AnalysisAnalysis of Vendor Data PackagesTest Plan...

  • Senior Data Engineer

    6 days ago

    New York, New York, United States Net2Source Inc. Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Net2Source Inc. As a Senior Data Engineer, you will be responsible for designing and managing data ecosystems, particularly within the finance sector.Key Responsibilities:Building and maintaining data pipelines to ensure data quality and integrityDriving...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States Harnham Full time

    Senior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Harnham. As a Senior Data Engineer, you will be responsible for designing and developing comprehensive technical designs for both streaming and batch processing systems.Key ResponsibilitiesDevelop technical designs for streaming and batch processing...

  • Senior Data Engineer

    3 days ago

    New York, New York, United States Capital One Full time

    Job Title: Senior Data EngineerCapital One is seeking a Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing data engineering solutions that drive business value.Key Responsibilities:Collaborate with cross-functional teams to design and develop data engineering solutions that...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States A Place For Mom Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at A Place for Mom. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data warehouse on Databricks within AWS, ensuring optimal performance and reliability.Key Responsibilities:Design and develop ETL processes...

  • Senior Data Engineer

    3 days ago

    New York, New York, United States Coinbase Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Coinbase. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines, trusted data sources, and analytics/data products that inject automation into data science processes.Key Responsibilities:Design...

  • Senior Data Engineer

    1 week ago

    New York, New York, United States Coinbase Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Coinbase. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines, trusted data sources, and analytics/data products that inject automation into data science processes.Key Responsibilities:Design...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States Tech Tammina Full time

    Senior PySpark/Python EngineerWe are seeking a highly skilled Senior PySpark/Python Engineer to join our team at Tech Tammina. The ideal candidate will have a strong background in data engineering, with expertise in PySpark, Python, and related technologies.Key Responsibilities:Design and implement data pipelines using PySpark and PythonWork with data lakes,...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States TENTH MOUNTAIN LLC Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at TENTH MOUNTAIN LLC. As a Senior Data Engineer, you will play a crucial role in migrating our existing data platform to an on-premises Hadoop environment.Key Responsibilities:Data Pipeline Development: Design and develop scalable, efficient ETL pipelines...

  • Senior Data Engineer

    3 days ago

    New York, New York, United States Intersog Full time

    Unlock Business Potential with DataAt Intersog, we're on a mission to empower our clients with data-driven insights that drive business growth. As a Senior Data Engineer, you'll play a critical role in turning data into actionable information that informs strategic decisions.Key Responsibilities:Analyze existing data sources to identify trends and...

  • Senior Engineer

    1 week ago

    New York, New York, United States Acquired Data Solutions Full time

    Job OverviewWe are seeking a highly skilled Senior Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to support Development Test & Evaluation (DT&E) of existing and emerging technologies for airport security equipment.Key ResponsibilitiesPerform in-depth engineering analysis of security related...

  • Senior Data Engineer

    7 days ago

    New York, New York, United States American Express Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at American Express. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale databases and data systems to support our business operations.Key ResponsibilitiesDesign and develop database architectures and data models to...

  • Senior Data Engineer

    4 weeks ago

    New York, New York, United States Peer Consulting Resources Inc. Full time

    Job Title: Senior Data EngineerLocation: RemoteDuration: Long-term contractYears of Experience: 7+ yearsRequired Hours/Week: 40 hours/weekMandatory Requirements:Expert-level experience in designing and implementing data marts and data warehousesProficiency in programming languages such as R, Python, and JavaExperience with data governance, data quality, and...

  • Senior Data Engineer

    1 week ago

    New York, New York, United States American Express Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at American Express. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and infrastructure. You will work closely with cross-functional teams to ensure the delivery of high-quality data solutions that meet...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States Prosum Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Runtime Platform Group. In this role, you will be responsible for building our company's FedRAMP-authorized environment for U.S. Federal Government projects.Key Responsibilities:Collaborate with internal teams and external stakeholders to define, build, and document cloud...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States Prosum Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Runtime Platform Group. In this role, you will be responsible for building our company's FedRAMP-authorized environment for U.S. Federal Government projects.Key Responsibilities:Collaborate with internal teams and external stakeholders to define, build, and document cloud...

  • Data Engineer for Cloud Data Platforms

    3 weeks ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. As a Data Engineer for Cloud Data Platforms,...

  • Senior Data Engineer

    2 weeks ago

    New York, New York, United States Reebelo Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Reebelo. As a key member of our data engineering team, you will be responsible for designing and implementing a robust data warehouse that meets the needs of our business intelligence team.Key Responsibilities:Design and implement a scalable data warehouse using modern...

  • Senior Data Engineer

    6 days ago

    New York, New York, United States Reebelo Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Reebelo. As a key member of our data engineering team, you will be responsible for designing and implementing a robust data warehouse that meets the needs of our business intelligence team.Key Responsibilities:Design and implement a scalable data warehouse using modern...

  • Data Engineer for Cloud Data Platforms

    3 weeks ago

    New York, New York, United States The Data Sherpas Full time

    About The Data SherpasWe are a team of highly skilled and motivated engineers who help our clients at every phase of their cloud journey. Our expertise spans cloud infrastructure, data engineering, and application development.Job DescriptionWe are seeking a self-motivated and data-driven engineer to join our team. The ideal candidate will have a solid...