Data Engineer

2 weeks ago


New York, United States Ztek Consulting Full time

Job Title Sr Data Engineer

Role:- New York- onsite

Relevant Experience (in Yrs) 8-10 yrs

Must Have Technical/Functional Skills Apache Spark, Scala/ Python and PySpark

Experience Required Min. 5-7 years hands on experience working in data modeling

Roles & Responsibilities

• Work on migrating applications from an on-premises location to the cloud service providers.

• • Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation.

• • Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.

• • Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology.

• • Perform problem analysis, data analysis, reporting, and communication.

• • Work with peers across the system to define and implement best practices and standards.

• • Assess applications and help determine the appropriate application infrastructure patterns.

• • Use best practices and knowledge of internal or external drivers to improve products or services.

What we are looking for:

• • Hands-on experience in building/implementing cloud platforms/applications on AWS platform.

• • Experience in developing data pipeline solutions to ingest and exploit new and existing data sources.

• • Expertise in leveraging SQL, programming language like Python and ETL tools like Databricks

• • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

• • Expertise in AWS Compute (EC2, EMR), AWS Storage (S3, EBS), AWS Databases (RDS, DynamoDB), AWS Data Integration (Glue).

• • Advanced understanding of Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.

• • Good understanding of AWS Identify and Access management, AWS Networking and AWS Monitoring tools.

• • Proficiency in CI/CD and deployment automation using GITLAB pipeline.

• • Proficiency in Cloud infrastructure provisioning tools e.g., Terraform.

• • Proficiency in one or more programming languages e.g., Python, Scala.


  • Project Engineer

    5 days ago


    New York, United States Engineer Rec Full time

    Our client are seeking Project Engineers for multiple projects along the East Coast, USA. Are you a Project Engineer currently looking for a new challenge and experienced in supporting offshore wind projects? If so please read on. The Project Engineer has the skills and experience to take a leading role related to land and underground installation of high...


  • New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Data Engineer

    2 months ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Data Engineer

    4 days ago


    New York, New York, United States rag & bone Full time

    We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have strong proficiency in Python programming language, extensive experience with Oracle PL/SQL, and a solid understanding of Azure Serverless compute resources. As a Data Engineer, you will be responsible for designing, implementing, and maintaining...

  • Data Engineer

    4 days ago


    New York, United States JK Partners Full time

    Key ResponsibilitiesCloud-First Data Ingestion: Develop and implement data ingestion processes using Python, SQL, and Spark in a cloud-first environment.Data Modeling and Infrastructure Engineering: Construct robust data models and infrastructure to accommodate a diverse array of market and alternative data sets.Dataset Operations: Maintain and monitor...

  • Data Engineer

    1 month ago


    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Data Engineer

    1 month ago


    New York, New York, United States TopEdge Technology Full time

    Job DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...

  • Data Engineer

    1 month ago


    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...


  • New York, United States Onset Data Loggers Full time

    Based in Bourne, Massachusetts, for more than 40 years Onset has been dedicated to designing and producing high-quality data loggers. Our manufacturing processes ensure precision and reliability in data logging technology. Onset's products are trusted worldwide for capturing critical data, making them an essential choice for professionals and organizations...

  • Data Engineer

    1 week ago


    New York, United States Jane Street Full time

    About the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...

  • Data Engineer

    1 month ago


    New York, United States Open Systems Technologies Full time

    A financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...

  • Data Engineer

    1 month ago


    New York, United States Open Systems Technologies Full time

    A financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...

  • Data Engineer

    2 weeks ago


    New York, United States Open Systems Technologies Full time

    An international law firm is looking for a Data Engineer to join their team in NYC. Compensation: $115-160kThe Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder who enjoys optimizing data systems and...

  • Data Engineer

    2 weeks ago


    New York, United States Open Systems Technologies Full time

    An international law firm is looking for a Data Engineer to join their team in NYC. Compensation: $115-160kThe Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. The Data Engineer is an experienced data pipeline builder who enjoys optimizing data systems and...

  • Data Engineer

    4 days ago


    New York, New York, United States Kustomer Full time

    About KustomerKustomer is the industry leading conversational CRM platform perfecting every customer experience. Built with intelligent tools such as AI and Automation, no code-configuration and a connected data platform that unifies data from multiple sources through a single timeline, Kustomer empowers businesses to operate with greater efficiency and...

  • Data Engineer

    1 month ago


    New York, United States Jane Street Full time

    About the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...


  • New York, United States Bayforce Full time

    Senior Data Engineer The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...

  • Senior Data Engineer

    1 month ago


    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Senior Data Engineer

    1 month ago


    New York, United States Bayforce Full time

    The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team’s development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing ones.Requirements •...

  • Sr Data Engineer

    1 month ago


    New York, United States Ticketing technology company Full time

    Role Description: The Senior Data Engineer will be responsible for accelerating and solidifying the Data Engineering team's development, deployment, and operational support practices by building tools leveraged by the entire Data Engineering team. In addition, the Senior Data Engineer will build new data pipelines and enhance and troubleshoot existing...