Data Engineer

3 weeks ago


New York, United States Ztek Consulting Full time

Job Title Sr Data Engineer

Role:- New York- onsite

Relevant Experience (in Yrs) 8-10 yrs

Must Have Technical/Functional Skills Apache Spark, Scala/ Python and PySpark

Experience Required Min. 5-7 years hands on experience working in data modeling

Roles & Responsibilities

• Work on migrating applications from an on-premises location to the cloud service providers.

• • Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation.

• • Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.

• • Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology.

• • Perform problem analysis, data analysis, reporting, and communication.

• • Work with peers across the system to define and implement best practices and standards.

• • Assess applications and help determine the appropriate application infrastructure patterns.

• • Use best practices and knowledge of internal or external drivers to improve products or services.

What we are looking for:

• • Hands-on experience in building/implementing cloud platforms/applications on AWS platform.

• • Experience in developing data pipeline solutions to ingest and exploit new and existing data sources.

• • Expertise in leveraging SQL, programming language like Python and ETL tools like Databricks

• • Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.

• • Expertise in AWS Compute (EC2, EMR), AWS Storage (S3, EBS), AWS Databases (RDS, DynamoDB), AWS Data Integration (Glue).

• • Advanced understanding of Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services.

• • Good understanding of AWS Identify and Access management, AWS Networking and AWS Monitoring tools.

• • Proficiency in CI/CD and deployment automation using GITLAB pipeline.

• • Proficiency in Cloud infrastructure provisioning tools e.g., Terraform.

• • Proficiency in one or more programming languages e.g., Python, Scala.


  • Project Engineer

    2 weeks ago


    New York, United States Engineer Rec Full time

    Our client are seeking Project Engineers for multiple projects along the East Coast, USA. Are you a Project Engineer currently looking for a new challenge and experienced in supporting offshore wind projects? If so please read on. The Project Engineer has the skills and experience to take a leading role related to land and underground installation of high...

  • Project Engineer

    2 days ago


    New York, United States Engineer Rec Full time

    Our client are seeking Project Engineers for multiple projects along the East Coast, USA. Are you a Project Engineer currently looking for a new challenge and experienced in supporting offshore wind projects? If so please read on. The Project Engineer has the skills and experience to take a leading role related to land and underground installation of high...


  • New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...


  • New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Deployment Engineer

    5 days ago


    New York, United States Heron Data Full time

    As a Deployment Engineer at Heron, you’ll play a pivotal role in ensuring our highest-value customers have a seamless experience with our product. You’ll guide prospects through their trial phase, ensuring smooth transitions as they become customers. Sitting at the nexus of customers, customer success, engineering, and product, your technical expertise...

  • Deployment Engineer

    2 days ago


    New York, United States Heron Data Full time

    As a Deployment Engineer at Heron, you’ll play a pivotal role in ensuring our highest-value customers have a seamless experience with our product. You’ll guide prospects through their trial phase, ensuring smooth transitions as they become customers. Sitting at the nexus of customers, customer success, engineering, and product, your technical expertise...

  • Deployment Engineer

    4 days ago


    New York, New York, United States Heron Data Full time

    As a Deployment Engineer at Heron, you'll play a pivotal role in ensuring our highest-value customers have a seamless experience with our product. You'll guide prospects through their trial phase, ensuring smooth transitions as they become customers. Sitting at the nexus of customers, customer success, engineering, and product, your technical expertise will...

  • Deployment Engineer

    2 days ago


    New York, New York, United States Heron Data Full time

    As a Deployment Engineer at Heron, you'll play a pivotal role in ensuring our highest-value customers have a seamless experience with our product. You'll guide prospects through their trial phase, ensuring smooth transitions as they become customers. Sitting at the nexus of customers, customer success, engineering, and product, your technical expertise will...

  • Data Engineer

    2 months ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Data Engineer

    1 day ago


    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Data Engineer

    1 week ago


    New York, New York, United States rag & bone Full time

    We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have strong proficiency in Python programming language, extensive experience with Oracle PL/SQL, and a solid understanding of Azure Serverless compute resources. As a Data Engineer, you will be responsible for designing, implementing, and maintaining...

  • Data Engineer

    1 week ago


    New York, United States JK Partners Full time

    Key ResponsibilitiesCloud-First Data Ingestion: Develop and implement data ingestion processes using Python, SQL, and Spark in a cloud-first environment.Data Modeling and Infrastructure Engineering: Construct robust data models and infrastructure to accommodate a diverse array of market and alternative data sets.Dataset Operations: Maintain and monitor...

  • Data Engineer

    1 month ago


    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Data Engineer

    2 days ago


    New York, New York, United States Masterworks Full time

    Masterworks Overview:Masterworks is the only platform for investing in blue-chip, multi-million dollar artworks. Prior to Masterworks, the only way to allocate to art was to purchase a multi-million dollar painting, making the asset class inaccessible for most investors. The company has over 900,000 users signed-up purchasing shares in primary offerings...

  • Data Engineer

    1 month ago


    New York, New York, United States TopEdge Technology Full time

    Job DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...

  • Data Engineer

    2 days ago


    New York, New York, United States TopEdge Technology Full time

    Job DescriptionPosition Data Engineer Duration 12 months Location New Jersey Remote Work Permitted Due to COVID-19 the client has agreed to allow the selected candidate to work remotely for the time being. However the selected candidate must be available to report onsite as directed by the client.Position Data EngineerJob DescriptionThe Senior Data Engineer...

  • Data Engineer

    1 month ago


    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...

  • Data Engineer

    1 day ago


    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...

  • Data Engineer

    2 weeks ago


    New York, United States Jane Street Full time

    About the PositionWe are looking for a Data Engineer who can help us understand, clean, manage, and share the data that guides our trading. At Jane Street, having a thorough and accurate understanding of data is at the core of the work we do.Using our mix of in-house and open-source software, you will analyze datasets gathered from a variety of sources,...

  • Data Engineer

    1 month ago


    New York, United States Open Systems Technologies Full time

    A financial firm is looking for a Data Engineer to join their team in New York, NY.Compensation: $150-200k Responsibilities:Build data pipelinesWork with data vendors such as Bloomberg, Refinitiv, etc.Take vendor data and normalize it for firm consumptionQualifications:A Bachelor's Degree in Computer Science or Computer Engineering4+ years of experience in...