Data Engineer

6 days ago

New York, United States Infojini Full time

TASKS:

• Create optimal data pipeline architecture that is coherent and scalable, based on best
practices of integrating data into a consolidated repository.
• Perform the technical design, development, and component testing.
• Build data and analytics tools, services and products that manage data, metadata or utilize
data pipeline to provide actionable insights into customer engagement and experience,
operational efficiency, and other key business performance metrics.
• Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of
data from a wide variety of data sources using SQL, cloud, and 'big data' technologies.
• Develop ETLs to move data securely from source to target systems.
• Develop new or build against existing APls for data access or landing data as output for
further downstream consumption in the appropriate target data store.

MANDATORY SKILLS/EXPERIENCE

Note: Candidates who do not have the mandatory skills will
not be considered

• 8+ years of experience in the Java application development and implementation of large
technology projects.
• 5+ years of experience in writing SQL.
• Experience in front-end and back-end application development.
• Proven experience as a Full Stack Developer with expertise in Java, Spring Boot, Python,
JavaScript, and related frameworks (e.g., React, Angular, Node.js, Vue)
• Experience with RDBMS (Oracle, MySQL, PostgreSQL)
• Understand basic design principles behind a scalable application.
• Experience with service-oriented architecture and RESTful web services
• Knowledge of JSON, XML, XSD, WSDL, JDBC, MQ, SOAP concepts
• Strong problem-solving skills and enjoy learning new technologies.
• Experience with an agile, iterative development process and version control tools such as Git,
GitHub, Subversion.
• Strong understanding of data engineering concepts and experience with tools such as SQL,
NoSQL databases, and data processing frameworks (e.g., Apache Spark).
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies
(e.g., Docker, Kubernetes) is a plus.
• Experience working on large datasets, data models and full-cycle data pipeline development.
• Experience working with Amazon Web Services or Microsoft Azure cloud computing platform
and services.
• Experience developing cloud-ready applications.
• Excellent problem-solving and communication skills.
• Ability to work effectively in a fast-paced and collaborative environment.

DESIRABLE SKILLS/EXPERIENCE:

• ETL experience in development with the suite of tools from Informatica PowerCenter, IBM
DataStage and B2B Data Transformation.
• Experience using Oracle 12g, AWS RDS/MySQL and/or a database appliance.
• Knowledge of IBM Master Data Management (MDM) implementation
• Knowledge of metadata-driven enterprise reporting platforms.
• Prior experience working on complex data integration projects.

  • Sr. Azure Data Engineer

    4 months ago

    New York, United States Hudson Data Full time

    Job Title: Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role Job Description: The candidate should have hands-on experience with various Azure services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build, and maintain ETL pipelines, manage data lakes, and...

  • Senior Systems Engineer

    6 days ago

    New York, United States VAST Data Full time

    VAST Data is looking for a Senior Systems Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...

  • Data Engineer

    1 month ago

    New York, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...

  • Data Engineer

    6 months ago

    New York, United States Silver Search, Inc Full time

    Data Engineer New York, NY Senior Data Engineer--Redshift/AWS/Python/Scripting---**Will be hybrid onsite in January 2022 onwards** Contract-to-hire Our client is a cutting edge E-Learning company based in NYC and is looking to hire a Senior Data Engineer to join their data and analytics center of excellence. He/She will be building...

  • Data Engineer

    3 weeks ago

    New York, United States Walsh Employment Full time

    Our client is a leading quantitative investment company with a focus on computer-driven trading for global financial markets. The company harnesses the power of data and advanced technologies to drive innovative strategies and superior investment returns through a platform that is driven by cutting-edge, cloud-based data solutions. We are now looking for a...

  • Data Engineer

    2 weeks ago

    New York, United States SimplifyVMS Full time

    As a Data Engineer, you will be responsible for building and optimizing data pipelines, architectures, and datasets for effective data analysis and machine learning applications. Responsibilities: Developing, constructing, testing, and maintaining architectures for data ingestion, processing, and extraction. Designing and implementing data pipelines to...

  • Data Engineer

    2 days ago

    New York, United States Glow Networks Full time

    Role: Data Engineer Location: New York City, NY (Hybrid-3 days a week onsite) Duration: 6 Months with possible extensions Contract: C2C/ W2 Job Requirements: Deep hands-on knowledge in big data engineering in a cloud environment, including: Excellent knowledge of SQL in a large scale data warehouse or data lakehouse environment such as Spark, Databricks,...

  • Data Engineer

    5 days ago

    New York, United States TechnoGen Full time

    Data Engineer Remote Snowflake Expertise: Design, develop, and optimize data pipelines within the Snowflake data platform. Implement best practices for Snowflake data modeling, warehouse architecture, security and performance optimization. Proficient in using Snowflake Snowpipe streaming for real-time data streaming and ingestion and different batch load...

  • Data Engineer

    5 days ago

    New York, United States TechnoGen Full time

    Data Engineer Remote Snowflake Expertise: Design, develop, and optimize data pipelines within the Snowflake data platform. Implement best practices for Snowflake data modeling, warehouse architecture, security and performance optimization. Proficient in using Snowflake Snowpipe streaming for real-time data streaming and ingestion and different batch load...

  • Data Engineer

    6 days ago

    New York, United States TechnoGen Full time

    Data Engineer Remote Snowflake Expertise: Design, develop, and optimize data pipelines within the Snowflake data platform. Implement best practices for Snowflake data modeling, warehouse architecture, security and performance optimization. Proficient in using Snowflake Snowpipe streaming for real-time data streaming and ingestion and different batch load...

  • Data Engineer

    3 days ago

    New York, United States BEHAVIORALLY, Inc. Full time

    Title: Data Engineer MUST: Hybrid in New York City, NY No Sponsorship provided. Full-Time position Minimum Qualifications: The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. Proven Experience with data modeling and developing Enterprise Data Warehouse solutions - OLTP, OLAP, Dimensions, Facts, and Data modeling....

  • Data Engineer

    3 days ago

    New York, United States BEHAVIORALLY, Inc. Full time

    Title: Data Engineer MUST: Hybrid in New York City, NY No Sponsorship provided. Full-Time position Minimum Qualifications: The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. Proven Experience with data modeling and developing Enterprise Data Warehouse solutions - OLTP, OLAP, Dimensions, Facts, and Data modeling....

  • Data Engineer

    6 days ago

    New York, United States Glow Networks Full time

    Role: Data EngineerLocation: New York City, NY (Hybrid-3 days a week onsite)Duration: 6 Months with possible extensionsContract: C2C/ W2Job Requirements: Deep hands-on knowledge in big data engineering in a cloud environment, including: Excellent knowledge of SQL in a large scale data warehouse or data lakehouse environment such as Spark, Databricks,...

  • Data Engineer

    1 month ago

    New York, United States hackajob Full time

    Exciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...

  • Data Engineer

    6 months ago

    New York, United States Capstone Investment Advisors Full time

    RESPONSIBILITIES: Be part of Data Engineering team responsible for all market data in the firmDesign and implement data-ingestion and data-processing pipelines and tools for a diverse range of datasets using Python, Linux and AWS Cloud platform.Work with variety of backend database storage systems including MS SQL Server, AWS Redshift, Cassandra,...

  • Data Engineer

    6 days ago

    New York, United States BEHAVIORALLY, Inc. Full time

    Title: Data Engineer MUST: Hybrid in New York City, NYNo Sponsorship provided.Full-Time position Minimum Qualifications: The role is ideal for someone who thrives in a fast-paced, cutting-edge technology environment. Proven Experience with data modeling and developing Enterprise Data Warehouse solutions - OLTP, OLAP, Dimensions, Facts, and Data modeling....

  • Data Engineer

    3 weeks ago

    New York, United States Atlas Search Full time

    ResponsibilitiesCloud Data Engineer is responsible for building and maintaining data pipelines within an AWS cloud environment. Work heavily with MongoDB and Snowflake as well as Cypress, Selenium and Kafka. Requirements3+ years of experience in the Data Engineering space working heavily with Public cloud solutions.Experience with MongoDB or...

  • Healthcare Data Engineer Data Engineer

    4 weeks ago

    New York, United States Tek Leaders Inc Full time

    Title: Healthcare Data Engineer Duration: 12 Months Location: 100% Remote (NYC NY) Essential skills for the role: Minimum of 35 years of experience in Healthcare Domain Minimum of 10 years of experience in Data Engineering. Required technical skills: Python PySpark SQL AWS Required Domain: Healthcare/Insurance Candidate is expected to have...

  • Data Engineer

    3 days ago

    New York, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering an exciting opportunity for a Data Engineer in NEW YORK, New York. This role involves working in the industry, specifically focusing on AWS Technologies, Python, NoSQL, and Snowflake. The workplace is dynamic and requires someone who can efficiently handle data-related tasks. Responsibilities:• Build efficient...

  • Data Engineer

    1 week ago

    New York, United States Robert Half Full time

    Job DescriptionJob DescriptionWe are offering an exciting opportunity for a Data Engineer in NEW YORK, New York. This role involves working in the industry, specifically focusing on AWS Technologies, Python, NoSQL, and Snowflake. The workplace is dynamic and requires someone who can efficiently handle data-related tasks. Responsibilities:• Build efficient...