E-Solutions | Big Data Engineer

7 days ago


new york city, United States E-Solutions Full time

Role : Big Data Engineer

Location : NYC office Fully Onsite (Local only)


Inperson Interview is must


Technical Skills:

• Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.

• Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake

• Languages: Python, SQL and Shell Scripting.

• Databases: MySQL, Teradata, and SQL SERVER.

• Orchestration/Tools: Oozie, Airflow, CTRL-M, Maven, Jenkins, IntelliJ, GIT


JD

• Expertise in all components of Big Data Ecosystem- Spark, Hive, Sqoop, Oozie, Impala and Hue

• Extensive Experience with AWS services ensuring efficient data management and analysis.

• Successfully led the migration of legacy systems to Datawarehouse environments and Cloud, utilizing Informatica, Snowflake and AWS technologies, resulting in improved scalability, performance, and cost-effectiveness.

• Extensively worked with lambda, S3, cloudwatch,SQS,SNS,Step Functions and IAM roles in AWS services.

• Extensive knowledge on data serialization techniques like Avro, Sequence Files, Parquet, JSON and ORC.

• Experienced in handling databases: MySQL, SQL Server, Teradata.

• Expertise working across all phases of SDLC requirements gathering, system design, development, enhancement, maintenance, testing, deployment, production support, and documentation.

• Working experience in creating complex data ingestion pipelines, data transformations, data management and data governance in a centralized enterprise data hub.

• Knowledge of Kubernetes ecosystem.

• Did Data analysis and interpretation Using Databricks features to perform data transformations, run queries, and build visualizations collaborating Working with diverse teams to deliver insights in Analytics platform. – good to have.

• Strong problem-solving skills

• Strong team player with good communication, analytical, presentation and inter-personal skills.



  • new york city, United States E-Solutions Full time

    Role : Big Data EngineerLocation : NYC office Fully Onsite (Local only)Inperson Interview is mustTechnical Skills:• Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.• Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake• Languages: Python, SQL and Shell Scripting.• Databases: MySQL, Teradata, and SQL SERVER.• Orchestration/Tools:...

  • Big Data Engineer

    7 days ago


    New York, United States E-Solutions Full time

    Role : Big Data EngineerLocation : NYC office Fully Onsite (Local only)Inperson Interview is mustTechnical Skills:• Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.• Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake• Languages: Python, SQL and Shell Scripting.• Databases: MySQL, Teradata, and SQL SERVER.• Orchestration/Tools:...


  • Kansas City, Missouri, United States Databricks Full time

    Job Description:As a Specialist Solutions Architect at Databricks, you will play a key role in guiding customers to successful implementations of big data projects. Your expertise in data engineering, cloud data technologies, and technical leadership will be instrumental in architecting production-level data pipelines, including end-to-end pipeline load...


  • New York, New York, United States RiVi Consulting Group Full time

    Job SummaryAs a seasoned Spark Developer at RiVi Consulting Group, you will play a vital role in designing and implementing cutting-edge big data solutions. Your expertise in Spark and HDFS will enable us to deliver scalable and efficient data processing capabilities to drive business growth.Key Responsibilities• Collaborate with stakeholders to understand...


  • New York, United States InterSources Full time

    Job Title: Big Data Engineer Type: Contract Location: New York, NY ( Day 1 onsite)Job Description: A Big Data Engineering lead handles the ETL jobs, Optimization, Automation of data processing for complex scenarios. Responsibilities: Data ingestion from Source DQ checks Handling ETL Automation Building features / variable Required Skills: Should be subject...


  • new york city, United States E-Solutions Full time

    Role: Sr. Mulesoft DeveloperLocation: New York, NY 10020 (100% Onsite ) Local onlyInperson interview is mustJob Description:You will be responsible for designing, developing, and maintaining integration solutions using Mulesoft. The ideal candidate will have a strong background in DevOps CI/CD pipelines, Java, Spring Framework, JavaScript, React JS and...


  • new york city, United States E-Solutions Full time

    Role: Sr. Mulesoft DeveloperLocation: New York, NY 10020 (100% Onsite ) Local onlyInperson interview is mustJob Description:You will be responsible for designing, developing, and maintaining integration solutions using Mulesoft. The ideal candidate will have a strong background in DevOps CI/CD pipelines, Java, Spring Framework, JavaScript, React JS and...


  • New York, United States CyberTec Full time

    Role 3: Big Data Architect with Devops experience and local to NY Start Date: ASAP Rate - $90/hr. Maximum Start Date: ASAP Local to NY its onsite Client: Microsoft We'd like to see candidates at the Tech 3 level Description: Job Summary and Responsibilities: Hands on keyboard engineer with experience in the DevOps space and, preferably, experience in the...


  • New York, New York, United States Conde Nast Full time

    Conde Nast is a global media company renowned for producing high-quality content for influential audiences, attracting over 100 million consumers across its industry-leading print, digital, and video brands.The company's portfolio includes respected media properties like Vogue, Vanity Fair, Glamour, and Wired, among others.We are seeking a VP of Data...


  • Kansas City, United States Databricks Full time

    FEQ425R190This role can be remote and fluent-proficiency in English and Spanish is required.As a Specialist Solutions Architect (SSA) - Data Engineering, you will guide in building big data solutions on Databricks that span a large variety of use cases. You will be in a customer-facing role, working with and supporting Solution Architects, that requires...

  • Data Engineer

    4 weeks ago


    new york city, United States hackajob Full time

    Exciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...

  • Data Engineer

    4 weeks ago


    new york city, United States hackajob Full time

    Exciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...


  • new york city, United States Preql Full time

    We’re seeking an experienced and exceptionally talented Data Solutions Engineer to drive growth at our top tier VC-backed early-stage SaaS startup. This role is critical to our immediate phase of growth and sets the stage for rapid scaling.About the RoleBe a major part in building a top-notch product that empowers businesses to utilize their data for...


  • new york city, United States Preql Full time

    We’re seeking an experienced and exceptionally talented Data Solutions Engineer to drive growth at our top tier VC-backed early-stage SaaS startup. This role is critical to our immediate phase of growth and sets the stage for rapid scaling.About the RoleBe a major part in building a top-notch product that empowers businesses to utilize their data for...

  • Data Engineer

    4 weeks ago


    new york city, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...

  • Data Engineer

    4 weeks ago


    new york city, United States Brooksource Full time

    Data EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...

  • Data Engineer

    4 weeks ago


    New York, United States hackajob Full time

    Exciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...


  • Jersey City, United States Della Infotech Full time

    Job Title: Big Data + Java Fullstack Location: Remote (US) Duration: C2C/Fulltime "Requirements: . Must have: Java Fullstack • BS degree in computer science, computer engineering or equivalent • 5 - 6 years of experience delivering enterprise software solutions • Proficient in Spark, Scala, Python, AWS Cloud technologies • 3+ years of experience...

  • Big data Architect

    1 week ago


    New York, United States SysMind Tech Full time

    Hi, Hope you are doing well. Here is the position. Kindly revert me back if you are interested. Role: Big Data Architect Location: Remote Duration: 12+ Months Skills: 1. 8-10 Years of strong Data architect\modeling experience 2. Design and architect the tables\data marts for staging, facts and dimensions 3. Develop mapping specs for Fact and Dimension...


  • New York, United States Preql Full time

    We’re seeking an experienced and exceptionally talented Data Solutions Engineer to drive growth at our top tier VC-backed early-stage SaaS startup. This role is critical to our immediate phase of growth and sets the stage for rapid scaling.About the RoleBe a major part in building a top-notch product that empowers businesses to utilize their data for...