E-Solutions | Big Data Engineer
7 days ago
Role : Big Data Engineer
Location : NYC office Fully Onsite (Local only)
Inperson Interview is must
Technical Skills:
• Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.
• Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake
• Languages: Python, SQL and Shell Scripting.
• Databases: MySQL, Teradata, and SQL SERVER.
• Orchestration/Tools: Oozie, Airflow, CTRL-M, Maven, Jenkins, IntelliJ, GIT
JD
• Expertise in all components of Big Data Ecosystem- Spark, Hive, Sqoop, Oozie, Impala and Hue
• Extensive Experience with AWS services ensuring efficient data management and analysis.
• Successfully led the migration of legacy systems to Datawarehouse environments and Cloud, utilizing Informatica, Snowflake and AWS technologies, resulting in improved scalability, performance, and cost-effectiveness.
• Extensively worked with lambda, S3, cloudwatch,SQS,SNS,Step Functions and IAM roles in AWS services.
• Extensive knowledge on data serialization techniques like Avro, Sequence Files, Parquet, JSON and ORC.
• Experienced in handling databases: MySQL, SQL Server, Teradata.
• Expertise working across all phases of SDLC requirements gathering, system design, development, enhancement, maintenance, testing, deployment, production support, and documentation.
• Working experience in creating complex data ingestion pipelines, data transformations, data management and data governance in a centralized enterprise data hub.
• Knowledge of Kubernetes ecosystem.
• Did Data analysis and interpretation Using Databricks features to perform data transformations, run queries, and build visualizations collaborating Working with diverse teams to deliver insights in Analytics platform. – good to have.
• Strong problem-solving skills
• Strong team player with good communication, analytical, presentation and inter-personal skills.
-
E-Solutions | Big Data Engineer
7 days ago
new york city, United States E-Solutions Full timeRole : Big Data EngineerLocation : NYC office Fully Onsite (Local only)Inperson Interview is mustTechnical Skills:• Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.• Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake• Languages: Python, SQL and Shell Scripting.• Databases: MySQL, Teradata, and SQL SERVER.• Orchestration/Tools:...
-
Big Data Engineer
7 days ago
New York, United States E-Solutions Full timeRole : Big Data EngineerLocation : NYC office Fully Onsite (Local only)Inperson Interview is mustTechnical Skills:• Big Data Ecosystem: HDFS, Hive, Oozie, Sqoop, Impala, Presto and Spark.• Cloud Ecosystem: AWS (EMR, S3, Athena), Snowflake• Languages: Python, SQL and Shell Scripting.• Databases: MySQL, Teradata, and SQL SERVER.• Orchestration/Tools:...
-
Big Data Solutions Architect
1 month ago
Kansas City, Missouri, United States Databricks Full timeJob Description:As a Specialist Solutions Architect at Databricks, you will play a key role in guiding customers to successful implementations of big data projects. Your expertise in data engineering, cloud data technologies, and technical leadership will be instrumental in architecting production-level data pipelines, including end-to-end pipeline load...
-
Big Data Solutions Developer
4 weeks ago
New York, New York, United States RiVi Consulting Group Full timeJob SummaryAs a seasoned Spark Developer at RiVi Consulting Group, you will play a vital role in designing and implementing cutting-edge big data solutions. Your expertise in Spark and HDFS will enable us to deliver scalable and efficient data processing capabilities to drive business growth.Key Responsibilities• Collaborate with stakeholders to understand...
-
Big Data Engineer Lead
2 weeks ago
New York, United States InterSources Full timeJob Title: Big Data Engineer Type: Contract Location: New York, NY ( Day 1 onsite)Job Description: A Big Data Engineering lead handles the ETL jobs, Optimization, Automation of data processing for complex scenarios. Responsibilities: Data ingestion from Source DQ checks Handling ETL Automation Building features / variable Required Skills: Should be subject...
-
E-Solutions | Sr. Mulesoft Developer
7 days ago
new york city, United States E-Solutions Full timeRole: Sr. Mulesoft DeveloperLocation: New York, NY 10020 (100% Onsite ) Local onlyInperson interview is mustJob Description:You will be responsible for designing, developing, and maintaining integration solutions using Mulesoft. The ideal candidate will have a strong background in DevOps CI/CD pipelines, Java, Spring Framework, JavaScript, React JS and...
-
E-Solutions | Sr. Mulesoft Developer
1 week ago
new york city, United States E-Solutions Full timeRole: Sr. Mulesoft DeveloperLocation: New York, NY 10020 (100% Onsite ) Local onlyInperson interview is mustJob Description:You will be responsible for designing, developing, and maintaining integration solutions using Mulesoft. The ideal candidate will have a strong background in DevOps CI/CD pipelines, Java, Spring Framework, JavaScript, React JS and...
-
Big Data Architect with Devops
6 months ago
New York, United States CyberTec Full timeRole 3: Big Data Architect with Devops experience and local to NY Start Date: ASAP Rate - $90/hr. Maximum Start Date: ASAP Local to NY its onsite Client: Microsoft We'd like to see candidates at the Tech 3 level Description: Job Summary and Responsibilities: Hands on keyboard engineer with experience in the DevOps space and, preferably, experience in the...
-
Data Solutions Engineering Director
4 weeks ago
New York, New York, United States Conde Nast Full timeConde Nast is a global media company renowned for producing high-quality content for influential audiences, attracting over 100 million consumers across its industry-leading print, digital, and video brands.The company's portfolio includes respected media properties like Vogue, Vanity Fair, Glamour, and Wired, among others.We are seeking a VP of Data...
-
Specialist Solutions Architect
5 days ago
Kansas City, United States Databricks Full timeFEQ425R190This role can be remote and fluent-proficiency in English and Spanish is required.As a Specialist Solutions Architect (SSA) - Data Engineering, you will guide in building big data solutions on Databricks that span a large variety of use cases. You will be in a customer-facing role, working with and supporting Solution Architects, that requires...
-
Data Engineer
3 weeks ago
new york city, United States hackajob Full timeExciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...
-
Data Engineer
4 weeks ago
new york city, United States hackajob Full timeExciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...
-
Data Solutions Engineer
1 month ago
new york city, United States Preql Full timeWe’re seeking an experienced and exceptionally talented Data Solutions Engineer to drive growth at our top tier VC-backed early-stage SaaS startup. This role is critical to our immediate phase of growth and sets the stage for rapid scaling.About the RoleBe a major part in building a top-notch product that empowers businesses to utilize their data for...
-
Data Solutions Engineer
2 months ago
new york city, United States Preql Full timeWe’re seeking an experienced and exceptionally talented Data Solutions Engineer to drive growth at our top tier VC-backed early-stage SaaS startup. This role is critical to our immediate phase of growth and sets the stage for rapid scaling.About the RoleBe a major part in building a top-notch product that empowers businesses to utilize their data for...
-
Data Engineer
4 weeks ago
new york city, United States Brooksource Full timeData EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...
-
Data Engineer
4 weeks ago
new york city, United States Brooksource Full timeData EngineerLocation: New York, NY (Hybrid)Contract-to-HireWe’re looking for an experienced Data Engineer to join a Fortune 50 Broadcast Media & Entertainment leader. This role involves designing, building, and optimizing data pipelines, integrating multiple datasets, and creating applications that drive strategic business decisions. You’ll collaborate...
-
Data Engineer
4 weeks ago
New York, United States hackajob Full timeExciting Opportunity Alert! Join our Team as a Data Engineer!hackajob has partnered with an innovative company seeking a skilled Data Engineer to leverage data for impactful solutions. If you have expertise in big data tools like Spark and Kafka, and experience with cloud services like AWS, we want to hear from YOU!Role: Data EngineerLocation: Hybrid (New...
-
Big Data + Java Fullstack
6 days ago
Jersey City, United States Della Infotech Full timeJob Title: Big Data + Java Fullstack Location: Remote (US) Duration: C2C/Fulltime "Requirements: . Must have: Java Fullstack • BS degree in computer science, computer engineering or equivalent • 5 - 6 years of experience delivering enterprise software solutions • Proficient in Spark, Scala, Python, AWS Cloud technologies • 3+ years of experience...
-
Big data Architect
1 week ago
New York, United States SysMind Tech Full timeHi, Hope you are doing well. Here is the position. Kindly revert me back if you are interested. Role: Big Data Architect Location: Remote Duration: 12+ Months Skills: 1. 8-10 Years of strong Data architect\modeling experience 2. Design and architect the tables\data marts for staging, facts and dimensions 3. Develop mapping specs for Fact and Dimension...
-
Data Solutions Engineer
2 months ago
New York, United States Preql Full timeWe’re seeking an experienced and exceptionally talented Data Solutions Engineer to drive growth at our top tier VC-backed early-stage SaaS startup. This role is critical to our immediate phase of growth and sets the stage for rapid scaling.About the RoleBe a major part in building a top-notch product that empowers businesses to utilize their data for...