Senior Big Data Engineer

4 weeks ago

Jersey City, United States Zortech Solutions Full time

Role: Senior Big Data Engineer

Location: New Jersey (hybrid)

Duration: 6+ Months

Job Description:

Please submit someone who can go for in person interview, travel expenses will be taken care by client

Job Description:

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data projects. Your expertise in Java, Python, Spark cluster management, data science, big data, REST API development, and knowledge of Databricks and Delta Lake will be essential in driving the success of our data initiatives.

Responsibilities:

Design, develop, and implement scalable data pipelines and ETL processes using Java, Python, and Spark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design efficient solutions. Manage and optimize Spark clusters to ensure high performance and reliability. Perform data exploration, data cleaning, and data transformation tasks to prepare data for analysis and modeling. Develop and maintain data models and schemas to support data integration and analysis. Implement data quality and validation checks to ensure accuracy and consistency of data. Utilize REST API development skills to create and integrate data services and endpoints for seamless data access and consumption. Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues. Stay updated with the latest technologies and trends in big data, data engineering, data science, and REST API development, and provide recommendations for process improvements. Mentor and guide junior team members, providing technical leadership and sharing best practices.

Qualifications:

Master's degree in Computer Science, Data Science, or a related field. Minimum of 3 years of professional experience in data engineering, working with Java, Python, Spark, and big data technologies. Strong programming skills in Java and Python, with expertise in building scalable and maintainable code. Proven experience in Spark cluster management, optimization, and performance tuning. Solid understanding of data science concepts and experience working with data scientists and analysts. Proficiency in SQL and experience with relational databases (e.g., Snowflake, Delta Tables). Experience in designing and developing REST APIs using frameworks such as Flask or Spring. Familiarity with cloud-based data platforms (e.g.Azure) Experience with data warehousing concepts and tools (e.g., Snowflake, BigQuery) is a plus. Strong problem-solving and analytical skills, with the ability to tackle complex data engineering challenges. Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.

If you are a highly motivated and skilled Senior Data Engineer with a passion for big data, data engineering, and REST API development, we would love to hear from you. Join our team and contribute to the success of our data-driven initiatives as we strive to make a significant impact in the industry. #J-18808-Ljbffr

  • Senior Big Data

    6 days ago

    Jersey City, United States Diverse Lynx Full time

    Role: Senior Big Data /Scala Developer Location: Jersey city NJ and Tampa , FL (Onsite) Contract JD:- Big Dat Hadoop Spark Scal Cluster Kafk Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated...

  • Senior Data Engineer

    3 days ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by...

  • Principal Data Engineer

    1 month ago

    Jersey City, New Jersey, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...

  • Senior Data Architect

    4 weeks ago

    Jersey City, United States Artemis Consultants Full time

    As a senior data architect, you will develop and manage data models, guidelines, and techniques. You may also manage the resources of a variety of business analysts to leverage design data analysis and visualization tools, and standardize data models and domains.Common Skillsets:10+ years of experience as Technical Architect/Data ArchitectExpertise in...

  • Senior Data Architect

    1 month ago

    Jersey City, United States Artemis Consultants Full time

    As a senior data architect, you will develop and manage data models, guidelines, and techniques. You may also manage the resources of a variety of business analysts to leverage design data analysis and visualization tools, and standardize data models and domains.Common Skillsets:10+ years of experience as Technical Architect/Data ArchitectExpertise in...

  • Senior Data Architect

    4 weeks ago

    Jersey City, United States Artemis Consultants Full time

    As a senior data architect, you will develop and manage data models, guidelines, and techniques. You may also manage the resources of a variety of business analysts to leverage design data analysis and visualization tools, and standardize data models and domains.Common Skillsets:10+ years of experience as Technical Architect/Data ArchitectExpertise in...

  • Big Data Developer

    1 month ago

    Texas City, United States Involgix Full time

    Role Big Data Developer Duration 18+ Months Contract Location Austin TX Roles and Responsibilities Must have * Prior experience in developing application with big data technologies(hadoop spark kafka amazon aws) * Excellent in coding large scale application in java (at least 5+ years of experience in java) * Good understanding of SQL & relational...

  • Senior Data Scientist

    4 days ago

    Oklahoma City, United States Data Axle Inc. Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging proprietary...

  • Lead Data BSA

    7 days ago

    Jersey City, United States Creative Data Resources Full time

    Come Work with Us! At client, our culture is deeply supportive and rich in opportunity and reward. You will help our clients thrive and our communities prosper, empowered by a spirit of shared purpose. Whether you're helping clients find new opportunities, developing new technology, or providing expert advice to internal partners, you will be doing work that...

  • Principal Data Engineer

    2 days ago

    Jersey City, United States Tiger Analytics Full time

    Job DescriptionJob DescriptionTiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you’ll find our...

  • Principal Data Engineer

    2 days ago

    Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe...

  • Principal Data Engineer

    2 days ago

    Jersey City, United States Tiger Analytics Full time

    Tiger Analytics is a global AI and analytics consulting firm. With data and technology at the core of our solutions, we are solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe...

  • Data Warehouse/Snowflake Expert

    4 weeks ago

    Jersey City, United States The Fountain Group Full time

    Rate: 60-80/hour W2 with flexibility for stellar candidates. Hybrid Role: Must be willing to work onsite 2-3 days/week in Jersey City, Boston, or Tampa. Description Seeking a senior Level Data Warehouse Specialist with Snowflake experience 6+ years of Development experience in design, development, and implementation of software systems. Experienced in data...

  • Senior QA Engineer

    2 weeks ago

    Charles City, United States binance Full time

    Binance is the leading global blockchain ecosystem and cryptocurrency infrastructure provider whose suite of financial products includes the world’s largest digital-asset exchange. Our mission is to accelerate cryptocurrency adoption and increase the freedom of money. If you’re looking for a fast-paced, mission-driven organization where opportunities to...

  • Big Data developer

    1 month ago

    Ohio City, United States Infoprompt Inc Full time

    Responsibilities Participate in Team activities Design discussions Stand up meetings and planning Review with team. Perform data analysis data profiling data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries PySpark programs and UNIX shell scripts. Follow the organization coding standard document Create mappings ...

  • Senior Estimator

    1 day ago

    Park City, United States Big-D Full time

    Big-D is looking for a dynamic Senior Estimator. This is a great opportunity to start a career with a company that is on a mission to be the most sought-after company in the business. We seek and employee exceptional, hard-working, lifetime learners; we give them the tools to succeed when we find them. We have a culture of growth and achievement powered by...

  • Data Analyst

    7 days ago

    Jersey City, United States Underwriting Solutions Full time

    **Company Description** We help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable. The Analytical Data Operations (ADO) division of Verisk’s ISO business is the information refinery for...

  • Senior Data Engineer

    6 days ago

    Oklahoma City, United States Corvus Insurance Full time

    We’re united by a mission: to make the world a safer place. Corvus Insurance uses novel data and artificial intelligence/machine learning to achieve better insights into commercial insurance risk. Our software empowers brokers and policyholders to better predict and prevent complex claims through data-driven tools and Smart Commercial Insurance policies....

  • Senior Data Engineer

    1 day ago

    Genoa City, United States Uline Full time

    Senior Data Engineer Corporate Headquarters 12575 Uline Drive, Pleasant Prairie, WI 53158 Fuel the future of data engineering and analytics for our growing North American company! As a Senior Data Engineer at Uline, you'll play a pivotal role in constructing and maintaining our new, cutting-edge data collection systems and analytics platform. Better...

  • Director, Data Engineering

    2 weeks ago

    Jersey City, United States Verisk Analytics Full time

    As the Data Engineering Director, you will lead a team of data engineers responsible for building efficient, maintainable production-grade data pipelines. This role can be based in our Jersey City, NJ location (hybrid work model) or remote. This is a Data Engineer, Director, Engineer, Product Engineer, Project Management, Technology, Data