Big Data developer

Found in: beBee S US - 2 weeks ago


Ohio City, United States Infoprompt Inc Full time

Responsibilities Participate in Team activities Design discussions Stand up meetings and planning Review with team. Perform data analysis data profiling data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries PySpark programs and UNIX shell scripts. Follow the organization coding standard document Create mappings sessions and workflows as per the mapping specification document. Perform Gap and impact analysis of ETL and IOP jobs for the new requirement and enhancements. Create jobs in Hadoop using SQOOP PYSPARK and Stream Sets to meet the business user needs. Create mockup data perform Unit testing and capture the result sets against the jobs developed in lower environment. Updating the production support Run book Control M schedule document as per the production release. Create and update design documents provide detail description about workflows after every production release. Continuously monitor the production data loads fix the issues update the tracker document with the issues Identify the performance issues. Performance tuning long running ETL/ELT jobs by creating partitions enabling full load and other standard approaches. Perform Quality assurance check Reconciliation post data loads and communicate to


  • Senior Big Data

    7 days ago


    Jersey City, United States Diverse Lynx Full time

    Role: Senior Big Data /Scala Developer Location: Jersey city NJ and Tampa , FL (Onsite) Contract JD:- Big Dat Hadoop Spark Scala Cluster Kafka Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated...


  • Jersey City, United States Zortech Solutions Full time

    Role: Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months Job Description: Please submit someone who can go for in person interview, travel expenses will be taken care by client Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a...


  • Jersey City, United States Petadata Full time

    Job DescriptionJob DescriptionPosition: Lead Big Data EngineerLocation: Jersy City, NJ (Hybrid)Experience: 10+ YearsWork type: Fulltime(W2) onlyPETADATA is currently looking to hire for the position of Lead Big Data Engineer for one of their clients. Roles & Responsibilities:The Ideal candidate should be able to define the overall strategy and roadmap for...

  • Big Data Developer

    6 days ago


    jersey city, United States Tata Consultancy Services Full time

    Location – Jersey City, NJ / Tampa, FL / New Castle, DEBigData Spark/Scala Senior Developer Strong Experienced in Spark Scala Programing. Very extensive experience on Hive, Impala, K...

  • Big Data Developer

    Found in: Jooble US O C2 - 5 days ago


    Jersey City, NJ, United States Tata Consultancy Services Full time

    Location – Jersey City, NJ / Tampa, FL / New Castle, DE BigData Spark/Scala Senior Developer Strong Experienced in Spark Scala Programing . Very extensive experience on Hive , Impala , K...

  • Big Data Engineer

    6 days ago


    Jersey City, United States Abode Techzone LLC Full time

    Job Description:Looking for consultants local to NY, NJ & CTMainly we are looking for AWSNot Azure OR GCPNEED EXTENSIVE EXPERIENCE WORKING WITH BANKING CLIENTSLooking for 9 Plus years of experienceAs a Software Engineer within the Corporate Investment Banking Treasury Services, you are part of an agile team that works to enhance, design, and deliver the...

  • Sr. Controls System Development Engineer, Data Center Engineering

    Found in: Careerbuilder One Red US C2 - 1 week ago


    Columbus, Ohio, USA, United States Amazon Data Services, Inc. Full time

    Amazon Web Services (AWS) is looking for highly technical and critical individual to solve the most challenging problems in our industry. AWS Data Center Planning, Deliver, & Operations is a global team responsible for the design and operation of industry-leading, large-scale, business critical facilities. We are currently seeking highly motivated...

  • Java Cloud/Big Data Software Engineer II

    Found in: beBee S US - 4 days ago


    Jersey City, United States JPMorgan Chase Full time

    You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you. As a Software Engineer II at JPMorgan Chase within the Corporate Sector - Country Risk team, you are part of an agile team that works to enhance, design, and deliver the software...

  • Principal Data Engineer

    Found in: beBee jobs US - 2 weeks ago


    Jersey City, New Jersey, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...

  • Data Engineer

    7 days ago


    Crystal City, United States CareerBuilder Full time

    Data Engineer Role Description & Requirements Data is absolutely the lifeblood of ADVANA and our data engineers are the doctors administering it! Our data engineers support data collection, ingestion, validation, and loading of optimized data in the appropriate data stores. They work on a team made up of analyst(s), developer(s), data scientist(s), and a...

  • Principal Data Engineer

    Found in: beBee S US - 1 week ago


    Jersey City, United States CareerBuilder Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...

  • Principal Data Engineer

    Found in: beBee S US - 1 week ago


    Jersey City, United States Tiger Analytics, LLC Full time

    As a Principal Data Engineer (Azure), you would have hands on experience working on Azure as cloud, Databricks and some exposure/experience on Data Modelling.using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks,...


  • Jersey City, United States CareerBuilder Full time

    Role: Senior Big Data Engineer Location : NJ (hybrid) Experience : 8+ Year Duration : 12+ months Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines and infrastructure for our big data...


  • Salt Lake City, United States Open Data Science Conferenc Full time

    We are looking for a highly motivated Senior Data Scientist experienced in generating insights/evidence from claims and EHR real world data (RWD) to join our growing RWD analytics team at Clarivate. In this role you will be developing and managing the delivery of custom analytics solutions for customers as well as working with our internal product teams to...

  • Controls Deployment Engineer, Data Center Capacity Delivery

    Found in: Careerbuilder One Red US C2 - 7 days ago


    Hilliard, Ohio, USA, United States Amazon Data Services, Inc. Full time

    As part of the global controls team, you will work with highly motivated engineers, experts and innovators in the data center industry. You will be responsible for innovating, deploying and optimizing the automation systems within the data centers. Automation systems consist of building management system (BMS) and electrical power monitoring system (EPMS)....

  • Data Scientist with Security Clearance

    Found in: Dice One Red US C2 - 6 days ago


    Crystal City, United States Amplify Federal Full time

    Data Scientist Are you a data professional ready to join a dynamic team cracking the government’s most exhilarating data puzzles? Does the idea of leveraging data to justify the adoption of business transformation initiatives excite you? Do you enjoy partnering with decision-makers to understand data insights and develop solutions that help them better...


  • Jersey City, United States Korn Ferry Full time

    We have partnered with our client in their search for a Big Data Developer. Responsibilities: You should be comfortable working in a fast-paced environment and can help build APIs, Calculators, on new cutting-edge cloud and big data technologies such as AWS EMR, EC2, Scala Spark, Scala, Snowflake Executes standard software solutions, design, development, and...

  • Lead Data Engineer

    2 days ago


    Salt Lake City, United States Nicholas Full time

    (SLC, UT) Analyze and manage large multi-state food service company’s data engineering. Lead design & implementation of scalable & fault-tolerant data app on Big-Data & AWS Serverless. Use Extract, Transform and Load (ETL) tools and iPaaS to process and combine data from multiple OLTP sources into central repository data warehouse, SQL and No-SQL dbs....

  • Lead Data Scientist

    Found in: beBee S US - 6 days ago


    Garden City, United States Lumen Full time

    We’ve made the Newsweek 2024 Greatest Workplaces for Diversity list and achieved a perfect score of 100 on the Human Rights Campaign Corporate Equality Index (CEI) for the fifth consecutive year.We’re looking for top-tier talent and offer the flexibility you need to thrive and deliver lasting impact.The Data Scientist is responsible for developing tools...

  • Engineer III

    6 days ago


    Atlantic City, United States Acquired Data Solutions Full time

    Job DescriptionJob DescriptionMUST HAVE CURRENT DHS SUITABILITY OR CURRENT SECRET CLEARANCE AT OTHER GOVERNMENT AGENCIES.Mid Level (6-12 years experience)Acquired Data Solutions, Inc. is a test and engineering company that is seeking an onsite Mid Level Engineer to join our Transportation Security Laboratory (TSL) Team in Egg Harbor, NJ as Key Personnel to...