Big Data Analytics Developer

24 hours ago


New York, New York, United States Diverse Lynx Full time

Job Title: Big Data Analytics Developer

About the Role:

This role involves working on big data analytics tasks using strong coding skills in Python, Java or Scala. Proficiency in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols is required.

A solid understanding of relational and NoSQL database such as PostgreSQL, MySQL, DynamoDB or MongoDB is necessary. Familiarity with data pipelines orchestration tools such as Airflow or Flask is also required.

Requirements:

  • Proficiency in containerization technologies such as Docker and Kubernetes.
  • Hands-on experience with front-end framework like React, Vue.js, Next.js or Angular.js.
  • Experience in infrastructure as code (IaC) using Terraform, particularly with AWS provider.
  • Strong Coding skills in Python, Java or Scala for data processing task.
  • Proficient in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols.
  • Solid Understanding of relational and NoSQL database, such as PostgreSQL, MySQL, DynamoDB or MongoDB.
  • Familiarity with data pipelines orchestration tools such as Airflow or Flask.
  • Proficiency in data transformation and ETL process, including tools like Apache Spark or Glue.
  • Strong experience with cloud platforms, especially AWS, including services like Lambda, S3, RDS and Glue.
  • Familiarity with big data technologies, including Hadoop, Hive or Redshift.
  • Experience with user authentication and authorization using AWS Cognito.
  • Expertise in API development, security and implementing best practices for scalable solutions.
  • Experience with monitoring and logging tools, such as Prometheus, Grafana or ELK Stack to ensure system reliability and application performance.
  • Strong understanding of DevOps principles, CI/CD pipelines and best practices.
  • Experience with core AWS technologies such as EC2, ELB, Auto Scaling, S3, EFS, Lambda, API Gateway, Step Functions, CloudWatch, VPC, Route 53, ACM.
  • Experience with BI tools like Tableau, AWS Quick Sight


  • New York, New York, United States Early Warning Services Full time

    About Our TeamWe are Early Warning Services, a leading provider of payment solutions. We are seeking a highly skilled Big Data Analytics Expert to join our team.The successful candidate will be responsible for developing, documenting, testing, debugging, and maintaining data engineering solutions for Paze.The ideal candidate will have expertise in software...

  • Big Data Developer

    3 weeks ago


    New York, New York, United States Eliassen Group Full time

    We are seeking a talented Big Data Developer to join our team at Eliassen Group. This is a 100% remote role that involves building next-generation data analytics platforms using advanced big data technologies.The ideal candidate will have 5+ years of experience in designing, architecting, developing, scaling, and improving data platforms and services.We are...

  • Big Data Engineer

    2 days ago


    New York, New York, United States ShiftCode Analytics Full time

    Job Description:Hiring for a Big Data Engineer in New York. The ideal candidate will have 5+ years of experience in Hadoop and related technologies. Responsibilities include designing and implementing scalable data architectures, developing and maintaining large-scale data processing systems, and collaborating with cross-functional teams to ensure seamless...


  • New York, New York, United States Tiger Analytics Full time

    We are seeking a highly skilled Data Analytics Manager to join our team at Tiger Analytics. As a key member of our organization, you will be responsible for leading analytics projects and collaborating with client stakeholders and our global team.Key Responsibilities:Develop and implement high-level analytics solution designs that meet business...

  • Data Analytics Leader

    19 hours ago


    New York, New York, United States Tiger Analytics Full time

    Tiger Analytics is an advanced analytics consulting firm. We deliver business value from data to Fortune 100 companies.We are looking for someone with a good blend of business consulting skills and data analytics background.Responsibilities:Lead and manage analytics projects aimed at solving business problems within the banking domain.Engage with clients to...

  • Big Data Developer

    7 days ago


    New York, New York, United States Infojini Full time

    **Job Description:**We're seeking a talented Big Data Developer to join our team at Infojini. As a Big Data Developer, you'll be responsible for designing, developing, and implementing large-scale big data solutions using Hadoop, Spark, and other relevant technologies.About the Role:Design, develop, and implement large-scale big data solutionsCollaborate...


  • New York, New York, United States ShiftCode Analytics Full time

    Job Overview:We're seeking a skilled Big Data Administrator to manage our Hadoop ecosystem in NY. The ideal candidate will have a strong background in Hadoop and related technologies, as well as experience with Java development and distributed systems architecture.Estimated Salary: $140,000 per annum, based on experience and location.Key Responsibilities:-...


  • New York, New York, United States ShiftCode Analytics Full time

    About the Role">We are seeking a highly skilled Data Analytics Expert to join our team at ShiftCode Analytics. As a key member of our organization, you will be responsible for developing and managing Tableau reports to support senior managers, business leads, and other stakeholders.">Responsibilities">Work with various department's report authors to create...


  • New York, New York, United States Tiger Analytics Full time

    We are seeking a highly experienced Senior Director of Data Analytics to join our team at Tiger Analytics.About the RoleThis is a senior leadership position that requires a strong background in data analytics and technology consulting. The successful candidate will have a proven track record of delivering large-scale data analytics projects, managing client...


  • New York, New York, United States Inficare Full time

    Job Title: Big Data Developer with Scala ExperienceLocation: New York, USA (Hybrid)Job Type: ContractJob Duration: Long TermDescription:Company Overview:Inficare is a leading provider of healthcare solutions.We are seeking a highly skilled big data developer with experience in Scala to join our team. In this role, you will develop and maintain data...


  • New York, New York, United States TechnoGen Full time

    Job OverviewWe are seeking a Senior Big Data Developer to join our team at TechnoGen in Brooklyn, NY. This is a 9-month full-time contractor position with a competitive salary of $200,000 per year.The ideal candidate will have experience building applications and managing infrastructure using major cloud providers. A strong understanding of distributed...


  • New York, New York, United States POINT72, L.P. Full time

    About UsPOINT72, L.P. is a global investment manager dedicated to delivering exceptional returns to our clients.We are committed to fostering a culture of innovation, collaboration, and excellence, and we seek like-minded individuals to join our team.Job SummaryWe are seeking an experienced Data Engineer II to lead the development of big data solutions,...


  • New York, New York, United States ShiftCode Analytics Full time

    About the JobWe are hiring a seasoned HBase expert to join our team at ShiftCode Analytics in New York. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining large-scale Hadoop environments.Job Responsibilities:Design and implement high-performance Hadoop clusters.Develop and deploy scalable data...

  • Data Analytics Lead

    2 weeks ago


    New York, New York, United States Tiger Analytics Full time

    Job OverviewTiger Analytics, a trusted analytics partner for Fortune 100 companies, is seeking an experienced Data Analytics Lead to drive business value from data.This role involves leading and managing analytics projects within the banking domain, engaging with clients to define and translate business objectives into actionable analytics solutions, and...


  • New York, New York, United States Lorven Technologies Full time

    We are currently seeking a Big Data Software Developer to join our team at Lorven Technologies in New York City. This is a full-time position that requires over 10 years of experience in software development using Python, PySpark, and its frameworks.The ideal candidate will have strong SQL skills and experience working with RDMS or NoSQL...

  • Big Data Engineer

    24 hours ago


    New York, New York, United States Diverse Lynx Full time

    About the PositionWe are seeking a Big Data Engineer to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing and implementing big data pipelines using Apache Kafka and other technologies.Key ResponsibilitiesDesign and implement big data pipelines using Apache Kafka and other...


  • New York, New York, United States Inficare Full time

    Inficare is seeking a talented Software Developer for Big Data Solutions using Java and Scala. In this role, you will develop and maintain data processing applications using Spark and Scala. Our ideal candidate has strong knowledge of Java, excellent problem-solving and analytical skills, and proficiency in Spark.You will collaborate with cross-functional...


  • New York, New York, United States Texture Full time

    Unlock your potential and join Texture's dynamic team, shaping the future of energy data management.About the RoleThis is a unique opportunity to work with a pioneering company that's revolutionizing the energy sector. As a senior data engineer, you'll play a key role in designing, constructing, and optimizing our data pipelines to support various data...


  • New York, New York, United States Blood Bank of Delmarva Full time

    Data Engineering Leader Job OpeningWe're seeking an experienced Big Data Solutions Director to lead our data engineering team at the Blood Bank of Delmarva. As a key member of our organization, you'll be responsible for designing and implementing robust, scalable data pipelines using SQL, Python, and cloud-based ETL tools such as Databricks.About UsThe Blood...

  • Big Data Architect

    2 days ago


    New York, New York, United States ApTask Full time

    As a Big Data Architect at ApTask, you will play a critical role in shaping the company's data strategy and driving business outcomes through data-driven insights. This position requires a deep understanding of big data technologies, including Hadoop, NoSQL databases, and data processing frameworks. You will design and implement scalable data architectures,...