Cloud Data Processing Specialist

6 days ago


New York, New York, United States Diverse Lynx Full time

Job Title: Cloud Data Processing Specialist

About Diverse Lynx LLC:

We are an Equal Employment Opportunity employer that promotes diversity and supports a workforce across all levels in the company.

Job Description:

This role involves working on data processing tasks using strong coding skills in Python, Java or Scala. Proficiency in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols is required.

A solid understanding of relational and NoSQL database such as PostgreSQL, MySQL, DynamoDB or MongoDB is necessary. Familiarity with data pipelines orchestration tools such as Airflow or Flask is also required.

Benefits:

  • Competitive salary range: $120,000 - $180,000 per annum
  • A dynamic work environment
  • Ongoing training and professional development opportunities

Skills Requirements:

  • Proficiency in containerization technologies such as Docker and Kubernetes.
  • Hands-on experience with front-end framework like React, Vue.js, Next.js or Angular.js.
  • Experience in infrastructure as code (IaC) using Terraform, particularly with AWS provider.
  • Strong Coding skills in Python, Java or Scala for data processing task.
  • Proficient in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols.
  • Solid Understanding of relational and NoSQL database, such as PostgreSQL, MySQL, DynamoDB or MongoDB.
  • Familiarity with data pipelines orchestration tools such as Airflow or Flask.
  • Proficiency in data transformation and ETL process, including tools like Apache Spark or Glue.
  • Strong experience with cloud platforms, especially AWS, including services like Lambda, S3, RDS and Glue.
  • Familiarity with big data technologies, including Hadoop, Hive or Redshift.
  • Experience with user authentication and authorization using AWS Cognito.
  • Expertise in API development, security and implementing best practices for scalable solutions.
  • Experience with monitoring and logging tools, such as Prometheus, Grafana or ELK Stack to ensure system reliability and application performance.
  • Strong understanding of DevOps principles, CI/CD pipelines and best practices.
  • Experience with core AWS technologies such as EC2, ELB, Auto Scaling, S3, EFS, Lambda, API Gateway, Step Functions, CloudWatch, VPC, Route 53, ACM.
  • Experience with BI tools like Tableau, AWS Quick Sight


  • New York, New York, United States Hudson Data Full time

    Hudson Data is seeking a highly skilled Cloud Data Engineer Expert to join our team.We are looking for an experienced professional with hands-on knowledge of various Azure services, including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. The ideal candidate should be able to design, build, and maintain ETL pipelines, manage data...


  • New York, New York, United States Condé Nast Full time

    About the RoleThis is an exciting opportunity to join our Data Solutions Engineering team as a Data Engineer. The successful candidate will have a degree in Computer Science or a related field and 2.5+ years of experience in distributed data processing. Proficiency in SQL and experience with data modeling, batch data pipeline design, and implementation are...


  • New York, New York, United States Lorven Technologies Full time

    We are seeking a skilled Senior Cloud Data Specialist to join our team at Lorven Technologies. In this role, you will be responsible for designing and implementing cloud-based data solutions using Azure cloud services.Job Summary:The successful candidate will have 10+ years of experience in software development using Python, PySpark, and its frameworks, with...


  • New York, New York, United States TechnoGen Full time

    Job Title: Cloud Data Governance SpecialistAt TechnoGen, we are seeking a skilled Cloud Data Governance Specialist to join our team. As an expert in Informatica Cloud Data Governance tools, you will be responsible for automating business processes and facilitating use case discussions.The successful candidate will have a deep understanding of Informatica...


  • New York, New York, United States ApTask Full time

    The role of Cloud Data Solutions Specialist at ApTask requires strong expertise in designing and implementing data architectures using cloud-based tools. Key responsibilities include leveraging Apache Spark, Azure Data Factory, and other data pipeline tools to optimize data processing and analytics. A solid understanding of data modeling, data warehousing,...


  • New York, New York, United States Inizio Partners Full time

    About Inizio PartnersWe are seeking a highly skilled Data Engineering Specialist to join our team in designing and developing cloud-based data processing applications using Google Cloud Platform (GCP). The ideal candidate will have a strong background in cloud computing, experience with GCP services, and expertise in programming languages such as Python and...


  • New York, New York, United States Optimove Full time

    About the RoleWe are seeking a highly motivated Cloud Data Migration Specialist to join our team. In this position, you will be responsible for developing and supporting a wide range of data transformations and migrations. You will work closely with internal teams to construct custom ETL processes, design data pipelines, and apply data quality measures.The...


  • New York, New York, United States ShiftCode Analytics Full time

    Key ResponsibilitiesDesign and implement cloud-based data integration solutions using PaaS, IaaS, and SaaS models.Develop reference architectures and playbooks for data cataloging, data modeling, data quality, master data management, sensitive data classification, and protection.Collaborate with internal IT groups and vendors to ensure standards are followed...


  • New York, New York, United States Mizuho Americas Full time

    We are seeking a seasoned Cloud Data Architecture Specialist to join our team at Mizuho Americas. In this role, you will design and implement scalable data architectures for various use cases, leveraging cloud-based technologies.About the Job:Design and implement cloud-based data architecturesCollaborate with engineering teams to ensure seamless...


  • New York, New York, United States Databricks Full time

    Job Overview:Databricks, a leading cloud computing company, is seeking an experienced sales professional to join our team as a Cloud Data Sales Specialist. As a key member of our sales force, you will be responsible for driving growth and revenue in the big data market.Responsibilities:Develop and execute territory plans to achieve sales targetsPromote...


  • New York, New York, United States Bluecore Full time

    About the RoleWe're looking for a Cloud Data Warehouse Specialist to lead the development of our cloud data warehouse, ensuring seamless integration with client-facing and internal-facing business use cases. If you have experience in architecting and developing cloud-based data warehouses, this could be the perfect opportunity for you.Main...


  • New York, New York, United States Tech Tammina Full time

    Tech Tammina is seeking a highly experienced Data Engineer - GCP Specialist to join our team. This role offers an estimated annual salary of $250,000-$350,000 based on location and industry standards.This position involves designing, developing, and maintaining data pipelines on Google Cloud Platform (GCP) for our company. The ideal candidate should have...


  • New York, New York, United States Early Warning Services Full time

    Key RequirementsWe are looking for candidates with a minimum 5 years' direct experience in Software Engineering or related experience. You should have two or more years' experience in the development of Data Warehouse, Big Data - structured and unstructured platforms, real-time & batch processing, and data standards.The ideal candidate will have knowledge of...


  • New York, New York, United States Tekfortune Inc Full time

    About the Role:We are looking for a highly experienced Cloud Data Warehouse Specialist to join our team at Tekfortune Inc. The successful candidate will design, develop, and maintain data pipelines in Databricks, integrating data from various sources into the platform.The ideal candidate will have a strong background in cloud-based data warehousing and a...


  • New York, New York, United States Athari Full time

    Athari seeks an experienced Data Analytics Specialist to join our team. The successful candidate will be responsible for managing and analyzing large datasets within Salesforce Marketing Cloud.Key ResponsibilitiesData Management: Collect, clean, and organize data from various sources to ensure accuracy and readiness for analysis.Data Extensions: Prepare and...

  • Cloud Data Engineer

    1 month ago


    New York, New York, United States HR Recruiting Services Full time

    Job Description:We are seeking an experienced Cloud Data Engineer to join our team at HR Recruiting Services. This is a challenging and rewarding opportunity for a skilled professional with a strong background in data engineering and cloud computing.About the Role:This role will be responsible for designing, implementing, and maintaining scalable data...

  • Data Cloud Strategist

    4 weeks ago


    New York, New York, United States Thunder Full time

    About the RoleAs a seasoned Data Cloud Solution Architect, you will play a critical senior lead role on programs and within our practice. You will lead all discovery workshops, helping to define clients' vision, strategy, and requirements for their project.Key Responsibilities:You will help clients define unique campaign strategies and journeys through...


  • New York, New York, United States The Dignify Solutions LLC Full time

    Salary InformationAs a senior-level Informatica Cloud Engineer, we offer a competitive salary range of $130,000 - $190,000 per year, depending on your level of experience and qualifications.About the Job:We are looking for a highly skilled professional to join our team in New York, NY or Charlotte, NC. As an Informatica Cloud Engineer, you will be...

  • Cloud Data Engineer

    7 days ago


    New York, New York, United States Memorial Sloan Full time

    Job Title: Cloud Data Engineer About the Role:We are seeking an experienced Cloud Data Engineer to join our team at Memorial Sloan Kettering Cancer Center. The ideal candidate will have a strong background in designing, implementing, and maintaining data infrastructure solutions for hybrid and multi-cloud data ecosystems. Key Responsibilities:- Design and...


  • New York, New York, United States Memorial Sloan Full time

    About the RoleThis is an exciting opportunity to work with a talented team of data engineers and scientists to drive innovation in data engineering and analytics. You will be responsible for designing, implementing, and maintaining scalable data processing systems, enabling us to derive valuable insights from our data in a hybrid and multi-cloud data...