Big Data Specialist

3 weeks ago


Phoenix, Arizona, United States Global Channel Management Full time
About Us
Global Channel Management is a leading provider of channel management solutions. Our company is committed to delivering high-quality products and services to our customers. We are seeking a talented and experienced professional to join our team as a CouchDB Cassandra Data Engineer.

Job Description
We are looking for a skilled professional to work with us in developing, maintaining, and scaling our distributed systems built around CouchDB and Cassandra. The ideal candidate will have extensive experience in building data processing pipelines, expertise in Spark engine syntax modules, including Spark SQL, and familiarity with APIs such as RDD, DataFrame, Dataset, and PySpark. Additionally, fluency in programming languages like Python, Java, and Scala is required. Knowledge of Spark internals and streaming technology (Kafka, KSQL, etc.) is also essential. We expect the successful candidate to be an expert in SQL and big data processing, including Hadoop ecosystems, Hive, Impala, Druid, etc., and familiar with machine learning algorithms and foundations such as PyTorch. Experience with ETL tools and expertise in managing post-loading data is also necessary. The selected individual will need to be an expert in one or more distributed file systems, such as HDFS, S3, and Ceph, and familiar with visualization tools. Familiarity with Amazon's AWS for building Apache Spark clusters is a must.

Responsibilities
The CouchDB Cassandra Data Engineer duties include providing technical, analytical knowledge, and resolving technical challenges throughout project delivery. Code reviews, testing case reviews, and ensuring that the code created matches the requirements are part of the process. The role requires proactive, autonomous, and collaborative work with global teams to solve project requirements and define issues/challenges with sufficient lead time to mitigate project delivery risks.

Requirements
- 5+ years of experience in CouchDB and Cassandra
- Expertise in building data processing pipelines
- Extensive knowledge of Spark engine syntax modules, including Spark SQL
- Familiarity with APIs such as RDD, DataFrame, Dataset, and PySpark
- Fluency in programming languages like Python, Java, and Scala
- Knowledge of Spark internals and streaming technology (Kafka, KSQL, etc.)
- Expertise in SQL and big data processing, including Hadoop ecosystems, Hive, Impala, Druid, etc.
- Familiarity with machine learning algorithms and foundations such as PyTorch
- Experience with ETL tools and expertise in managing post-loading data
- Expertise in one or more distributed file systems, such as HDFS, S3, and Ceph
- Familiarity with visualization tools
- Familiarity with Amazon's AWS for building Apache Spark clusters

Benefits
- Competitive salary: $120,000 per year
- Opportunities for career growth and professional development
- Collaborative and dynamic work environment
- Recognition and rewards for outstanding performance

Contact Information
Please submit your application through our website.
  • Big Data Specialist

    3 weeks ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    We are looking for a highly skilled Big Data Specialist to join our team at Diverse Lynx LLC. As a key member of our data analytics team, you will play a crucial role in developing and maintaining data pipelines using Big Data processes. This is an excellent opportunity to work closely with our data science team to implement data analytics pipelines and help...


  • Phoenix, Arizona, United States Diverse Lynx Full time

    Job Summary: Diverse Lynx LLC is seeking a highly motivated Big Data Technology Specialist to join our team. The successful candidate will have a strong background in big data technologies, including Hadoop, MapReduce, Spark, and Hive, as well as experience with CICD pipelines, automated test frameworks, DevOps, and source code management tools (XLR,...


  • Phoenix, Arizona, United States Lorven Technologies Full time

    Job Title: Big Data Infrastructure SpecialistWe are seeking a highly skilled Big Data Infrastructure Specialist to join our team at Lorven Technologies in Phoenix, AZ. As a key member of our data engineering team, you will be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. The ideal...


  • Phoenix, Arizona, United States SysMind Tech Full time

    Job Summary:SysMind Tech is seeking an experienced Big Data Architecture Specialist to lead our big data initiatives. The ideal candidate will have expertise in designing, developing and deploying large-scale big data architectures using Python and PySpark.Key Responsibilities:Design, develop, deploy, test and maintain complex big data architectures.Lead a...


  • Phoenix, Arizona, United States Syntricate Technologies Full time

    Job SummaryWe are seeking a highly skilled Cloud-Native Big Data Specialist to join our team at Syntricate Technologies. In this role, you will design and implement scalable data architectures using big data technologies such as MapR, Spark, and HIVE.Key Responsibilities:Design and develop big data solutions using various technologies like MapR, Spark, and...

  • Big Data Professional

    3 weeks ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    About the Role">This role involves designing and implementing big data solutions that drive business growth and decision-making.As a Data Engineer Specialist at Diverse Lynx LLC, you will have the opportunity to work with cutting-edge technologies like Spark, Hive, and SQL.Key Skills and Qualifications:Expertise in big data engineering, including mapreduce,...


  • Phoenix, Arizona, United States iSoftTek Solutions Inc Full time

    Estimated Salary:$120,000 - $160,000 per year, depending on experience.Job Description:We are looking for a skilled Big Data Engineer to develop and maintain big data solutions and frameworks. In this role, you will work closely with cross-functional teams to design, implement, and optimize data processing and analytics systems using Hadoop, Spark, and other...

  • Big Data Architect

    2 weeks ago


    Phoenix, Arizona, United States iSoftTek Solutions Inc Full time

    Job Title: Big Data ArchitectWe are seeking a talented Big Data Architect to join our team at iSoftTek Solutions Inc. in Phoenix, AZ. The ideal candidate will have experience in designing and implementing big data solutions using technologies such as Hadoop and Spark. The salary for this role is estimated to be around $140,000 per year.The responsibilities...

  • Big Data Engineer

    1 month ago


    Phoenix, Arizona, United States Diverse Lynx Full time

    Job Description:At Diverse Lynx LLC, we're seeking a skilled Big Data Engineer to join our team. As a key member of our data science team, you'll be responsible for developing and maintaining data pipelines using Big Data processes. Your focus will be on ingesting, storing, processing, and analyzing large datasets to uncover valuable insights. You'll work...


  • Phoenix, Arizona, United States Lorven Technologies Full time

    Data Engineer (Phoenix)Lorven Technologies is seeking a highly skilled Data Engineer to join our team in Phoenix. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using GCP technologies such as Dataflow, Cloud Composer, and Big Query.The ideal candidate will have 6+ years of experience in data...

  • Big Data Developer

    3 weeks ago


    Phoenix, Arizona, United States Syntricate Technologies Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team at Syntricate Technologies. This is a challenging role that requires expertise in designing and implementing big data solutions using various technologies such as MapReduce, Spark, Hive, and SQL.The ideal candidate will have a strong understanding of data...


  • Phoenix, Arizona, United States eTek IT Services, Inc. Full time

    About eTek IT Services, Inc.eTek IT Services, Inc. is a leading provider of cutting-edge data solutions, focusing on innovative approaches to Big Data challenges.


  • Phoenix, Arizona, United States Diverse Lynx Full time

    Job Description: We are seeking a highly skilled Data Scientist with Big Data Focus to join our team at Diverse Lynx LLC. The successful candidate will have a strong background in machine learning, statistical modeling, and big data analytics.About the Role:This is a full-time position that requires a hands-on approach to design and develop predictive models...

  • Big Data Developer

    3 weeks ago


    Phoenix, Arizona, United States SysMind Tech Full time

    Job DescriptionSysMind Tech is a leading technology firm that provides innovative solutions to businesses. We are currently seeking an experienced Big Data Engineer to join our team.The ideal candidate will have a solid understanding of big data technologies and be able to design, develop, and implement scalable data pipelines. You will work closely with our...


  • Phoenix, Arizona, United States Syntricate Technologies Full time

    Estimated Salary: $150,000 per year As a Bigdata Developer at Syntricate Technologies, you will be responsible for working on complex big data projects using Pyspark, Python, and other related technologies. You will have the opportunity to work with a variety of databases, including Cassandra and Postgres, and develop strong skills in Unix shell scripting.


  • Phoenix, Arizona, United States Diverse Lynx Full time

    Job Description:We are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC in Phoenix, AZ. This is a full-time position requiring 8+ years of experience in large-scale application development using the Big Data ecosystem, including Hadoop (HDFS, MapReduce, Yarn), Hive, and Kafka.Responsibilities:Design, develop, and maintain...


  • Phoenix, Arizona, United States Diverse Lynx Full time

    Job Summary:We are seeking a highly skilled expert in big data technologies to join our team at Diverse Lynx LLC in Phoenix, AZ. This is a full-time position requiring 8+ years of experience in designing, developing, and maintaining large-scale big data applications using Hadoop, Hive, and Kafka.Key Responsibilities:Design, develop, and maintain scalable big...


  • Phoenix, Arizona, United States iSoftTek Solutions Inc Full time

    Cloud Big Data Developer wanted at iSoftTek Solutions Inc.! We are looking for an experienced professional to design and implement big data solutions using cloud-based technologies. The ideal candidate will have experience in developing scalable data pipelines and working with cross-functional teams. The salary for this role is estimated to be around...

  • Big Data Developer

    3 weeks ago


    Phoenix, Arizona, United States SysMind Tech Full time

    Job Title: Big Data DeveloperAbout Us: SysMind Tech is a leading technology company that provides innovative solutions for businesses. Our team is passionate about delivering high-quality software applications that meet the evolving needs of our customers.Salary Range: $120,000 - $180,000 per year, depending on experience and qualifications.About the Role:...


  • Phoenix, Arizona, United States SysMind Tech Full time

    About the Job:Join our team as a Big Data Architecture Lead at SysMind Tech and take on the challenge of designing and implementing cutting-edge big data architectures to drive business success. This is an exceptional opportunity to work with a talented team of professionals who share your passion for innovation and excellence.About the Role:Key...