BigData Developer

2 weeks ago

Phoenix, United States Diverse Lynx Full time
Title: BigData Developer
Location: Phoenix, AZ
Experience: 6+ Years

Technical/Functional Skills: Big Data /Hadoop, Hive , Python , Spark, PySpark, SQL

Roles and Responsibilities:
  • Develop and maintain data pipelines using BigData processes.
  • Focus on ingesting, storing, processing, and analyzing large datasets
  • Work closely with data science team to implement data analytics pipelines.
  • Help define data governance policies and support data-versioning processes.
  • Maintain security and data privacy, working closely with data protection officer.
  • Analyze vast number of data stores to uncover insights
  • Enhancing data collection procedures to include all relevant information for developing analytic systems.
  • Processing, cleansing, and validating the integrity of data to be used for analysis.
  • Analyzing large amounts of information to find patterns and solutions.
  • Developing prediction systems and machine learning algorithms
  • Presenting results in a clear manner.
  • Propose solutions and strategies to tackle business challenges
  • Collaborate with Business and IT teams.

Required skills and qualifications:
  • Experience with Python, Spark, and Hive
  • Understanding of data-warehousing and data-modeling techniques
  • Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R)
  • Strong data engineering skills with Azure cloud platform
  • Experience with streaming frameworks such as Kafka
  • Knowledge of Core Java, Linux, SQL, and any scripting language
  • Good interpersonal skills and positive attitude.
  • Strong Software Engineering Background
  • Hands-on experience with data science tools
  • Problem-solving aptitude
  • Analytical mind and great business sense
  • Degree in Computer Science, Engineering or relevant field is preferred.


Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • BigData Developer

    4 weeks ago

    Phoenix, United States Diverse Lynx Full time

    Title: BigData Developer Location: Phoenix, AZ Experience: 6+ Years Technical/Functional Skills: Big Data /Hadoop, Hive , Python , Spark, PySpark, SQL Roles and Responsibilities: Develop and maintain data pipelines using BigData processes. Focus on ingesting, storing, processing, and analyzing large datasets Work closely with data science team...

  • BigData with Python+Pyspark

    2 weeks ago

    Phoenix, United States Diverse Lynx Full time

    Title: BigData with Python+Pyspark Location: Phoenix, Arizona Job Type: Contract Job description: Technical/Functional Skills Big Data Python Pyspark Hive; Familiar with Agile or other rapid application development methods Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. Hands-on...

  • BigData with Python+Pyspark

    5 days ago

    Phoenix, United States Diverse Lynx Full time

    Title: BigData with Python+Pyspark Location: Phoenix, Arizona Job Type: Contract Job description: Technical/Functional Skills Big Data Python Pyspark Hive; Familiar with Agile or other rapid application development methods Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. Hands-on...

  • Java bigdata Developer

    4 weeks ago

    Phoenix, United States eTeam Full time

    Java developer with big data skills on the large Finance portfolio. 5+ years of recent hands-on experience on an agile development team of building big data capabilities with Apache Spark HIVE on Java/Python Demonstrated experience in Agile development application design software development and testing. Strong Hands-on Apache Spark Data frame and Datasets...

  • Big Data Developer

    2 weeks ago

    Phoenix, United States Syntricate Technologies Full time

    Job Title BigData Work Location Phoenix, Az Relevant Experience(in yrs) 6-8 Years Technical/Functional Skills Hive & Spark Architecture including Spark Core, Spark SQL, Data Frames. Experience Required 6-8 Years Roles & Responsibilities Build data systems and pipelines on cloud providers (GCP preferable); Experience working in GCP based Big Data deployments...

  • Big Data Developer

    5 days ago

    Phoenix, United States Syntricate Technologies Full time

    Job Title BigData Work Location Phoenix, Az Relevant Experience(in yrs) 6-8 Years Technical/Functional Skills Hive & Spark Architecture including Spark Core, Spark SQL, Data Frames. Experience Required 6-8 Years Roles & Responsibilities Build data systems and pipelines on cloud providers (GCP preferable); Experience working in GCP based Big Data deployments...

  • Bigdata Engineer

    5 days ago

    Phoenix, United States Diverse Lynx Full time

    Technical/Functional Skills Big Data Python Pyspark Hive; Familiar with Agile or other rapid application development methods Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent. Hands-on experience with programming using Python Expert on Hadoop and Spark Architecture and its working...

  • Enterprise Solution Architect

    3 weeks ago

    Phoenix, United States Smart IT Frame LLC Full time

    Title: Solution / Enterprise Architect.Location: Phoenix, AZClient: CognizantJob type: Long term ContactSkill Set: ['API', 'DB Architecture & Design', 'ETL - Big Data / Data Warehousing', 'RDBMS', 'Relational / Dimensional Modeling', 'Responsive Web Design', 'REST Web Services', 'SQL', 'NoSQL', 'Microsoft Office Suite']Enterprise Architect...

  • Enterprise Solution Architect

    3 weeks ago

    Phoenix, United States Smart IT Frame LLC Full time

    Title: Solution / Enterprise Architect.Location: Phoenix, AZClient: CognizantJob type: Long term ContactSkill Set: ['API', 'DB Architecture & Design', 'ETL - Big Data / Data Warehousing', 'RDBMS', 'Relational / Dimensional Modeling', 'Responsive Web Design', 'REST Web Services', 'SQL', 'NoSQL', 'Microsoft Office Suite']Enterprise Architect...

  • Enterprise Solution Architect

    3 weeks ago

    Phoenix, United States Smart IT Frame LLC Full time

    Title: Solution / Enterprise Architect.Location: Phoenix, AZClient: CognizantJob type: Long term ContactSkill Set: ['API', 'DB Architecture & Design', 'ETL - Big Data / Data Warehousing', 'RDBMS', 'Relational / Dimensional Modeling', 'Responsive Web Design', 'REST Web Services', 'SQL', 'NoSQL', 'Microsoft Office Suite']Enterprise Architect...