Bigdata Engineer

3 weeks ago

Phoenix, United States Diverse Lynx Full time
Technical/Functional Skills
  • Big Data
  • Python
  • Pyspark
  • Hive;
  • Familiar with Agile or other rapid application development methods
  • Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.
  • Hands-on experience with programming using Python
  • Expert on Hadoop and Spark Architecture and its working principle
  • Hands-on experience on writing and understanding sophisticated SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data
  • Hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
  • Proven Datawarehousing concepts
  • Knowledge of Financial reporting ecosystem is a plus
  • Proven experience within Data Engineering/ Data Warehousing using Big Data technologies will be ddon
  • Expert on Distributed ecosystem
  • Ability to design and develop optimized Data pipelines for batch and real time data processing •Should have experience in analysis, design, development, testing, and implementation of system applications •Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
  • Experience with design and coding across one or more platforms and languages as appropriate
  • Experience in analytical languages (Python or the equivalent) and knowledge about machine learning techniques.
  • Extensive experiencing in application, integration, system, and regression testing, including demonstration of automation and other CI/CD efforts.
  • Experience with version control software like git and CI/CD testing/automation experience.
  • Strong analytical ability
  • Excellent communication skills
Experience Required 8+
Roles & Responsibilities
  • Perform hands-on architecture, design, development, and testing.
  • Drive user story analysis and elaboration, design and develop web applications, test and build automation tools
  • Bring a culture of innovation, ideas, and continuous improvement.
  • Work closely with product managers, back-end and other front-end engineers to implement web applications
  • Optimize components for maximum performance across devices and browsers
  • Drive automation and ensure automated test scripts are built.
  • Willingness to adopt new technologies and passion for learning
  • Utilize best-of-breed technologies to build a layered, component-based architecture over existing Client technologies
  • Be highly motivated and maintain a positive, "can-do" attitude in a fast moving environment
  • Foster the spirit of collaboration across multiple internal teams


Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

  • BigData Architect

    2 weeks ago

    Phoenix, United States Intraedge Full time

    We are hiring 3 BigData Engineer's & 2 Bigdata Architects (Spark, Java): OnsiteLocation: Phoenix, AZLong-term contract*** WE NEED SOMEONE to be ONSITE from DAY 1 *** F2F Interview is MUST Minimum Qualifications:5+ years of work experience in software design and implementation using Java or Scala.Experience in data processing using Spark.Experience in...

  • BigData Developer

    1 month ago

    Phoenix, United States Diverse Lynx Full time

    Title: BigData Developer Location: Phoenix, AZ Experience: 6+ Years Technical/Functional Skills: Big Data /Hadoop, Hive , Python , Spark, PySpark, SQL Roles and Responsibilities: Develop and maintain data pipelines using BigData processes. Focus on ingesting, storing, processing, and analyzing large datasets Work closely with data science team...

  • Bigdata Engineer with Java

    1 week ago

    Phoenix, United States Trident Consulting Full time

    JOB INFORMATIONJob Title : Bigdata Engineer with Java experienceLocation: Phoenix , AZType: Long term Contract No Remote. This is onsite position Only Local Consultants. Inperson Interview Required Job Description/ ResponsibilitiesBigdata Engineer with Java experience8 years of recent hands on experience on an agile development team of building big data...

  • GCP Bigdata Engineer

    3 weeks ago

    Phoenix, United States Centraprise Full time

    Company DescriptionCentraprise is providing traditional staffing services, professional and technical staffing and management services to some of the country's leading companies with highest quality of service. Due to our expertise across multi-platform technologies and skill-sets, Centraprise provides services to a wide spectrum of customers across...

  • BigData with Python+Pyspark

    3 weeks ago

    Phoenix, United States Diverse Lynx Full time

    Title: BigData with Python+Pyspark Location: Phoenix, Arizona Job Type: Contract Job description: Technical/Functional Skills Big Data Python Pyspark Hive; Familiar with Agile or other rapid application development methods Bachelors degree in Engineering or Computer Science or equivalent OR Masters in Computer Applications or equivalent. Hands-on...

  • Bigdata GCP

    10 hours ago

    Phoenix, United States Avance Consulting Full time

    Job DescriptionJob DescriptionBig Data Engineer with mapreduce , spark , hive , sql skillset"Expert in SQL and Data warehousing concepts.Hands-on experience with public cloud data warehouse (GCP, Azure, AWS).GCP certification will be very good to have. MapR experience is mustStrong Hands on experience with one or more programming languages ( Python or...

  • Java with spark developer

    2 days ago

    Phoenix, United States Tata Consultancy Services Full time

    Job title : Java with spark developerLocation : Phoenix, AZ(Onsite)Job type : Full time/ PermanentJob description :Java, Spark, Big DataData AnalyticsBigdata, HiveFamiliar with Agile or other rapid application development methodsHands-on expertise with application design and software development in Big Data across one or more platforms, languages, and tools...

  • Java with spark developer

    6 minutes ago

    Phoenix, United States Tata Consultancy Services Full time

    Job title : Java with spark developerLocation : Phoenix, AZ(Onsite)Job type : Full time/ PermanentJob description :Java, Spark, Big DataData AnalyticsBigdata, HiveFamiliar with Agile or other rapid application development methodsHands-on expertise with application design and software development in Big Data across one or more platforms, languages, and tools...

  • Java Spark

    2 days ago

    Phoenix, United States Avance Consulting Full time

    Job DescriptionJob DescriptionJob DescriptionJob Title Java + Spark DeveloperRelevant Experience(in yrs)6 +Work Location (State, City and Zip)Phoenix, Arizona, 85054Technical/Functional Skills· Java, Spark, Big Data· Data Analytics· Bigdata, Hive· Familiar with Agile or other rapid application development methods· Hands-on expertise with application...

  • Big Data with GCP

    1 month ago

    Phoenix, United States Tata Consultancy Services Full time

    JobTitle Big data with GCP RelevantExperience(inyrs) 8yrs WorkLocation (State, City and Zip) Phoenix, New york Technical/FunctionalSkills Bigdata with GCP Roles& Responsibilities Big Data Engineer with ETL - Big Data / Data Warehousing "Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP,Azure, AWS). GCP...

  • Enterprise Solution Architect

    1 month ago

    Phoenix, United States Smart IT Frame LLC Full time

    Title: Solution / Enterprise Architect.Location: Phoenix, AZClient: CognizantJob type: Long term ContactSkill Set: ['API', 'DB Architecture & Design', 'ETL - Big Data / Data Warehousing', 'RDBMS', 'Relational / Dimensional Modeling', 'Responsive Web Design', 'REST Web Services', 'SQL', 'NoSQL', 'Microsoft Office Suite']Enterprise Architect...

  • Enterprise Solution Architect

    1 month ago

    Phoenix, United States Smart IT Frame LLC Full time

    Title: Solution / Enterprise Architect.Location: Phoenix, AZClient: CognizantJob type: Long term ContactSkill Set: ['API', 'DB Architecture & Design', 'ETL - Big Data / Data Warehousing', 'RDBMS', 'Relational / Dimensional Modeling', 'Responsive Web Design', 'REST Web Services', 'SQL', 'NoSQL', 'Microsoft Office Suite']Enterprise Architect...

  • Enterprise Solution Architect

    1 month ago

    Phoenix, United States Smart IT Frame LLC Full time

    Title: Solution / Enterprise Architect.Location: Phoenix, AZClient: CognizantJob type: Long term ContactSkill Set: ['API', 'DB Architecture & Design', 'ETL - Big Data / Data Warehousing', 'RDBMS', 'Relational / Dimensional Modeling', 'Responsive Web Design', 'REST Web Services', 'SQL', 'NoSQL', 'Microsoft Office Suite']Enterprise Architect...