Data Engineer

3 weeks ago

Phoenix, United States Forhyre Full time
Job DescriptionJob Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset: Python/Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL
Secondary: Databricks
Nice to have: Informatica/ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform
    Recommend and execute improvements
  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes/standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms/servers/applications/systems.

Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal

  • Data Engineer

    1 week ago

    Phoenix, United States Cogliano IT Staffing Full time

    Data Engineer needed for a Direct Hire position in Phoenix, AZ! Position will be remote, but candidate needs to live within a reasonable distance of Phoenix. You will be project leader and independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven company. Your expertise in data engineering and software engineering...

  • Data Engineer

    4 weeks ago

    Phoenix, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionRequired SkillsBig Data Engineer with 3-4 years of hands-on Spark/Scala and Hive experience. The candidate must be able to work a hybrid schedule with the team in Phoenix, AZ (onsite every Tues/Wed/Thurs). If the candidate is not located in Phoenix, but wiling to relocate and work onsite, they can begin working remotely and then...

  • Data Engineering

    1 week ago

    Phoenix, United States Diverse Lynx Full time

    Data Engineer- Oracle Fusion cloud: Learning & Talent AZ-Phoenix-85054 Relevant Experience(in yrs) = 5-8 years Technical/Functional Skills • Must have 5-8 years of Data Engineering experience in a Big Data environment. • Strong Data transformation/ETL skills using Spark, Python, PySpark, HiveQL • Must have hands on experience building data ingestion...

  • Critical Operations Tech Overnight

    4 weeks ago

    Phoenix, United States QTS Data Centers Full time

    Learn what makes QTS a unique place to grow your career! SUMMARY The Critical Operations Technician I is responsible for the installation, repair, and maintenance of IT, electrical, mechanical, plumbing/piping equipment, machinery and controls located in the interior and exterior of building. This role monitors operations and conducts a routine and ongoing...

  • Data Engineering Consultant

    4 weeks ago

    Phoenix, United States Plex Consulting, LLC Full time

    Job DescriptionJob DescriptionJob Title: Data Engineering ConsultantCompany: Plex ConsultingLocation: Phoenix, AZAbout the company:Plex Consulting is a leading technology consulting firm offering data solutions to a diverse range of clients across industries. We combine our expertise in data engineering, analytics, and data science to provide innovative and...

  • Data Engineer

    1 week ago

    Phoenix, United States Nucleusteq Full time

    What You'll Do  ● Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies  ● Partner with business teams and communicate with product managers to automate business processes, build visualizations on key performance indicators, and provide real-time...

  • Senior QA Automation Engineer

    3 weeks ago

    Phoenix, United States NTT DATA Full time

    100% Remote NTT DATA's Client is seeking a Senior QA Automation Engineer with 6 or more years of experience of testing with RESTful services using Postman or Groovy scripts. 3 or more years of experience with Agile tools like Azure DevOps, JIRA, etc. 3 or more years of experience with CI/CD tools like ADO, Jenkins etc. 3 or more years of development...

  • Senior Data Engineer

    1 week ago

    Phoenix, United States Diverse Lynx Full time

    Job Title: Senior Data Engineer Experience: 8+ Year Location: Phoenix, AZ Duration: 12+ Months Data Engineer: Big Data; ETL - Big Data / Data Warehousing; GCP; Hadoop / HDFS; Hive; PySpark; Python 3 to 7 years of experience within Data Engineering/ Data Warehousing using Big Data Hands-on experience with GCP, google composer, bigQuery and bigTable ...

  • GCP Data Engineer

    6 days ago

    Phoenix, United States JobRialto Full time

    Job Description Client is looking for a GCP Data Engineer with 3-4 years of hands-on experience to help build and enhance their Big Data application Required Skills GCP Data Engineer with 3-4 years of hands-on GCP/BigQuery experience (GCP, BigQuery, DataProc, DataFlow, Composer, etc.). Candidates can work remote while on contract, but once converted...

  • Data Engineer

    4 days ago

    Phoenix, United States The IT Gigs Full time

    Job title: Data Engineer/Data ArchitectLocation: Phoenix, AZ (Onsite)/ CaliforniaJob type: W2 OnlyVISA: USC, GC , OPT11+ years of experience OnlyJD:MUST HAVE AWS CERTIFICATIONSQualifications:Proven experience with Apache Spark, Hive, and Hadoop.Strong programming skills in Python, Scala, SQL, and Shell Scripting.Hands-on experience with GCP services,...

  • GCP Data Engineer

    3 weeks ago

    Phoenix, United States Triunity Software Full time

    Job DescriptionJob DescriptionNature: Day One On-siteDuration: 24 MonthsCandidates Required: 04Experience: 5 to 8 Years Following is the Job description for the role of a Data Engineer,Mandatory Skill Set: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git.Good to have Skill Set:...

  • Data Engineer

    10 hours ago

    Phoenix, United States The IT Gigs Full time

    Job title: Data Engineer/Data ArchitectLocation: Phoenix, AZ (Onsite)/ CaliforniaJob type: W2 OnlyVISA: USC, GC , OPT11+ years of experience OnlyJD:MUST HAVE AWS CERTIFICATIONSQualifications:Proven experience with Apache Spark, Hive, and Hadoop.Strong programming skills in Python, Scala, SQL, and Shell Scripting.Hands-on experience with GCP services,...

  • Data Engineer

    6 days ago

    Phoenix, United States The IT Gigs Full time

    Job title: Data Engineer/Data ArchitectLocation: Phoenix, AZ (Onsite)/ CaliforniaJob type: W2 OnlyVISA: USC, GC , OPT11+ years of experience OnlyJD:MUST HAVE AWS CERTIFICATIONSQualifications:Proven experience with Apache Spark, Hive, and Hadoop.Strong programming skills in Python, Scala, SQL, and Shell Scripting.Hands-on experience with GCP services,...

  • Data Engineer Banking

    16 hours ago

    Phoenix, United States Recurring Decimal Full time

    Data Engineer Location: Phoenix, AZ or Los Angeles, CAHybridCompliance in Banking Domain knowledge is a mustKnowledge of cloud platforms (AWS, Azure, GCP) for data analysisand management is a mustProven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and regulatory...

  • Data Engineer Banking

    1 day ago

    Phoenix, United States Recurring Decimal Full time

    Data Engineer Location: Phoenix, AZ or Los Angeles, CAHybridCompliance in Banking Domain knowledge is a mustKnowledge of cloud platforms (AWS, Azure, GCP) for data analysisand management is a mustProven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and regulatory...

  • Data Engineer Banking

    22 hours ago

    Phoenix, United States Recurring Decimal Full time

    Data Engineer Location: Phoenix, AZ or Los Angeles, CAHybridCompliance in Banking Domain knowledge is a mustKnowledge of cloud platforms (AWS, Azure, GCP) for data analysisand management is a mustProven experience (5+ years) as a Business Analyst, Data Engineer, or similar role within the financial industry, with a strong focus on compliance and regulatory...

  • Data Engineer

    3 weeks ago

    Phoenix, United States Tekdoors Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer Location: Jacksonville, FL / Phoenix, AZ (Hybrid Work) Duration: 24+ Months Employment Type: Contract W2 Experience: 8+ YearsMust-Have: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Proven experience as a Data Engineer with a minimum of 8 years in...

  • AI/ML Data Engineer

    10 hours ago

    Phoenix, United States Insight Global Full time

    Position: AI/ML Data EngineerLocation: Hybrid in Phoenix, AZ (3 days/week on site)Duration: 9 month contract to hireRequired Skills and Experience *-8+ years of hands on Data Engineering experience.-Very well versed with AI and Machine Learning.-Proficient with Application Lifecycle Management (ALM)-Understanding of public cloud environmentsJob Description...

  • AI/ML Data Engineer

    4 hours ago

    Phoenix, United States Insight Global Full time

    Position: AI/ML Data EngineerLocation: Hybrid in Phoenix, AZ (3 days/week on site)Duration: 9 month contract to hireRequired Skills and Experience *-8+ years of hands on Data Engineering experience.-Very well versed with AI and Machine Learning.-Proficient with Application Lifecycle Management (ALM)-Understanding of public cloud environmentsJob Description...

  • Big Data Engineer

    6 days ago

    Phoenix, United States Tekaccel Inc. Full time

    Title: Big Data EngineerLocation: Phoenix, AZTerms: ContractJob Details:Skills: Hive, Java, Python, Hadoop / HDFSRequirements:The ideal candidate has 8+ years of recent hands-on experience on an agile development team of building big data capabilities with Apache Spark, and HIVE on Java.Demonstrated experience in Agile development, application design,...