Data Engineer

3 weeks ago

Phoenix, United States Cogliano IT Staffing Full time
Data Engineer needed for a Direct Hire position in Phoenix, AZ Position will be remote, but candidate needs to live within a reasonable distance of Phoenix.

You will be project leader and independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven company. Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production. We understand that our data does not reach its full potential until it is analyzed, and insights effectively communicated to the enterprise. You will work in close collaboration with operations, subject matter experts, data scientists, and software engineers to develop advanced, highly automated data products. You will be a champion of DataOps, and agile practices; actively participating in project teams to drive value.
  • Agile Project Work: Work as a project leader in cross-functional, geographically distributed agile teams of highly skilled data engineers, software/machine learning engineers, data scientists, DevOps engineers, designers, product managers, technical delivery teams, and others to continuously innovate analytic solutions.
    • Design, develop, and review real-time/bulk data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages, images, video, etc) while also coach jr. team members.
    • Ensure the project team is following established design patterns for data ingest, transformation, and egress.
    • Develop documentation of Data Lineage and Data Dictionaries to create a broad awareness of the enterprise data model and its applications.
    • Apply best practices within DataOps (Version Control, P.R. Based Development, Schema Change Control, CI/CD, Deployment Automation, Test Automation, Shift left on Security, Loosely Coupled Architectures, Monitoring, Proactive Notifications)
  • Problem Solving/Project Leadership: Provide thought leadership in problem solving to enrich possible solutions by constructively challenging paradigms and actively soliciting other opinions. Actively participate in R&D initiatives
  • Architecture: Utilize modern cloud technologies and employ best practices from DevOps/DataOps to produce enterprise quality production Python and SQL code with minimal errors. Identify and direct the implementation code optimization opportunities during code review sessions and proactively pull in external experts as needed.
  • Self-Development: Flexibly seek out new work or training opportunities to broaden experience. Independently research the latest technologies and openly discuss applications within the department.
  • Perform other duties as requested.
Preferred Qualifications:
  • Working knowledge of Azure Stream Architectures, DBT, Schema Change tools, Data Dictionary tools, Azure Machine Learning Environment, GIS Data
  • Working knowledge of Software Engineering and Object Orient Programming Principles
  • Working knowledge of Distributed Parallel Processing Environments such as Spark or Snowflake
  • Working knowledge of problem solving/root cause analysis on Production workloads
  • Working knowledge of Agile, Scrum, and Kanban
  • Working knowledge of workflow orchestration using tools such as Airflow, Prefect, Dagster, or similar tooling
  • Working knowledge with CI/CD and automation tools like Jenkins or Azure DevOps
  • Experience with containerization tools such as Docker.
  • Strong verbal and written communication skills in English language

Minimum Requirements:
  • Bachelor's degree in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline and five (5) years of relevant work experience
OR
  • Master's in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline and three (3) year of relevant work experience
OR
  • Ph.D. in engineering, computer science, analytical field (Statistics, Mathematics, etc.) or related discipline and one (1) year of relevant work experience
  • Strong experience in at least three areas:
    • Knowledgeable Practitioner of SQL development with experience designing high quality, production SQL codebases
    • Knowledgeable Practitioner of Python development with experience designing high quality, production Python codebases
    • Knowledgeable Practitioner in data engineering, software engineering, and Client systems architecture
    • Knowledgeable Practitioner of data modeling
    • Experience applying software development best practices in data engineering projects, including Version Control, P.R. Based Development, Schema Change Control, CI/CD, Deployment Automation, Test Driven Development/Test Automation, Shift left on Security, Loosely Coupled Architectures, Monitoring, Proactive Notifications using Python and SQL
    • Data science experience wrangling data, model selection, model training, modeling validation, e.g., Operational Readiness Evaluator and Model Development and Assessment Framework, and deployment at scale

  • Data Engineer

    1 week ago

    Phoenix, Arizona, United States Motion Recruitment Full time

    Job DescriptionWe are currently seeking a talented and motivated Data Engineer with expertise in Google Cloud Platform (GCP). This financial tech company offers the opportunity for growth and advancement in a dynamic and innovative work environment.The #1 feature of this opportunity is the chance to work with GCP, designing and implementing data solutions...

  • Data Engineer

    1 month ago

    Phoenix, United States eTek IT Services, Inc. Full time

    Job DescriptionJob DescriptionRequired SkillsBig Data Engineer with 3-4 years of hands-on Spark/Scala and Hive experience. The candidate must be able to work a hybrid schedule with the team in Phoenix, AZ (onsite every Tues/Wed/Thurs). If the candidate is not located in Phoenix, but wiling to relocate and work onsite, they can begin working remotely and then...

  • Data Engineering Consultant

    1 month ago

    Phoenix, United States Plex Consulting, LLC Full time

    Job DescriptionJob DescriptionJob Title: Data Engineering ConsultantCompany: Plex ConsultingLocation: Phoenix, AZAbout the company:Plex Consulting is a leading technology consulting firm offering data solutions to a diverse range of clients across industries. We combine our expertise in data engineering, analytics, and data science to provide innovative and...

  • Senior Data Engineer

    1 week ago

    Phoenix, United States Insight Global Full time

    Must be local to Arizona!DescriptionYou will be an independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven for our client. Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production. At our client, they understand...

  • Senior Data Engineer

    1 week ago

    Phoenix, United States Insight Global Full time

    Must be local to Arizona!DescriptionYou will be an independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven for our client. Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production. At our client, they understand...

  • Senior Data Engineer

    6 days ago

    Phoenix, United States Insight Global Full time

    Must be local to Arizona!DescriptionYou will be an independent contributor on a fast-growing Data Engineering team pursuing a vision of analytics-driven for our client. Your expertise in data engineering and software engineering will enable and empower our organization to build and deploy data driven solutions to production. At our client, they understand...

  • Critical Operations Tech Overnight

    1 month ago

    Phoenix, United States QTS Data Centers Full time

    Learn what makes QTS a unique place to grow your career! SUMMARY The Critical Operations Technician I is responsible for the installation, repair, and maintenance of IT, electrical, mechanical, plumbing/piping equipment, machinery and controls located in the interior and exterior of building. This role monitors operations and conducts a routine and ongoing...

  • Data Software engineer

    1 week ago

    Phoenix, United States Insight Global Full time

    Company: Amex Role: Data Software engineer Duration: 9 month contract to hire Location: Phoenix, FL OR Sunrise, Florida (3x a week) Must Have: -8+ years of Data Experience, working with NLP.-Proficient in Python coding and programming.-Exposure with speech to text functions and exposure into AI.Day-to-day: A large financial enterprise is looking for a Senior...

  • Data Software engineer

    1 week ago

    Phoenix, United States Insight Global Full time

    Company: Amex Role: Data Software engineer Duration: 9 month contract to hire Location: Phoenix, FL OR Sunrise, Florida (3x a week) Must Have: -8+ years of Data Experience, working with NLP.-Proficient in Python coding and programming.-Exposure with speech to text functions and exposure into AI.Day-to-day: A large financial enterprise is looking for a Senior...

  • Data Engineer

    1 month ago

    Phoenix, United States Forhyre Full time

    Job DescriptionJob DescriptionWe are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop...

  • Principal Data Engineer 1

    1 week ago

    Phoenix, United States Western Alliance Bank Full time

    Principal Data Engineer 1 with Western Alliance Bank (Phoenix, AZ) Job Description: Design, build and implement critical components of the enterprise data platform in accordance with the strategic data and analytics needs of the organization. Develop a cross-business unit data tier that is leveraged to improve products and deliver insights. Serve as a...

  • Data Engineer

    7 hours ago

    Phoenix, United States Progilisys Solutions Full time

    Job DescriptionJob DescriptionMUST BE A U.S. CITIZEN and HOLD AT LEAST A TIER 2 FEDERAL SECURITY CLEARANCENOT OPEN TO CORP TO CORPImmediate need for Data Modelers, Data Analysts, Data Architects, and Data Engineers for a government contract we are working on for our client. Must have at least a Tier 2 Federal Security Clearance and U.S. Citizenship. This is...

  • GCP Data Engineer

    1 month ago

    Phoenix, United States Triunity Software Full time

    Job DescriptionJob DescriptionNature: Day One On-siteDuration: 24 MonthsCandidates Required: 04Experience: 5 to 8 Years Following is the Job description for the role of a Data Engineer,Mandatory Skill Set: Apache Spark, Hive, Hadoop, BigQuery, BigTable, Cloud Composure, Dataflow, Google Cloud Storage, Python, SQL, Shell Scripting, Git.Good to have Skill Set:...

  • Data Engineer

    2 weeks ago

    Phoenix, United States The IT Gigs Full time

    Job title: Data Engineer/Data ArchitectLocation: Phoenix, AZ (Onsite)/ CaliforniaJob type: W2 OnlyVISA: USC, GC , OPT11+ years of experience OnlyJD:MUST HAVE AWS CERTIFICATIONSQualifications:Proven experience with Apache Spark, Hive, and Hadoop.Strong programming skills in Python, Scala, SQL, and Shell Scripting.Hands-on experience with GCP services,...

  • Data Engineer

    2 weeks ago

    Phoenix, United States The IT Gigs Full time

    Job title: Data Engineer/Data ArchitectLocation: Phoenix, AZ (Onsite)/ CaliforniaJob type: W2 OnlyVISA: USC, GC , OPT11+ years of experience OnlyJD:MUST HAVE AWS CERTIFICATIONSQualifications:Proven experience with Apache Spark, Hive, and Hadoop.Strong programming skills in Python, Scala, SQL, and Shell Scripting.Hands-on experience with GCP services,...

  • Critical Facilities Engineer, NA

    22 hours ago

    Phoenix, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another's experience. Vantage Data Centers powers, cools, protects and connects the technology of the world's well-known hyperscalers, cloud providers and large...

  • Critical Facilities Engineer, NA

    1 day ago

    Phoenix, United States Vantage Data Centers Full time

    About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud...

  • Data Center Technician, Jwcc

    4 weeks ago

    Phoenix, United States Amazon Data Services, Inc. Full time

    Current, active US Government Security Clearance of Top Secret or above - 2+ years of experience with server hardware - 1+ years of experience with UNIX/Linux operating systems You are able to execute small projects on your own and work with your manager in planning and executing larger local projects. You act as an escalation point for junior technicians....

  • Data Engineer

    1 month ago

    Phoenix, United States Tekdoors Full time

    Job DescriptionJob DescriptionJob Title: Data Engineer Location: Jacksonville, FL / Phoenix, AZ (Hybrid Work) Duration: 24+ Months Employment Type: Contract W2 Experience: 8+ YearsMust-Have: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Proven experience as a Data Engineer with a minimum of 8 years in...

  • AI/ML Data Engineer

    2 weeks ago

    Phoenix, United States Insight Global Full time

    Position: AI/ML Data EngineerLocation: Hybrid in Phoenix, AZ (3 days/week on site)Duration: 9 month contract to hireRequired Skills and Experience *-8+ years of hands on Data Engineering experience.-Very well versed with AI and Machine Learning.-Proficient with Application Lifecycle Management (ALM)-Understanding of public cloud environmentsJob Description...