Azure Data Engineer

2 months ago

Bentonville, United States e.biT Consulting Full time

SUMMARY DESCRIPTION:The Data Engineer will serve in a strategic role managing the infrastructure that supports data storage, transforming, processing, and retrieval enabling efficient data analysis and decision-making within the organization. This position is critical as part of the Database and Analytics team responsible for development and implementation of complex enterprise-level data integration and consumption solutions. It requires a highly technical, self-motivated senior developer who will work with analysts, architects, and systems engineers to develop and unit test solutions based on the functional and technical specifications to meet quality and performance requirements.


PRIMARY DUTIES AND RESPONSIBILITIES:

Design and optimize data models, warehouses, architectures, schemas, indexing, and partitioning strategies.

Collaborate with BI and data analysts to understand data requirements and optimize storage for analytical queries.

Modernize databases and data warehouses and prepare them for analysis, managing for optimal performance.

Design, build, manage, and optimize enterprise data pipelines ensuring efficient data flow, data integrity, and data quality throughout the process.

Automate efficient data acquisition, transformation, and integration from a variety of data sources including databases, APIs, message queues, data streams, etc.

Competently performs advanced data tasks with minimal supervision, including architecting advanced data solutions, leading and coaching others, and effectively partnering with stakeholders.

Interface with other technical and non-technical departments and outside vendors on assigned projects.

Under the direction of the IT Management, will establish standards, policies and procedures pertaining to data governance, database/data warehouse management, metadata management, security, optimization, and utilization.

Ensure data security and privacy by implementing access controls, encryption, and anonymization techniques as per data governance and compliance policies.

Provide training and consulting to other associates on database structure and standards.

Document data pipelines, processes, and architectural designs for future reference and knowledge sharing.

Stay informed of latest trends and technologies in the data engineering field, and evaluate and adopt new tools, frameworks, and platforms (like Microsoft Fabric) to enhance data processing and storage capabilities.

When necessary, implement and document schema modifications made to legacy production environment.

Perform any other function required by IT Management for the successful operation of all IT and data services provided to our clients.

Available nights and weekends as needed for system changes and rollouts.


EDUCATION AND EXPERIENCE REQUIREMENTS:

Bachelor’s or Master’s degree in computer science, information systems, applied mathematics, or closely related field.

Minimum of eight (8) years full time employment experience as a data engineer, data architect, or equivalent required.

Knowledge of Mortgage and/or Title Industry is helpful.




SKILLS:

Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures, and integrated datasets using traditional and modern data integration technologies (such as ETL, ELT, MPP, data replication, change data captures, message-oriented data movement, API design, stream data integration and data virtualization)

Experience working with cloud data engineering stacks (specifically Azure) and tools (Microsoft Fabric, Data Lake, Synapse, Azure Data Factory, Databricks, Informatica, etc.)

Strong, in-depth understanding of database architecture, storage, and administration utilizing Azure stack.

Deep understanding of Data architectural approaches, Data Engineering Solutions, Software Engineering principles and best practices.

Working knowledge and experience with modern BI and ETL tools (Power BI, Power Automate, ADF, SSIS, etc.)

Experience utilizing data storage solutions including Azure Blob storage, ADLS Gen 2.

Solid understanding of relational and dimensional database principles and best practices in a client/server, thin-client, and cloud computing environment.

Advanced working knowledge of TSQL and SQL Server, transactions, error handling, security and maintenance with experience writing complex stored procedures, views, and user-defined functions.

Experience with .net scripting and understanding of API integration in a service-oriented architecture.

Communicate effectively and professionally, in both oral and written communications, with all levels of associates.

Understanding of and experience with agile methodology.

Strong independent troubleshooting and problem-solving skills.

Organizational, time management, and motivational skills.

Must be able to perform in a fast paced and mission critical production environment.

Ability to analyze and troubleshoot problems, determine solutions, and produce the desired outcome.

Team Player with a strong work ethic.

PowerShell scripting experience desired.


Experience Waiver: Management reserves the right to amend, modify or waive any education, experience, or skill requirements for this position.


Equipment to be used:

Personal Computer / Printer

Any other equipment necessary to perform the normal functions of this job.


PHYSICAL REQUIREMENTS:

Typical Physical Demands:

Some travel may be required.

Must maintain a professional appearance.

Position requires long periods of work at a desk, utilizing a keyboard and monitor.


Working Conditions:

Available to work evenings and/or weekends (as required).

Workdays and hours are Monday thru Friday 8:30 am to 5:30 pm


ADDITIONAL REQUIREMENTS:

Ability to:

Establish and maintain effective working relationships with Business and IT associates.

Embrace and champion change as well as advocate for a data-driven culture.

Improve business productivity by proposing innovative and creative solutions.

Follow directions from management.

Understand and follow posted work rules and procedures.

Communicate in a positive manner to all associates and other business professionals.

Maintain a positive professional attitude.


This position outlines the basic tasks and requirements for the position noted. It is not a comprehensive listing of all job duties of the associate.


FLSA STATUS: Exempt

  • Senior Data Engineer

    4 weeks ago

    Bentonville, United States Kitestring Technical Services Full time

    Kitestring is a 20+-million-dollar company with 155+ associates and growing. We are a 24 year old start up in Northwest Arkansas. We provide technical expertise to various clients delivering innovations that improve how customers shop and the enterprise operates. At Kitestring Technical Services, our mission is to share our collective knowledge to positively...

  • Software Engineer

    4 days ago

    Bentonville, United States Saxon Global Full time

    Software Engineer 6 month contract to hire Hybrid at any hub location (Bentonville, Dallas, Sunnyvale, Hoboken) Required: Java, SQL, Kafka, Apache Spark, Azure, GCP, Databricks Must have experience with batch & streaming data Required Skills : Needing a candidate who is very expereinced with moving data using Java. - Must Have: Apache Spark, Java, GCP,...

  • Java Developer

    3 weeks ago

    Bentonville, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title : Java DeveloperLocation : Bentonville, AR Job Type : Contract Mandatory Skill :Java 9+GCP Dataproc/Azure Databricks using PySparkJob Responsibilities:6-10 years of experience in development using Java Java 9+ and Spring Boot technologiesWorking on cloud experience, deploying containerized applications, building data...

  • Senior Java Engineer

    5 days ago

    Bentonville, Arkansas, United States VDart Inc Full time

    Job OverviewPosition Title: Senior Java EngineerLocation: RemoteEmployment Type: ContractEssential Skills:Proficient in Java 9+Experience with GCP Dataproc or Azure Databricks utilizing PySparkKey Responsibilities:6-10 years of expertise in software development using JavaStrong knowledge of Java 9+ and Spring Boot frameworksExperience in cloud technologies,...

  • Data Scientist

    2 months ago

    Bentonville, United States workcog Full time

    Job Title Data ScientistLocation Bentonville AR (Onsite)Company WalmartJob DescriptionWe are seeking a motivated and detail-oriented individual to join our data science team as an Entry Level Data Scientist. As part of our team you will have the opportunity to work on a variety of projects and gain hands-on experience in data analysis machine learning ...

  • Data Scientist

    2 months ago

    Bentonville, Arkansas, United States workcog Full time

    Job Title Data ScientistLocation Bentonville AR (Onsite)Company WalmartJob DescriptionWe are seeking a motivated and detail-oriented individual to join our data science team as an Entry Level Data Scientist. As part of our team you will have the opportunity to work on a variety of projects and gain hands-on experience in data analysis machine learning and...

  • Senior Data Engineer

    3 weeks ago

    Bentonville, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title: Senior Data EngineerLocation: Bentonville, AR - OnsiteDuration: 6+ months Term: ContractJob Description:Experience Desired: 10+ Years.Must Have Skills 2+ years of recent GCP experienceGCP Dataproc, GCS & BIGQuery experience5+ years of hands-on experience Hadoop, Hive or Spark, Airflow or a workflow...

  • Software engineer

    2 weeks ago

    Bentonville, United States Falcon Smart IT (FalconSmartIT) Full time

    Job Title: Software engineerLocation: Bentonville, AR (Onsite)Job Type: ContractJob Description: Mandatory Skills:Java 9+Spring Boot,GCP DataProc/Azure Databricks using pySpark Required : 7-year experience .UST Global® is a leading provider of platforms, digital innovation, artificial Intelligence and end-to-end IT & Business services and solutions for...

  • Software engineer

    2 weeks ago

    Bentonville, United States Falcon Smart IT (FalconSmartIT) Full time

    Job Title: Software engineerLocation: Bentonville, AR (Onsite)Job Type: ContractJob Description: Mandatory Skills:Java 9+Spring Boot,GCP DataProc/Azure Databricks using pySpark Required : 7-year experience .UST Global® is a leading provider of platforms, digital innovation, artificial Intelligence and end-to-end IT & Business services and solutions for...

  • Remote Cloud Data Engineer

    3 months ago

    Bentonville, United States Saxon Global Full time

    Cloud Data Engineers with GCP experience. GCP Data Engineer Certification will be a plus. Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep, etc.). API /Event Driven Application/Software Engineering Experience with Scala Experience in Spark...

  • Cloud Engineer

    2 months ago

    Bentonville, United States Insight Global Full time

    One of our largest organizations in NWA is currently expanding their international presence for GCP and Azure, and are seeking a talented Cloud Automation Engineer to join their Internal Platforms Organization. As a Cloud Automation Engineer, you will play a crucial role in supporting the international expansion efforts. You will work with the existing team...

  • Senior Data Engineer

    4 weeks ago

    Bentonville, United States Cloudious LLC Full time

    Job DescriptionJob DescriptionRetail EXPSenior Data Engineer Design and develop big data applications using the latest open source technologies. Desired working in offshore model and Managed outcome Develop logical and physical data models for big data platforms. Automate workflows using Apache Airflow. Create data pipelines using Apache Hive, Apache Spark,...

  • Future Builders Internship Program – Software Development Engineer

    19 hours ago

    Bentonville, Arkansas, United States Lennar Homes Full time

    About Lennar HomesLennar Homes is a leading homebuilder dedicated to making a positive impact and creating an extraordinary experience for our Homeowners, Communities, and Associates. We build quality homes and provide exceptional customer service, giving back to the communities in which we work and live in, and fostering a culture of opportunity and growth...

  • Software Engineer I

    2 months ago

    Bentonville, United States Flexton Inc. Full time

    Job Title: Software Engineer II - Java- Local to Bentonville ARLocation: Bentonville AR – HybridNeed Local to Bentonville AR candidates onlyMust have retail/eCommerce domain experience. Basic Qualifications:6+ years' experience designing and implementing Java backend applications.Experience in driving a large java-based application migration from one...

  • Software Engineer I

    4 weeks ago

    Bentonville, United States Flexton Inc. Full time

    Job Title: Software Engineer II - Java- Local to Bentonville ARLocation: Bentonville AR – HybridNeed Local to Bentonville AR candidates onlyMust have retail/eCommerce domain experience. Basic Qualifications:6+ years' experience designing and implementing Java backend applications.Experience in driving a large java-based application migration from one...

  • Data Analyst II

    4 weeks ago

    Bentonville, United States Walmart Full time

    What you'll do at Position Summary... What you'll do... Data Analyst II - Data Ventures PLEASE NOTE: The team comes into the office 3 days a week; this is not a remote position. This role is based out of Bentonville, Arkansas. If you are not local and apply for this role, please specify "open to relocation" at the top of your resume, if that is applicable,...

  • Lead Software Engineer I

    3 weeks ago

    Bentonville, United States Flexton Inc. Full time

    Job Title: Lead Software Engineer - Java- Local to Bentonville ARLocation: Bentonville AR – HybridNeed Local to Bentonville AR candidates onlyMust have retail/eCommerce domain experience. Basic Qualifications:8+ years' experience designing and implementing Java backend applications.Should have experience leading and managing a team. Experience in driving a...

  • Lead Software Engineer I

    3 weeks ago

    Bentonville, United States Flexton Inc. Full time

    Job Title: Lead Software Engineer - Java- Local to Bentonville ARLocation: Bentonville AR – HybridNeed Local to Bentonville AR candidates onlyMust have retail/eCommerce domain experience. Basic Qualifications:8+ years' experience designing and implementing Java backend applications.Should have experience leading and managing a team. Experience in driving a...

  • Senior Software Engineer

    3 weeks ago

    Bentonville, United States Flexton Inc. Full time

    We are seeking a talented and motivated Senior Fullstack Software Engineer to join our development team. The ideal candidate will have a strong background in JavaScript, Node.js, and React, along with experience in either Python or Spring Boot/Java. A solid understanding of NoSQL databases is essential, and knowledge of data structures and algorithms will be...

  • Senior Software Engineer

    3 weeks ago

    Bentonville, United States Flexton Inc. Full time

    We are seeking a talented and motivated Senior Fullstack Software Engineer to join our development team. The ideal candidate will have a strong background in JavaScript, Node.js, and React, along with experience in either Python or Spring Boot/Java. A solid understanding of NoSQL databases is essential, and knowledge of data structures and algorithms will be...