Senior Data Engineer

2 days ago

Austin Texas, United States SHI International Corp. Full time
About the Role

We are seeking a highly skilled Senior Data Engineer to drive data infrastructure and analytics integration within our organization. This role is crucial in developing and deploying data pipelines, data lakes, and databases, working closely with machine learning engineers, software development engineers, and stakeholders.

Key Responsibilities
  • Lead initiatives to develop and execute a governance model for data infrastructure and analytics
  • Design, develop, and implement data solutions, including data pipelines, data lakes, and databases
  • Ensure familiarity with AWS, Azure, Google Cloud, and big data technologies
  • Measure and communicate the impact of data initiatives on the business and drive continuous improvement
  • Analyze data and translate recommendations into actionable items for end users
  • Assess and monitor performance, ensuring systems remain compliant with standards and secure against cybersecurity threats
  • Lead complex, data-driven projects impacting SHI's business
  • Explore and execute analytical solutions for various problems
  • Acquire, analyze, and act on complex data sets; create ETL jobs; explore, inspect, and clean data; engineer features
  • Implement and enforce data normalization practices to ensure database efficiency and integrity
  • Organize and lead meetings with stakeholders; collaborate with internal groups to achieve project goals
  • Stay updated on data science, big data, and cloud developments
  • Ensure data systems are scalable, reliable, and efficient; integrate data solutions with systems and platforms; optimize performance
  • Document design specifications, processes, models, and systems for transparency and reproducibility
Requirements
  • Bachelor's or Master's degree in Computer Science, Software Engineering, Information Systems, Engineering, Mathematics, or a related field
  • Minimum of 5 years of experience in data engineering, with exposure to software engineering best practices
  • 2 years of direct experience using technologies like AWS, Azure, Google Cloud, and big data technologies
  • Demonstrated experience in developing and deploying data pipelines in production environments
  • Deep understanding of data structures, algorithms, and software design principles
Preferred Skills
  • Proficiency in programming languages such as Python, Java, or Scala
  • Extensive experience with data engineering frameworks and libraries like Apache Spark, Hadoop, and Kafka
  • Solid understanding of software engineering principles, including version control (Git), testing, and CI/CD pipelines
  • Strong skills in data preprocessing, feature engineering, and data analysis using tools like Pandas and SQL
  • Expertise in SQL and data modeling, including data normalization and database optimization techniques
  • Proficiency with cloud platforms such as AWS, Azure, or GCP (Google Cloud Platform) for deploying and managing data solutions
  • Expertise in designing and supporting data pipelines, data lakes, and databases
  • Experience in analyzing business requirements, recommending, and designing technical solutions
  • Ability to write detailed and concise technical and design specifications
  • Excellent analytical and problem-solving skills, capable of handling complex projects and delivering effective solutions
  • Proficient in system security best practices
  • Adaptability to changing priorities; can conform to shifting priorities, demands, and timelines through analytical and problem-solving capabilities
  • Strong ability to work independently or in a team-oriented, collaborative environment
  • Ability to take initiative and prioritize tasks, manage time, problem prevention, and problem-solving skills
About SHI International Corp.

SHI International Corp. is a global provider of IT solutions and services, with a commitment to diversity and a concierge approach to helping organizations solve what's next. We offer a range of benefits, including continuous professional growth and leadership opportunities, health, wellness, and financial benefits, and world-class facilities and technology.

  • Senior Data Engineer

    1 week ago

    Texas, United States Pyramid Consulting, Inc Full time

    Job DescriptionJob Title: Senior Data EngineerJob Type: ContractLocation: Westlake, TXJob Description:We are seeking a highly skilled Senior Data Engineer to join our team at Pyramid Consulting, Inc. as a contract employee. The ideal candidate will have a strong background in data engineering, with experience in designing and implementing large-scale data...

  • Senior Data Engineer

    7 days ago

    Austin, Texas, United States Eidon AI Full time

    About Eidon AIEidon AI is a pioneering company at the forefront of revolutionizing the AI data ecosystem through decentralization. Our mission is to co-create a full decentralized AI stack in a trustless and permissionless way, with fair rewards for participation and contribution, that advances and benefits all of humanity.Job DescriptionWe are seeking a...

  • Senior Data Engineer

    2 months ago

    Austin, United States Aypa Power Full time

    Job DescriptionJob DescriptionSalary: Senior Data Engineer  Aypa Power, a Blackstone portfolio company, is a leading developer, owner, and operator of utility-scale energy storage and hybrid renewable projects that power our communities and cities. Our mission is to responsibly decarbonize the grid and make North American energy markets more affordable,...

  • Senior Data Architect

    1 week ago

    Austin, Texas, United States SHI International Corp. Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our innovative team at SHI International Corp. This role is crucial in driving data infrastructure and analytics integration within our organization.Key ResponsibilitiesLead initiatives to develop and execute a governance model for data infrastructure and analyticsDesign, develop, and...

  • Senior Data Engineer

    1 day ago

    Austin, Texas, United States 2K Full time

    About 2K2K is a global video game company, publishing titles developed by some of the most influential game development studios in the world. Our portfolio of titles is expanding due to our global strategic plan, building and acquiring exciting studios whose content continues to inspire us.Our TeamOur team of engineers, marketers, artists, writers, data...

  • Senior Data Scientist

    5 days ago

    Austin, Texas, United States Visa Full time

    About the TeamThe Data and AI Platform (DAP) technology organization within Visa is at the forefront of harnessing the power of Artificial Intelligence (AI) to drive strategic growth and operational efficiency.The AI Experimentation Platform (AIEP) team is dedicated to developing an advanced platform that fosters technological innovation and delivers...

  • Senior Data Engineer, Customer Data Platform

    3 months ago

    Austin, Texas, United States Expedia Group Full time

    Senior Data Engineer, Customer Data PlatformThe Customer Data Platform team at Expedia Group is looking for a proven, entrepreneurial, hands-on technical leader who will define and implement the technical vision for our next generation of traveler data products that will power EG's hyper personalized traveler experiences.The Customer Data Platform team at...

  • Senior Data Engineer, Customer Data Platform

    3 months ago

    Austin, United States Expedia Group Full time

    Senior Data Engineer, Customer Data Platform The Customer Data Platform team at Expedia Group is looking for a proven, entrepreneurial, hands-on technical leader who will define and implement the technical vision for our next generation of traveler data products that will power EG’s hyper personalized traveler experiences. The Customer Data Platform team...

  • Senior Software Engineer

    5 days ago

    Dallas, Texas, United States HEB Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team at H-E-B, LP. As a Staff Software Engineer, you will be responsible for designing, developing, and maintaining large-scale data engineering systems.Key ResponsibilitiesDesign and develop data pipelines using Spark, Scala, MapReduce, Pig, Sqoop, and Hive.Transfer and...

  • Senior Data Engineer

    2 months ago

    Austin, United States 2K Full time

    Who We Are2K is headquartered in Novato, California and is a wholly owned label of Take-Two Interactive Software, Inc. (NASDAQ: TTWO). Founded in 2005, 2K Games is a global video game company, publishing titles developed by some of the most influential game development studios in the world. Our studios responsible for developing 2K’s portfolio of...

  • Senior Data Engineer

    4 weeks ago

    Austin, Texas, United States 2K Full time

    Who We Are2K is headquartered in Novato, California and is a wholly owned label of Take-Two Interactive Software, Inc. (NASDAQ: TTWO). Founded in 2005, 2K Games is a global video game company, publishing titles developed by some of the most influential game development studios in the world. Our studios responsible for developing 2K's portfolio of world-class...

  • Senior Data Engineer

    4 months ago

    Austin, United States 2K Full time

    Who We Are 2K is headquartered in Novato, California and is a wholly owned label of Take-Two Interactive Software, Inc. (NASDAQ: TTWO). Founded in 2005, 2K Games is a global video game company, publishing titles developed by some of the most influential game development studios in the world. Our studios responsible for developing 2K’s portfolio of...

  • Senior Data Engineer

    5 days ago

    Plano, Texas, United States One Park Financial Full time

    About One Park FinancialOne Park Financial is a leading Financial Technology company dedicated to empowering small businesses by connecting them with a wide variety of flexible financing and funding options. Our mission is to provide entrepreneurs with the working capital they need to elevate their businesses to new heights.Our CultureWe foster a dynamic and...

  • Senior Software Engineer

    5 months ago

    Texas City, United States OPT Nation Full time

    Position OverviewAs a senior software engineer for data security on the SingleStore engineering team you will have the unique benefit of building systems software in a rapid production environment with a small and collaborative team. Your duties will include overseeing the direction design and development of key security features for the SingleStore...

  • Senior Civil Engineer

    4 days ago

    Austin, Texas, United States Lockwood, Andrews & Newnam, Inc. Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Civil Engineer to join our team at Lockwood, Andrews & Newnam, Inc. (LAN). As a Senior Civil Engineer, you will be responsible for leading and managing engineering projects from conception to completion.Key ResponsibilitiesUse computer-assisted engineering and design software and equipment...

  • **Senior Manager, Software Engineering

    1 week ago

    Austin, Texas, United States Realtor Careers Full time

    About the RoleWe are seeking an experienced Senior Manager, Software Engineering to lead our Data Platform team at Realtor Careers. As a key member of our engineering organization, you will be responsible for driving the development and implementation of our data platform, ensuring it meets the needs of our business and customers.Key ResponsibilitiesLead and...

  • Senior Data and Software Engineer

    1 month ago

    Austin, United States Satoshi Energy Full time

    Job DescriptionJob DescriptionThe mission at Satoshi Energy is to enable every electric power company to utilize bitcoin in order to accelerate progress toward a world with decentralized sound money and abundant sustainable energy. The company was founded in 2018 on two premises: 1) energy companies will leverage bitcoin mining to support investment in low...

  • Senior Data Architect

    3 days ago

    Dallas, Texas, United States Northeading Technologies Full time

    Job Title: Senior Data ArchitectJob Summary:Northeading Technologies is seeking a highly skilled Senior Data Architect to join our team. As a Senior Data Architect, you will play a crucial role in designing, developing, and maintaining robust data pipelines and architectures that support our data-driven initiatives.Responsibilities:Data Pipeline Design and...

  • Senior Data

    3 months ago

    Austin, United States Eidon AI Full time

    Job DescriptionJob DescriptionLocation: Bay Area candidates are also welcomeAbout Eidon AIWe are a team of AI & Crypto researchers and engineers (coming from Google DeepMind, top10 Hedge Funds, and pioneering AI/Crypto companies) with the long-term mission of co-creating the full decentralized AI stack in a trustless and permissionless way, with fair rewards...

  • Senior Mechanical Engineer

    3 days ago

    Austin, Texas, United States Dell Full time

    About the RoleWe are seeking a highly skilled Mechanical Senior Principal Engineer to join our Custom Design and Emerging Technology team in Austin, Texas. As a key member of our team, you will be responsible for developing innovative data center infrastructure solutions at the server, rack, and data center level.Key ResponsibilitiesManage multiple programs...