Data Engineer
4 days ago
Duration: 12 months
Location: Austin, TX 78758 (5 days onsite)
Number of Interviews: 3 interviews
Job Description:
- Client is looking for a Senior Data Engineer to join a team of highly skilled individuals working on our initiatives in resource and application discovery within Client security.
- Our product, Veritas, is a foundational service within Client security that provides data for security initiatives like security reviews, threat modeling and detection, access control and incident response.
- You will work closely with a diverse range of roles, such as Software Development Engineers, Data Scientist, Data Engineers, Technical Program Managers, Product managers and our Security Engineer customers, to build high quality datasets for security investigations, application modeling, and more.
- You'll mostly work with AWS services like EMR, Glue, Athena, Redshift, S3, SNS, SQS, Airflow and some internal tools.
- Our lake comprises over 500 datasets from different sources, with some datasets experiencing large daily volumes exceeding 1TB.
- You will be gathering and understanding data requirements, partnering with software engineers, and collaborating across roles and teams to create the necessary data infrastructure and high quality pipelines to drive our team's initiatives.
- We have high-visibility data ingestion goals in a fast-paced, operational environment. The ideal candidate should enjoy the challenge of operating complex and mission-critical systems under extreme loads.
Typical Day in the Role:
- As a Data Engineer you will be working in one of the world's largest and most complex data warehouse environments.
- You will understand and analyze business processes, logical data models, and relational database implementations.
- You will independently build end-to-end data pipelines to ingest and transform data from different types of data sources and systems
- You will be responsible for designing and implementing a platform using AWS Data engineering tools and modeling the tables.
- You will write high-performing and optimized SQL queries
- You will continually improve the data quality and operations, via automation and building full CI/CD data pipelines
- You will work with business customers in understanding the business requirements and implementing solutions to support analytical.
Required Skills & Experience:
- 4-6 years of related experience.
- Recognize and adopt best practices in data integrity, data model, testing, analysis, validation, and documentation.
- A good candidate has strong analytical skills and enjoys working with large complex data sets.
- A good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies.
Preferred:
- Neo4j Graph
Top 3 must-have hard skills:
- Excellent knowledge of SQL
- Developing complex data model
- Evaluate and implement various big-data technologies and solutions (e.g. Redshift, Hive/EMR, Spark, SNS, SQS, Kinesis) to optimize the processing of extremely large datasets
#TB_EN
-
Data Engineer
2 weeks ago
Austin, United States eStaff Full timeWe seek a Data Engineer to work on our W2 from anywhere in Texas for a long-term assignment. Please emailhbarnett@estaffllc.com, your resume if you are interested. We cannot work with C2Cs. JOB DESCRIPTION: We are looking for Data engineers who currently live in Texas only. The Data Engineer will be pivotal in designing, developing, and maintaining...
-
Data Engineer
3 weeks ago
Austin, United States Diverse Lynx Full timeJob Title: Data Engineer (Python, Pyspark, Java) Location: Sunnyvale, CA & Austin, TX REMOTE (PST Hours) Job Type: Full timeJOB DESCRIPTION Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Responsibilities Design, implement, optimize, and maintain data pipelines and reports using...
-
Data Engineer
7 months ago
Austin, United States Loxo Full timeAs an early hire to our engineering team, you will be responsible for managing Loxo's data integration function. You will be primarily responsible for migrating new clients' legacy data from their previous recruitment platform to Loxo and will work closely with the Customer Success team to deliver a positive onboarding experience for all new Loxo users. You...
-
Data Engineer
2 weeks ago
Austin, United States Pedernales Electric Full timeData Engineer Austin, TX, US, 78701 PHYSICAL OFFICE LOCATION: PEC Technology Center - 1506 N US Highway 281, Austin, TX 78701 Hybrid Work Options Available $100,000.00 Minimum Starting Base Pay* + KPI Bonuses + Competitive Benefits *Qualifications may warrant greater starting base pay within the full pay range. Individual base pay is determined by...
-
Data Engineer
7 months ago
Austin, United States Virtual Full timeResponsibilities: ? Assembling mixed sets of data that meet non-functional and functional business requirements. ? Identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. ? Building required infrastructure for optimal...
-
Senior Data engineer
3 weeks ago
Austin, United States Futran Tech Solutions Pvt. Ltd. Full timeTitle - Senior Data engineer Duration - 9+ Months Location - Austin, TX (Day 1 onsite) Locals Only Responsibilities : We are looking for a Senior Data Engineer to join our team and help us build and maintain our data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing scalable and...
-
Data Engineering Lead
7 days ago
Austin, Texas, United States Apple Full timeOur TeamWe're a diverse group of talented engineers, data scientists, and product managers who share a passion for innovation and excellence.Salary: $200,000/yearWe're looking for a Data Engineering Lead to lead our team in building and maintaining scalable and reliable data platforms.ResponsibilitiesThe ideal candidate will have strong leadership skills,...
-
Data Engineering Lead
1 day ago
Austin, Texas, United States Diverse Lynx Full timeData Engineer Lead Job DescriptionWe are seeking a highly experienced data engineer lead to join our team at Diverse Lynx LLC. The successful candidate will be responsible for leading a team of data engineers, overseeing the development and maintenance of big data platforms, and ensuring the delivery of high-quality projects.Key Responsibilities:Lead a team...
-
Principal Data Engineer
3 weeks ago
Austin, United States University of Texas at Austin Full timeTechnical LeadershipDesign, plan, develop and deploy production quality enterprise level data pipelines using Cloud technologies with a team of data engineers using new and emerging industry standard tools, frameworks, and best practices.Conduct and participate in code reviews for a high-quality code.Contribute to Data Engineering, SDLC, process improvements...
-
Data Engineer
1 month ago
Austin, United States Avathon Full timeJob DescriptionJob DescriptionWho are we and why this opportunity?Avathon, Inc. delivers world-class AI solutions that allow a business to solve their most critical problems, empowering them to run a more sustainable, safer, and profitable business. Our award-winning AI solutions predict future outcomes, optimize processes, and prevent cyberattacks. We...
-
Data Engineer
4 days ago
Austin, United States Avathon Full timeWho are we and why this opportunity?Avathon, Inc. delivers world-class AI solutions that allow a business to solve their most critical problems, empowering them to run a more sustainable, safer, and profitable business. Our award-winning AI solutions predict future outcomes, optimize processes, and prevent cyberattacks. We partner with the world's industry...
-
"Data Engineer"
3 weeks ago
Austin, United States TechnoGen Full timeClient: Office of the Attorney General of Texas Job Title: Data Engineer Duration: 8+ Months Start Date: ASAP Location: Austin, TX 78753 (Remote) Number of Hours: 40 Hrs/Week Position Type: Contract Interview Type: In Person or Webcam Requirement ID: STX_DATA504_MA Position ID: Solicitation: 302CSD2504 Office of the Attorney General of Texas requires the...
-
Data Engineering Lead
1 day ago
Austin, Texas, United States Saxon Global Full timeSaxon Global is a leading provider of data engineering services, and we are seeking an experienced Data Engineer to join our team. With a focus on cloud-based solutions, this role will involve designing, building, and deploying AWS Cloud solutions to meet the needs of our clients.The successful candidate will have a strong background in data engineering,...
-
Data Engineering Specialist
3 weeks ago
Austin, Texas, United States Unreal Gigs Full timeAt Unreal Gigs, we're seeking a highly skilled Data Engineering Specialist to join our team. This exciting role offers the opportunity to work with cutting-edge data technologies and architect scalable pipelines that power advanced analytics and machine learning.About the RoleWe're looking for a talented individual who can design, develop, and optimize data...
-
Data Engineer
5 months ago
Austin, United States Diverse Lynx Full timeKey Skills: Snowflake, Big data processing, Python, pyspark, ETL. Job Description: Engineers they need is more for Data Engineering work (90% Data Engg and 10% Client model training). From Data engineering, we need folks with experience in Big data processing, Python, pyspark, ETL, feature engineering etc . Diverse Lynx LLC is an Equal Employment...
-
Senior Data Engineer
5 months ago
Austin, United States University of Texas at Austin Full timeData Engineering:Providing leadership, guidance, and execution as it relates to designing and automating scalable data integration solutions between institutional data sources, including the UT source systems, Amazon Web Services, and vendor APIsAssure performance and reliability of integration processes through monitoring, performance analysis and...
-
Data Engineer for Cloud Data Ecosystem
3 weeks ago
Austin, Texas, United States The University of Texas at Austin Full time**Job Summary:**The University of Texas at Austin seeks a skilled Data Engineer to join our team and contribute to the development of a next-generation data ecosystem. This position is an exciting opportunity to work with a cross-campus team using the latest cloud technologies to build a scalable information infrastructure.**Company Overview:**The University...
-
Cloud Data Engineer
6 days ago
Austin, Texas, United States United Software Group Full timeJob Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at United Software Group. As a Cloud Data Engineer, you will be responsible for designing and implementing data solutions within the Azure ecosystem.The ideal candidate will have 5+ years of experience in Azure native services with good exposure to ADF,...
-
Data Engineer
6 days ago
Austin, United States ZipRecruiter Full timeJob DescriptionJob Description Are you passionate about building data infrastructure that powers advanced analytics and machine learning? Do you thrive on transforming raw data into well-organized, accessible, and reliable datasets that fuel data-driven decision-making? If you’re excited about working with cutting-edge data technologies and architecting...
-
Senior Data Engineer
6 days ago
Austin, United States Harnham Full timeSenior Data EngineerHealthtech organizationFully remote (the company are based in Austin, TX)$160,000 to $180,000 + 10% bonusCompany OverviewWe have been exclusively retained to work with a pioneering healthcare analytics software company with a primary focus on Medicaid data. Their mission is to enhance the quality of care and services for underserved...