Lead AWS Data engineer

3 weeks ago

Dallas, United States InfoVision Inc. Full time

Senior AWS Data Engineer

Dallas, TX (Onsite)

Longterm


Job Description


Looking for a highly technical, hands-on Data Engineer for our Data Lake Team that can independently lead data engineering projects and strive to proactively improve process efficiency, making recommendations for process and system improvements where applicable. The Data Engineer role will be responsible for not only understanding data pipelines but, event streaming applications, and how to build systems that handle massive amounts of data while making it consumable by other application teams, users and data scientists.


You will also be assisting in the design and architecture of highly scalable, fault tolerant infrastructure capable of processing millions of operations per minute coming from millions of TVs, efficiently store petabytes of data and provide fast insights from the data. You will also be working with teams across the client enterprise to bring their data into our Big Data ecosystem, monitor data quality for cleanliness and fix discrepancies. Ensure data accuracy through validation tasks, perform root cause analysis and implement solutions for data prep and cleanliness, review data at all granular/aggregate levels, and versioning.


About You

  • You have a BS or MS in Computer Science or similar relevant field
  • You work well in a collaborative, team-based environment
  • You are an experienced engineering with 5+ years of experience
  • You have a passion for big data structures
  • You possess strong organizational and analytical skills related to working with structured and unstructured data operations
  • You have experience implementing and maintaining high performance / high availability data structures
  • You are most comfortable operating within cloud based eco systems
  • You enjoy leading projects and mentoring other team members

Specific Skills

  • Experience or knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
  • Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
  • Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
  • Experience or knowledge of object-oriented/object function scripting languages: i.e., Python, Java, Scala, R, SQL.
  • Experience or knowledge of data pipeline and workflow management tools: i.e., AWS Data Pipeline, Apache Airflow, Argo.
  • Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.
  • Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
  • Hands-on experience in designing and maintaining data schema life-cycles.

  • Data Engineer

    7 days ago

    Dallas, Texas, United States Inizio Partners Full time

    About the JobWe are expanding our Data Engineering capabilities and seeking an experienced AWS, Python, and SQL Data Engineer to join our team. This role will involve designing and implementing new data pipelines using AWS, as well as training other team members. As a Data Engineer on our Data Engineering team, you will design, write, scale, and maintain...

  • Data Engineer

    1 month ago

    Dallas, Texas, United States NTT DATA Full time

    Job DescriptionNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will play a critical role in designing, developing, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement efficient and scalable data pipelines to extract,...

  • Senior Data Engineer

    2 weeks ago

    Dallas, Texas, United States Inizio Partners Full time

    About the Role:We are seeking an experienced AWS Data Engineer to join our team. As a key member of our Data Engineering team, you will be responsible for designing and implementing our new data pipelines using AWS. You will work closely with our data science and data visualization teams to transform ingested data into actionable insights. Key...

  • Data Engineer

    2 weeks ago

    Dallas, Texas, United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...

  • Lead Data Engineer

    2 weeks ago

    Dallas, Texas, United States Alcority Full time

    Job Title: Lead Data EngineerWe are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms.This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable...

  • Data Engineer

    2 weeks ago

    Dallas, Texas, United States Software Technology Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Software Technology Inc. The ideal candidate will have a strong background in Scala, PySpark, and AWS, with experience in building and optimizing data pipelines.Key Responsibilities:Design and develop scalable data pipelines using Scala, PySpark, and AWSCollaborate with...

  • Data Engineering Lead

    1 month ago

    Dallas, Texas, United States Glocomms Full time

    Lead Data EngineerGlocomms is seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. As a key member of our data engineering team, you will be responsible for leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven initiatives.Key...

  • Lead Data Engineer

    2 months ago

    Dallas, United States Glocomms Full time

    We are seeking a highly skilled and experienced Lead Data Engineer. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to support our data-driven...

  • Data Engineer

    4 months ago

    Dallas, United States NTT DATA Full time

    Job Description NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Onsite) to join our team in Dallas, Texas (US-TX), United States (US).Job Responsibilities...

  • Data Engineer

    7 days ago

    Dallas, Texas, United States Diverse Lynx Full time

    Job Title: Data Engineer - AWS Cloud ExpertJob Summary: We are seeking a highly skilled Data Engineer to join our team at Diverse Lynx LLC. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining data pipelines that ensure seamless integration between on-premises and cloud-based environments.Key Responsibilities:* Design...

  • Data Science Engineering Lead

    7 days ago

    Dallas, Texas, United States Data Axle Full time

    Job SummaryData Axle is seeking a highly experienced Principal Data Engineer to lead the design, implementation, and optimization of our modern data architecture.This role requires a strong background in data engineering, expertise in Python and SQL programming, and a passion for creating scalable solutions to support business needs.The ideal candidate will...

  • Lead Data Engineer

    1 month ago

    Dallas, United States Glocomms Full time

    We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to...

  • Lead Data Engineer

    2 weeks ago

    dallas, United States Glocomms Full time

    We are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and scalable data architectures to...

  • Cloud Data Engineer

    2 weeks ago

    Dallas, Texas, United States NTT DATA Group Corporation Full time

    Job Summary:We are seeking a skilled Cloud Data Engineer to join our team at NTT DATA Group Corporation. In this role, you will work with data services, data analysts, and data scientists to design, implement, and support Cloud Data Management and Advanced Analytics platforms.Key Responsibilities:Design and implement Cloud Data Management and Advanced...

  • Data Engineer

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    Job OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key Responsibilities:Collaborate with senior engineers and clients to understand data requirements and...

  • AWS Cloud Engineer

    2 weeks ago

    Dallas, Texas, United States Glow Networks Full time

    Job DescriptionGlow Networks is seeking a talented AWS Cloud Engineer to develop platforms for big data and data science on AWS.As a Cloud Native Engineer, you will be responsible for designing and implementing cloud native technology to develop, manage, automate, and facilitate the operational capabilities of the big data and data science team.Key...

  • Commissioning Engineer

    4 weeks ago

    Dallas, Texas, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Commissioning Engineer to join our AWS Data Center Commissioning Team. As a Commissioning Engineer, you will be responsible for testing and validating the electrical and mechanical infrastructure of our data centers.Key ResponsibilitiesReview design documents and lead Factory Witness Testing (FWT) to ensure...

  • Lead Data Architect

    2 weeks ago

    Dallas, Texas, United States Glocomms Full time

    Lead Data EngineerWe are seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team at Glocomms. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of robust data pipelines, streaming ingestion frameworks, and...

  • Senior Data Solutions Engineer

    2 weeks ago

    Dallas, Texas, United States Axis Data Full time

    Job OverviewAxis Data is a leading data engineering and analytics consulting firm, partnering with Palantir to deliver cutting-edge data operations solutions.As a Senior Engineer at Axis Data, you will lead the development and deployment of data solutions, leveraging your expertise in Palantir Foundry and data engineering.Key Responsibilities:Design,...

  • Data Engineer

    2 weeks ago

    Dallas, Texas, United States Galaxy i technologies Inc Full time

    Job Title: Data EngineerLocation: RemoteJob Type: Full-timeAbout Us:Galaxy i technologies Inc is a leading technology company that specializes in data engineering and analytics. We are seeking a highly skilled Data Engineer to join our team.Job Description:We are looking for a Data Engineer who has a passion for building scalable and high-performing data...