Current jobs related to Senior Big Data Engineer - Irving TX United States - Anblicks

  • Big Data Engineer

    1 week ago

    Irving, Texas, United States Citigroup Inc Full time

    Citigroup Inc. is a leading global bank with operations in over 160 countries and jurisdictions, serving more than 200 million customer accounts.The company's core activities include safeguarding assets, lending money, making payments, and accessing the capital markets on behalf of its clients.This Senior Data Engineer position is responsible for building...

  • Big Data Engineer

    1 week ago

    Irving, Texas, United States Diverse Lynx Full time

    Job Title: Big Data EngineerAbout Us:Diverse Lynx LLC is an Equal Employment Opportunity employer. We promote and support a diverse workforce across all levels in the company.Salary: $120,000 - $150,000 per yearJob Description:We are looking for a highly skilled Big Data Engineer to join our team. As a Senior Apache Spark developer, you will be responsible...

  • Cloud Engineer

    1 month ago

    Irving, United States Resource Informatics Group Full time

    Job Title: Cloud Engineer - Senior / Big Data Location: McLean, VA / Dallas, TX (hybrid role) Duration: 6+ Months (possibility of extension or conversion) Experience: - 5 - 8 years Job Description 5+ Years of exp needed. Will be working in AWS environment. Product - Data Lake Platform in AWS This Developer will be working on Glue, DynamoDB, S3, Lambda...

  • Senior Big Data Professional

    1 week ago

    Irving, Texas, United States Diverse Lynx Full time

    We are seeking a highly skilled Senior Big Data Professional to join our team at Diverse Lynx LLC. As a key member of our technical staff, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Apache Spark.About the Role:The successful candidate will have a minimum of 6-8 years of experience in big...

  • Senior Big Data Engineer

    2 weeks ago

    Irving, United States Anblicks Full time

    Must be local to TXDescription:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and...

  • Senior Big Data Engineer

    3 days ago

    Irving, United States Anblicks Full time

    Must be local to TXDescription:The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.Responsibilities:Responsible for design and...

  • Big Data Engineer

    3 months ago

    Irving, United States Newt Global Full time

    Greeting from Newt Global LLC!!!We are currently looking for Big Data Engineer to join our team for long term project with our Banking client. Interested with the below job description, please share your resume with expected rate/hr. Big Data Engineer Irving, TX (Hybrid – 2 Days a Week)Contract Type: W2 or SCorp (No Third Party Resume)Long TermExp: 8+ yrs...

  • Big Data Engineer

    3 days ago

    Irving, United States Newt Global Full time

    Greeting from Newt Global LLC!!!We are currently looking for Big Data Engineer to join our team for long term project with our Banking client. Interested with the below job description, please share your resume with expected rate/hr. Big Data Engineer Irving, TX (Hybrid – 2 Days a Week)Contract Type: W2 or SCorp (No Third Party Resume)Long TermExp: 8+ yrs...

  • Big Data Engineer

    2 weeks ago

    Irving, United States Newt Global Full time

    Greeting from Newt Global LLC!!!We are currently looking for Big Data Engineer to join our team for long term project with our Banking client. Interested with the below job description, please share your resume with expected rate/hr. Big Data Engineer Irving, TX (Hybrid – 2 Days a Week)Contract Type: W2 or SCorp (No Third Party Resume)Long TermExp: 8+ yrs...

  • Big Data Engineer

    4 weeks ago

    Irving, Texas, United States Diverse Lynx Full time

    Job DescriptionWe are seeking a highly skilled Big Data Engineer to join our team at Diverse Lynx LLC.About UsDiverse Lynx LLC is an Equal Employment Opportunity employer committed to promoting diversity and inclusion in the workplace. We believe that a diverse workforce brings unique perspectives and ideas, leading to innovation and success.SalaryThe...

  • Senior Data Engineer

    7 months ago

    Irving, United States OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION: • Analyze and understand data sources & APIs • Design and Develop methods to connect & collect data from different data sources • Design and Develop methods to filter/cleanse the data • Design...

  • Senior Data Engineer

    2 weeks ago

    Irving, Texas, United States Resource Logistics Full time

    **Job Overview:**Resource Logistics is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale ETL pipelines using batch and streaming technologies.**Salary:** $120,000 - $150,000 per year.**Key Responsibilities:Design and implement ETL...

  • S Slalom Data Engineer- Senior Consultant

    3 weeks ago

    Atlanta, GA, United States Data Engineer Jobs Full time

    *Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of the Atlanta Area and must be willing to be onsite at the client and/or Slalom Atlanta office up to 5 days a week.* Who You'll Work With As a modern technology company, our Slalom Technologists are disrupting the market and bringing to life the...

  • Senior Data Engineering Manager

    1 month ago

    Irving, Texas, United States InfoVision Inc. Full time

    At InfoVision Inc., we are seeking a seasoned Senior Data Engineering Manager to lead our cloud-based big data solutions. This is a long-term opportunity that requires a highly skilled professional with experience in designing and building large-scale distributed systems.The successful candidate will have 10+ years of experience in data engineering, with...

  • Senior Data Engineer

    1 month ago

    Irving, United States Newt Global Full time

    Greeting from Newt Global LLC!!!We are currently looking for Big Data Engineer to join our team for long term project with our Banking client. Interested with the below job description, please share your resume with expected rate/hr.Big Data EngineerIrving, TX (Hybrid – 2 Days a Week)Contract Type: W2Long TermExp: 6+ yrsBanking Exp RequiredBig Data...

  • Senior Data Engineering Professional

    2 weeks ago

    Irving, Texas, United States OTSI Full time

    About the Role:This Senior Data Engineer position at Object Technology Solutions, Inc (OTSI) focuses on analyzing and understanding data sources and APIs, as well as designing and developing methods to extract data from stores. The ideal candidate will have experience with cloud architecture, DevOps, and machine learning engineering. This role offers...

  • Senior Architect DevOps

    3 weeks ago

    Plano,TX-8383 DominionPkwy, United States Cognizant Full time

    Senior Architect DevOps (Big Data) at Cognizant summary: The Senior Architect DevOps at Cognizant is responsible for developing high-performing, scalable enterprise applications with a focus on data lake architecture and cloud computing. This role requires expertise in big data technologies, data science principles, and DevOps methodologies to deliver...

  • Senior Hadoop Data Engineer

    2 weeks ago

    Irving, Texas, United States Diverse Lynx Full time

    Job Title: Senior Hadoop Data EngineerWe are seeking a highly skilled Hadoop Developer to join our team at Diverse Lynx LLC. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop technologies such as Apache Spark and PySpark.About Us: Diverse Lynx LLC...

  • Cloud Engineer with Big Data Expertise

    2 weeks ago

    Irving, Texas, United States HexaQuEST Global, Inc. Full time

    **Company Overview:**At HexaQuEST Global, Inc., we are seeking a skilled Cloud Engineer to join our team. This role involves working on big data projects using Google Cloud Platform (GCP) tools such as Big Query, Dataproc, and Serverless.**Estimated Salary:** $120,000 - $180,000 per annum.**Job Description:**We are looking for a highly experienced...

  • Lead Big Data Engineer

    2 months ago

    Irving, United States Infovision Full time

    Job title: Lead Big Data Engineer (GCP Cloud)Location: Irving, TXDuration: Long-termSkills Needed:10+ years of experience in designing and building data pipelines in large-scale distributed systems.Lead the design, development, and maintenance of scalable batch and real-time data processing pipelines.Proficiency with Google Cloud Platform (GCP) and tools...

Senior Big Data Engineer

2 months ago

Irving TX United States Anblicks Full time

Description:

The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.


Responsibilities:

  • Responsible for design and development of big data solutions. Partner with domain experts, product managers, analyst, and data scientists to develop Big Data pipelines in Hadoop
  • Responsible for moving all legacy workloads to cloud platform
  • Work with data scientist to build Client pipelines using heterogeneous sources and provide engineering services for data science applications
  • Ensure automation through CI/CD across platforms both in cloud and on-premises
  • Define needs around maintainability, testability, performance, security, quality and usability for data platform
  • Drive implementation, consistent patterns, reusable components, and coding standards for data engineering processes
  • Convert SAS based pipelines into languages like PySpark, Scala to execute on Hadoop and non-Hadoop ecosystems
  • Tune Big data applications on Hadoop and non-Hadoop platforms for optimal performance
  • Evaluate new IT developments and evolving business requirements and recommend appropriate systems alternatives and/or enhancements to current systems by analyzing business processes, systems and industry standards.
  • Applies in-depth understanding of how data analytics collectively integrate within the sub-function as well as coordinates and contributes to the objectives of the entire function.
  • Produces detailed analysis of issues where the best course of action is not evident from the information available, but actions must be recommended/taken.
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

  • 8+ years of total IT experience
  • 5+ years of experience with Hadoop (Cloudera)/big data technologies
  • Advanced knowledge of the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
  • Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python.
  • Experience with Spark programming (pyspark or scala or java)
  • Expert level building pipelines using Apache Spark Familiarity with core provider services from AWS, Azure or GCP, preferably having supported deployments on one or more of these platforms
  • Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;
  • Exposure to containerization and related technologies (e.g. Docker, Kubernetes)
  • Exposure to aspects of DevOps (source control, continuous integration, deployments, etc.)
  • Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus.
  • System level understanding - Data structures, algorithms, distributed storage & compute
  • Can-do attitude on solving complex business problems, good interpersonal and teamwork skills
  • Possess team management experience and have led a team of data engineers and analysts.
  • Experience in Snowflake is a plus.

Education:

  • Bachelor’s degree/University degree or equivalent experience