Senior Data Engineer

2 months ago

dallas, United States Anblicks Full time

The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in a collaborative and agile environment.

Responsibilities:

Responsible for design and development of big data solutions. Partner with domain experts, product managers, analyst, and data scientists to develop Big Data pipelines in Hadoop

Responsible for moving all legacy workloads to cloud platform

Work with data scientist to build Client pipelines using heterogeneous sources and provide engineering services for data science applications

Ensure automation through CI/CD across platforms both in cloud and on-premises

Define needs around maintainability, testability, performance, security, quality and usability for data platform

Drive implementation, consistent patterns, reusable components, and coding standards for data engineering processes

Convert SAS based pipelines into languages like PySpark, Scala to execute on Hadoop and non-Hadoop ecosystems

Tune Big data applications on Hadoop and non-Hadoop platforms for optimal performance

Evaluate new IT developments and evolving business requirements and recommend appropriate systems alternatives and/or enhancements to current systems by analyzing business processes, systems and industry standards.

Applies in-depth understanding of how data analytics collectively integrate within the sub-function as well as coordinates and contributes to the objectives of the entire function.

Produces detailed analysis of issues where the best course of action is not evident from the information available, but actions must be recommended/taken.

Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

8+ years of total IT experience

5+ years of experience with Hadoop (Cloudera)/big data technologies

Advanced knowledge of the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)

Experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python.

Experience with Spark programming (pyspark or scala or java)

Expert level building pipelines using Apache Spark Familiarity with core provider services from AWS, Azure or GCP, preferably having supported deployments on one or more of these platforms

Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;

Exposure to containerization and related technologies (e.g. Docker, Kubernetes)

Exposure to aspects of DevOps (source control, continuous integration, deployments, etc.)

Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus.

System level understanding - Data structures, algorithms, distributed storage & compute

Can-do attitude on solving complex business problems, good interpersonal and teamwork skills

Possess team management experience and have led a team of data engineers and analysts.

Experience in Snowflake is a plus.

Education:

Bachelor’s degree/University degree or equivalent experience

  • Senior Data Solutions Engineer

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    Job OverviewWe are seeking a seasoned Senior Data Solutions Engineer to lead the development and deployment of cutting-edge data solutions at Axis Data.This role requires strong technical expertise in Palantir Foundry, SQL, and Python, as well as exceptional client engagement and problem-solving skills.ResponsibilitiesData Pipeline Development: Design,...

  • Senior Data Solutions Engineer

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at Axis Data. As a key member of our team, you will be responsible for designing and delivering comprehensive data solutions tailored to our clients' specific business needs.About the RoleThis is an excellent opportunity for recent graduates or early-career professionals who are...

  • Senior Data Consultant

    2 weeks ago

    Dallas, Texas, United States Axis Data Full time

    Senior Data ConsultantAxis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry.About the PositionWe are seeking an experienced Senior Data Consultant to join our team. As a Senior Data Consultant, you...

  • Data Engineering Consultant

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    Job Title: Data Engineering ConsultantDescription:We are seeking a highly skilled Data Engineering Consultant to join our team at Axis Data. As a Data Engineering Consultant, you will be responsible for designing and implementing comprehensive data solutions tailored to the specific business needs of our clients. This role is an excellent opportunity for...

  • Data Engineer: Design and Deliver Data Solutions

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    At Axis Data, a US-based advanced data engineering and analytics consulting firm, we're looking for a talented Data Engineer to collaborate with clients in designing and delivering comprehensive data solutions tailored to their specific business needs.We're an excellent opportunity for recent graduates or early-career professionals passionate about data and...

  • Lead Data Solutions Engineer

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    As a Senior Data Engineer at Axis Data, you will lead the development and deployment of data solutions leveraging your expertise in Palantir Foundry and data engineering. This position requires strong technical skills client engagement and a proactive approach to problem-solving.Key Responsibilities:Data Pipeline Development: Design develop and optimize data...

  • Senior Data Engineer

    3 weeks ago

    Dallas, United States Coforge Full time

    Job Title: Senior Data EngineerSkills: Data Architecture, Snowflake, ETL, Data Transformation, Data Build Tool, SQL, Data IntegrationExperience: 12+ yearsJob Location: Dallas, TXFTE/ HybridWe at Coforge are hiring Senior Data Engineer with the following skillset:10 years of Data engineering/Architecture experience with good exposure to snowflake and...

  • Senior Data Engineering Specialist

    7 days ago

    Dallas, Texas, United States Jacobs Full time

    Job Title:Senior Data Engineering SpecialistEstimated Salary:$140,000 - $170,000 per yearOverview:Jacobs is a leading provider of data analytics solutions. We are seeking a highly skilled Senior Data Engineering Specialist to lead our data engineering projects and develop scalable data pipelines.About the Role:We are looking for a creative and versatile...

  • Data Engineering Solutions Leader

    2 weeks ago

    Dallas, Texas, United States Axis Data Full time

    Data Engineering Solutions LeaderAxis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry.About the RoleWe are seeking an experienced Data Engineering Solutions Leader to join our team. In this role,...

  • Senior Data Engineer

    1 month ago

    Dallas, United States InfoVision Inc. Full time

    Senior Data EngineerDallas, TXLong term contractJob Description:We are looking for a Data Engineer to join our Advanced Analytics team under the Wholesale organization. This engineer will design and deliver data solutions for the analytics and data science teams in the consumer organization. The engineer will be able to work with all types of interesting...

  • Data Insights Analyst

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    We are seeking a highly skilled Data Insights Analyst to join our team at Axis Data.Company OverviewAxis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry.Job DescriptionAs a Data Insights Analyst,...

  • Data Engineering Solutions Leader

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    Job Title: Data Engineering Solutions LeaderAbout Axis Data:A US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry.Role Overview:As a Data Engineering Solutions Leader at Axis Data, you will lead the engagement...

  • Technical Data Consultant

    2 weeks ago

    Dallas, Texas, United States Axis Data Full time

    We are looking for a talented Technical Data Consultant to join our team at Axis Data.Job DescriptionAs a Technical Data Consultant, you will collaborate with clients to design and deliver comprehensive data solutions tailored to their specific business needs. This role is an excellent opportunity for recent graduates or early-career professionals who are...

  • Senior Data Engineer

    2 weeks ago

    Dallas, Texas, United States Georgia IT Inc Full time

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team at Georgia IT Inc. as part of our Data Engineering department in Dallas, Texas. The successful candidate will be responsible for designing and implementing scalable data pipelines, ensuring data quality and integrity, and collaborating with cross-functional...

  • Data Analytics Consultant

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    Data Analysis and LeadershipWe are looking for a seasoned Senior Business Data Analyst who can provide technical leadership and troubleshoot complex data-related issues. As a member of our team, you will contribute to the strategic planning and development of data engineering practices at Axis Data.Your strong problem-solving skills and strategic mindset...

  • Technical Project Manager

    2 weeks ago

    Dallas, Texas, United States Axis Data Full time

    Job Title: Technical Project Manager - Data EngineeringAbout Us:Axis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry.Job Description:As a Technical Project Manager - Data Engineering at Axis Data,...

  • Business Data Specialist

    1 week ago

    Dallas, Texas, United States Axis Data Full time

    Job Title: Senior Business Intelligence ProfessionalCompany Overview: Axis Data is a US-based advanced data engineering and analytics consulting firm, and a certified partner of Palantir. We help clients implement and support the most advanced data operations platform: Palantir Foundry.Salary: $80,000 - $100,000 per year (depending on experience)Job...

  • Senior Data Engineer

    5 months ago

    Dallas, United States Saviance Full time

    Job Title-Senior Data Engineer Location: Remote Duration: 6 Months Contract to Hire (Quarterly Onsite for a few days in Dallas TX) About BigRio: BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine Learning, and Custom Software strategy, analysis,...

  • Coforge | Senior Data Engineer

    3 weeks ago

    dallas, United States Coforge Full time

    Job Title: Senior Data EngineerSkills: Data Architecture, Snowflake, ETL, Data Transformation, Data Build Tool, SQL, Data IntegrationExperience: 12+ yearsJob Location: Dallas, TXFTE/ HybridWe at Coforge are hiring Senior Data Engineer with the following skillset:10 years of Data engineering/Architecture experience with good exposure to snowflake and...

  • Senior Software Engineer

    2 weeks ago

    Dallas, Texas, United States Diverse Lynx Full time

    Senior Software Engineer - DataWe are seeking an experienced Senior Software Engineer - Data to join our team at Diverse Lynx LLC. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining data pipelines that ensure seamless integration between on-premises and cloud-based environments.Your expertise in...