Data engineer

3 weeks ago

Cary, United States eTeam Full time
Job Title :- Data engineer (10+ years candidate required)
Job Location :- Remote

Job Description :-

LinkedIn is Mandatory

Description:-

  • Bachelors degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent field of study required
  • 7+ years of experience in working with data solutions.
  • 3+ years of experience coding in Python, or Scala or similar scripting language.
  • 3+ years of experience in developing data pipelines in AWS Cloud Platform (preferred), Azure, or Snowflake at scale.
  • 2+ years Experience in designing and implementing data ingestion with real-time data streaming tools like Kafka, Kinesis or any similar tools.SAP/Client or other cloud integrations are preferred.
  • 3+ years experience working with MPP databases such as Snowflake (Preferred) , Redshift or similar MPP databases.
  • 2+ years experience working with Serverless ETL processes (Lambda, AWS Glue, Matillion or similar)
  • 1+ years experience with big data technologies like EMR, Hadoop, Spark, Cassandra, MongoDB or other open source big data tools.
  • Knowledge of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Experience designing, documenting, and defending designs for key components in large distributed computing systems
  • Demonstrated ability to learn new technologies quickly and independently
  • Demonstrated ability to achieve stretch goals in a very innovative and fast paced environment
  • Ability to handle multiple competing priorities in a fast-paced environment
  • Excellent verbal and written communication skills, especially in technical communications
  • Strong interpersonal skills and a desire to work collaboratively
Experience participating in an Agile software development team, e.g. SCRUM

Job Responsibilities :
  • Responsible for the building, deployment, and maintenance of critical scalable Data Pipelines to assemble large, complex sets of data that meet non-functional and functional business requirements
  • Work closely with SMEs, Data Modeler, Architects, Analysts and other team members on requirements to build scalable real time/near real time/batch data solutions.
  • Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading into Data Lake/Cloud Data Warehouse/MPP (Snowflake/Redshift/similar Technologies ) .
  • Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platforms quality, robustness, maintainability, and speed.
  • Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members.
  • Interacts with technical teams across and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
  • Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions.
  • Keep up with current trends in big data and Analytics , evaluate tools and pace yourself for innovation.

Mentor Junior engineers ,create necessary documentation and Run-books while still being able to deliver on goals

  • Azure Data Engineer

    1 week ago

    Cary, United States Tata Consultancy Services Full time

    Role: Azure Data Engineer Type : Full time Location : Cary, North Carolina, United States- onsite Roles & Responsibilities :Data EngineeringData pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPEData automation / processing using lensData pipeline automation using ADFData Engineering supportData Preparation, Exploration and...

  • Azure Data Engineer

    1 week ago

    Cary, United States Tata Consultancy Services Full time

    Role: Azure Data Engineer Type : Full time Location : Cary, North Carolina, United States- onsite Roles & Responsibilities :Data EngineeringData pipeline development using COSMOS / SCOPE, On demand data pull using COSMOS / SCOPEData automation / processing using lensData pipeline automation using ADFData Engineering supportData Preparation, Exploration and...

  • Azure Data Engineer

    7 days ago

    Cary, United States Tata Consultancy Services Full time

    #LI-CM2 Technical/Functional Skills 1. Bachelor's degree in Computer Science, Engineering, or related field.2. Proven experience as a data engineer or similar role, with a focus on Microsoft SQL Server, Azure, and related technologies.3. Strong proficiency in Microsoft SSIS, SSAS, and SSRS for data integration, analysis, and reporting.4. Hands-on experience...

  • Azure Data Engineer

    2 weeks ago

    Cary, United States Tata Consultancy Services Full time

    Technical/Functional Skills Bachelor's degree in Computer Science, Engineering, or related field.Proven experience as a data engineer or similar role, with a focus on Microsoft SQL Server, Azure, and related technologies.Strong proficiency in Microsoft SSIS, SSAS, and SSRS for data integration, analysis, and reporting.Hands-on experience with Azure cloud...

  • Azure Data Engineer

    2 weeks ago

    Cary, United States Tata Consultancy Services Full time

    Technical/Functional Skills Bachelor's degree in Computer Science, Engineering, or related field.Proven experience as a data engineer or similar role, with a focus on Microsoft SQL Server, Azure, and related technologies.Strong proficiency in Microsoft SSIS, SSAS, and SSRS for data integration, analysis, and reporting.Hands-on experience with Azure cloud...

  • AI Cloud Data Engineer

    4 days ago

    Cary, United States MetLife Full time

    AI Cloud Data Engineer General Information City/Cities Cary State(s) North Carolina Country United States Working Schedule Full-Time Work Arrangement Hybrid Relocation Assistance Available No Posted Date 08-Mar-2024 Job ID 1651 Description and Requirements Role Value Proposition: MetLife Data & Analytics organization is the team of expert technologists...

  • AI Cloud Data Engineer

    4 days ago

    Cary, United States MetLife Services and Solutions, LLC Full time

    Description and Requirements Role Value Proposition: MetLife Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable MetLife businesses to generate insights, and value to its customers. The team is the center of excellence in data engineering in...

  • Big Data Engineering Technical Lead

    2 weeks ago

    Cary, United States eTeam Full time

    Big Data Spark, Kafka, Databricks, Hive, Nifi WS, Java, Scal 10+ yrs experience as Data Engineer Extensive experience in spark on data processing Kafka design experience like monitoring & parallelism. Comfortable with Python/Java/Scala coding experience Crisp / clear cut communication Flexible with learning new technology Flink experience is a plus WS...

  • Solution Train Engineer

    7 days ago

    Cary, United States MetLife Full time

    Description and Requirements Role Value Proposition: This role is for Solution Train Engineer (STE) for Data Migrations Solutions. The STE guides the scrum teams to manage and optimize the flow of value for its customers. As a Solution Train Engineer (STE) for our Data Migration Initiative, you will play a pivotal role in orchestrating and driving the...

  • Product Engineer, Data Focus

    2 weeks ago

    Cary, United States Cielo Projects Full time

    Company DescriptionCornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel.At Cornerstone Building Brands we provide our residential and commercial customers with a comprehensive portfolio of products and solutions, when and where they need it. As a trusted...

  • Product Engineer, Data Focus

    2 weeks ago

    Cary, United States Cornerstone Building Brands Full time

    Job Description The Product Data Engineer position is an integral addition to our Product Data and Engineering team. The individual who accepts this role will have the opportunity to work directly with our Window and Door products as well as collaborate across all of Cornerstone Building Brands. This role will focus on transforming our product data and data...

  • Product Engineer, Data Focus

    2 weeks ago

    Cary, United States Cielo Projects Full time

    Company DescriptionCornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel. At Cornerstone Building Brands we provide our residential and commercial customers with a comprehensive portfolio of products and solutions, when and where they need it. As a trusted...

  • Product Engineer, Data Focus

    5 days ago

    Cary, United States Cornerstone Building Brands Full time

    Job DescriptionJob DescriptionCompany DescriptionCornerstone Building Brands is hiring a Product Engineer, Data Focus. The candidate must be located within the US and can work remotely, with some travel.At Cornerstone Building Brands we provide our residential and commercial customers with a comprehensive portfolio of products and solutions, when and where...

  • Senior Data Analyst

    16 hours ago

    Cary, North Carolina, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic's success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it's building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we're always innovating.Being Epic means being a...

  • Senior Data Scientist

    19 hours ago

    Cary, North Carolina, United States Epic Games Full time

    WHAT MAKES US EPIC?At the core of Epic's success are talented, passionate people. Epic prides itself on creating a collaborative, welcoming, and creative environment. Whether it's building award-winning games or crafting engine technology that enables others to make visually stunning interactive experiences, we're always innovating.Being Epic means being a...

  • Master Data Manager

    3 weeks ago

    Cary, United States Omada Search Full time

    The Global Master Data Manager leads the development and management of master data and its related processes. This role will be responsible for improving the quality and protecting sensitive data and information assets. This position will be the global process owner for master data management processes. It will lead the strategic and operational definition,...

  • Master Data Manager

    3 weeks ago

    Cary, United States Omada Search Full time

    Job DescriptionJob DescriptionThe Global Master Data Manager leads the development and management of master data and its related processes. This role will be responsible for improving the quality and protecting sensitive data and information assets. This position will be the global process owner for master data management processes. It will lead the...

  • Master Data Manager

    3 weeks ago

    Cary, United States Omada Search Full time

    The Global Master Data Manager leads the development and management of master data and its related processes. This role will be responsible for improving the quality and protecting sensitive data and information assets. This position will be the global process owner for master data management processes. It will lead the strategic and operational definition,...

  • Data Modernization Product Owner

    4 days ago

    Cary, United States MetLife Services and Solutions, LLC Full time

    Description and Requirements Role Value Proposition: We are seeking a highly motivated and experienced Data Modernization Product Owner to join our team. The ideal candidate will have a strong background in data management, modernization strategies and product ownership. Responsibility: Delivery As the Data Modernization Product Owner, you will play...

  • SQL/Data Architect

    2 weeks ago

    Cary, United States eTeam Full time

    Note from customer 1. Strong SQL Experience 2. Experience in Performance Tuning and update low performance queries to improve performance 3. Understand and fix bottle necks in the system SQL DBA/Architect Skills/Qualifications: Write and groom stories to define, estimate, and track work; dvocate for the right tools for the task at hand; Write...