Big Data Developer

2 months ago

Dallas, United States Anblicks Full time

JOB Description

Role: Big Data Engineer

Location : Dallas, TX

Relocation : Need to be onsite to work Hybrid


Job Role Responsibilities:


Integral team member of our Data Engineering team responsible for design and development of Big data solutions Partner with domain experts, product managers, analyst, and data scientists to develop Big Data pipelines in Hadoop or Snowflake Responsible for delivering data as a service framework

Responsible for moving all legacy workloads to cloud platform

Work with data scientist to build Client pipelines using heterogeneous sources and provide engineering services for data science applications

Ensure automation through CI/CD across platforms both in cloud and on-premises

Ability to research and assess open source technologies and components to recommend and integrate into the design and implementation

Be the technical expert and mentor other team members on Big Data and Cloud Tech stacks

Define needs around maintainability, testability, performance, security, quality and usability for data platform

Drive implementation, consistent patterns, reusable components, and coding standards for data engineering processes

Convert SAS based pipelines into languages like PySpark, Scala to execute on Hadoop and non-Hadoop ecosystems


Qualifications:

8+ years of experience in Hadoop/big data technologies.

3+ years of experience in spark.

2+ years’ experience in Snowflake

2+ year of experience working on Google or AWS cloud developing data solutions. Certifications preferred.

Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;

Experience with containerization and related technologies (e.g. Docker, Kubernetes)

Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)

1 year Hadoop administration experience preferred

1+ year of SAS experience preferred.

Comprehensive knowledge of the principles of software engineering and data analytics

Advanced knowledge of the Hadoop ecosystem and Big Data technologies Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)

Knowledge of agile (scrum) development methodology is a plus

Strong development/automation skills

Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus.

System level understanding - Data structures, algorithms, distributed storage & compute

Can-do attitude on solving complex business problems, good interpersonal and teamwork skills

  • Big Data Developer

    4 weeks ago

    Dallas, Texas, United States Anblicks Full time

    Job Title: Big Data DeveloperAt Anblicks, we are seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing and developing big data solutions using next-generation data techniques.Key Responsibilities:Design and develop big data solutions using Hadoop and other big data technologies.Partner...

  • Big Data Developer

    4 days ago

    Dallas, Texas, United States Anblicks Full time

    Data Engineer - Hadoop and Cloud ExpertAt Anblicks, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing big data solutions using next-generation data techniques. You will work closely with product owners, customers, and technologists to deliver data products/solutions in a...

  • Big Data Developer

    4 weeks ago

    Dallas, United States Anblicks Full time

    Job title : Big Data Engineer (Python, Pyspark)Location : Dallas, TexasJob Type: FulltimeWork type : Hybrid Data Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions...

  • Big Data Developer

    1 day ago

    dallas, United States Anblicks Full time

    Job title : Big Data Engineer (Python, Pyspark)Location : Dallas, TexasJob Type: FulltimeWork type : HybridData Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in...

  • Big Data Developer

    22 hours ago

    dallas, United States Anblicks Full time

    Job title : Big Data Engineer (Python, Pyspark)Location : Dallas, TexasJob Type: FulltimeWork type : HybridData Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in...

  • Big Data Developer

    3 weeks ago

    Dallas, United States Anblicks Full time

    Job title : Big Data Engineer (Python, Pyspark)Location : Dallas, TexasJob Type: FulltimeWork type : HybridData Engineer: The Data Engineer is responsible for building Data Engineering Solutions using next generation data techniques. The individual will be working directly with product owners, customers and technologists to deliver data products/solutions in...

  • Big Data Developer

    2 months ago

    Dallas, Texas, United States Anblicks Full time

    Job Title: Big Data DeveloperLocation: Dallas, TexasJob Type: Hybrid• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL, Hive queries, APIs to extract data from the store• Work closely with data...

  • Big Data Developer

    1 month ago

    Dallas, United States Anblicks Full time

    Role: Big Data EngineerLocation : Dallas, TexasJob Type: Hybrid• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL , Hive queries, APIs to extract data from the store• Work closely with data...

  • Big Data Developer

    2 months ago

    dallas, United States Anblicks Full time

    Role: Big Data EngineerLocation : Dallas, TexasJob Type: Hybrid• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL , Hive queries, APIs to extract data from the store• Work closely with data...

  • Big Data Developer

    2 months ago

    dallas, United States Anblicks Full time

    Role: Big Data EngineerLocation : Dallas, TexasJob Type: Hybrid• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL , Hive queries, APIs to extract data from the store• Work closely with data...

  • Big Data Developer

    2 months ago

    Dallas, United States Anblicks Full time

    Role: Big Data EngineerLocation : Dallas, TexasJob Type: Hybrid• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL , Hive queries, APIs to extract data from the store• Work closely with data...

  • Big Data Spark Developer

    2 months ago

    Dallas, United States Hexaware Technologies Full time

    What Working at Hexaware offers:Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member is valued and empowered to succeed.Hexaware provides access to a vast array of tools that enhance,...

  • Big Data Spark Developer

    2 months ago

    Dallas, United States Hexaware Technologies Full time

    What Working at Hexaware offers:Hexaware is a dynamic and innovative IT organization committed to delivering cutting-edge solutions to our clients worldwide. We pride ourselves on fostering a collaborative and inclusive work environment where every team member is valued and empowered to succeed.Hexaware provides access to a vast array of tools that enhance,...

  • Big Data Engineer

    2 weeks ago

    Dallas, Texas, United States Anblicks Full time

    Job Title: Big Data DeveloperAt Anblicks, we are seeking a highly skilled Big Data Developer to join our team.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from different data sourcesDesign and develop methods to filter and cleanse the dataDesign and develop SQL, Hive queries, and APIs...

  • Senior Python Developer for Big Data Analytics

    1 month ago

    Dallas, Texas, United States Synechron Full time

    About the RoleWe are seeking a highly skilled Senior Python Developer to join our team in Dallas, TX / Pittsburgh, PA. As a key member of our data science team, you will be responsible for developing and maintaining data processing pipelines using PySpark for large-scale data processing and analytics.Key ResponsibilitiesDesign and implement efficient data...

  • Big Data Solutions Architect

    2 weeks ago

    Dallas, Texas, United States Anblicks Full time

    Job Title: Big Data DeveloperAt Anblicks, we are seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing and developing big data solutions using next-generation data techniques.Key Responsibilities:Design and develop big data solutions using Hadoop and other big data technologies.Partner...

  • Big Data Engineer

    3 weeks ago

    Dallas, Texas, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Amazon. As a key member of our Data Engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems that support our business operations.Your primary focus will be on developing and implementing data pipelines, data...

  • Senior Python Developer for Big Data Processing

    4 days ago

    Dallas, Texas, United States Synechron Full time

    We are seeking a highly skilled Senior Python Developer to lead our big data processing efforts. The ideal candidate will have a strong background in data analysis and a proven track record of delivering high-quality results.Key Responsibilities:Develop and maintain data processing pipelines using PySpark for large-scale data processing and analytics.Work...

  • Big Data Solution Architect

    4 weeks ago

    Dallas, Texas, United States V-Soft Consulting Group, Inc. Full time

    Big Data/Hadoop Solution ArchitectWe are seeking a highly skilled Big Data/Hadoop Solution Architect to join our team at V-Soft Consulting Group, Inc.The ideal candidate will have a strong background in data engineering, with at least 3 years of experience in architecture design and development. They will work closely with our development team to design and...

  • Big Data Engineer

    7 days ago

    Dallas, Texas, United States CloudBC Labs Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer to join our team at CloudBC Labs. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Google Cloud technologies.Key Responsibilities- Design and implement data pipelines using Google Cloud...