Big Data Solutions Architect

1 day ago


Dallas, Texas, United States Anblicks Full time
Job Title: Big Data Developer

At Anblicks, we are seeking a highly skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing and developing big data solutions using next-generation data techniques.

Key Responsibilities:
  • Design and develop big data solutions using Hadoop and other big data technologies.
  • Partner with domain experts, product managers, analysts, and data scientists to develop big data pipelines in Hadoop.
  • Responsible for moving all legacy workloads to cloud platforms.
  • Work with data scientists to build client pipelines using heterogeneous sources and provide engineering services for data science applications.
  • Ensure automation through CI/CD across platforms both in cloud and on-premises.
  • Define needs around maintainability, testability, performance, security, quality, and usability for data platforms.
  • Drive implementation, consistent patterns, reusable components, and coding standards for data engineering processes.
  • Convert SAS-based pipelines into languages like PySpark, Scala to execute on Hadoop and non-Hadoop ecosystems.
  • Tune big data applications on Hadoop and non-Hadoop platforms for optimal performance.
  • Evaluate new IT developments and evolving business requirements and recommend appropriate systems alternatives and/or enhancements to current systems by analyzing business processes, systems, and industry standards.
  • Apply in-depth understanding of how data analytics collectively integrate within the sub-function as well as coordinates and contributes to the objectives of the entire function.
  • Produce detailed analysis of issues where the best course of action is not evident from the information available, but actions must be recommended/taken.
  • Assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding client, its clients, and assets, by driving compliance with applicable laws, rules, and regulations, adhering to policy, applying sound ethical judgment regarding personal behavior, conduct, and business practices, and escalating, managing, and reporting control issues with transparency.
Qualifications:
  • 8+ years of total IT experience.
  • 5+ years of experience with Hadoop (Cloudera)/big data technologies.
  • Advanced knowledge of the Hadoop ecosystem and big data technologies.
  • Hands-on experience with the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr).
  • Experience on designing and developing data pipelines for data ingestion or transformation using Java or Scala or Python.
  • Experience with Spark programming (PySpark or Scala or Java).
  • Expert-level building pipelines using Apache Spark.
  • Familiarity with core provider services from AWS, Azure, or GCP, preferably having supported deployments on one or more of these platforms.
  • Hands-on experience with Python/PySpark/Scala and basic libraries for machine learning is required.
  • Exposure to containerization and related technologies (e.g., Docker, Kubernetes).
  • Exposure to aspects of DevOps (source control, continuous integration, deployments, etc.).
  • Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus.
  • System-level understanding - data structures, algorithms, distributed storage & compute.
  • Can-do attitude on solving complex business problems, good interpersonal and teamwork skills.
  • Possess team management experience and have led a team of data engineers and analysts.
  • Experience in Snowflake is a plus.
Education:
  • Bachelor's degree/University degree or equivalent experience.


  • Dallas, Texas, United States V-Soft Consulting Group, Inc. Full time

    Big Data/Hadoop Solution ArchitectWe are seeking a highly skilled Big Data/Hadoop Solution Architect to join our team at V-Soft Consulting Group, Inc.The ideal candidate will have a strong background in data engineering, with at least 3 years of experience in architecture design and development. They will work closely with our development team to design and...

  • Senior Data Architect

    4 weeks ago


    Dallas, Texas, United States Catapult Solutions Group Full time

    Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to join our team at Catapult Solutions Group. As a key member of our data management team, you will play a pivotal role in shaping the future of our data architecture initiatives.Your expertise will be crucial in developing and managing Data Governance and Master Data Management...

  • Big Data Engineer

    1 day ago


    Dallas, Texas, United States Anblicks Full time

    Job Title: Big Data DeveloperAt Anblicks, we are seeking a highly skilled Big Data Developer to join our team.Key Responsibilities:Analyze and understand data sources and APIsDesign and develop methods to connect and collect data from different data sourcesDesign and develop methods to filter and cleanse the dataDesign and develop SQL, Hive queries, and APIs...

  • Senior Data Architect

    14 hours ago


    Dallas, Texas, United States blueStone Staffing Solutions Full time

    Job SummaryWe are seeking a highly skilled Data Engineer Lead to join our team at blueStone Staffing Solutions. As a key member of our data engineering team, you will be responsible for designing, implementing, and operating stable, scalable, and highly performant data pipelines that cleanse, structure, and integrate disparate big data sets into a readable...

  • Big Data Engineer

    1 month ago


    Dallas, Texas, United States Anblicks Full time

    Role: Big Data EngineerLocation: Dallas, TexasJob Type: Hybrid• Collaborate with data scientists to design and develop data pipelines• Develop and implement data processing solutions using Hadoop, NoSQL, and Apache Spark• Work closely with cloud architects to design and implement robust cloud-based data architectures• Develop and maintain automated...


  • Dallas, Texas, United States Glow Networks Full time

    Job Title: Data Platform ArchitectGlow Networks is seeking an experienced Data Platform Architect to lead the design and implementation of scalable data solutions.Key Responsibilities:Design and implement data architectures that prioritize scalability, performance, and support for advanced analytics and data science workloads.Collaborate with Cloud...

  • Data Architect

    2 weeks ago


    Dallas, Texas, United States Mastech Digital Full time

    Job Title: Data ArchitectAt Mastech Digital, we are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a critical role in designing and managing data architectural solutions for multiple environments, including data warehouses, ODS, data replication/ETL, and data management initiatives.Key Responsibilities:Design and...

  • GCP Data Architect

    1 day ago


    Dallas, Texas, United States Avant Digital, Inc. Full time

    Job Title: GCP Data ArchitectJob Summary:We are seeking a highly experienced and passionate GCP Architect to join our team at Avant Digital, Inc. The ideal candidate will have a strong background in designing and implementing scalable and efficient data solutions on the Google Cloud Platform.Key Responsibilities:Architect and design end-to-end data solutions...

  • Data Architect

    2 days ago


    Dallas, Texas, United States Mastech Digital Full time

    Job Title: Senior Data ArchitectLocation: Dallas, TXDuration: 6+ monthsThe Senior Data Architect will design and manage Data Architectural solutions for multiple environments, including Data Warehouse, ODS, Data Replication/ETL, and Data Management initiatives. This expert role will work closely with Business, DBA, ETL, and Data Management teams to provide...


  • Dallas, Texas, United States Synechron Full time

    Job Title: Java Solution ArchitectWe are seeking an experienced Java Solution Architect to lead the development and implementation of robust and scalable solutions. The ideal candidate will play a critical role in guiding the technical direction of our projects, leveraging Java, Python, and Big Data technologies.Key Responsibilities:Lead a team of Java...


  • Dallas, Texas, United States o9 Solutions Full time

    About o9 SolutionsAt o9 Solutions, we're revolutionizing the way enterprises plan and make decisions. Our mission is to be the Most Valuable Platform (MVP) for businesses worldwide. With our AI-driven platform, the o9 Digital Brain, we're helping global enterprises unlock millions and billions of dollars in value leakage.Job DescriptionTechnical...

  • Senior Data Architect

    3 weeks ago


    Dallas, Texas, United States Mastech Digital Full time

    Job Title: Senior Data ArchitectWe are seeking a highly skilled Senior Data Architect to join our team at Mastech Digital. As a Senior Data Architect, you will be responsible for designing and implementing data architectures that meet the needs of our clients.Key Responsibilities:Establishing policies and procedures for data governanceEnsuring data decisions...


  • Dallas, Texas, United States InfoVision Inc. Full time

    Principal ArchitectInfoVision Inc. is seeking a highly skilled Principal Architect to lead the design and implementation of cloud-based solutions.Key Responsibilities:Design and implement end-to-end solutions on AWS or equivalent cloud solutions.Develop strong expertise in AWS services, SQL, and Non-SQL DBs, including MongoDB, BigQuery, Dataproc, Cloud...


  • Dallas, Texas, United States Resource Informatics Group Inc Full time

    Job OverviewResource Informatics Group Inc is seeking a highly skilled Senior Data Engineer to lead our data engineering and ETL projects. As a key member of our team, you will be responsible for architecting and developing ETL solutions, mentoring junior staff members, and ensuring development standards are maintained.Key Responsibilities:Manage and deliver...


  • Dallas, Texas, United States Glow Networks Full time

    Job OverviewGlow Networks is seeking a seasoned Data Platform Architect to spearhead the design and implementation of scalable data solutions. The ideal candidate will possess a strong background in data architecture, data integration, and data processing frameworks, with expertise in Databricks and a passion for optimizing diverse workloads.Key...

  • Big Data Developer

    1 month ago


    Dallas, Texas, United States Anblicks Full time

    Job Title: Big Data DeveloperLocation: Dallas, TexasJob Type: Hybrid• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and Develop SQL, Hive queries, APIs to extract data from the store• Work closely with data...

  • Senior Data Architect

    4 weeks ago


    Dallas, Texas, United States CES Limited Full time

    Job Title: Senior Data ArchitectCES Limited is seeking a highly skilled Senior Data Architect to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing data architectural solutions for multiple environments.Key Responsibilities:Design and manage data architectural solutions for multiple...

  • Data Architect

    1 day ago


    Dallas, Texas, United States Noblesoft Technologies Full time

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to join our team at Noblesoft Technologies. As a Data Architect, you will be responsible for designing and implementing data architectures that meet the business needs of our organization.Key Responsibilities:Design and implement data architectures that meet business requirementsDevelop...


  • Dallas, Texas, United States InfoVision Inc. Full time

    Principal ArchitectInfoVision Inc. is seeking a highly skilled Principal Architect to lead the design and implementation of end-to-end solutions on AWS or equivalent cloud solutions. The ideal candidate will have a strong expertise in AWS services, SQL and Non-SQL DB's, and experience in designing data models in cloud data warehouses.Key...

  • Senior Data Architect

    17 hours ago


    Dallas, Texas, United States Optimize Search Group Full time

    Job Title: Senior Data ArchitectDuration: Direct HireLocation: Dallas, TX (100% On-Site)We are seeking a highly skilled and experienced Senior Data Architect to join our dynamic team. The ideal candidate will have a strong background in data engineering, data warehousing, and cloud platforms. This role will involve leading the design and development of...