Big Data Developer

4 weeks ago


Dallas, Texas, United States Anblicks Full time
Data Engineer - Hadoop and Cloud Expert

At Anblicks, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing big data solutions using next-generation data techniques. You will work closely with product owners, customers, and technologists to deliver data products/solutions in a collaborative and agile environment.

Responsibilities:
• Design and develop big data solutions using Hadoop and cloud platforms
• Partner with domain experts, product managers, analysts, and data scientists to develop big data pipelines
• Move legacy workloads to cloud platforms
• Work with data scientists to build client pipelines using heterogeneous sources and provide engineering services for data science applications
• Ensure automation through CI/CD across platforms both in cloud and on-premises
• Define needs around maintainability, testability, performance, security, quality, and usability for data platforms
• Drive implementation, consistent patterns, reusable components, and coding standards for data engineering processes
• Convert SAS-based pipelines into languages like PySpark, Scala, and execute on Hadoop and non-Hadoop ecosystems
• Tune big data applications on Hadoop and non-Hadoop platforms for optimal performance
• Evaluate new IT developments and evolving business requirements and recommend appropriate systems alternatives and/or enhancements to current systems

Qualifications:
• 8+ years of total IT experience
• 5+ years of experience with Hadoop and big data technologies
• Advanced knowledge of the Hadoop ecosystem and big data technologies
• Hands-on experience with the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
• Experience designing and developing data pipelines for data ingestion or transformation using Java, Scala, or Python
• Experience with Spark programming (PySpark, Scala, or Java)
• Expert-level building pipelines using Apache Spark
• Familiarity with core provider services from AWS, Azure, or GCP, preferably having supported deployments on one or more of these platforms
• Hands-on experience with Python, PySpark, Scala, and basic libraries for machine learning
• Exposure to containerization and related technologies (e.g., Docker, Kubernetes)
• Exposure to aspects of DevOps (source control, continuous integration, deployments, etc.)
• Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus
• System-level understanding - data structures, algorithms, distributed storage & compute
• Can-do attitude on solving complex business problems, good interpersonal and teamwork skills
• Possess team management experience and have led a team of data engineers and analysts
• Experience in Snowflake is a plus

Education:
Bachelor's degree/University degree or equivalent experience

  • Dallas, Texas, United States Synechron Full time

    We are seeking a highly skilled Senior Python Developer to lead our big data processing efforts. The ideal candidate will have a strong background in data analysis and a proven track record of delivering high-quality results.Key Responsibilities:Develop and maintain data processing pipelines using PySpark for large-scale data processing and analytics.Work...

  • Big Data Engineer

    4 weeks ago


    Dallas, Texas, United States CloudBC Labs Full time

    Job SummaryWe are seeking a highly skilled Big Data Engineer to join our team at CloudBC Labs. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Google Cloud technologies.Key Responsibilities- Design and implement data pipelines using Google Cloud...

  • Big Data Engineer

    4 weeks ago


    Dallas, Texas, United States Tekfortune Inc Full time

    Job Title: Hadoop DeveloperJob Description:We are seeking a highly skilled Hadoop Developer to join our team at Tekfortune Inc. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key Responsibilities:Design and develop Hadoop-based data processing...


  • Dallas, Texas, United States Anblicks Full time

    Job Title: Big Data and Analytics EngineerJob Summary:Analyze and understand data sources & APIsDesign and Develop methods to connect & collect data from different data sourcesDesign and Develop methods to filter/cleanse the dataDesign and Develop SQL , Hive queries, APIs to extract data from the storeWork closely with data Scientists to ensure the source...


  • Dallas, Texas, United States System One Full time

    Job SummaryWe are seeking a highly skilled Data Processing and Analytics Expert to join our team at System One. As a key member of our big data infrastructure team, you will be responsible for providing production support for tier 1 applications and enterprise platforms.Key ResponsibilitiesWork across multiple clusters supporting multi-tiered applications in...


  • Dallas, Texas, United States Big Thought Full time

    About the Role:The Director of Development and Fundraising will work closely with the Chief Development Officer to implement a strategy for sustainable fundraising for Big Thought. This individual will develop and manage a portfolio of philanthropic supporters and prospects who power the organization's mission and vision.About Big Thought:Big Thought equips...

  • Data Engineer

    1 month ago


    Dallas, Texas, United States NTT DATA Full time

    Job SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...

  • Data Engineer

    4 weeks ago


    Dallas, Texas, United States Axis Data Full time

    Job OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key Responsibilities:Collaborate with senior engineers and clients to understand data requirements and...

  • Big Data Engineer

    4 weeks ago


    Dallas, Texas, United States enwidth Full time

    Job Requirements:We are seeking a highly skilled Data Architecture Specialist to join our team at enwidth. The ideal candidate will have a strong background in programming languages such as Java, Scala, and Python, with a minimum of 3+ years of experience.Key Responsibilities:Develop and implement data architecture solutions using Hadoop Spark and...

  • Data Engineer

    4 weeks ago


    Dallas, Texas, United States Capgemini Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Sogeti, a leading provider of professional technology services. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines that deliver timely and accurate data to our cross-functional teams.Key ResponsibilitiesPartner with Product and...


  • Dallas, Texas, United States Data Axle Full time

    Job SummaryData Axle is seeking a highly experienced Principal Data Engineer to lead the design, implementation, and optimization of our modern data architecture.This role requires a strong background in data engineering, expertise in Python and SQL programming, and a passion for creating scalable solutions to support business needs.The ideal candidate will...


  • Dallas, Texas, United States NTT DATA Full time

    Job DescriptionReq ID: 283121 NTT DATA Services is seeking a highly analytical and financially astute Corporate Development Analyst to join its team in Dallas, Texas. The ideal candidate will possess a strong understanding of valuation methodologies and extensive experience in M&A, corporate development, or accounting.The successful candidate will develop...


  • Dallas, Texas, United States Photon Full time

    Job Title:PySpark Data EngineerWe are seeking a skilled PySpark Data Engineer to drive the development of robust data processing and transformation solutions within our data platform.You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate with...

  • Data Engineer Manager

    1 month ago


    Dallas, Texas, United States evolv consulting Full time

    Job SummaryWe are seeking a highly skilled Data Engineer Manager to lead the design and implementation of scalable big data platforms and solutions. The ideal candidate will have a proven track record of delivering big data solutions and a strong understanding of data formats, consensus management systems, and distributed caching.Key Responsibilities Lead...

  • Senior Data Engineer

    4 weeks ago


    Dallas, Texas, United States tlnt Full time

    Job OverviewWe are seeking a highly experienced Senior Data Engineer to join our team. The ideal candidate will have 5+ years of expertise in Azure data engineering and be proficient in tools and technologies like Pyspark, Azure Data Factory (ADF), Databricks, big data technologies, SQL, and Python.Key ResponsibilitiesDesign, build, and maintain data...


  • Dallas, Texas, United States Amazon Full time

    About the RoleWe are seeking a highly skilled Software Development Engineer to join our SMGS Data Platform team at Amazon. As a member of this team, you will play a key role in shaping the direction of our business and building innovative solutions using native AWS services and frameworks.Key ResponsibilitiesDesign and develop scalable platforms that enable...


  • Dallas, Texas, United States NTT DATA Full time

    Job Title: Senior Android DeveloperWe are seeking a highly skilled Senior Android Developer to join our Application Engineering team at NTT DATA. As a Senior mobile engineer, you will be responsible for designing, developing, and maintaining high-quality mobile applications on the Android platform.Responsibilities:Design, develop, and maintain mobile...

  • Data Architect

    3 weeks ago


    Dallas, Texas, United States Clinicapro Full time

    About ClinicaproClinicapro is a leading provider of innovative data solutions. We are committed to helping our clients make informed decisions through data-driven insights.Key ResponsibilitiesDesign and develop scalable data pipelines to support data integration and analytics.Collaborate with data scientists and analysts to ensure data quality and...

  • Lead Data Architect

    4 weeks ago


    Dallas, Texas, United States Likewize Full time

    Job Title: Lead Data ArchitectAt Likewize, we are seeking a highly skilled Lead Data Architect to drive our data-driven decision-making initiatives. As a key member of our team, you will design, develop, and maintain a data platform that empowers teams with actionable insights.Key Responsibilities:Develop and execute a comprehensive data strategy aligned...


  • Dallas, Texas, United States Abode Techzone LLC Full time

    Job Title:Senior Cloud Data Engineer - Air flowLocation: RemoteProject Duration: 12 months ContractInterview: Three rounds of Video interviewJob Description :Primary Skills:Air Flow, Big Query, Data Proc , Spark), Hadoop. Lead the Team. E2E DeliverySecondary Skills:Java, Unix Scripts, Oozie, Google Cloud Big Query & Big Table, Google Data Proc, Google Data...