Big Data Developer
4 weeks ago
At Anblicks, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing big data solutions using next-generation data techniques. You will work closely with product owners, customers, and technologists to deliver data products/solutions in a collaborative and agile environment.
Responsibilities:
• Design and develop big data solutions using Hadoop and cloud platforms
• Partner with domain experts, product managers, analysts, and data scientists to develop big data pipelines
• Move legacy workloads to cloud platforms
• Work with data scientists to build client pipelines using heterogeneous sources and provide engineering services for data science applications
• Ensure automation through CI/CD across platforms both in cloud and on-premises
• Define needs around maintainability, testability, performance, security, quality, and usability for data platforms
• Drive implementation, consistent patterns, reusable components, and coding standards for data engineering processes
• Convert SAS-based pipelines into languages like PySpark, Scala, and execute on Hadoop and non-Hadoop ecosystems
• Tune big data applications on Hadoop and non-Hadoop platforms for optimal performance
• Evaluate new IT developments and evolving business requirements and recommend appropriate systems alternatives and/or enhancements to current systems
Qualifications:
• 8+ years of total IT experience
• 5+ years of experience with Hadoop and big data technologies
• Advanced knowledge of the Hadoop ecosystem and big data technologies
• Hands-on experience with the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
• Experience designing and developing data pipelines for data ingestion or transformation using Java, Scala, or Python
• Experience with Spark programming (PySpark, Scala, or Java)
• Expert-level building pipelines using Apache Spark
• Familiarity with core provider services from AWS, Azure, or GCP, preferably having supported deployments on one or more of these platforms
• Hands-on experience with Python, PySpark, Scala, and basic libraries for machine learning
• Exposure to containerization and related technologies (e.g., Docker, Kubernetes)
• Exposure to aspects of DevOps (source control, continuous integration, deployments, etc.)
• Proficient in programming in Java or Python with prior Apache Beam/Spark experience a plus
• System-level understanding - data structures, algorithms, distributed storage & compute
• Can-do attitude on solving complex business problems, good interpersonal and teamwork skills
• Possess team management experience and have led a team of data engineers and analysts
• Experience in Snowflake is a plus
Education:
Bachelor's degree/University degree or equivalent experience
-
Senior Python Developer for Big Data Processing
4 weeks ago
Dallas, Texas, United States Synechron Full timeWe are seeking a highly skilled Senior Python Developer to lead our big data processing efforts. The ideal candidate will have a strong background in data analysis and a proven track record of delivering high-quality results.Key Responsibilities:Develop and maintain data processing pipelines using PySpark for large-scale data processing and analytics.Work...
-
Big Data Engineer
4 weeks ago
Dallas, Texas, United States CloudBC Labs Full timeJob SummaryWe are seeking a highly skilled Big Data Engineer to join our team at CloudBC Labs. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Google Cloud technologies.Key Responsibilities- Design and implement data pipelines using Google Cloud...
-
Big Data Engineer
4 weeks ago
Dallas, Texas, United States Tekfortune Inc Full timeJob Title: Hadoop DeveloperJob Description:We are seeking a highly skilled Hadoop Developer to join our team at Tekfortune Inc. As a Hadoop Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and related technologies.Key Responsibilities:Design and develop Hadoop-based data processing...
-
Big Data and Analytics Engineer
3 weeks ago
Dallas, Texas, United States Anblicks Full timeJob Title: Big Data and Analytics EngineerJob Summary:Analyze and understand data sources & APIsDesign and Develop methods to connect & collect data from different data sourcesDesign and Develop methods to filter/cleanse the dataDesign and Develop SQL , Hive queries, APIs to extract data from the storeWork closely with data Scientists to ensure the source...
-
Big Data Infrastructure Specialist
4 weeks ago
Dallas, Texas, United States System One Full timeJob SummaryWe are seeking a highly skilled Data Processing and Analytics Expert to join our team at System One. As a key member of our big data infrastructure team, you will be responsible for providing production support for tier 1 applications and enterprise platforms.Key ResponsibilitiesWork across multiple clusters supporting multi-tiered applications in...
-
Director of Development and Fundraising
4 weeks ago
Dallas, Texas, United States Big Thought Full timeAbout the Role:The Director of Development and Fundraising will work closely with the Chief Development Officer to implement a strategy for sustainable fundraising for Big Thought. This individual will develop and manage a portfolio of philanthropic supporters and prospects who power the organization's mission and vision.About Big Thought:Big Thought equips...
-
Data Engineer
1 month ago
Dallas, Texas, United States NTT DATA Full timeJob SummaryNTT DATA Services is seeking a highly skilled Data Engineer to join our team in Dallas, Texas. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems to support our business operations.Key Responsibilities:Develop and maintain data pipelines to extract, transform, and load data from diverse...
-
Data Engineer
4 weeks ago
Dallas, Texas, United States Axis Data Full timeJob OverviewAxis Data is a leading provider of advanced data engineering and analytics consulting services. As a Data Engineer, you will play a key role in developing and implementing end-to-end data solutions that meet the unique needs of our clients.Key Responsibilities:Collaborate with senior engineers and clients to understand data requirements and...
-
Big Data Engineer
4 weeks ago
Dallas, Texas, United States enwidth Full timeJob Requirements:We are seeking a highly skilled Data Architecture Specialist to join our team at enwidth. The ideal candidate will have a strong background in programming languages such as Java, Scala, and Python, with a minimum of 3+ years of experience.Key Responsibilities:Develop and implement data architecture solutions using Hadoop Spark and...
-
Data Engineer
4 weeks ago
Dallas, Texas, United States Capgemini Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Sogeti, a leading provider of professional technology services. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines that deliver timely and accurate data to our cross-functional teams.Key ResponsibilitiesPartner with Product and...
-
Data Science Engineering Lead
4 weeks ago
Dallas, Texas, United States Data Axle Full timeJob SummaryData Axle is seeking a highly experienced Principal Data Engineer to lead the design, implementation, and optimization of our modern data architecture.This role requires a strong background in data engineering, expertise in Python and SQL programming, and a passion for creating scalable solutions to support business needs.The ideal candidate will...
-
Corporate Development Analyst
4 weeks ago
Dallas, Texas, United States NTT DATA Full timeJob DescriptionReq ID: 283121 NTT DATA Services is seeking a highly analytical and financially astute Corporate Development Analyst to join its team in Dallas, Texas. The ideal candidate will possess a strong understanding of valuation methodologies and extensive experience in M&A, corporate development, or accounting.The successful candidate will develop...
-
Data Engineering Specialist
4 weeks ago
Dallas, Texas, United States Photon Full timeJob Title:PySpark Data EngineerWe are seeking a skilled PySpark Data Engineer to drive the development of robust data processing and transformation solutions within our data platform.You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate with...
-
Data Engineer Manager
1 month ago
Dallas, Texas, United States evolv consulting Full timeJob SummaryWe are seeking a highly skilled Data Engineer Manager to lead the design and implementation of scalable big data platforms and solutions. The ideal candidate will have a proven track record of delivering big data solutions and a strong understanding of data formats, consensus management systems, and distributed caching.Key Responsibilities Lead...
-
Senior Data Engineer
4 weeks ago
Dallas, Texas, United States tlnt Full timeJob OverviewWe are seeking a highly experienced Senior Data Engineer to join our team. The ideal candidate will have 5+ years of expertise in Azure data engineering and be proficient in tools and technologies like Pyspark, Azure Data Factory (ADF), Databricks, big data technologies, SQL, and Python.Key ResponsibilitiesDesign, build, and maintain data...
-
Dallas, Texas, United States Amazon Full timeAbout the RoleWe are seeking a highly skilled Software Development Engineer to join our SMGS Data Platform team at Amazon. As a member of this team, you will play a key role in shaping the direction of our business and building innovative solutions using native AWS services and frameworks.Key ResponsibilitiesDesign and develop scalable platforms that enable...
-
Dallas, Texas, United States NTT DATA Full timeJob Title: Senior Android DeveloperWe are seeking a highly skilled Senior Android Developer to join our Application Engineering team at NTT DATA. As a Senior mobile engineer, you will be responsible for designing, developing, and maintaining high-quality mobile applications on the Android platform.Responsibilities:Design, develop, and maintain mobile...
-
Data Architect
3 weeks ago
Dallas, Texas, United States Clinicapro Full timeAbout ClinicaproClinicapro is a leading provider of innovative data solutions. We are committed to helping our clients make informed decisions through data-driven insights.Key ResponsibilitiesDesign and develop scalable data pipelines to support data integration and analytics.Collaborate with data scientists and analysts to ensure data quality and...
-
Lead Data Architect
4 weeks ago
Dallas, Texas, United States Likewize Full timeJob Title: Lead Data ArchitectAt Likewize, we are seeking a highly skilled Lead Data Architect to drive our data-driven decision-making initiatives. As a key member of our team, you will design, develop, and maintain a data platform that empowers teams with actionable insights.Key Responsibilities:Develop and execute a comprehensive data strategy aligned...
-
Senior Cloud Data Engineer
4 weeks ago
Dallas, Texas, United States Abode Techzone LLC Full timeJob Title:Senior Cloud Data Engineer - Air flowLocation: RemoteProject Duration: 12 months ContractInterview: Three rounds of Video interviewJob Description :Primary Skills:Air Flow, Big Query, Data Proc , Spark), Hadoop. Lead the Team. E2E DeliverySecondary Skills:Java, Unix Scripts, Oozie, Google Cloud Big Query & Big Table, Google Data Proc, Google Data...