Big Data Architect

4 days ago


Plano, Texas, United States TechnoGen Full time
Job Description

We are seeking a highly skilled and experienced Data Scientist to join our team at TechnoGen. The ideal candidate should possess expertise in a variety of technologies and tools, with a particular focus on Databricks, Python, Pyspark, MongoDB, Redis, Kubernetes, and containerization deployment.


Key Responsibilities
  1. Develop and maintain data pipelines using Databricks, Python, and Pyspark.
  2. Implement Python API-based project development using REST APIs for efficient data processing.
  3. Utilize MongoDB and Redis for data storage and retrieval.
  4. Deploy and manage applications using Kubernetes and containerization technologies.
  5. Collaborate with the Data Science and Machine Learning teams to develop and deploy DS/ML pipelines.
  6. Explore and implement Delta Live Tables for real-time data processing and analytics.
  7. Participate in the design, development, and optimization of data architecture.
  8. Troubleshoot and resolve data-related issues in a timely manner.
  9. Stay updated with emerging technologies and industry trends to continuously improve data engineering processes.

Requirements
  1. Proficiency in Databricks, Python coding, and workflows.
  2. Strong experience with Pyspark coding for data processing tasks.
  3. In-depth knowledge of MongoDB and Redis for data storage and retrieval.
  4. Familiarity with Kubernetes and containerization deployment for application management.
  5. Experience in DS/ML pipeline development and deployment is highly desirable.
  6. Knowledge of Delta Live Tables for real-time data processing is a plus.
  7. Familiarity with Azure DevOps for continuous integration and deployment.
  8. Understanding of real-time streaming concepts and technologies.

Compensation and Benefits

The salary for this position is $120,000 per year, based on your skills and experience. As a TechnoGen employee, you will receive comprehensive benefits, including medical, dental, and vision insurance, 401(k) matching, and paid time off.



  • Plano, Texas, United States Innova Solutions Full time

    Job OverviewInnova Solutions is seeking a skilled Cloud Computing Solutions Developer to join our team. As a key member of our Big Data and Analytics department, you will play a crucial role in designing, building, and operating cloud services.About the RoleThis position requires expertise in Requirements Engineering, Solution Architecture, Design,...

  • Senior Data Architect

    2 weeks ago


    Plano, Texas, United States Capital One Full time

    Company Overview:Capital One is a leading financial institution committed to empowering individuals and families through innovative financial solutions.Job Description:We are seeking an experienced Senior Data Architect to lead our cloud computing efforts and drive the implementation of big data technologies.About the Role: Collaborate with cross-functional...


  • Plano, Texas, United States SysMind Tech Full time

    Job Description:SysMind Tech is seeking a skilled Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and implementing large-scale data processing systems using distributed cloud services.About the Role:The successful candidate will be responsible for architecting and implementing scalable data infrastructure...


  • Plano, Texas, United States Smart Data Solutions Full time

    Job DescriptionSmart Data Solutions is seeking a seasoned Senior Technical Architect to join our team in Plano, Texas.About the RoleWe are looking for an experienced technical professional who can lead the design and architecture of our on-premise technical infrastructure stack, ensuring alignment with our overall technology strategy. The ideal candidate...


  • Plano, Texas, United States Syntricate Technologies Full time

    About the RoleSyntricate Technologies is seeking a Senior Big Data/Data Engineer to lead our data engineering team. As a key member of our team, you will be responsible for designing, building, and maintaining large-scale data processing systems using AWS technologies such as EMR and Glue.You will have the opportunity to work on exciting projects,...


  • Plano, Texas, United States RIT Solutions, Inc. Full time

    We are seeking an experienced Enterprise Data Architect to lead the design and implementation of large-scale data architectures at RIT Solutions, Inc. The successful candidate will have expertise in data warehousing, business intelligence, and cloud computing.The Enterprise Data Architect will be responsible for designing, implementing, and maintaining...

  • Data Architect Lead

    3 weeks ago


    Plano, Texas, United States The Dignify Solutions LLC Full time

    About The RoleWe are seeking a highly skilled Data Architect Lead to join our team at The Dignify Solutions LLC.The ideal candidate will have a strong background in data warehousing solutions and experience working with cloud technologies such as AWS and Snowflake DB.Key responsibilities will include strategic data partner with customers, implementing data...


  • Plano, Texas, United States Syntricate Technologies Full time

    Big Data Java AWS ExpertWe are seeking a highly skilled Big Data Java AWS Expert to join our team at Syntricate Technologies. As a key member of our team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Java and AWS technologies.Key Responsibilities:Design and develop scalable data processing...


  • Plano, Texas, United States Syntricate Technologies Full time

    Syntricate Technologies is a dynamic and innovative technology firm that is shaping the future of big data and cloud computing. We are now hiring a Senior Big Data/Data Engineer to drive our next phase of growth and innovation.The successful candidate will have a strong foundation in Java programming, as well as extensive experience with Spark, AWS, and...

  • Cloud Data Architect

    2 weeks ago


    Plano, Texas, United States Capital One Full time

    We are seeking a highly skilled Streaming Data Specialist to join our team at Capital One. As a Streaming Data Specialist, you will be responsible for building and maintaining critical data transform frameworks using open source tools in-house frameworks make data applications ecosystem more resilient from cyber data risks.Your key responsibilities will...


  • Plano, Texas, United States SysMind Tech Full time

    About SysMind TechWe are a technology-driven company that provides innovative solutions to our clients. Our team is passionate about leveraging the power of big data and cloud computing to drive business growth.


  • Plano, Texas, United States Diverse Lynx Full time

    Job Title: Enterprise Data Solutions ArchitectDescription:As an Enterprise Data Solutions Architect at Diverse Lynx LLC, you will be responsible for designing, building, and operationalizing large-scale enterprise data solutions and applications. Your expertise in BI/DW data modelling, ETL processes, and data integration will be instrumental in creating...

  • Senior Data Engineer

    3 weeks ago


    Plano, Texas, United States Diverse Lynx Full time

    We are seeking a highly skilled Senior Data Engineer to join our team at Diverse Lynx LLC. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines using Apache Spark and Java.This is a fantastic opportunity for an experienced professional to utilize their skills in big data processing and analytics to...


  • Plano, Texas, United States snipeHIRE Full time

    About the RoleWe are seeking an experienced Data Analytics Solutions Architect to join our team at snipeHIRE. As a key member of our delivery team, you will be responsible for designing and implementing data analytics solutions that drive business value for our clients.


  • Plano, Texas, United States Capital One Full time

    As a Cloud Data Architect at Capital One, you will be responsible for designing and building enterprise-level scalable low-latency fault-tolerant streaming data platforms that provide meaningful timely insights.Your key responsibilities will include: Designing and building next-generation Distributed Streaming Data Pipelines Analytics Data Stores using...


  • Plano, Texas, United States RIT Solutions, Inc. Full time

    Role OverviewWe are seeking a highly skilled Enterprise Data Solutions Architect to join our team at RIT Solutions, Inc. in Plano TX (hybrid & local) / Richmond, VA or McLean, VA hybrid.About the RoleThe ideal candidate will have experience in designing and implementing data warehouse solutions using various technologies such as Python, SQL, NoSQL, Airflow,...


  • Plano, Texas, United States Insight Global Full time

    We are a global provider of workforce solutions with a passion for innovation and customer satisfaction. Our goal is to help our clients succeed by providing them with the best talent and expertise in the industry.The estimated salary for this role is $130,000 per year, considering the job requirements and the location in Plano, Texas.About the Role:We are...

  • Data Architect Lead

    4 days ago


    Plano, Texas, United States Momento USA Full time

    Job OverviewMomento USA, a global technology consulting firm, is seeking a skilled Data Architect Lead to join our team in Plano, TX. As an integral member of our analytics team, you will be responsible for designing and implementing scalable, secure, and resilient architectures that meet the needs of our clients.About the RoleCreate practical solutions that...

  • Senior Data Architect

    3 weeks ago


    Plano, Texas, United States Capital One Full time

    Job DescriptionAbout Capital OneCapital One is a leading financial services company that provides a wide range of banking and lending products to consumers and businesses.About This RoleWe are seeking a highly skilled Lead Data Engineer to join our Enterprise Platforms Technology team in Plano, Texas. As a Lead Data Engineer, you will play a key role in...


  • Plano, Texas, United States Strategic Staffing Solutions Full time

    About the RoleStrategic Staffing Solutions is seeking a highly skilled Data Engineer to join our team. The successful candidate will have experience in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and develop scalable data pipelines using Kafka and SnowflakeMaintain and improve existing data systems to ensure high...