Data Transfer and Processing Expert

1 month ago

Santa Clara, United States GBIT (Global Bridge InfoTech Inc) Full time

Need local candidate



Job Description: We are on the lookout for a seasoned Real-Time Data Transfer and Processing Expert to enhance our capabilities in handling high-volume, high-velocity data streams.



Responsibilities:

  • Develop and optimize real-time data transfer and processing systems.
  • Implement robust data streaming pipelines using technologies like Apache Flink and Kafka.
  • Integrate messaging technologies such as MQTT, Kafka, and others to facilitate efficient data flow.
  • Utilize networking protocols including TCP, UDP, and QUIC to ensure reliable and fast data transmission.
  • Design event-driven architectures that respond to data streams instantaneously.
  • Ensure system scalability to handle growing data demands and maintain low latency.
  • Design/Propose a system that can handle network outages.
  • Collaborate with teams to embed machine learning models into streaming workflows.
  • Implement and maintain strong security measures to safeguard data during transfers.
  • Creation of key performance metrics, measuring the utilization, performance, and overall health


Requirements:

  • Bachelor’s or master’s degree in computer science, Information Technology, or related field.
  • 5+ years of industry experience with real-time data transfer and stream processing.
  • Proficiency in messaging technologies like MQTT and experience with Kafka.
  • Knowledge of Cellular and Wi-Fi technologies
  • Solid understanding of networking protocols (TCP, UDP, QUIC) and their application in real-time systems.
  • Demonstrated ability in building scalable and fault-tolerant data pipelines.
  • Strong analytical skills and the ability to work with complex data sets.
  • Excellent problem-solving abilities and a keen eye for detail.

Nice to Have:

  • Experience with cloud computing platforms and services.
  • Experience with ROS
  • Knowledge of data compression and optimization techniques.
  • Familiarity with edge computing and IoT data management.


Notes: Same project as for the last role. Want 5+ years, don’t want to be training.

  • Project: Finished vehicle logistics Autonomy FVLA – in general – Parts come off the production line – drive to different areas – This is a work process that they want to automate
  • Car come off the production line and drive themselves to wherever they need to go
  • Plug a piece of equipment in to control, sensors along the way to tell them where the vehicle is, and software to tell the car where to drive
  • Software development lifecycle
  • Cloud computing platforms
  • Data compression and optimization techniques
  • All about moving data from edge devices to the cloud
  • Real-time data transfer, handling high-volume, high-velocity data streams. – these are must-haves Networking, implementing robust data stream
  • Moving data back and forth from edge devices to the cloud – Wi-Fi technology or other, networking protocols, resilient, reliable data pipelines
  • Develop and optimize real-time data transfer and processing systems.
  • Implement robust data streaming pipelines using technologies like Apache Flink and Kafka.
  • Network protocols are important

Scalability – more or less data

  • **Security is important – going over wireless networks – wireless technologies, cellular, and Wi-Fi ***
  • Cars are moving around, sensors are situated in different positions, and data is being sent upstream – continue controlling driving the car.
  • Real-time data transfer, handling high-volume, high-velocity data streams. – these are must-haves Networking, implementing robust data stream.
  • Sensors observe cars, send data to the cloud, and back

  • Data Transfer and Processing Expert

    1 month ago

    Santa Clara, United States GBIT (Global Bridge InfoTech Inc) Full time

    Need local candidateJob Description: We are on the lookout for a seasoned Real-Time Data Transfer and Processing Expert to enhance our capabilities in handling high-volume, high-velocity data streams. Responsibilities:Develop and optimize real-time data transfer and processing systems.Implement robust data streaming pipelines using technologies like Apache...

  • Expert Process Engineer in Wafer Cleaning Technology

    2 days ago

    Santa Clara, California, United States Halo Industries, Inc. Full time

    Job OverviewThe OpportunityAs Halo Industries, Inc. scales its initial pilot production line, we are in search of a seasoned process engineer to advance wafer fabrication methodologies that meet client demands while sustaining production efficiency across various equipment, including grinders, polishers, and cleaning systems. This role will particularly...

  • Staff Data Engineer, Data Platform

    1 month ago

    Santa Clara, California, United States Tenstorrent Inc. Full time

    Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high...

  • Data Analyst

    3 weeks ago

    Santa Clara, United States netPolarity, Inc. (Saicon Consultants, Inc.) Full time

    Duties: Responsibilities:• Partner with Business Insights leaders to support reporting requirements across Global and Product Analytics verticals. • Partner with functional subject matter experts in developing methodologies for new metrics and scale them globally as well as educate users as needed. • Partner with peers, IT and systems teams in...

  • Data Analyst

    4 weeks ago

    Santa Clara, United States netPolarity, Inc. (Saicon Consultants, Inc.) Full time

    Duties: Responsibilities:• Partner with Business Insights leaders to support reporting requirements across Global and Product Analytics verticals. • Partner with functional subject matter experts in developing methodologies for new metrics and scale them globally as well as educate users as needed. • Partner with peers, IT and systems teams in...

  • Compensation Processing Expert

    6 days ago

    Santa Ana, California, United States Jobot Full time

    Position Overview:We are looking for a dedicated and detail-focused Compensation Processing Expert to manage payroll operations effectively. This role is crucial in ensuring that our employees are compensated accurately and punctually while adhering to all applicable regulations.About Us:This organization is renowned for delivering exceptional cleaning and...

  • AI and Data Governance Legal Expert

    23 hours ago

    Santa Clara, California, United States NVIDIA Full time

    About NVIDIANVIDIA is a leader in high-performance computing, making possible the realistic simulation of human imagination in video games and films, and the remarkable simulation of human intelligence in deep learning, autonomous vehicles, and robotics. Our innovative legal team provides cutting-edge solutions to help us stay ahead of the curve.Key...

  • Laser Process Engineer

    3 weeks ago

    Santa Clara, United States Halo Industries, Inc. Full time

    Job DescriptionJob DescriptionHalo Industries has invented a technology to replace a decades-old semiconductor material-slicing process that wastes billions of dollars annually. Halo’s laser-based technology eliminates this waste, delivering improvements in both material cost and performance, while enabling manufacturing advancements in a diverse set of...

  • Laser Process Engineer

    3 months ago

    Santa Clara, United States Halo Industries, Inc. Full time

    Job DescriptionJob DescriptionHalo Industries has invented a technology to replace a decades-old semiconductor material-slicing process that wastes billions of dollars annually. Halo’s laser-based technology eliminates this waste, delivering improvements in both material cost and performance, while enabling manufacturing advancements in a diverse set of...

  • Azure ML Architect/Developer with Experience on Data Bricks Development platform for Data Science

    4 weeks ago

    Santa Clara, United States Laksan Technologies Full time

    Job DescriptionJob DescriptionExperience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks ML platform. Model development , deployment and job scheduling using unstructured data. Certification in databricks ML Expert level in Designing and Architect solutions in Azure Data factory, Azure Databricks, Azure Datalake,...

  • Azure ML Architect + Data Bricks

    3 weeks ago

    Santa Clara, United States Intellectt Inc Full time

    Job Title: Azure ML Architect + Data BricksLocation: Santa Clara, CaliforniaType: Contract Job description:Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks ML platform. Model development , deployment and job scheduling using unstructured data.Certification in databricks ML Expert level in Designing and...

  • Azure ML Architect + Data Bricks

    3 weeks ago

    Santa Clara, United States Intellectt Inc Full time

    Job Title: Azure ML Architect + Data BricksLocation: Santa Clara, CaliforniaType: Contract Job description:Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks ML platform. Model development , deployment and job scheduling using unstructured data.Certification in databricks ML Expert level in Designing and...

  • Azure ML Architect + Data Bricks

    1 month ago

    Santa Clara, United States VDart Inc Full time

    Job DescriptionJob DescriptionJob Title: Azure ML Architect + Data Bricks Location: Santa Clara, CA -OnsiteDuration: / Term: 6+ months ContractJob Description: Experience in designing and implementing scalable and secure Azure cloud solutions using Data Bricks ML platform. Model development, deployment and job scheduling using unstructured data....

  • Process Documentation Writer

    2 months ago

    Santa Clara, United States Cypress HCM Full time

    Job DescriptionJob DescriptionProcess Documentation Expert Our client is seeking a meticulous and experienced Process Documentation Expert to join their team. In this role, you will be responsible for creating clear and concise documentation that outlines various processes within our organization. You will collaborate closely with subject matter experts...

  • Senior Microsoft Power Solutions Expert

    7 days ago

    Santa Clara, California, United States Abbott Laboratories company Full time

    About Abbott LaboratoriesAbbott Laboratories is a prominent global healthcare organization dedicated to enhancing lives across various stages of health. Our extensive range of innovative technologies encompasses diagnostics, medical devices, nutritional products, and branded generic medicines. With a workforce of 114,000 professionals, we serve individuals...

  • Senior Legal Counsel

    1 week ago

    Santa Clara, United States Citrix Systems Full time

    Senior Privacy & Data Protection Counsel (United States) This opening is for an onsite position at either our Santa Clara, CA or Fort Lauderdale, FL offices. About Cloud Software Group Cloud Software Group combines the capabilities of both Citrix and TIBCO, creating one of the world's largest cloud software providers, serving more than 100 million users...

  • Data Analyst

    3 months ago

    Santa Clara, United States YO HR CONSULTANCY Full time

    Job DescriptionJob DescriptionData AnalystExperience: 3-5 years Contract Duration: 11& Months& Scope of Work: 1. Analyze Federal entitlements/Installed base data issues and follow up with business process owners for remediation of data quality issues. 2. Understand the data management process and create a playbook as applicable. 3. Analyze and validate...

  • Guest Experience Expert

    1 month ago

    Santa Clara, United States Marriott International Inc Full time

    Additional Information Pay: $29.96/hr, Overnight Shift Job Number 24126950 Job Category Rooms & Guest Services Operations Location Santa Clara Marriott, 2700 Mission College Boulevard, Santa Clara, California, United States VIEW ON MAP Schedule Full-Time Located Remotely? N Relocation? N Position Type Non-Management POSITION SUMMARY Our jobs arent just...

  • Data Analyst

    4 weeks ago

    Santa Clara, United States Cloudious LLC Full time

    Job DescriptionJob DescriptionScope of Work:1. Analyze Federal entitlements/Installed base data issues and follow-up with business process owners for remediation of data quality issues.2. Understand data management process and create playbook as applicable.3. Analyze and validate Impact Opportunities and entitlements data.4. Understand Impact BU packaging...

  • Data Analyst

    4 weeks ago

    Santa Clara, United States Ismile Technologies Full time

    Job DescriptionJob DescriptionJob Title: Data Analyst (Onsite)Location: Santa Clara, CA 95054Max Rate: $70/hrWork Authorization: U.S. Citizens onlyJob Description:We are seeking a skilled Data Analyst to join our team onsite in Santa Clara, CA. The ideal candidate will have strong data analysis skills and a keen business acumen. This role involves analyzing...