Python, Pyspark Tech Lead/DIG
3 weeks ago
Location: PLEASANTON(Remote)
Job Type:C2C
Must Have: Python, Pyspark, NVIDIA Clara and SQL
Job Description:
Relevant Experience (in Yrs) 10+
Technical/Functional Skills Python, Pyspark, NVIDIA Clara and SQL
Experience Required
Bachelors Degree with a minimum of 10+ years of relevant experience or equivalent.
8+ years of experience as Python, PySpark, SQL developer
Proficiency in writing Python/PySpark code from scratch to read data from different data sources and load into target databases (SQL / MongoDB) after applying transformation logics.
solid understanding of SQL, rational databases, and normalization.
Extensive experience in developing, maintaining, and managing Python code.
Connecting to data sources, importing data and transforming data for Business Intelligence.
Experience on Python application refactoring using PySpark and NVIDIA Clara
Roles & Responsibilities
Coordinating with development teams to determine application requirements.
Work on client projects to deliver Python, PySpark based Data engineering Analytics solutions Build and operate very large data warehouses or data lakes ETL optimization, designing, coding, Build data pipelines
pplications to stream and process datasets at low latencies Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data
Expertise in refactoring Python code to PySpark
Writing scalable code using Python programming language.
Testing and debugging applications.
Developing back-end components.
Integrating user-facing elements using server-side logic.
ssessing and prioritizing client feature requests.
Integrating data storage solutions.
Coordinating with front-end developers.
Reprogramming existing databases to improve functionality.
Developing digital tools to monitor online traffic.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
-
Python, Pyspark Tech Lead/DIG
1 week ago
Pleasanton, United States Diverse Lynx Full timeTitle: Lead Data Engineer Location: PLEASANTON(Remote) Job Type:C2C Must Have: Python, Pyspark, NVIDIA Clara and SQL Job Description: Relevant Experience (in Yrs) 10+ Technical/Functional Skills Python, Pyspark, NVIDIA Clara and SQL Experience Required Bachelors Degree with a minimum of 10+ years of relevant experience or equivalent. 8+ years of...
-
Python, Pyspark Tech Lead/DIG
13 hours ago
Pleasanton, United States Diverse Lynx Full timeTitle: Lead Data Engineer Location: PLEASANTON(Remote) Job Type:C2C Must Have: Python, Pyspark, NVIDIA Clara and SQL Job Description: Relevant Experience (in Yrs) 10+ Technical/Functional Skills Python, Pyspark, NVIDIA Clara and SQL Experience Required Bachelors Degree with a minimum of 10+ years of relevant experience or equivalent. 8+ years of...
-
Data Engineer Data Engineer
1 week ago
Pleasanton, United States Ursus Inc Full timeJOB TITLE: Data Engineer LOCATION: Pleasanton, CA DURATION: 6 Month Contract PAY RANGE: $47-57/hour TOP SKILLS: 3+ years of industry experience in Data Engineering 3+ years of work experience including hands-on technical experience with SQL, Python, PySpark, Jupyter Notebook, database design, and ETL processes COMPANY: Our client is a leading provider of...
-
Software Engineer
1 week ago
Pleasanton, United States Tech-Mex, Inc. Full timeTech-Mex, Inc., is an innovative U.S. technology staffing company with an office in the Silicon Valley. Tech-Mex, Inc., is currently seeking qualified Tech Professionals. Below is a list of the general skills languages we are currently looking for, and our general eligibility requirements. If you possess one or more of these skills and qualifications and...
-
Software Engineer
24 hours ago
Pleasanton, United States Tech-Mex, Inc. Full timeTech-Mex, Inc., is an innovative U.S. technology staffing company with an office in the Silicon Valley. Tech-Mex, Inc., is currently seeking qualified Tech Professionals. Below is a list of the general skills languages we are currently looking for, and our general eligibility requirements. If you possess one or more of these skills and qualifications and...
-
QE Lead
24 hours ago
Pleasanton, United States CA-One Tech Cloud Inc. Full timeJob Overview: We are seeking a highly skilled and experienced QE Lead to join our team. As a QE Lead, you will be responsible for overseeing the quality engineering process and ensuring the successful delivery of high-quality products. This is a key leadership role that requires strong technical expertise in quantum engineering. Responsibilities: - Lead and...
-
Lead GCP Data Engineer
4 weeks ago
Pleasanton, United States New York Technology Partners Full timeJob Title: Lead GCP Data EngineerLocation: Pleasanton, CA (3 Days Hybrid)Position type: 3 Month Contract Key Role RequirementsBachelor's degree in computer science, or related field Approx. 10+ years of experience with a proven experience in data platform and big data engineeringHands-on Experience in SQL is mandatory. Quickly learning skills to adapt GCP...
-
Data Engineer
1 week ago
Pleasanton, United States Cypress HCM Full timeData EngineerAs a Data Engineer, you will play a critical role in helping define and grow processes, methods, and outcomes for using data engineering to build robust data sources and pipelines for deriving actionable user experience insights. You will play a pivotal role of working with a cross functional group of leaders and individuals in evolving scalable...
-
Data Engineer
1 week ago
Pleasanton, United States Cypress HCM Full timeData EngineerAs a Data Engineer, you will play a critical role in helping define and grow processes, methods, and outcomes for using data engineering to build robust data sources and pipelines for deriving actionable user experience insights. You will play a pivotal role of working with a cross functional group of leaders and individuals in evolving scalable...
-
Data Engineer
3 days ago
Pleasanton, United States Tekwissen Full timeOverview: TekWissen Group is a workforce management provider throughout the USA and many other countries in the world. Client is an American ondemand financial management, human capital management, and student information system software vendor. Job Title: Data Engineer Job Location: Pleasanton, CA 94588 / Boulder, CO 80301 Job Type: Contract Duration: 6...
-
Back end Java Lead Developer
1 week ago
Pleasanton, United States CA-One Tech Cloud Inc. Full time*Need strong Java Backend Engineer Lead, Java web services, Strong in Micro services, Spring boot, Kubernetes, Container management, Dockers, Jenkins, TCI -* *Pleasanton CA* *only on W2* *No OPT or CPT or H1b transfers please* *share resumes to Vidya@ca-one.com* Job Type: Full-time Pay: $65.00 - $70.00 per hour Benefits: * 401(k) * Dental insurance * Health...
-
Linux Engineer
1 week ago
Pleasanton, United States Tech-Mex, Inc. Full timeLead Linux Kernels Engineer with C, ARM experience needed for US software companies. We have a key opening for a Lead Linux Kernels Engineer. If this sounds like you, please apply for this amazing opportunity. PREFERRED SKILLS: Familiarity with Hive data access patterns and basic MapReduce tuning Familiarity with HBase, YARN, Kafka REQUIRED SKILLS: ...
-
Service Technician
5 days ago
Pleasanton, United States Illinois Tool Works, Inc. Full timeAre you mechanically and electrically inclined? Do you like providing customers with quality service solutions? Join our team and become a part of the leading nationwide provider of commercial food equipment service! You will work with customers to e Service Technician, Service Tech, Technician, Mechanical, Manufacturing, Social Services
-
Commercial HVAC Install Technician
3 weeks ago
Pleasanton, United States AC Logix Inc. Full timeJob DescriptionJob DescriptionFamily owned since 2002 AC LOGIX, INC. is a Critical Air Conditioning Systems Mechanical Contractor seeking full time HVAC Installation techs within the Bay Area to join our team.Candidates should have the ability to braze and solder ACR, Type L, M piping, familiarity with sheet metal -duct and air conditioning system...
-
Senior Data Engineer
1 week ago
Pleasanton, United States Bayone Full timeResponsibilities: Identify, extract/scrape, verify suitable data from different sources. Design and conduct exploratory data analysis (for example, statistical analysis/inferences/segmentation, anomaly detection, assumption testing, important factors/relationships detection). Define A/B tests, analyze A/B test results and statistical significance in A/B...
-
Senior Software Engineer
1 week ago
Pleasanton, United States XperiencOps Inc Full timeWe are currently seeking a talented Senior Software Engineer to join our team at XperiencOps Inc. As a Senior Software Engineer, you will be responsible for designing, developing, and maintaining high-performance and scalable APIs that power our core products. Your main focus will be on architecting and building robust RESTful APIs that seamlessly integrate...
-
Accounting Manager
3 weeks ago
Pleasanton, United States LTD Global Full timeJob DescriptionJob DescriptionResponsibilitiesProcess review/ recommendation on efficiencies Responsible for assessing current operational processes; facilitate discussions with team members and clients to assist in determining the baseline of workflow and current processesPerform quantitative and qualitative analysis to determine process gaps; consolidate...
-
Senior Software Engineer
2 weeks ago
Pleasanton, United States XperiencOps Inc Full timeJob DescriptionJob DescriptionWe are currently seeking a talented Senior Software Engineer to join our team at XperiencOps Inc. As a Senior Software Engineer, you will be responsible for designing, developing, and maintaining high-performance and scalable APIs that power our core products.Your main focus will be on architecting and building robust RESTful...
-
Director of Marketing
3 weeks ago
Pleasanton, United States VALID8 Financial Full timeJoin our mission of ensuring the safety of the air we breathe. SafeTraces is a rapidly growing San Francisco Bay Area company with ground-breaking indoor air safety verification technology that has a wide range of applications across the built environment, including commercial real estate, healthcare, and schools. Through a combination of novel particle...
-
Devops Engineer
1 week ago
Pleasanton, United States Diverse Lynx Full timeRequirement ID: 9395459 Role name: Devops Engineer Role Description: Own (as part of a team) the configuration code; work closely with internal customers to identify requirements and make the necessary changes to onboard the team members on to Enterprise GitHub. Help in the creation of hooks from repository through continuous integration and on to enterprise...