Vsolutions Technologies | Data Engineer
1 day ago
The Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data APl's, and ETL jobs, to meet the data needs of applications, services, data assets, and business intelligence and analytical tools.
Working with business users, data architects, application development teams, data analytics teams, business analytics, product managers, and the data governance COE, the Senior Data Engineer will design and develop ELT between databases, data assets, external partners, and third-party systems in a combination of cloud and on-premises platforms.
How will you make an impact:
- Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity
- Designs and develops scalable ELT packages/pipelines for data extract load and transform data between source systems, extract on, and integration of data into various data assets, including data lake and fit for purpose data repositories, both on prem and cloud
- Collaborate with data architects to understand data structures and concepts including conceptual, logical, and dimensional models and provide early feedback
- Designs and develops data migrations in support of enterprise application and system implementations from legacy systems
- Writes functional specifications for data pipelines and APls and writes and performs unit/integration tests Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
- Assists in planning, coordinating, and executing engineer ng projects
- Supports and collaborates with other Engineers through evaluation, design analysis, and development phases
- Maintains knowledge, ensures competency and compliance with policies and procedures, to be the technical expert while collaborating with cross-functional teams
- This list is not all inclusive and you are expected to perform other duties as requested or assigned
Skill/Experience
- Bachelor’s degree in computer science, Mathematics, Statistics, or other related technical field
- 5+ years of experience in ETL tool, cloud technologies like Azure Data Factory, Informatica
- 3+ years of experience in Matillion and Snowflake
- Experience in data profiling, data analysis and building Data Quality metrics
- Experience in reference data management tools like EBX, Informatica MOM or related tools
- Experience building ETL for moving the data from desperate source system into data lake and dimensional models
- Expertise in SQL(No-SOL experience is a plus) against relational and cloud data structures
- Experience in data virtualization, Tibco Data Virtualization preferred
- Experience in documenting and implementing the best practices for building data transformation and load processes.
- Knowledge of best practices and IT operations in an a ways-up, always-available service
- Experience with or knowledge of Agile Software Development methodologies
- Excellent problem solving and troubleshooting skills
- Process oriented with great documentation skills
- Excellent oral and written communication skills with a keen sense of customer service
-
san francisco bay area, United States Vsolutions Technologies Full timeVsolutions Technologies is a fast-growing IT services and consulting startup. We deliver cutting-edge solutions that help companies scale, innovate, and drive measurable results.The Role:We’re looking for a dynamic Sales / Business Development Manager who can thrive in a high-energy, fast-paced environment. You’ll build strategic relationships with...
-
Sales Business Development Manager
2 days ago
San Francisco Bay Area, United States Vsolutions Technologies Full timeVsolutions Technologies is a fast-growing IT services and consulting startup. We deliver cutting-edge solutions that help companies scale, innovate, and drive measurable results.The Role:We’re looking for a dynamic Sales / Business Development Manager who can thrive in a high-energy, fast-paced environment. You’ll build strategic relationships with...
-
Data Engineer
2 days ago
San Francisco Bay Area, United States Vsolutions Technologies Full timeThe Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data APl's, and ETL jobs, to meet the data needs of applications, services, data assets, and business intelligence and analytical tools.Working with business users, data architects, application development teams, data analytics teams, business...
-
Data Engineer
2 days ago
San Francisco Bay Area, United States Diligente Technologies Full timeTitle: Data Engineer(Databricks Azure)Location: San Francisco, CA(Remote)Contract ResponsibilitiesLead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild...
-
Diligente Technologies | Senior Network Engineer
19 hours ago
san francisco bay area, United States Diligente Technologies Full timeTitle- Senior Network EngineerDuration: 12+ Months Location- San Francisco, CAJob Description:SUMMARY:Performs network and network security engineering, administration and support functions within the enterprise network infrastructure. The position is accountable for performing the analysis, design, implementation, administration, and maintenance on highly...
-
Lead Data
2 days ago
San Francisco Bay Area, United States Diligente Technologies Full timeLead, design and implement innovative analytical solution using Tableau, SQL, and other Big Data related technologiesWork with product and engineering team to understand requirements, evaluate new features and architecture to help drive decisionsBuild collaborative partnerships with architects, technical leads and key individuals within other functional...
-
Data/ML engineer
2 days ago
San Francisco Bay Area, United States Intelliswift Software Full timeMust Have skills: Databricks, python, spark, ML model, tensorflow/pytorch, LLM, Java, SpringbootJob DescriptionRequired Skills & Experience: • Hands-on code mindset with deep understanding in technologies skillset and an ability to understand larger picture. • Sound knowledge to understand Architectural Patterns, best practices and Non-Functional...
-
Data Engineering Team Lead
2 weeks ago
San Francisco, California, United States Peregrine Technologies Full timeAbout Peregrine TechnologiesPeregrine Technologies is a leading provider of innovative software solutions for public safety agencies across the United States. With a strong foundation in technology and a passion for making a difference, we empower our customers to improve operations and make better decisions in the moments that matter.We are a team of public...
-
Sr. Data Engineer
1 day ago
San Francisco Bay Area, United States Acunor Full timeJob Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...
-
Intelliswift Software | Data/ML engineer
1 day ago
san francisco bay area, United States Intelliswift Software Full timeMust Have skills: Databricks, python, spark, ML model, tensorflow/pytorch, LLM, Java, SpringbootJob DescriptionRequired Skills & Experience: • Hands-on code mindset with deep understanding in technologies skillset and an ability to understand larger picture. • Sound knowledge to understand Architectural Patterns, best practices and Non-Functional...
-
Cloud Data Engineering Specialist
1 day ago
San Francisco, California, United States SS&C Technologies Full timeSS&C Technologies is a leading global provider of investment and financial services and software for the financial services and healthcare industries. With a strong presence in over 90 offices in 35 countries, our company has been named to the Fortune 1000 list as a top U.S. company based on revenue. As a Senior Data Engineer at SS&C, you will be part of a...
-
Senior Network Engineer
1 day ago
San Francisco Bay Area, United States Diligente Technologies Full timeTitle- Senior Network EngineerDuration: 12+ Months Location- San Francisco, CAJob Description:SUMMARY:Performs network and network security engineering, administration and support functions within the enterprise network infrastructure. The position is accountable for performing the analysis, design, implementation, administration, and maintenance on highly...
-
Data Engineer
2 days ago
San Francisco Bay Area, United States Intelliswift Software Full timeTitle: Data EngineerLocation: San Francisco, CA (1-2 Days onsite/Week)Duration: 12+ Month Contract Key Responsibilities:• Design and implement scalable data pipelines using Databricks and Spark.• Develop and maintain data processing applications in Scala and Python.• Integrate and manage data streams using Kafka.• Build and maintain microservices...
-
Acunor | Sr. Data Engineer
19 hours ago
san francisco bay area, United States Acunor Full timeJob Title: Senior Data EngineerLocation: San Francisco - onsite No. of years of experience: 8+ years’ What you’ll Do: Create and maintain optimal data pipeline architecture Build data pipelines that transform raw, unstructured data into formats that data analyst can use to for analysis Assemble large, complex data sets that meet functional /...
-
Technology Sales Engineer
1 week ago
San Francisco, United States IBM Computing Full timeIBM Technology Sales Engineer - Data in San Francisco, CaliforniaIntroductionTechnology Sales Engineer role (what we internally call a, 'Brand Technical Specialist') within IBM's Data & AI brand means accelerating enterprises' success by improving their ability to understand their data. It means providing solutions that enable people across organizations, in...
-
Senior Data Engineer
2 days ago
San Francisco Bay Area, United States Amicus Full timeSenior Data EngineerAmicus is currently working with an exciting start-up in the business intelligence space, who are looking to bolster their growing engineering team with the addition of an experienced Senior Data Engineer.Requirements:3-5 years’ experience as a data engineer.Experience with Python, Apache Airflow and GCP.Experience building ETL...
-
San Francisco, California, United States Braintrust Data Full timeAbout Braintrust DataWe are a cutting-edge developer platform for building world-class AI products. Our innovative approach combines code and datasets, incrementally refining both using frequent evaluations. We provide a rich set of tools to visualize changes and interrogate failures, empowering developers to integrate our platform into their continuous...
-
Sr. Data Engineer
2 days ago
San Francisco Bay Area, United States Flexton Inc. Full timePay Rate: $80/hr to $90/hr on W2Type: ContractMust Haves:JavaPythonShellResponsibilities: -Design, develop, and manage data pipelines and workflows to enable efficient and accurate data processing using Trino SQL/Spark SQL warehoused in HDFS datasets. -Effectively performs code designs and reviews/approves test cases. -Implement data quality checks and...
-
AWS Data Engineer
2 days ago
San Francisco Bay Area, United States Incedo Inc. Full timeJob Description:The role involves leading the design and management of data solutions in a cloud environment with a focus on AWS services.Responsibilities:Lead the design, implementation, and optimization of scalable data pipelines and architectures utilizing AWS Glue, Elastic MapReduce (EMR), Lambda, Redshift, Athena, DynamoDB, OpenSearch, and S3.Use Spark...
-
san francisco bay area, United States Diligente Technologies Full timeEmployment Type: ContractLocation: San Francisco, CAResponsibilitiesSupport the Network Infrastructure environment with a service-oriented approach, ensuring efficient delivery to meet customer needs and service expectations.Work within establish configuration and change management policies to ensure awareness, approval and success of changes made to the...