Lead Data Engineer
2 weeks ago
Lead Data Engineer | Remote
Optomi, in partnership with a global leader in the financial services industry, is seeking a Lead Data Engineer to join their team This candidate will be responsible for designing, ingesting, storing, validating and disseminating data in a consumable format, for business intelligence teams and data analysts to get deeper business insight from the data.
What the right candidate will have:
- 7+ years of strong experience in Java or Scala
- 7+ years of experience in ETL projects
- 5+ years of experience in big data projects
- 3+ years of experience with API development (REST API’s)
- Strong experience in big data technologies like AWS EMR, AWS EKS, Apache Spark
- Strong experience with technologies like AWS Dynamo DB, AWS Lambda
- Strong experience in processing with JSON and CSV files
- Must be able to write complex SQL queries
- Experience in performance tuning and optimization
- Familiar with columnar storage formats (ORC, Parquet) and various compression techniques
- Experience in writing Unix shell scripts
- Unit testing using JUnit or ScalaTest
- Git/Maven/Gradle
- Code Reviews
- Experience with CI/CD pipelines
- Believes in Scrum/Agile, and has deep experience delivering software when working on teams that use Scrum/Agile methodology
- Strong and creative analytical and problem-solving skills
Responsibilities of the right candidate:
- Understand complex business requirements
- Design and develop ETL pipeline for collecting, validating and transforming data according to the specification
- Develop automated unit tests, functional tests and performance tests.
- Maintain optimal data pipeline architecture
- Design ETL jobs for optimal execution in AWS cloud environment
- Reduce processing time and cost of ETL workloads
- Lead peer reviews and design/code review meetings
- Provide support for production support operations team
- Implement data quality checks.
- Identify areas where machine learning can be used to identify data anomalies
-
Lead Big Data Engineer
2 weeks ago
Rockville, United States Tential Full timeLead Big Data Developer Are you passionate in data? Do you like working in a challenging environment where massive volume of data is ingested and processed every day? Are you a continuous learner who wants to learn new tools and technologies in evolving big data and data science technology? Do you have passion in detecting data anomalies in large datasets?...
-
Lead Big Data Engineer
5 days ago
Rockville, United States Tential Full timeLead Big Data DeveloperAre you passionate in data? Do you like working in a challenging environment where massive volume of data is ingested and processed every day? Are you a continuous learner who wants to learn new tools and technologies in evolving big data and data science technology? Do you have passion in detecting data anomalies in large datasets? Do...
-
Lead Data Engineer
2 weeks ago
Rockville, United States Optomi Full timeLead Data Engineer | RemoteOptomi, in partnership with a global leader in the financial services industry, is seeking a Lead Data Engineer to join their team! This candidate will be responsible for designing, ingesting, storing, validating and disseminating data in a consumable format, for business intelligence teams and data analysts to get deeper business...
-
Data Engineer
20 hours ago
Rockville, United States GCB Services LLC Full timeJob DescriptionJob DescriptionJob DescriptionEnsure analytics infrastructure and associated systems meet business requirements and industry best practices.Gather and process raw data from multiple disparate sources (including writing scripts, calling APIs, write SQL queries, etc.) into a form suitable for analysis.Gathers, analyzes, documents, and translates...
-
Data Engineer
4 weeks ago
Rockville, United States ASCENDING Full timeJob DescriptionJob DescriptionFull-time, Remote - Location Requirement: Must be located in the Eastern Time ZoneAvailable for W-2 or 1099 Individual. Our client, one of the largest Amazon Web Services (AWS) partners for data services, is looking for a true Mid level Big Data Engineer to contribute to join their team of technologists to build and contribute...
-
OTSS On Call Data Collection
2 months ago
Rockville, United States Acquired Data Solutions Full timeJob DescriptionJob DescriptionSalary: $20 - $25 / hourT & E Tester - TSAJob Summary/DescriptionADS is seeking personnel at various skill levels who are available on short notice to provide testing services for several days to weeks at domestic airport locations. Testers must possess or be able to acquire the licenses, permits, skills and resources required...
-
Senior Data Engineer
1 month ago
Rockville, United States University of Maryland Medical System Full timeJob DescriptionJob DescriptionCompany DescriptionRenowned as the academic flagship of the University of Maryland Medical System, our Magnet®-designated facility is a nationally recognized, academic medical center with opportunities across the continuum of care. Come join UMMC and discover the atmosphere where talents and ideas come together to enhance...
-
Sr. Data Engineer
1 month ago
Rockville, United States ASCENDING Full timeJob DescriptionJob DescriptionOur client is a leading provider of financial and economic data to the investment banking industry. They are seeking an experienced Senior Data Engineer to join and growing team.- This role is only available for W2 or individual contracts. Please no C2C. - Remote 100%Responsibilities:Analyze system requirements and design...
-
Intern: Test Integration Engineer
1 month ago
Rockville, United States Acquired Data Solutions Full timeJob DescriptionJob DescriptionSalary: Intern / Co-op: Test/Integration Engineer - Hardware/SoftwareJob Summary/DescriptionAcquired Data Solutions is seeking an engineering intern with automated programming experience.Candidates must be familiar with test and measure instruments used in laboratories and manufacturingtest environments.Programming experience in...
-
Lead Software Engineer
4 days ago
Rockville, United States Axle Informatics Full time(ID: 2024-5283) Axle is a bioscience and information technology company that offers advancements in translational research, biomedical informatics, and data science applications to research centers and healthcare organizations nationally and abroad. With experts in biomedical science, software engineering, and program management, we focus on developing and...
-
Laboratory Construcation Project Manager
2 hours ago
Rockville, United States NTT DATA Full timeReq ID: 284306 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Laboratory Construcation Project Manager to join our team in Rockville, Maryland (US-MD), United States...
-
Senior Data Engineer
5 days ago
Rockville, United States fusionSpan Full timeJob DescriptionJob DescriptionfusionSpan is a dynamic, fast-paced organization. We are a team of highly committed individuals who are inspired by the role technology plays in society. This position is 100% remote across the US. Working hours align with EST timezone.A data engineer at fusionSpan will be part of the cross-functional Data & Integrations team at...
-
Software/Integration Engineer
4 weeks ago
Rockville, United States Acquired Data Solutions Full timeJob DescriptionJob DescriptionSalary: 80k - 115k annually, paid semimonthlySoftware/Integration Engineer - Hardware/SoftwareJob Summary/DescriptionHave a broad understanding of engineering fundamentals in order to provide software developmentand troubleshooting, test and measurement, and technical support for solutions in a wide range offields.Working as a...
-
Software/Integration Engineer
4 weeks ago
Rockville, United States Acquired Data Solutions Full timeJob DescriptionJob DescriptionSoftware/Integration Engineer - Hardware/SoftwareJob Summary/DescriptionHave a broad understanding of engineering fundamentals in order to provide software developmentand troubleshooting, test and measurement, and technical support for solutions in a wide range offields.Working as a close-knit team to help the customer achieve...
-
Vice President, Data Science, Marketplace
4 days ago
Rockville, United States Xometry Full timeXometry (NASDAQ: XMTR) powers the industries of today and tomorrow by connecting the people with big ideas to the manufacturers who can bring them to life. Xometry's digital marketplace gives manufacturers the critical resources they need to grow their business while also making it easy for buyers at Fortune 1000 companies to tap into global manufacturing...
-
Software/Integration Engineer
2 weeks ago
Rockville, United States Acquired Data Solutions, Inc. Full timeSoftware/Integration Engineer - Hardware/SoftwareJob Summary/DescriptionHave a broad understanding of engineering fundamentals in order to provide software developmentand troubleshooting, test and measurement, and technical support for solutions in a wide range offields.Working as a close-knit team to help the customer achieve their goals is a must.Minimum...
-
Lead MS 365/Azure Systems Engineer
4 weeks ago
Rockville, United States ConsultNet Full timeLead MS 365/Azure Systems Engineer Anywhere, US (100% Remote) Long Term Contract Job Description: We are seeking a strong Senior-level Systems Engineer to come in as a LEAD Systems Engineer supporting our clients enterprise systems engineering efforts. This Lead Systems Engineer is ultimately going to be responsible for the architecture, engineering,...
-
Lead MS 365/Azure Systems Engineer
1 month ago
Rockville, United States ConsultNet Full timeLead MS 365/Azure Systems Engineer Anywhere, US (100% Remote) Long Term Contract Job Description: We are seeking a strong Senior-level Systems Engineer to come in as a LEAD Systems Engineer supporting our client's enterprise systems engineering efforts. This Lead Systems Engineer is ultimately going to be responsible for the architecture, engineering,...
-
Lead MS 365/Azure Systems Engineer
1 month ago
Rockville, United States ConsultNet Full timeLead MS 365/Azure Systems Engineer Anywhere, US (100% Remote) Long Term Contract Job Description: We are seeking a strong Senior-level Systems Engineer to come in as a LEAD Systems Engineer supporting our client's enterprise systems engineering efforts. This Lead Systems Engineer is ultimately going to be responsible for the architecture, engineering,...
-
Lead MS 365/Azure Systems Engineer
1 month ago
Rockville, United States ConsultNet Full timeLead MS 365/Azure Systems Engineer Anywhere, US (100% Remote) Long Term Contract Job Description: We are seeking a strong Senior-level Systems Engineer to come in as a LEAD Systems Engineer supporting our client's enterprise systems engineering efforts. This Lead Systems Engineer is ultimately going to be responsible for the architecture,...