Data Engineer
3 weeks ago
Company Overview:
For over twenty years, Atmospheric G2 has provided our customers market-leading weather intelligence software that enables them to confidently assess the impacts of weather on their markets. Our flagship product is up on monitors throughout the trading day across most trade floors in North America and Europe. AG2 forecasts have been proven, via various third-party studies, to have the best accuracy in the world, exceeding the US National Weather Service and other weather vendors. At AG2, we understand that the strength of our offerings depends on the talent of our team, and we are seeking skilled Data Engineers to help us maintain our position as an industry leader.
Job Description:
We are looking for an experienced Data Engineer to join our team and contribute to the development of data processing and transformation pipelines. The ideal candidate will have expertise in building Python ETL processes, leveraging AWS Step Functions and Lambda, and working with relational databases such as MySQL (or equivalents). Familiarity with weather data formats, including GRIB, NetCDF, and Zarr, is a bonus and will help in supporting AG2’s core mission of providing high-quality, accurate weather intelligence.
Key Responsibilities:
- Develop, maintain, and optimize ETL pipelines for processing and transforming data, primarily using Python with AWS Step Functions and Lambda.
- Manage, monitor, and scale data workflows to ensure reliability, accuracy, and timeliness.
- Design and implement data models and database structures, primarily in MySQL or equivalent systems.
- Collaborate closely with cross-functional teams to understand data requirements and deliver solutions that support business goals.
- Enhance data pipelines to integrate with weather-specific formats (GRIB, NetCDF, Zarr) as applicable.
- Participate in code reviews and provide constructive feedback to peers, promoting a high-quality codebase.
- Contribute to best practices in data engineering, including data quality and observability.
- Stay informed on emerging data engineering technologies, particularly those in AWS and weather data handling.
Requirements:
- 5+ years of experience in data engineering, with a strong focus on Python-based ETL processes.
- Proficiency with AWS services, including Step Functions, Lambda, and other data-related services.
- Strong experience with MySQL or equivalent relational database systems.
- Experience working with weather data formats (GRIB, NetCDF, Zarr) is a plus.
- Strong problem-solving skills with attention to data accuracy and quality.
- Familiarity with version control systems, particularly Git.
- Excellent communication and collaboration skills to work effectively within cross-functional teams.
What We Offer:
- A competitive salary and comprehensive benefits package.
- A well-established company with a start-up mindset, fostering innovation and agility.
- A collaborative work environment that values professional growth and contribution.
- Flexibility with a hybrid work model to support work-life balance.
Join our team to make an impact in the world of weather intelligence, leveraging your data engineering expertise to drive informed decisions across global markets.
-
Data Engineer
3 weeks ago
Manchester, United States Atmospheric G2 Full timeCompany Overview:For over twenty years, Atmospheric G2 has provided our customers market-leading weather intelligence software that enables them to confidently assess the impacts of weather on their markets. Our flagship product is up on monitors throughout the trading day across most trade floors in North America and Europe. AG2 forecasts have been proven,...
-
Boston, MA, United States NTT DATA, Inc. Full timeLocation - US/BostonJob Duties: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement system internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability,...
-
Data Analyst
3 weeks ago
Herndon, VA, United States Numero Data Full timeRequired Skills:Ideal candidate should have a degree in a quantitative field (e.g., mathematics, computer science, physics, economics, engineering, statistics, operations research, quantitative social science, etc.).Basic Knowledge on software development principles and architecture.Good analytical and problem-solving abilities.Ability to break down and...
-
Data Scientist
2 weeks ago
Herndon, VA, United States Numero Data Full timeStrictly on W2Required Skills:Ideal candidate should have a degree in a quantitative field (e.g., mathematics, computer science, physics, economics, engineering, statistics, operations research, quantitative social science, etc.).Basic Knowledge on software development principles and architecture.Good analytical and problem-solving abilities.Ability to break...
-
Senior Electrical or Mechanical Engineer
3 weeks ago
Edison, NJ, United States BRUNS-PAK Data Center Solutions Full timeJob Title: Senior Electrical or Mechanical Engineer (Contract) - Data Center FacilitiesJob Type: Contract. On-Site in Edison, NJ.Company Overview:BRUNS-PAK helps clients strategize, implement, and provision innovative, resilient solutions for mission-critical data center infrastructure. In an always-on world flooded by data and demanding information...
-
Principal Data Modeling Engineer
3 weeks ago
Merrimack, NH, United States Fidelity Investments Full timeJob Description:Join a workplace where you can develop client solutions that utilize the latest technology while exceeding client expectations. Experience work that is challenging, produces talent and career growth and where no two days are the same. Where you will experience strong coaching and mentoring to aid you in reaching your goals as we support our...
-
Principal Data Modeling Engineer
2 weeks ago
Merrimack, NH, United States Fidelity Investments Full timeJob Description:Join a workplace where you can develop client solutions that utilize the latest technology while exceeding client expectations. Experience work that is challenging, produces talent and career growth and where no two days are the same. Where you will experience strong coaching and mentoring to aid you in reaching your goals as we support our...
-
Systems Engineer
3 weeks ago
Tampa, FL, United States Imperium Data Full timeImperium Data Talent Solutions has a client located in the Tampa, Florida area looking to add a Systems Engineer to their team. The client is a growing company and offers very competitive compensation and benefits. This opportunity also offers a hybrid work schedule (3 days on-site) and working with cutting-edge technology (cloud, AI, etc.).For immediate...
-
Data Engineer
3 weeks ago
Denver, CO, United States Brooksource Full timeJob Title: Data Engineer – Telemetry ConsultantLocation: Denver, Austin, Dallas, St. Louis, or Charlotte4 days onsite/one day remoteLong-Term Contract to HirePay: $70-$75/hrJob OverviewOur client is seeking a Senior Data Engineer with expertise in telemetry systems to join their Connectivity Data Science and Engineering Organization. You will work closely...
-
Data Engineer
3 weeks ago
Portland, OR, United States Aquent Full timeAs a Data Engineer, you will work closely with business and technical teams to adapt and transform business requirements into effective data management solutions. You will leverage cutting-edge technologies such as Databricks, AWS EMR, Spark, Snowflake, and DBSQL to design, optimize, and implement data models and solutions that drive business value. Key...
-
Data Engineer
4 weeks ago
Washington, DC, United States Booz Allen Full timeData EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a Data Engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate sources. We need an experienced data...
-
IT - Data Engineer
3 days ago
Dallas, TX, United States Adex Corporation Full timeJob Description: Contract Job Title: Data Engineer Do you have the following skills, experience and drive to succeed in this role Find out below. When you're in the business of making connections, diversity and inclusion become part of your fiber. We believe in unlocking the power of diversity to drive digital connectivity, so if you feel your experience...
-
Data Engineer
3 weeks ago
Raleigh, NC, United States InterEx Group Full timeJob SummaryWe are seeking a skilled and motivated Data Engineer to join a Specialty Insurance Firm. In this role, you will be responsible for building, maintaining, and optimizing the data infrastructure and pipelines to support advanced analytics, risk modeling, and data-driven decision-makingKey ResponsibilitiesData Pipeline Development: Design, build, and...
-
Data Engineer
3 weeks ago
Washington, DC, United States Addison Group Full timeWe are focused on leveraging technology to drive data insights and innovation. We are seeking a skilled Data Engineer with experience in Google Cloud Platform (GCP), SQL, and ETL processes to join our growing data team. This role offers the opportunity to work on cutting-edge cloud-based solutions, build scalable data pipelines, and contribute to impactful...
-
Data Engineer
3 weeks ago
Charlotte, NC, United States Synechron Full timeJob Title: Data Engineer DeveloperLocation: Charlotte, NC (Hybrid)Job Type: Full-TimeJob Summary: As a Data Engineer Developer, you will be pivotal in shaping our data landscape. You will design, develop, and maintain high-performance data pipelines and integration solutions, turning raw data into actionable insights. If you have a passion for data...
-
Data Engineer
3 weeks ago
Gaithersburg, MD, United States Bestinfo Systems LLC Full timeData Science Engineer - Contract - Onsite - Gaithersburg, MD Position: Data Science EngineerLocation: On Site 5x week at Gaithersburg, MDTop 3 Skills:Data Science/Data Engineer experience ideally with someone that has worked with networks/ also has network engineering background.5+ years of experience programming using C/C++, java, Python, Go and Pandas.AWS...
-
Data Engineer
2 weeks ago
Moline, AL, United States Aquent Full timeData Engineer Candidate must be employeed as W2 only. No C2C, please. Remote — this job may be performed anywhere in the United States, but candidate must work in the Central time zone. Are you interested in working with a group of fun people who are rooted in design and building web apps for Fortune 500 companies? If so, then this may be the role for...
-
Data Engineer
3 weeks ago
Salem, OR, United States Net2Source Inc. Full timeJob Title: Data Engineer Location: Salem, ORDuration: 12 Months Job Description: Establishes database management systems, standards, guidelines and quality assurance for database deliverables, such as conceptual design, logical database, capacity planning, external data interface specification, data loading plan, data maintenance plan and security...
-
Data Engineer
3 weeks ago
Cincinnati, OH, United States CBTS Full timePay: $45/hr - $50/hr W-2 Only, US Citizen/Green Card/EAD, NO (Sponsorship, H1-B or C2C), Onsite 5 days a week Cincinnati, OH 45227, 6 month Contract thru April 2025Must Have: Data Engineer, Advanced SQL, Ascential DataStage, Data Extraction, Data Modelling, ETL Developer/Snowflake, JavaScript Object Notation (JSON), Cloud Snowflake Database, Experience with...
-
Data Engineer
2 weeks ago
Torrance, CA, United States American Honda Motor Company, Inc. Full timeWhat Makes a Honda, is Who makes a HondaHonda has a clear vision for the future, and it’s a joyful one. We are looking for individuals with the skills, courage, persistence, and dreams that will help us reach our future-focused goals. At our core is innovation. Honda is constantly innovating and developing solutions to drive our business with record...