Data Engineer

6 days ago

Augusta, Maine, United States Beacon Hill Staffing Group Full time
Job Summary

The Data Engineer is responsible for designing, developing, and maintaining data pipelines and infrastructure to support data-driven decision-making within the organization. This role requires strong proficiency in Python, SQL, cloud technologies, and Kubernetes to ensure the efficient processing, storage, and retrieval of data.

Key Responsibilities
  • Data Pipeline Development:
    • Design, build, and maintain scalable and reliable data pipelines using Python and SQL.
    • Develop ETL (Extract, Transform, Load) processes to integrate data from various sources into data warehouses and databases.
    • Ensure data quality and consistency across different data sources and systems.
  • Cloud Data Infrastructure:
    • Implement and manage data storage and processing solutions on cloud platforms (e.g., AWS, Azure, Google Cloud).
    • Utilize cloud data services such as BigQuery, Snowflake, Redshift, or similar to store and analyze large datasets.
    • Configure and manage cloud resources for optimal performance and cost-efficiency.
  • Containerization and Orchestration:
    • Deploy and manage data applications and services using Docker and Kubernetes.
    • Develop and maintain Kubernetes manifests, Helm charts, and CI/CD pipelines to automate data workflows.
    • Monitor and troubleshoot containerized applications to ensure high availability and reliability.
  • Performance Optimization:
    • Optimize data processing pipelines for performance and scalability.
    • Tune SQL queries and data storage configurations to handle large volumes of data efficiently.
    • Implement monitoring and logging solutions to track data pipeline performance and identify issues.
  • Collaboration and Communication:
    • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide support.
    • Collaborate with DevOps and infrastructure teams to integrate data solutions with existing systems.
    • Document data processes, workflows, and configurations for transparency and knowledge sharing.
Qualifications
  • Experience: Experience as a Data Engineer or in a similar role with a strong focus on Python, SQL, and cloud technologies.
  • Technical Skills:
    • Proficiency in Python for data engineering tasks, including scripting and automation.
    • Advanced SQL skills for querying and manipulating data.
    • Hands-on experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services.
    • Experience with containerization and orchestration technologies such as Docker and Kubernetes.

Beacon Hill is an Equal Opportunity Employer that values the strength diversity brings to the workplace. Individuals with Disabilities and Protected Veterans are encouraged to apply.

  • Data Engineer

    3 weeks ago

    Augusta, Maine, United States Peraton Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Peraton. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Apache NiFi, Apache Kafka, and Apache SparkDevelop and maintain data...

  • Data Engineer

    2 weeks ago

    Augusta, Maine, United States Peraton Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Peraton. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems and pipelines.Responsibilities:Design and implement data pipelines using Apache NiFi, Apache Kafka, and Apache SparkDevelop and maintain...

  • Data Engineer

    2 weeks ago

    Augusta, Maine, United States Norstella Full time

    About NorstellaNorstella is a leading global pharma intelligence solution provider, offering a wide range of expertise, cutting-edge data solutions, and expert advisory services. Our mission is to help clients bring life-saving therapies to market quicker and help patients in need.Role SummaryThe Data Engineer/Data Scientist will play a critical role in...

  • Data Engineer, Analytics Leader

    3 weeks ago

    Augusta, Maine, United States META Full time

    About the RoleWe are seeking a highly skilled Data Engineer, Analytics to join our team at Meta. As a key member of our Data Engineering team, you will play a critical role in supporting the development of our data foundation, driving informed decision-making, and delivering high-quality data solutions.Key ResponsibilitiesProactively drive the vision for...

  • Data Engineer, Analytics Leader

    3 weeks ago

    Augusta, Maine, United States META Full time

    About the RoleWe are seeking a highly skilled Data Engineer, Analytics to join our team at Meta. As a technical leader, you will play a key role in driving the vision for data foundation and analytics to accelerate building and improvement of cross-platform components across Instagram.Key ResponsibilitiesProactively drive the vision for data foundation and...

  • Data Engineer

    3 weeks ago

    Augusta, Maine, United States Zapata Technology Full time

    Job SummaryZapata Technology is seeking an experienced Data Engineer to lead the migration of our data infrastructure from Confluent with manual ETL processes to Apache NiFi. The ideal candidate will have extensive experience in data engineering, ETL processes, and managing data pipelines in cloud-native environments.Key ResponsibilitiesDesign and develop...

  • Data Protection and Storage Engineer

    3 weeks ago

    Augusta, Maine, United States AVANGRID , Inc. Full time

    Job SummaryWe are seeking a highly skilled Data Protection and Storage Engineer to join our team at AVANGRID, Inc. in a key role that will be responsible for the definition, maintenance, and support of Operational Smart Grids (OSG) infrastructure operational policies, standards, best practices, procedures, tools, and projects.Key ResponsibilitiesProvide...

  • Academic Faculty in Data Science

    3 weeks ago

    Augusta, Maine, United States InsideHigherEd Full time

    Job SummaryWe are seeking a highly qualified and experienced academic faculty member to join our team as a tenure-track faculty position in Data Science. The successful candidate will be responsible for teaching, research, and service in the School of Computer and Cyber Sciences.Key ResponsibilitiesTeaching: Teach classes during the academic year as assigned...

  • Academic Faculty in Data Science

    3 weeks ago

    Augusta, Maine, United States InsideHigherEd Full time

    Job SummaryWe are seeking a highly qualified individual to join our faculty as an Academic Faculty in Data Science. The successful candidate will be responsible for teaching, research, and service in the School of Computer and Cyber Sciences at Augusta University.ResponsibilitiesTeaching: 60% of time will be dedicated to teaching classes during the academic...

  • Academic Faculty in Data Science

    3 weeks ago

    Augusta, Maine, United States InsideHigherEd Full time

    Job SummaryWe are seeking a highly qualified individual to join our faculty as an Academic Faculty in Data Science. The successful candidate will be responsible for teaching, research, and service in the School of Computer and Cyber Sciences.ResponsibilitiesTeaching: 60% of time will be dedicated to teaching classes during the academic year, including...

  • Field Planning Engineer

    1 week ago

    Augusta, Maine, United States JCSI Full time

    Job DescriptionAt JCSI, we are seeking a highly skilled and experienced Field Planning Engineer to join our Augusta, ME team. As a key member of our Power Grid Utility and Substation Engineering team, you will be responsible for leading and working on various projects, including distribution line design, site visits, data gathering, and project...

  • Aerospace Engineer

    4 weeks ago

    Augusta, Maine, United States StandardAero Full time

    About the RoleWe are seeking a highly skilled Aerospace Engineer to join our team at StandardAero. As a Propulsion Engineer, you will play a critical role in the overhaul and repair of turbine engines, ensuring the highest level of quality and efficiency.Key ResponsibilitiesAct as a technical liaison for best practice sharing and OEM communications.Prepare...

  • Principal Engineer

    1 week ago

    Augusta, Maine, United States Iberdrola Full time

    Job SummaryThe Principal Engineer is a key role within the Projects organization, responsible for overseeing the work of engineers and coordinating with P&T on standards. This position will work closely with cross-functional project teams and report to the Substation or Lines or Integrated Director.ResponsibilitiesProject engineering performance and...

  • Aerospace Engineer

    1 week ago

    Augusta, Maine, United States StandardAero Full time

    About the RoleAs a Propulsion Engineer at StandardAero, you will play a critical role in ensuring the performance and reliability of our customers' turbine engines. Your expertise will be instrumental in troubleshooting, production processes, and product failure investigations.Key ResponsibilitiesAct as a technical liaison for best practice sharing and OEM...

  • Lead Engineer

    2 days ago

    Augusta, Maine, United States AVANGRID , Inc. Full time

    Job Title: Lead EngineerAVANGRID, Inc. is seeking a highly skilled Lead Engineer to join our team. As a key member of our Protection and Control (P&C) Department, you will be responsible for developing and implementing engineering standards, relay setting file templates, and record-keeping processes.Key Responsibilities:Assist in the development of P&C...

  • Staff Geotechnical Engineer

    1 week ago

    Augusta, Maine, United States S. W. Cole Engineering, Inc. Full time

    Job Title: Staff Geotechnical EngineerWe are seeking a highly skilled and motivated Staff Geotechnical Engineer to join our team at S. W. Cole Engineering, Inc. in Sidney, Maine.Job SummaryThe successful candidate will be responsible for coordinating and monitoring field exploration activities, collecting and analyzing geotechnical data, and performing...

  • Academic Faculty in Data Science

    2 weeks ago

    Augusta, Maine, United States InsideHigherEd Full time

    Job SummaryThe School of Computer and Cyber Sciences at Augusta University invites applications for a tenure-track/tenured faculty position at the rank of Assistant Professor, Associate Professor or Professor in Data Science.The selected candidate will demonstrate the potential for sustained research excellence as well as a commitment to quality in...

  • Cyber Engineer

    3 weeks ago

    Augusta, Maine, United States U.S. Army Training and Doctrine Command Full time

    About the PositionThis is a Cyber Excepted Service (CES) personnel system position in the Excepted Service under 10 USC 1599f. As a CES position, you must adhere to U.S. Code, Title 10, as well as Department of Defense Instruction. The position is located at Fort Eisenhower, Georgia.ResponsibilitiesMonitor projects through all construction phases to keep the...

  • Academic Faculty in Data Science

    6 days ago

    Augusta, Maine, United States InsideHigherEd Full time

    Job SummaryThe School of Computer and Cyber Sciences at Augusta University invites applications for a tenure-track/tenured faculty position at the rank of Assistant Professor, Associate Professor or Professor in Data Science. The selected candidate will demonstrate the potential for sustained research excellence as well as a commitment to quality in...

  • Telecommunications Engineer

    1 week ago

    Augusta, Maine, United States Piedmont Healthcare Corporate Full time

    Job Title: Voice EngineerJob Summary:We are seeking a highly skilled Voice Engineer to join our team at Piedmont Healthcare Corporate. The successful candidate will be responsible for the installation, implementation, configuring, programming, and maintenance of telecommunications equipment, video conferencing equipment, and voice/data equipment.Key...