Spark (Databricks) Engineer – All Levels

1 month ago


Chevy Chase, Maryland, United States GEICO Full time

If you are looking to work on some of the latest and most advanced projects while utilizing the most cutting-edge technologies, then continue reading. GEICO's AI & ML Engineering team is responsible for building and enabling GEICO to build AI/ML products, services and capabilities for the future. Our team is also responsible for designing, implementing, testing and maintaining the Machine Learning platform supporting Data Science initiatives across many groups. We are looking for highly motivated individuals with the ability to solve difficult problems, learn new technologies and push the boundaries of what is possible. A successful candidate must have excellent verbal and written communication skills. The candidate must also be able to work independently and in a team environment.

Job Responsibilities

· Design, implement, test, and maintain big data solutions using Spark/Databricks

· Understand complex data sets and ETL processes, and how they can be optimized using Spark/Databricks

· Design and develop high-performance Spark jobs for data transformation, cleansing, and enrichment

· Optimize Spark jobs for both performance and cost

· Integrate Spark jobs and notebooks into the appropriate data pipelines

· Monitor, debug and update Spark jobs, notebooks and code as needed

· Stay up-to-date with the latest development within Scala, Spark and Databricks

Required Qualifications

· 5+ years of hands-on experience writing Production quality code in Scala (preferred) or PySpark

· Hands-on experience with platforms such as Databricks and Apache Spark

· In depth experience with the Apache Spark Architecture and components

· Hands-on experience with the end-to-end Spark development lifecycle

· Hands-on experience with SQL and Spark SQL

· Experience with Cloud Platforms such as MS Azure, AWS, or Google Cloud

· Experience with Machine Learning cloud technologies such as Azure Databricks, SparkML, Azure Machine Learning (AML), AWS SageMaker or similar technologies

Desired Qualifications

· Master's degree in computer science or related field

· Experience with the Azure Ecosystem (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Machine Learning (AML), Azure Cognitive Services, Azure Storage)

· Hands-on experience with Spark Streaming

· Experience with PySpark

· AI/Machine Learning knowledge is a plus

· Insurance domain knowledge is a plus

Benefits:

As a full time associate, you'll enjoy our Total Rewards Program* to help secure your financial future and preserve your health and well-being, including:

  • Premier Medical, Dental and Vision Insurance with no waiting period**
  • Paid Vacation, Sick and Parental Leave
  • 401(k) Plan with Profit Sharing
  • Tuition Assistance including Direct Billing and Reimbursement payment plan options
  • Paid Training, Licensures, and Certificates

*Benefits may be different by location. Benefit eligibility requirements vary and may include length of service.

**Coverage begins with the pay period after hire date. Must enroll in New Hire Benefits within 30 days of the date of hire for coverage to take effect.

GEICO is proud to be an equal opportunity employer. We are committed to cultivating an environment where equal employment opportunities are available to all associates and job applicants regardless of race, color, religious creed, national origin, ancestry, age, gender, pregnancy, sexual orientation, gender identity, marital status, familial status, disability or genetic information, in compliance with applicable federal, state and local law. GEICO celebrates diversity and believes it is critical to our success. As such, we are committed to recruit, develop and retain the most talented individuals to join our team

#LI-AP1



  • Chevy Chase, Maryland, United States GEICO Full time

    GEICO is looking for a Principal Engineer to build GEICO's next generation Underwriting as a Service platform. The platform will be used to launch insurance products expediently and be engineered to scale up and extend to any insurance line of business. We're looking for engineering leaders who are interested in teaching and mentoring others in Agile and...


  • Chevy Chase, Maryland, United States GEICO Full time

    About the RoleWe are seeking an experienced Senior Data Engineer to join our team at GEICO. As a key member of our engineering staff, you will play a critical role in designing and building scalable, resilient data lakehouse components.Key ResponsibilitiesScope, design, and build scalable, resilient data lakehouse componentsLead architecture sessions and...


  • Chevy Chase, Maryland, United States GEICO Full time

    About the RoleGEICO is seeking an experienced Senior Software Engineer to join our team as a Platform Architect - Data Science. As a key member of our capacity management platform team, you will be responsible for designing and implementing high-performance, low-maintenance platforms and applications that drive our insurance business transformation.Key...


  • Chevy Chase, Maryland, United States GEICO Full time

    Job SummaryGEICO is seeking an experienced Senior Staff Engineer to join our team and play a key role in the development of our Data Lakehouse Platform. As a Senior Staff Engineer, you will be responsible for leading the design, development, and implementation of scalable, resilient, and highly available data infrastructure solutions.Key ResponsibilitiesLead...


  • Chevy Chase, Maryland, United States GAMA-1 Technologies Full time

    Job DescriptionGAMA-1 Technologies is seeking a skilled Software Quality Assurance Engineer to join our team in the Low-Earth Orbit (LEO) Ground Sustainment Services (LGSS) program. As a key member of our team, you will play a critical role in sustaining and enhancing the Joint Polar Satellite System (JPSS) Common Ground System (CGS).The JPSS CGS is...


  • Chevy Chase, Maryland, United States GEICO Full time

    GEICO's LEADS engineering staff with development of Data software applications. As a subject matter expert, MENTORS and LEADS engineering teams and team members in software delivery within Data in an Agile Environment.Essential Functions:PROVIDES leadership to engineering teams UTILIZING Data and related technologies. OWNS complete solution across entire...

  • Technical Lead

    7 days ago


    Chevy Chase, Maryland, United States GEICO Full time

    About the RoleGEICO is seeking an experienced Software Engineer with a passion for building high-performance, low-maintenance, zero-downtime platforms and applications. As a key member of the engineering staff, you will help drive our insurance business transformation by transitioning from a traditional IT model to a tech organization with engineering...

  • Platform Architect

    7 days ago


    Chevy Chase, Maryland, United States GEICO Full time

    About the RoleWe are seeking a highly skilled and experienced Senior Software Engineer to join our team at GEICO. As a key member of our capacity management platform team, you will be responsible for designing and implementing high-performance, low-maintenance, and zero-downtime platforms and applications.Key ResponsibilitiesProvide technical leadership and...


  • Chevy Chase, Maryland, United States GEICO Full time

    Job DescriptionGEICO is seeking an experienced Data Engineer to join our team as a Staff Engineer. This is a key role in our engineering staff, working across the organization to innovate and bring the best open-source data infrastructure and practices into Geico.Key ResponsibilitiesDesign and build scalable, resilient Data Lakehouse components using...


  • Chevy Chase, Maryland, United States GEICO Full time

    Company OverviewGEICO is on the lookout for a seasoned Senior Java Engineer who is enthusiastic about creating high-performance, low-maintenance, and resilient platforms and applications. Role OverviewIn this pivotal role, you will contribute to our transformation in the insurance sector as we evolve from a conventional IT framework to a technology-driven...


  • Chevy Chase, Maryland, United States GEICO Full time

    About the RoleGEICO is seeking an experienced and skilled Software Engineer II to join our team. As a key member of our engineering staff, you will be responsible for designing, building, and maintaining scalable, resilient distributed systems.Key ResponsibilitiesScope, design, and build scalable, resilient distributed systemsBuild product definition and...

  • Senior Java Engineer

    1 month ago


    Chevy Chase, Maryland, United States GEICO Full time

    At GEICO Technology Solutions, we are on a journey to revolutionize the Insurtech space with our technology offerings in the Insurance market and provide excellent service with better efficiency to our Customers and Associates. To achieve our vision and mission, we are focusing on transforming our existing tech to deliver products and capabilities that are...


  • Chevy Chase, Maryland, United States GEICO Full time

    Position OverviewGEICO is in search of a skilled Lead Software Engineer who is enthusiastic about creating high-performance, low-maintenance, and reliable platforms and applications. Your role will be pivotal in steering our insurance business transformation as we evolve from a conventional IT framework to a technology-driven organization committed to...


  • Chevy Chase, Maryland, United States Palermo Rhodes Full time

    Job SummaryWe are seeking a highly skilled Civil Engineering Project Manager/Field Engineer to join our team at Palermo Rhodes. As a key member of our regional office in Silver Spring, Maryland, you will be responsible for ensuring the successful execution of our projects, specializing in Auger Pressure Grouted Piling, Displacement Piling, Driven Piling,...


  • Chevy Chase, Maryland, United States GEICO Full time

    Are you an experienced cybersecurity analyst with technical skills looking to join a fast-paced and energetic team whose primary goal is to ensure there are zero surprises when it comes to cybersecurity? GEICO's Cybersecurity Engineering team is seeking a Principal Cloud Security Engineer to solve complex cloud security-related challenges. GEICO has a...


  • Chevy Chase, Maryland, United States Tolin Mechanical Systems Full time

    Company Overview: Tolin Mechanical Systems is a leading independent provider of HVAC services, boasting significant annual revenue and a dedicated workforce. Our strategy focuses on acquiring high-quality local HVAC service providers and enhancing their growth through a commitment to expanding maintenance contracts. Established in 1948, Tolin Mechanical has...


  • Chevy Chase, Maryland, United States GTT, LLC Full time

    Job OverviewPosition: Senior Software EngineerContract Duration: 3-month contract with potential for full-time employmentHourly Rate: Up to $90/hrEligibility: Only US Citizens or Green Card holders will be considered due to contract-to-hire option.Role SummaryThe Enterprise Voice team at GTT, LLC is on the lookout for a dedicated and detail-oriented Software...


  • Chevy Chase, Maryland, United States GTT Full time

    Position Title: Senior Staff Engineer - Amazon ConnectContract Type: 3-month contract with potential for full-time employmentHourly Rate: Up to $100/hrEligibility: Candidates must possess work authorization as a US Citizen or Green Card holder.Role Overview:As a Senior Staff Engineer, you will play a pivotal role within the Voice engineering team, dedicated...


  • Chevy Chase, Maryland, United States The MathWorks Inc Full time

    Are you passionate about MATLAB and eager to assist top-tier technology firms in overcoming their most significant challenges? Join us in driving the advancement of development and innovation at these pioneering organizations.Location: Remote | Position: Technical Sales Engineering | Experience Level: ExperiencedWe are in search of a skilled Hardware...


  • Chevy Chase, Maryland, United States TOLIN FACILITY SERVICES Full time

    Position Overview: Facility Maintenance EngineerWe are seeking a proficient Facility Maintenance Engineer who is committed to delivering exceptional service. This role involves the upkeep and troubleshooting of various building systems while ensuring a high level of tenant satisfaction.Key Responsibilities:Address maintenance requests in a timely...