Databricks Data Engineer

6 days ago

Washington, United States Square Peg Technologies Full time
Job DescriptionJob Description

Clearance Required:

Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph.

Location:

Northern Virginia

The Mission:

Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining data pipelines for our customers. The Data Engineer will develop automated pipelines for a variety of data types and datasets. Using Databricks, which was named to both the Magic Quadrant for Cloud Database Management Systems and the Magic Quadrant for Data Science and Machine Learning Platforms, you'll using best in class technology to help our customer solve some of their most challenging data problems.

Don't know Databricks, no problem Sign up for our extensive training program to be a part of shaping the future of AI/ML

Basic Qualifications:

  • Proficient with one or more programming languages (Python, SQL, Java)
  • Prepare big data, implement data models and develop database to support the business solutions
  • Understanding of SQL database structures and mapping data structures between different SQL databases
  • Knowledge of API development techniques
  • Demonstrated experience in data engineering, data processing and modeling techniques using cloud-based data management, data science, and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake.
  • Demonstrated experience with cloud based database services such as Databricks and AWS

Preferred Qualifications

  • Experience with using Apache Spark and Hadoop to conduct large-scale data processing
  • Extensive experience in Extract-Transform-Load (ETL) processes
  • Demonstrated extensive experience with cloud services (AWS strongly preferred)
  • Familiarity with open source data engineering tools and processes

Square Peg Technologies Company Information

Square Peg Technologies is a boutique technology consulting firm that specializes in data solutions using the latest technologies in analytics, data science, data engineering and data management. Our mission is to develop and integrate cutting edge technology solutions that inspire our customers to push the fields of science and technology forward. Here at Square Peg, you will not get lost in a crowd. We value each person’s contribution, celebrate wins together and invest in the personal and professional development of our employees. Along with a strong positive culture that allows employees to thrive and grow, we also offer top notch benefits to include a large amount of vacation, annual bonuses, 401k matching, paid training, and 100% health care coverage.

At Square Peg Tech, we aim to be at the forefront of technology and innovation. Our ideal candidate must be forward leaning and eager to engage with customers, academia and industry leaders on the future applications of AI/ML, as well as best practices in advanced analytics. With a firm footprint in the Intelligence Community, Square Peg Tech is looking to expand its capabilities into the Department of Defense, NASA and other prominent government agencies.


  • Databricks Data Scientist

    6 days ago

    Washington, United States Square Peg Technologies Full time

    Job DescriptionJob DescriptionClearance Level:Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. Location:Northern VirginiaThe Mission:Square Peg is seeking a Data Scientist who can turn structure and unstructured data sets into useful information to solve challenges. You'll work closely with the customer and stakeholders to optimize...

  • Databricks Data Scientist

    5 days ago

    Washington, United States ZipRecruiter Full time

    Clearance Level:Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph.Location:Northern VirginiaThe Mission:Square Peg is seeking a Data Scientist who can turn structured and unstructured data sets into useful information to solve challenges. You'll work closely with the customer and stakeholders to optimize business processes through data...

  • Big Data Architect Cloudera and Databrick

    2 weeks ago

    Washington, United States AHU Technologies Inc Full time

    Job Description: Short Description: The Client seeks an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Client Data Modernization Effort. Complete Description: This role will provide expertise to support the development of a Big Data / Data Lake system architecture...

  • Big Data Architect/ Cloudera and Databrick

    1 month ago

    Washington, Washington, D.C., United States AHU Technologies Inc Full time

    Job Title: Enterprise Big Data Solution ArchitectWe are seeking an experienced IT Consultant to support the design, development, implementation, and maintenance of an enterprise Big Data solution as part of the Client Data Modernization Effort.Key Responsibilities:Coordinates IT project management, engineering, maintenance, QA, and risk management.Plans,...

  • Big Data Architect/ Cloudera and Databrick

    3 months ago

    Washington, United States AHU Technologies Inc Full time

    Job Description:Short Description:The Client seeks an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Client Data Modernization Effort.Complete Description:This role will provide expertise to support the development of a Big Data / Data Lake system architecture...

  • Senior Informatica Data Engineer

    2 weeks ago

    Washington, United States TriOptus LLC Full time

    Randstad is seeking a Senior Informatica Data Engineer for a client in Washington, DC. This role focuses on designing, implementing, and optimizing data pipelines using Informatica, IDMC, and cloud technologies to manage and transform both structured and unstructured data. The engineer will collaborate with teams to create data solutions aligned with...

  • Senior Legal Counsel, Litigation

    4 weeks ago

    Washington, United States Databricks Full time

    Job SummaryThe Senior Counsel, Litigation and Investigations will be responsible for managing the strategic defense of domestic and global claims and litigation and partnering closely with the Databricks Employee Relations team on complex and sensitive investigations.Key ResponsibilitiesProvide risk-adjusted advice on a broad range of projects and employment...

  • 16 years Big Data Architect IT Consultant with Databricks

    2 weeks ago

    Washington, United States AHU Technologies Inc Full time

    Role : Big Data Architect IT Consultant Master Client : State of DC Location : Washington,D.C. Job description This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects,...

  • Data Engineer

    6 days ago

    Washington, United States Alliance of Professionals & Consultants, Inc. Full time

    Job Title: Data EngineerType of Engagement: 1-year contract (Not open to 3rd party C2C consultants. Visa sponsorship is not available)Work Location: Hybrid position located in Washington, DC.  Candidates must reside in the Greater Washington, DC area. This position requires a Secret security clearance. Required Skills:  Tech Stack (must haves): Python,...

  • Data Science

    2 weeks ago

    Washington, United States Insight Global Full time

    Job DescriptionJob DescriptionLocation: Remote (EST)Length: 6-month contract to hireSalary: 140k-160kClearance: Secret (Can hold Top Secret)Responsibilities: Develop and maintain a data exploration and feature engineering pipeline to enable data readiness for modeling within a secure and compliant infrastructure. Implement and manage Databricks,...

  • Senior Data Engineer

    7 days ago

    Washington, United States Allwyn Corporation Full time

    Role: Sr. Data EngineerLocation: Remote. Need to attend PI planning meetings quarterly once at Washington, DCSUMMARY OF DUTIES· Design, develop, and maintain scalable ETL data pipelines for batch and streaming data, handling both structured and unstructured formats effectively.· Utilize advanced analytics tools and methodologies to supplement and enhance...

  • ETL Data Engineer

    2 months ago

    Washington, United States Serigor Inc Full time

    Job Title: ETL Data Engineer (ONSITE)Location: Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...

  • ETL Data Engineer

    1 month ago

    washington, United States Serigor Inc Full time

    Job Title: ETL Data Engineer (ONSITE)Location: Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...

  • Data Engineer

    6 days ago

    Washington, United States Client Server Software Solutions Full time

    Job DescriptionJob DescriptionJob Description:Constellation West is looking for an entry-level to senior-level Data Engineer to support the CDAO's Mission Analytics Directorate through the Advana program, which provides core and data analytics across various domains, including procurement and financial management (FM). By enhancing the integration of...

  • Big Data Architect IT Consultant

    2 weeks ago

    Washington, United States AHU Technologies Inc Full time

    Benefits: R Java Python REST SQL NoSQL Tableau Azure Big Data storage TITLE: Big Data Architect IT Consultant Master LOCATION: Washington DC/ Onsite MINIMUM EDUCATION: Bachelor’s degree in IT, related field, or equivalent experience. REQUIRED EXPERIENCE: 16 years INTERVIEWS: Webcam Only Short Job Description: The client is seeking experienced IT Consultant...

  • Data Architecture

    3 weeks ago

    Washington, United States Go Intellects Full time

    Benefits: Competitive salary This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications....

  • Data Scientist

    2 days ago

    Washington, United States Data Society Full time

    We Are:At Data Society, we provide bespoke, leading-edge data and AI solutions for Fortune 1,000 companies and federal, state, and local governmental organizations. We partner with our clients to educate, equip, and empower their workforces with the skills they need to achieve their goals and expand their impact. We are empowering the workforces of the...

  • Allwyn Corporation | Senior Data Engineer | washington

    7 days ago

    washington, United States Allwyn Corporation Full time

    Role: Sr. Data EngineerLocation: Remote. Need to attend PI planning meetings quarterly once at Washington, DCSUMMARY OF DUTIES· Design, develop, and maintain scalable ETL data pipelines for batch and streaming data, handling both structured and unstructured formats effectively.· Utilize advanced analytics tools and methodologies to supplement and enhance...

  • ETL Data Engineer

    3 weeks ago

    Washington, DC, United States Serigor Inc Full time

    Job Title:ETL Data Engineer (ONSITE)Location:Washington, DCDuration:12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange. The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The ETL data engineer will support the...

  • Lead Data Engineer

    2 months ago

    Washington, United States CAVA - Support Center Full time

    Company Profile:At CAVA we make it deliciously simple to eat well and feel good everyday. We are guided by a Mediterranean heritage that’s beenperfecting how to eat and live for four thousand years. We prioritizeauthenticity, curiosity and the pursuit of excellence in everything we do. Weare working towards something big, together. We foster a culture...