Databricks Data Engineer

3 months ago

Washington, United States Square Peg Technologies Full time
Job DescriptionJob Description

Clearance Required:

Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph.

Location:

Northern Virginia

The Mission:

Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining data pipelines for our customers. The Data Engineer will develop automated pipelines for a variety of data types and datasets. Using Databricks, which was named to both the Magic Quadrant for Cloud Database Management Systems and the Magic Quadrant for Data Science and Machine Learning Platforms, you'll using best in class technology to help our customer solve some of their most challenging data problems.

Don't know Databricks, no problem Sign up for our extensive training program to be a part of shaping the future of AI/ML

Basic Qualifications:

  • Proficient with one or more programming languages (Python, SQL, Java)
  • Prepare big data, implement data models and develop database to support the business solutions
  • Understanding of SQL database structures and mapping data structures between different SQL databases
  • Knowledge of API development techniques
  • Demonstrated experience in data engineering, data processing and modeling techniques using cloud-based data management, data science, and ML platforms such as Databricks, Splunk, Cloudera, and Snowflake.
  • Demonstrated experience with cloud based database services such as Databricks and AWS

Preferred Qualifications

  • Experience with using Apache Spark and Hadoop to conduct large-scale data processing
  • Extensive experience in Extract-Transform-Load (ETL) processes
  • Demonstrated extensive experience with cloud services (AWS strongly preferred)
  • Familiarity with open source data engineering tools and processes

Square Peg Technologies Company Information

Square Peg Technologies is a boutique technology consulting firm that specializes in data solutions using the latest technologies in analytics, data science, data engineering and data management. Our mission is to develop and integrate cutting edge technology solutions that inspire our customers to push the fields of science and technology forward. Here at Square Peg, you will not get lost in a crowd. We value each person’s contribution, celebrate wins together and invest in the personal and professional development of our employees. Along with a strong positive culture that allows employees to thrive and grow, we also offer top notch benefits to include a large amount of vacation, annual bonuses, 401k matching, paid training, and 100% health care coverage.

At Square Peg Tech, we aim to be at the forefront of technology and innovation. Our ideal candidate must be forward leaning and eager to engage with customers, academia and industry leaders on the future applications of AI/ML, as well as best practices in advanced analytics. With a firm footprint in the Intelligence Community, Square Peg Tech is looking to expand its capabilities into the Department of Defense, NASA and other prominent government agencies.


  • Cloud Security Engineer

    3 days ago

    Washington, United States Databricks Full time

    About the RoleWe are seeking a highly skilled Cloud Security Engineer to join our Cloud Infrastructure Security Team at Databricks. As a member of this team, you will play a critical role in implementing secure infrastructure and security solutions in multiple clouds, including AWS, OCI, GCP, and Azure.Key ResponsibilitiesDesign and implement secure...

  • Databricks Data Scientist

    3 months ago

    Washington, United States Square Peg Technologies Full time

    Job DescriptionJob DescriptionClearance Level:Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. Location:Northern VirginiaThe Mission:Square Peg is seeking a Data Scientist who can turn structure and unstructured data sets into useful information to solve challenges. You'll work closely with the customer and stakeholders to optimize...

  • Big Data Architect/ Cloudera and Databrick

    2 days ago

    Washington, United States AHU Technologies Inc Full time

    Job Description:Short Description:The Client seeks an experienced IT Consultant to support the design, development, implementation and maintenance of an enterprise Big Data solution as part of the Client Data Modernization Effort.Complete Description:This role will provide expertise to support the development of a Big Data / Data Lake system architecture...

  • Databricks ETL Developer

    4 weeks ago

    Washington, United States Expedite Technology Solutions LLC Full time

    Education: Bachelor's Clearance Required: Public Trust Role Title Databricks ETL Developer Start Date for assignment 10/01/2024 End Date for assignment 06/30/2025 # of Resources Needed 1 Hours per Week 40 Job Description This work is Sold Unsold Specialization : NA Technical Skills : Skill Years/Level of Experience ETL Pipelines P3 -...

  • Databricks ETL Developer

    4 weeks ago

    Washington, United States Expedite Technology Solutions LLC Full time

    Role Description : Our project to move a data warehouse from Oracle and SAP Data Services technologies to Databricks is in its early stages. This is an opportunity to become a key player in an important element of the agency's cloud migration. Responsibilities: Work with product owners and internal and external teams to develop automated data pipelines from...

  • Senior Data Engineer

    1 week ago

    Washington, Washington, D.C., United States KPMG Full time

    Job SummaryKPMG is seeking a highly skilled Senior Data Engineer to join our Federal Advisory practice. As a key member of our team, you will be responsible for designing, building, and maintaining robust data pipelines and ETL processes using Databricks and other relevant technologies to support financial data workflows.Key ResponsibilitiesDevelop and...

  • Senior Data Engineer

    15 hours ago

    Washington, Washington, D.C., United States KPMG Full time

    About KPMGKPMG is a leading professional services firm that provides audit, tax, and advisory services to clients across various industries. Our team of experts is dedicated to helping our clients achieve their goals and overcome complex challenges.Job SummaryWe are seeking a highly skilled Senior Specialist to join our Federal Advisory practice. As a Senior...

  • Data Engineering Lead

    2 months ago

    Washington, United States Analytica Full time

    Job DescriptionJob Description Analytica is seeking a remote Data Engineering Lead to lead cloud data engineering implementations that support business intelligence, machine learning, data science and/or graph analytics on federal client projects.  The ideal candidate will be comfortable working hands-on with technical implementations as well as working...

  • Data Engineering Lead

    3 weeks ago

    Washington, United States Analytica Full time

    Job DescriptionJob Description Analytica is seeking a remote Data Engineering Lead to lead cloud data engineering implementations that support business intelligence, machine learning, data science and/or graph analytics on federal client projects.  The ideal candidate will be comfortable working hands-on with technical implementations as well as working...

  • Senior Manager Data Engineering

    2 weeks ago

    Washington, United States CAVA - Support Center Full time $165,000 - $205,000

    Job DescriptionJob Description  Company Profile:At CAVA we make it deliciously simple to eat well and feel good every day. We are guided by a Mediterranean heritage that’s been perfecting how to eat and live for four thousand years. We prioritize authenticity, curiosity and the pursuit of excellence in everything we do. We are working towards...

  • Big Data Architect/Cloud Data Engineer

    14 hours ago

    Washington, Washington, D.C., United States AHU Technologies Inc Full time

    Job Title: Big Data Architect/Cloud Data EngineerAt AHU Technologies Inc, we are seeking an experienced IT Consultant to support the design, development, implementation, and maintenance of an enterprise Big Data solution as part of our Data Modernization Effort.Job Summary:This role will provide expertise to support the development of a Big Data/Data Lake...

  • Data Engineer

    7 days ago

    Washington, United States Adlumin, Inc. Full time

    Job DescriptionJob DescriptionLocation: RemoteSchedule: Full-TimeTravel: NoneAbout Adlumin:Adlumin, Inc. provides the enterprise-grade security operations platform and managed detection and response (MDR) services that keep mid-market organizations secure. With one license and one platform, Adlumin’s patented technology and seamless integrations provide...

  • ETL Data Engineer

    3 months ago

    Washington, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: ETL Data Engineer (ONSITE)Location: Washington, DCDuration: 12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange.  The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The...

  • ETL Data Engineer

    3 months ago

    Washington, United States Serigor Inc. Full time

    Job DescriptionJob DescriptionJob Title: ETL Data Engineer (ONSITE)Location: Washington, DCDuration: 12 Months+Job Description:The Enterprise Data team at client requires an ETL data engineer to support data operations for its Cloud Data Exchange.  The resource will utilize native Azure tools to perform ETL, data loading and data transformation tasks.The...

  • Senior Data Engineer

    4 weeks ago

    Bellevue - Washington - USA, United States LTIMindtree Full time

    Experience in SQL Programming languageKnowledge of endtoend process on creation maintenance of Data pipelinesWorking experience on Azure DevOps is a mustWorking Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storageProficiency in Azure synapseImplement endend data pipelines using cosmos Azure Data factoryExperience on Version control ADO...

  • Senior Data Engineer

    4 weeks ago

    Bellevue - Washington - USA, United States LTIMindtree Full time

    Experience in SQL Programming language Knowledge of endtoend process on creation maintenance of Data pipelines Working experience on Azure DevOps is a must Working Knowledge on Azure Data factory Azure Data Lake and Azure Data lake storage Proficiency in Azure synapse Implement endend data pipelines using cosmos Azure Data factory Experience on...

  • Software Engineer, Data Streaming Expert

    1 week ago

    Washington, United States Redpanda Data Inc. Full time

    About the Role:We are a team of seasoned engineers, hackers, and builders, working on the future of data streaming at Redpanda Data Inc.Funded by premier investors, we are building a unified streaming data platform for developers, delivering a reduction in complexity, wicked-fast performance, onboard Wasm transforms, and transparent tiered storage.Key...

  • Data Architecture

    3 days ago

    Washington, United States Go intellects Inc Full time

    Benefits: Competitive salary This role will provide expertise to support the development of a Big Data / Data Lake system architecture that supports enterprise data operations for the District of Columbia government, including the Internet of Things (IoT) / Smart City projects, enterprise data warehouse, the open data portal, and data science applications....

  • Software Engineer, Data Streaming Expert

    1 week ago

    Washington, United States Redpanda Data Inc. Full time

    About the Role:We are a team of seasoned engineers, hackers, and builders, working on the future of data streaming at Redpanda Data Inc.Funded by premier investors, we are building a unified data streaming platform for developers, delivering a reduction in complexity, wicked-fast performance, onboard Wasm transforms, and transparent tiered storage.Key...

  • Electrical Design Engineer

    3 days ago

    Washington, Washington, D.C., United States Amazon Data Services, Inc. Full time

    About the RoleWe are seeking an experienced Electrical Design Engineer to join our Data Center Design Engineering team at Amazon Data Services, Inc. As an Electrical Design Engineer, you will be responsible for designing and developing electrical systems for our data centers, ensuring they meet the highest standards of quality, reliability, and...