Data Engineer
1 week ago
Responsibilities:
• Develop, maintain, and manage robust, efficient data pipelines to handle large amounts of data.
• Integrate data from various sources such as APIs and third-party datasets into a unified and accessible format.
• Design, establish, and manage databases, data warehouses, and other data storage solutions to meet business goals.
• Implement and manage Extract, Transform, Load (ETL/ELT) processes to ensure accurate and efficient data flow between systems.
• Ensure high data quality by implementing appropriate monitoring, testing, and validation techniques.
• Collaborate with data integration engineers, business analysts, and software engineers to understand and meet their data requirements.
• Automate manual data processes and workflows to enhance efficiency and reduce errors.
• Adhere to data security, privacy, and regulatory compliance requirements (e.g., GDPR, HIPAA).
• Continuously monitor and optimize the performance of data systems to increase efficiency and scalability.• Proficiency in Apache Kafka is a must for real-time data processing
• Familiarity with Apache Pig for scripting and dataflow programming
• Extensive knowledge of Apache Spark for large-scale data processing
• Demonstrable experience with Cloud Technologies for data storage and management
• Proficient in Data Visualization to represent data in a meaningful way
• Capable of Algorithm Implementation for solving complex data problems
• Strong background in Analytics for interpreting trends and patterns
• Mastery of Apache Hadoop for distributed data processing
• Experience in API Development for seamless data integration
• Proficient in AWS Technologies for cloud-based data solutions
-
Data Engineer
7 days ago
Baltimore, United States Robert Half Full timeThis is a full-time direct hire role that requires being onsite 2 days a week in Baltimore, MD. The position includes full benefits.Overview:A Senior Data Engineer is responsible for building and optimizing data pipelines, designing, and maintaining scalable systems for data storage and processing. This role will collaborate closely with product leaders,...
-
Data Engineer
7 days ago
Baltimore, United States Tata Consultancy Services Full timeJob Title : AWS Data Engineer (Astronomer)6-8 years of experience in AWS, Apache Airflow (on Astronomer platform), Python, Pyspark, SQLGood hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement.Experience in creating data pipelines and orchestrating using Apache AirflowSignificant experience with data migrations and development...
-
Sr. Data Engineer
2 weeks ago
Baltimore, United States Arch Systems Full timeJob DescriptionJob DescriptionRole: Sr. Data Engineer with Federal ExperienceClient: ACF ORRCompany: Arch Systems LLCLocation: RemoteType: Full-TimeJob Description:We are currently seeking a talented Data Engineer to join our dynamic team. As a Data Engineer, you will be instrumental in designing, building, and optimizing data pipelines and infrastructure on...
-
Senior Data Engineer
3 weeks ago
Baltimore, United States Capital One Full timeCenter 1 (19052), United States of America, McLean, VirginiaSenior Data Engineer (Python, AWS)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you‘ll be part of a big group of makers, breakers, doers and disruptors, who...
-
LEAD DATA ENGINEER
3 weeks ago
Baltimore, United States Capital One Full timeCenter 2 (19050), United States of America, McLean, VirginiaLead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who...
-
Robert Half | Data Engineer | baltimore, md
6 days ago
baltimore, United States Robert Half Full timeThis is a full-time direct hire role that requires being onsite 2 days a week in Baltimore, MD. The position includes full benefits.Overview:A Senior Data Engineer is responsible for building and optimizing data pipelines, designing, and maintaining scalable systems for data storage and processing. This role will collaborate closely with product leaders,...
-
Robert Half | Data Engineer | baltimore, md
1 week ago
baltimore, United States Robert Half Full timeThis is a full-time direct hire role that requires being onsite 2 days a week in Baltimore, MD. The position includes full benefits.Overview:A Senior Data Engineer is responsible for building and optimizing data pipelines, designing, and maintaining scalable systems for data storage and processing. This role will collaborate closely with product leaders,...
-
AWS Astronomer
1 week ago
Baltimore, United States Tata Consultancy Services Full timeAbout TCS : Tata Consultancy Services is an Indian multinational information technology services and consulting company with its headquarters in Mumbai. It is a part of the Tata Group and operates in 150 locations across 46 countries. In July 2022, it was reported that TCS had over 600,000 employees worldwide. About Job:Job Title: AWS Astronomer (Data...
-
AWS Astronomer
7 days ago
Baltimore, United States Tata Consultancy Services Full timeAbout TCS : Tata Consultancy Services is an Indian multinational information technology services and consulting company with its headquarters in Mumbai. It is a part of the Tata Group and operates in 150 locations across 46 countries. In July 2022, it was reported that TCS had over 600,000 employees worldwide. About Job:Job Title: AWS Astronomer (Data...
-
DIRECTOR, DATA ENGINEERING
2 months ago
Baltimore, United States Capital One Full timeWest Creek 4 (12074), United States of America, Richmond, VirginiaDirector, Data Engineering - Enterprise Identity PlatformCapital One is seeking a Director of Data Engineering to work in our Enterprise Identity Platform organization. This individual will manage the data and data products including ML models across teams for the Enterprise Identity Platform,...
-
SQL Data Engineer with ETL
4 weeks ago
Baltimore, United States ALTA IT Services Full timeRole Title: SQL Data Engineer Location: 100% Remote but candidates should be located in the MD, VA, DC, or West Virginia area for occasional onsite meetings monthly/quarterly. Role Type: 6-month Contract to Hire role. W2 only on this assignment / C2C not available PURPOSE: Develops and executes ETL code and ensures that the data loading processes...
-
Data Engineer
2 months ago
Baltimore, United States Motion Recruitment Full timeJob DescriptionOur client is a Baltimore-based investment management firm known for its long-term, research-driven approach to investing. The firm specializes in growth equity strategies, focusing on identifying high-quality companies with the potential for sustainable growth over time. The company is committed to delivering superior investment performance...
-
Data Architect
6 months ago
Baltimore, United States ASRC Federal Holding Company Full timeJob TitleData ArchitectLocationHOME OFFICE, BALTIMORE, MD-21224Job DescriptionSenior Data Architect - Washington, D.C. ASRC Federal Cyber, LLC is a technical, professional services company providing state-of-the-art solutions to government and commercial clients. Our services include custom-engineered solutions that integrate with the latest technology,...
-
baltimore, United States Tata Consultancy Services Full timeJob Title : AWS Data Engineer (Astronomer)6-8 years of experience in AWS, Apache Airflow (on Astronomer platform), Python, Pyspark, SQLGood hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement.Experience in creating data pipelines and orchestrating using Apache AirflowSignificant experience with data migrations and development...
-
baltimore, United States Tata Consultancy Services Full timeJob Title : AWS Data Engineer (Astronomer)6-8 years of experience in AWS, Apache Airflow (on Astronomer platform), Python, Pyspark, SQLGood hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement.Experience in creating data pipelines and orchestrating using Apache AirflowSignificant experience with data migrations and development...
-
Data Warehouse Architect
7 days ago
Baltimore, United States Q1 Technologies, Inc. Full timeROLE: AWS data ArchitectPRIMARY SKILLS: Data warehousing , pyspark , Github, AWS data platform, Glue, EMR, RedShift, databricks,Data Marts. DBT/Glue/EMR or Matillion, Bigdata ecosystem (Hadoop), data architecture, data engineering, data modelling, data consumption.•10-15 years of total experience and at least 3+ years of expertise in Cloud data warehouse...
-
Data Migration Specialist
1 month ago
baltimore, United States Serigor Inc Full timePosition Title: Data Migration SpecialistDuration: 6 MonthsLocation: This role will be fully remotePosition Description:The Data Migration specialist will play a key role in laying a solid foundation for migrating a legacy Permitting system to a SAAS product, by driving process of data classification, migration, and validation.Responsibilities:Will be...
-
Data Migration Specialist
2 months ago
baltimore, United States Serigor Inc Full timePosition Title: Data Migration SpecialistDuration: 6 MonthsLocation: This role will be fully remotePosition Description:The Data Migration specialist will play a key role in laying a solid foundation for migrating a legacy Permitting system to a SAAS product, by driving process of data classification, migration, and validation.Responsibilities:Will be...
-
Data Migration Specialist
2 months ago
Baltimore, United States Serigor Inc Full timePosition Title: Data Migration SpecialistDuration: 6 MonthsLocation: This role will be fully remotePosition Description:The Data Migration specialist will play a key role in laying a solid foundation for migrating a legacy Permitting system to a SAAS product, by driving process of data classification, migration, and validation.Responsibilities:Will be...
-
Baltimore, United States Capital One Full timeAre you passionate about leveraging data and emerging technologies to solve complex business problems? Join our team at Capital One and be part of driving a major transformation. As a Senior Backend Software Engineer, your role will involve collaborating with Agile teams to design, develop, and implement technical solutions using full-stack development tools...