Data Engineer/ Python Developer
4 months ago
3155892
Contract to Hire
Top Three Skills:
1. Data Engineer who is comfortable and capable of developing with python as well as SQL
2. Experience working with millions of rows of data this application pushed more then 19 million rows of data in a given day as well as 30,000 - 40,000 views a week
3. Data Engineer who is comfortable working in large databases both which have structured and unstructured data
Job Description: For this role as a Fullstack/Data engineer you will be part of a cross-functional Reporting & Analytics web application team ensuring successful, high quality product deployments. We are looking for an energetic, highly motivated, and detail-oriented data engineer to fill this role. This application is in the middle of a modernization, and we are looking for a well-rounded data engineer who "gets it", who thrives in an agile environment, and who doesn't recognize role boundaries, always swarming to get things done.
As a member of this team, you will be:
• Responsible for expanding and optimizing our data and future data pipeline architecture, as well as optimizing data flows and collections for cross-functional teams.
• An experienced data wrangler who enjoys optimizing data systems and building them from the ground up.
• Self-directed and comfortable supporting the data needs of multiple teams, systems, and products.
• Excited by the prospect of optimizing or even re-designing our data architecture to support our next generation of data initiatives.
Fundamental Responsibilities:
• Ability to recommend and implement ways to improve data reliability, efficiency, and quality.
• Able to employ a variety of languages and tools to marry systems together or try to hunt down opportunities to acquire new data from disparate systems
• Ensure current (and future) architecture supports the needs and requirements of all stakeholders
• Develop data set processes for data modeling, mining, and production
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Build & maintain the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and various other technologies.
• Create and maintain optimal data pipeline architecture,
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Work with stakeholders including executive/product/data/design teams to assist with data-related technical issues and support their data infrastructure needs.
Required Qualifications
• 4+ years experience in a Data Engineering role, preferably within a web app environment
• Strong understanding of both relational data structures and writing complex data analysis queries, as well as non-relational structures and concepts related to BI
• Advanced working SQL knowledge and experience working with relational/non-relational databases, query authoring (SQL) as well as working familiarity with a variety of databases (eg, MS SQL, MySQL, Oracle, MongoDB).
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
SW/Tool Experience:
• Experience with relational & non-relational databases, including MS SQL & MongoDB
• Expert in working with JavaScript and REST APIs
• Experience with data visualization tools: Domo (preferred), Tableau
• Experience with big data tools: Hadoop, Spark, Kafka, etc
• Experience with scripting languages: Python, R, SQL, Scala, etc
• Experience with tooling: Jenkins Pipeline, Git, Docker, OpenShift
• Experience with unit and functional-level automation: Jasmine/Mocha, Selenium, Spock
• Experience in agile scrum/DevOps/DataOps
-
Enterprise Data Engineer
6 days ago
Raleigh, North Carolina, United States VAST Data Full timeVAST Data is at the forefront of the data management revolution, and we're seeking an Enterprise Data Engineer to join our team. You'll be responsible for designing and implementing efficient data storage and retrieval systems, ensuring seamless integration with our cloud infrastructure.As a seasoned engineer, you'll possess strong experience in C/C++...
-
Python Engineer II
7 days ago
Raleigh, United States Disability Solutions Full timeWe are seeking an experienced and skilled Senior Software Engineer II to join our cross functional team of data scientists and software engineers. In this role, you will be responsible for designing, developing, and maintaining high-quality software applications using Python as the primary programming language . Responsibilities: - Collaborate with...
-
Senior Python Software Developer
2 weeks ago
Raleigh, North Carolina, United States SynergisticIT Full timeAt SynergisticIT, we empower recent computer science graduates or those looking to switch careers to make a career in the tech industry. We offer full-time positions with clients for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/Data Scientists, and Machine Learning engineers. Our services include filing...
-
Python and PL/SQL Developer
2 weeks ago
Raleigh, North Carolina, United States Resource Logistics Full timeData Scientist or Engineer Position: Resource Logistics is looking for a highly skilled Data Scientist or Engineer to join our team. The ideal candidate has 3+ years of experience in building and designing data warehouse solutions using large datasets.About the Job:Design and develop data warehouse architecturesImplement ETL processes to move data between...
-
Python Developer
1 month ago
Raleigh, United States Infosys Limited Digital Full timeJob details Country USA State / Region / Province North Carolina Work Location Raleigh, NC Domain Delivery Interest Group Infosys Limited Skills Technology|Analytics - Packages|Python - Big Data Company ITL USA Requisition ID 123603BR Job description Infosys is seeking a Python Technology Analyst . In this role, y ou will enable digital transformation for...
-
QA Automation Engineer
1 month ago
Raleigh, United States VAST Data Full timeDescription VAST Data is looking for a QA Automation Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the future of the...
-
Enterprise Software Developer
6 days ago
Raleigh, North Carolina, United States VAST Data Full timeAbout UsVAST Data is a fast-growing infrastructure company that is at the forefront of the AI revolution. We are looking for a talented Senior Software Engineer to join our team and help us build the future of data management.Salary RangeThe estimated annual salary for this role is $140,000 - $200,000, based on location and experience.Key...
-
Highly Skilled Python Developers
2 weeks ago
Raleigh, North Carolina, United States Jobot Full timeWe are looking for Highly Skilled Python Developers to join our fast-growing startup at Jobot.About the RoleThis role requires a highly skilled developer who can design, develop, and deploy scalable, secure, and resilient applications using Python, Django, and Microservices.Key ResponsibilitiesDesign, develop, and implement software solutions using Python...
-
Data Platform Engineer
6 days ago
Raleigh, North Carolina, United States VAST Data Full timeVAST Data Overview">We are VAST Data, the data platform company for the AI era. Our mission is to make AI simple to deploy and manage by providing enterprise software infrastructure that captures, catalogs, refines, enriches, and protects massive datasets.As a Senior Software Engineer - Platform, you will be part of our growing team that leverages intense...
-
Database QA Automation Engineer
1 month ago
Raleigh, United States VAST Data Full timeDescription linux kVAST Data is looking for a Database QA Automation Engineer to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is...
-
Python/Java Data Analyst Role
2 weeks ago
Raleigh, North Carolina, United States SynergisticIT Full timeWe are looking for highly motivated, self-learners, and technically inquisitive individuals with experience in programming languages like Java and understanding of the software development life cycle. The ideal candidate should have a Bachelors or Masters degree in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, or...
-
Data Engineer
1 month ago
Raleigh, United States Spectraforce Technologies Full timeJob Title: Data Engineer Location: 100% Remote Duration: 2+ Months (Possible Extension)Job Responsibilities: Be a technical expert on all aspects of Snowflake, Python and AWS services Deploy Snowflake objects following best practices for configuration, optimization, documentation and support Maintain deep understanding of complementary technologies and help...
-
Senior Database Quality Assurance Engineer
2 weeks ago
Raleigh, North Carolina, United States VAST Data Full timeVAST Data - Opportunity to Make HistoryAt VAST Data, we're building the enterprise software infrastructure to capture, catalog, refine, enrich, and protect massive datasets. We're looking for a highly skilled Database QA Automation Engineer to join our team.We offer an estimated annual salary of $140,000-$160,000 based on your experience and qualifications....
-
Enterprise Storage Developer
3 weeks ago
Raleigh, North Carolina, United States VAST Data Full timeJoin Our TeamVAST Data is looking for a talented QA Automation Engineer to join our growing team in RTP, North Carolina. As a key contributor, you will play a crucial role in developing testing and automation software tools, collaborating with developers, and defining testing plans.About the JobThis is a unique opportunity to be part of one of the...
-
Senior Software Engineer
1 month ago
Raleigh, United States VAST Data Full timeDescription VAST Data is looking for a Senior Software Engineer -Platform to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the...
-
Senior Software Engineer
1 month ago
Raleigh, United States VAST Data Full timeDescription VAST Data is looking for a Senior Software Engineer -Platform to join our growing team! This is a great opportunity to be part of one of the fastest-growing infrastructure companies in history, an organization that is in the center of the hurricane being created by the revolution in artificial intelligence. "VAST's data management vision is the...
-
Python AI Software Engineer
4 weeks ago
Raleigh, United States Schneider Electric Full timePython Developer Schneider Electric has an opportunity for a Python Developer in our Energy and Sustainability Services group to focus on Data-Driven APIs, Solutions, and AI Agent Development. This role will be part of a singular, high-performing team dedicated to building transformative platform-based solutions powered by AI and data-driven insights. The...
-
Data Engineering Lead
2 weeks ago
Raleigh, North Carolina, United States Saxon Global Full timeSaxon Global: Unlocking Enterprise Data PotentialWe are seeking a highly skilled Data Engineering Lead to join our Product Analytics team in Chicago. In this role, you will partner with various teams to define and execute data acquisition, storage, transformation, processing, and make data actionable for operational and analytics initiatives that create...
-
Oracle Data Integrator Developer
2 weeks ago
Raleigh, United States Kapital Data Corp Full timeTechnical Skills: Database Expertise: Proficiency in SQL and PL/SQL for querying and manipulating data. ETL Tools: Hands-on experience with Extract, Transform, Load (ETL) tools like Oracle Data Integrator (ODI), Informatica, or Talend. Legacy System Knowledge: Familiarity with the architecture and data structures of the specific legacy systems being...
-
Data Engineering Expert
2 weeks ago
Raleigh, North Carolina, United States SysMind Tech Full timeJob Title:Big Data Engineer Company Overview:SysMind Tech is a technology-driven company that specializes in providing innovative solutions to businesses. Estimated Salary:$120,000 - $180,000 per year (dependent on experience and location) Job Description:We are seeking an experienced Big Data Engineer to join our team. As a key member of our engineering...