DB Team Data Engineer

2 weeks ago


Columbus, Ohio, United States ATR International Full time

Job Description:

We are seeking a Data Engineer for a very important client

Job responsibilities

  • Execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
  • Write secure and high-quality code and maintains algorithms that run synchronously with appropriate systems.
  • Produce architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development.
  • Apply knowledge of tools within the Software Development Life Cycle toolchain to improve the value realized by automation.
  • Apply technical troubleshooting to break down solutions and solve technical problems of basic complexity.
  • Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
  • Proactively identify hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
  • Contribute to software engineering communities of practice and events that explore new and emerging technologies.
  • Add to team culture of diversity, equity, inclusion, and respect.
Requirement:

Required qualifications, capabilities, and skills.

  • 4 to 7 years of Spark on Cloud development experience
  • 4 to 7 years of strong
    SQLskills; Teradata is preference but experience in any other RDBMS
  • Proven experience in understanding requirement related to extraction, transformation, and loading (ETL) of data using Spark on Cloud
  • Formal training or certification on software engineering concepts and 3+ years applied experience.
  • Ability to independently design, build, test, and deploy code Should be able to lead by example and guide the team with his/her technical expertise.
  • Ability to identify risks/issues for the project and manage them accordingly.
  • Hands-on development experience and in-depth knowledge of Java/Python, Microservices, Containers/Kubernetes, Spark, and SQL.
  • Hands-on practical experience in system design, application development, testing, and operational stability
  • Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages.
  • Proficient in coding in one or more programming languages
  • Experience across the whole Software Development Life Cycle
  • Proven understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security
  • Proven knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
Preferred qualifications, capabilities, and skills

  • Knowledge about Data warehousing Concepts.
  • Experience with Agile based project methodology.
  • Ability to identify risks/issues for the project and manage them accordingly.
  • Knowledge or experience on ETL technologies like Informatica or Ab-initio would be preferable
  • People management skills would be given preference but is not mandatory.
MUST have
- teradata, DBMS knowledge

  • Cloud knowledge
  • AWS preferably
  • ETL knowledge
  • CICD and data warehouse concept
  • Java & Spark
NICE To Have

  • Abinitio
- postgres DB knowledge
- python

Required
Datamart
Intermediate 7-8
postgresql
Intermediate 7-8
Data Warehousing Expert 9-10

Preferred

SQL
Intermediate 7-8
ETL Tools
Intermediate 7-8
#Pando

  • Columbus, Ohio, United States ATR International Full time

    Job Description:We are seeking a Data Engineer for a very important client Job responsibilities Execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems. Write secure and high-quality code and maintains algorithms that run...


  • Columbus, Ohio, United States tapwage Full time

    Position : Java FSD with Cassandra DBLocation: Columbus, OH– (In person Interview mandatory)RTTO:Day One OnsiteExperience Level : 9+ YearsDetailed JD: Java FSD (Kafka, Gaia Kubernetes Platform, Splunk, IntelliJ) with Cassandra DB knowledge Traditional Java Developer with cassandra Familiary with Kafka, Gaia Kubernetes Platform, Splunk, IntelliJ Should be...


  • Columbus, Ohio, United States Amazon Data Services, Inc. Full time

    Amazon Web Services (AWS) is looking for highly technical and critical individual to solve the most challenging problems in our industry. AWS Data Center Planning, Deliver, & Operations is a global team responsible for the design and operation of industry-leading, large-scale, business critical facilities. We are currently seeking highly motivated...

  • Data Scientist

    2 weeks ago


    Columbus, Ohio, United States Atechstar Full time

    Responsibilities Creating managing and utilizing high performance relational and NoSQL databases such as Microsoft SQL Server Oracle Microsoft Access OLAP and other software. Selecting and implementing data mining methods most relevant to company projects and desired outcomes. Enhancing data collection to include information relevant for building analytic...

  • Data Scientist

    3 weeks ago


    Columbus, Ohio, United States LogicPlum Full time

    Minimum QualificationsMaster's degree in a quantitative discipline (e.g., Statistics, Operations Research, Bioinformatics, Economics, Computational Biology, Computer Science, Mathematics, Physics, Electrical Engineering, Industrial Engineering) or equivalent practical experience.Having 2 years of work experience in a data analysis related field.Experience...

  • Data Architecture

    4 weeks ago


    Columbus, Ohio, United States Atechstar Full time

    Job description Key ResponsibilitiesAll data and integration requirements including functional security performance quality and operations requirements Review and integrate the data architecture requirements in XR space Metaverse Provide input into final decisions regarding data sources integration patterns and security standards data privacy and compliance...


  • Columbus, Ohio, United States Ascyndent Full time

    Tune Databricks for performance and utilization optimizationProvide infrastructure guidance of Databricks capabilities to accommodate business/technical use casesAutomate and manage provisioning needs, such as Databricks Cluster Policies, Unity Catalog, Secrets Management, Role Based Access Control model and permissionsConfigure and manage...


  • Columbus, Ohio, United States Burns & McDonnell Full time

    Burns & McDonnell is a company comprised of more than 14,000 engineers, architects, construction professionals, scientists, consultants, and entrepreneurs with offices across the country and throughout the world. Burns & McDonnell's Mission Critical team was ranked #2 by the ENR in 2023. We have exciting opportunities for those interested in growing their...

  • Development Engineer

    4 weeks ago


    Columbus, Ohio, United States NES Fircroft Full time

    JT: Development Engineer Location: Columbus, OH Team: Catalyst Test Group Client: SAF Technology Licensor Job Overview: We are looking for Development Engineer who will be an integral part of the technical team based in Columbus, Ohio. This role has the opportunity to evaluate and provide solutions which support the development and deployment of company's...

  • IT Data Analyst

    4 weeks ago


    Columbus, Ohio, United States OPT Nation Full time

    The IT Data Analyst works with IT and business stakeholders to identify processes and solutions to combine and normalize information from many disparate sources. This position improves data quality and consistency supports program data requirements by analyzing process controls creates common vocabulary and performs root cause analyses.Essential Job...


  • Columbus, Ohio, United States Twelve Labs Full time

    Responsibilities Lead day-to-day Salesforce management and optimization. Organizing and analyzing marketing and customer data and helping sales and marketing teams deepen their market influence and build long-lasting customer relationships. Analytical and data-driven approach to creating new revenue opportunities. Knowledge of customer acquisition and...

  • Big Data developer

    4 weeks ago


    Columbus, Ohio, United States Infoprompt Inc Full time

    Responsibilities Participate in Team activities Design discussions Stand up meetings and planning Review with team. Perform data analysis data profiling data quality and data ingestion in various layers using big data/Hadoop/Hive/Impala queries PySpark programs and UNIX shell scripts. Follow the organization coding standard document Create mappings sessions...

  • Jr Data Analyst

    1 week ago


    Columbus, Ohio, United States MSIT Full time

    Responsiblties Integrate data into pipelines through extract transform and load (ETL) processes from operational systems and third-party data sources. Perform business analysis to understand the needs of teammates and stakeholders. Engage directly with MOFC teams to provide data trends and insights. Source and manage data to identify relevant trends and...

  • Software Engineer

    2 weeks ago


    Columbus, Ohio, United States codesbright Full time

    Responsibilities Role entails an interdisciplinary field of software engineering and engineering management controlling techniques and software involved with design integration and sustainment of complex systems over their life cycles. Focus is on design and code new software or modify existing software. Assist with developing test procedures and...

  • Sr. Data Analyst

    3 weeks ago


    Columbus, Ohio, United States Nissan Motor Corporation Full time

    With a focus on Mobility, Operational Excellence, Value to our Customers and the electrification of vehicles, you can expect to be part of something exciting. From the sleek design of our vehicles to the unique opportunities we offer around the globe, Nissan exemplifies ingenuity in everything we do. Our people are what drive the business forward.The Data...


  • Columbus, Ohio, United States ATR International Full time

    Job Description:Job responsibilities Execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems. Write secure and high-quality code and maintains algorithms that run synchronously with appropriate systems. Produce...


  • Columbus, Ohio, United States Marriott Full time

    Job Number Job Category Information TechnologyLocation Marriott International HQ, 7750 Wisconsin Avenue, Bethesda, Maryland, United StatesSchedule Full-TimeLocated Remotely? YRelocation? NPosition Type ManagementJOB SUMMARYMarriott's Data Center & Cloud Networks team is a fast-paced and innovative group that builds network infrastructure to connect hotel...


  • Columbus, Ohio, United States Marriott Full time

    Job Number Job Category Information Technology Location Marriott International HQ, 7750 Wisconsin Avenue, Bethesda, Maryland, United States Schedule Full-Time Located Remotely? Y Relocation? N Position Type Management JOB SUMMARY The Manager will support the implementation, and maintenance of the Data Governance strategy for the Company. Further, supports...


  • Columbus, Ohio, United States ATR International Full time

    Job Description:Design and deliver market-leading technology products in a secure and scalable way as a seasoned member of an agile teamJob responsibilitiesExecutes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problemsCreates...


  • Columbus, Ohio, United States McKessons Corporate Full time

    an experienced and knowledgeable Senior Data Quality Analyst to join our team and provide expert support for the implementation and development of theSr. Data Quality AnalystKnowledge in languages like Python, R, SQL, etc., for custom data quality checks or integrations.Experience with cloud-based data quality solutions or platforms such as AWS, Azure,...