Sr. Big Data Engineer

2 weeks ago


Santa Monica, United States NR Consulting Full time
Job Title: Sr. Big Data Engineer
Duration: FTE /Permanent Hiring
Location: Santa Monica CA ( Remote Till Covid )

Description:
  • 5+ years of data engineering experience developing large data pipelines
  • Strong SQL skills and ability to create queries to extract data and build performant datasets
  • Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data
  • Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query)
  • Nice to have experience with Cloud technologies like AWS (S3, EMR, EC2)
  • Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines
  • Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
  • Good Scripting skills, including Bash scripting and Python
  • Familiar with Scrum and Agile methodologies
  • You are a problem solver with strong attention to detail and excellent analytical and communication skills
  • Bachelor's or Master's Degree in Computer Science, Information Systems or related field
Top skills:
  • Big Data using Spark - key technology
  • SQL - must
  • Programming- Python must have main language used for programming
  • nice to have- AWS/cloud experience- will be helpful if they have cloud environment.
  • 5ys+ experience


  • Santa Monica, United States NR Consulting Full time

    Job Title: Sr. Big Data Engineer Duration: FTE /Permanent Hiring Location: Santa Monica CA ( Remote Till Covid ) Description: 5+ years of data engineering experience developing large data pipelines Strong SQL skills and ability to create queries to extract data and build performant datasets Hands-on experience with distributed systems such as Spark, Hadoop...


  • Santa Clara, United States Petlibro Full time

    About the jobAbout PetlibroPetlibro is a design thinking company creating products that nurture the intertwined lives of pets & their people. We launched with a philosophy that good design, in form & in function, can make a difference. Petlibro innovates with the latest technology to solve everyday problems for the modern pet parents and revolutionize how we...


  • Santa Clara, United States Petlibro Full time

    About the jobAbout PetlibroPetlibro is a design thinking company creating products that nurture the intertwined lives of pets & their people. We launched with a philosophy that good design, in form & in function, can make a difference. Petlibro innovates with the latest technology to solve everyday problems for the modern pet parents and revolutionize how we...


  • Santa Clara, United States Palo Alto Networks Full time

    PALO ALTO NETWORKS® is the fastest-growing security company in history.  We offer the chance to be part of an important mission: ending breaches and protecting our way of digital life. If you are a motivated, intelligent, creative, and hardworking individual, then this job is for you! We are ushering in the future of security innovation and reinventing...

  • Big Data Engineer

    2 weeks ago


    Santa Clara, United States Omega Solutions Full time

    Big Data Engineer San Jose, CA (Remote) Experian • Need 8Yrs of experience and Hands on programing experience in any one or more programing languages like Java, Scala or Python • Good experience with Distributed systems like Hadoop, HDFs and No SQL databases • Experience in Spark, Hive or Presto • Experience with AWS cloud services: EC2, EMR, Athena...


  • Santa Clara, United States Palo Alto Networks Full time

    PALO ALTO NETWORKS® is the fastest-growing security company in history.  We offer the chance to be part of an important mission: ending breaches and protecting our way of digital life. If you are a motivated, intelligent, creative, and hardworking individual, then this job is for you! In this service, we ingest tens of terabytes of data daily from several...

  • Sr. Data Analyst

    2 weeks ago


    Santa Monica, United States Russell Tobin Full time

    Job DescriptionJob DescriptionTitle: Sr Data AnalystLocation: Santa Monica, CA or NYCDuration: 6+ monthsPay rate: $65/hr - $78/hr (Based on experience)Basic Qualifications Must have experience handling large data sets.SQL queries and how to optimize these queries essential.It is essential to then glean insights from these queries.Experience with BI reporting...


  • Santa Monica, United States Atom Tickets Full time

    As BI Analyst, you'll be responsible for making sense of large data sets with statistical models, data visualization and more. You will need the insight that 10x's our business in some aspect that the rest of us simply aren't equipped to see. You will work on the data team with a Sr. Analyst and with virtually every functional organization at Atom, including...

  • Senior Data Engineer

    2 weeks ago


    Santa Clara, United States NVIDIA Full time

    We are looking for a Sr. Data Engineer - Data Science Platform. At NVIDIA, we pride ourselves on data-driven decision-making, and the data science team is at the heart of this initiative. We are looking for an excellent Sr. Data engineer with extensive data engineering experience for our data science platform supporting NVIDIA's cloud platform services. Our...


  • Santa Clara, United States Telenav Full time

    Do you dream of what cars of the future will look like when you combine them with connectivity, a smartphone, and cloud services? Can you imagine uniting those dreams with a company that has the skills and relationships to make that a reality? If so, Telenav wants you! At Telenav, we believe the car is at the beginning of a massive innovation wave that...

  • Data Engineer

    1 month ago


    Santa Monica, United States KTek Resourcing Full time

    Roles and Responsibilities:Hands on experience in data warehouse, data lake, data engineering projectsHands on experience on AWS Data Engineering and Data IngestionIn depth knowledge of following services on AWS platformGlue, EMR, LambdaPySPARK, SQL, Athena, RedshiftAirflow orchestrationUnderstanding of Agile scrum processKnowledge in Databricks.Experience...

  • Data Engineer

    4 weeks ago


    Santa Monica, United States KTek Resourcing Full time

    Roles and Responsibilities:Hands on experience in data warehouse, data lake, data engineering projectsHands on experience on AWS Data Engineering and Data IngestionIn depth knowledge of following services on AWS platformGlue, EMR, LambdaPySPARK, SQL, Athena, RedshiftAirflow orchestrationUnderstanding of Agile scrum processKnowledge in Databricks.Experience...

  • Data Engineer

    4 weeks ago


    Santa Monica, United States KTek Resourcing Full time

    Roles and Responsibilities:Hands on experience in data warehouse, data lake, data engineering projectsHands on experience on AWS Data Engineering and Data IngestionIn depth knowledge of following services on AWS platformGlue, EMR, LambdaPySPARK, SQL, Athena, RedshiftAirflow orchestrationUnderstanding of Agile scrum processKnowledge in Databricks.Experience...


  • Santa Clara, California, United States Palo Alto Networks Full time

    Job Description Your Career We are seeking an experienced Big Data Software Engineer to design, develop and deliver next-generation technologies within our Prisma Access team. We want passionate engineers who love to code and build great products. Engineers who bring new ideas in all facets of software development. Collaboration and teamwork are at the...

  • Sr. Engineer, AI

    6 days ago


    Santa Clara, United States Balbix Full time

    ENGINEERING Balbix, Inc. in San Jose, CA seeks Sr. Engineer, AI: Design & develop classical & deep learning algorithms to model this data to assess the cyber-security risk using mathematical programming libraries such as Scikit-learn, PyTorch, & Ten-sorFlow. $170,186 /yr. - $180,186/yr. Email res (must reference Job Code 41778) to HRbalbix.com.


  • Santa Clara, United States TCWGlobal Full time

    Sr. Data Center Engineering Technician W2 Contract to HireSanta Clara, CA 95051 (Onsite)50-60/hr + Benefits, PTO, Paid HolidaysWe are looking for a motivated Senior Engineering Technician for our Colossus quality assurance labs! In this role, you will be faced with the challenge of providing a test-bed for our developers to test software on various hardware...


  • Santa Clara, United States TCWGlobal Full time

    Sr. Data Center Engineering Technician W2 Contract to HireSanta Clara, CA 95051 (Onsite)50-60/hr + Benefits, PTO, Paid HolidaysWe are looking for a motivated Senior Engineering Technician for our Colossus quality assurance labs! In this role, you will be faced with the challenge of providing a test-bed for our developers to test software on various hardware...


  • Santa Clara, United States TCWGlobal Full time

    Sr. Data Center Engineering Technician W2 Contract to HireSanta Clara, CA 95051 (Onsite)50-60/hr + Benefits, PTO, Paid HolidaysWe are looking for a motivated Senior Engineering Technician for our Colossus quality assurance labs! In this role, you will be faced with the challenge of providing a test-bed for our developers to test software on various hardware...

  • Staff Data Engineer

    1 month ago


    Santa Monica, California, United States Metropolis Technologies Full time

    Location: Santa Monica, CA, Seattle, WA, Chicago, IL, Nashville, TN or New York City, NY (Hybrid) The CompanyMetropolis develops advanced computer vision and machine learning technology that makes mobile commerce remarkable. Our platform is already deployed in hundreds of mobility facilities and industries with billions in opportunity. We're building the...

  • Data Engineer

    2 weeks ago


    Santa Clara, United States InterSources Full time

    Title: Data Engineer Location: Remote Experience: 4+ Years About the Role Fintech is seeking a strong and passionate data engineer with experience in large scale system implementation, with a focus on complex data pipelines. The candidate must be able to design and drive large projects from inception to production. The right person will work with PMs,...