Big Data Engineer

2 days ago

Charlotte, NC, United States Insight Global Full time

We are seeking an experienced Senior Software Engineer with deep expertise in Spark, Scala, and Python to lead the implementation and optimization of large-scale financial models. This role involves translating complex mathematical equations into highly efficient, scalable code capable of processing massive datasets, ensuring models run at peak performance. The ideal candidate will have a strong background in distributed computing, performance tuning, and data transformation at scale.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Required Skills & Experience
• 5+ years experience in high performance python development
o Numba, vectorization, numby experience
o Python version 3.10
• Heavy data background
• 3+ years Spark - version 3.3 ideally
• 1+ years Scala
• 1+ years spark sql
• Proven leadership abilities, with experience leading cross-functional teams or projects
• Ability to analyze large data sets - 10 billion rows, 500 columns

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

  • Big Data Platform Engineer

    2 weeks ago

    Charlotte, NC, United States Veracity Full time

    Job Title: Big Data Platform Engineer Duration: 12 Months Location: Charlotte, NC - Hybrid RoleJob Summary: We are seeking a highly skilled and motivated Tools Administration & Engineering Specialist to join our Data private cloud. This role involves working closely with other technical staff to manage, support, and engineer platform tools across various big...

  • Big Data Platform Engineer

    7 days ago

    Charlotte, NC, United States Veracity Full time

    Job Title: Big Data Platform Engineer Duration: 12 Months Location: Charlotte, NC - Hybrid RoleJob Summary: We are seeking a highly skilled and motivated Tools Administration & Engineering Specialist to join our Data private cloud. This role involves working closely with other technical staff to manage, support, and engineer platform tools across various big...

  • Big Data engineer WITH Java

    1 week ago

    Charlotte, NC, United States RIT Solutions, Inc. Full time

    Title- Big Data engineer WITH Jav Location-Charlotte NC (2-3 days a week) Duration-6+ Months Must Haves: Hadoop Postgres Big dat Java (2 - 3 years ) ETL Kafk ny Cloud Experience CICD project will be worked on. The requirement is to redesign the data engineering jobs into Cloud based environment, maintain the current application ,...

  • Big Data engineer WITH Java

    4 days ago

    Charlotte, NC, United States RIT Solutions, Inc. Full time

    Title- Big Data engineer WITH Jav Location-Charlotte NC (2-3 days a week) Duration-6+ Months Must Haves: Hadoop Postgres Big dat Java (2 - 3 years ) ETL Kafk ny Cloud Experience CICD project will be worked on. The requirement is to redesign the data engineering jobs into Cloud based environment, maintain the current application ,...

  • Big Data Engineer

    6 days ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Big Data Engineer

    2 days ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Big Data Engineer

    4 hours ago

    Charlotte, NC, United States Syntricate Technologies Full time

    Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3) Database migration services (DMS) Highly skilled in Python, as a majority of our development is in Python. ...

  • Senior Data Platform Engineer

    2 days ago

    Charlotte, NC, United States The Hartford Full time

    Sr Cloud Engineer - IE07NE We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team as we help shape the future. The Hartford is seeking a seasoned Senior Data...

  • PYTHON DEVELOPER + BIG DATA

    1 week ago

    Charlotte, NC, United States Syntricate Technologies Full time

    PYTHON DEVELOPER + BIG DATA Charlotte, NC Hybrid, 2 days onsite 12 months Web Cam Interview $70/Hr on W2 Job Description: In this contingent resource assignment, candidate may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or...

  • PYTHON DEVELOPER + BIG DATA

    7 hours ago

    Charlotte, NC, United States Syntricate Technologies Full time

    PYTHON DEVELOPER + BIG DATA Charlotte, NC Hybrid, 2 days onsite 12 months Web Cam Interview $70/Hr on W2 Job Description: In this contingent resource assignment, candidate may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering. Review and analyze complex multi-faceted, larger scale or...