Senior Big Data Developer

1 day ago


Chicago, Illinois, United States DRW Full time

We are looking for a highly skilled Senior Big Data Developer to join our team at DRW. As a Senior Big Data Developer, you will play a key role in designing and building an innovative data platform used by Traders, Quantitative Researchers, and Back-Office personnel to analyze financial markets, determine trading opportunities, establish new strategies, and ensure smooth back-office processes.

**About Us:**

DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability to quickly pivot to capture opportunities, so we operate using our own capital and trading at our own risk.

**Required Skills and Qualifications:**

  • 7+ years of experience working with modern data technologies and/or building data-intensive distributed systems
  • Expert level skills in Java/Scala or Python with a proven ability to output high-quality, maintainable, code
  • Strong familiarity with SQL and Bash
  • Experience leveraging and building cloud-native technologies for scalable data processing.
  • Prior experience with both batch and streaming systems and an understanding of the limitations those paradigms impose
  • Experience with an array of data processing technologies (e.g. Flink, Spark, Polars, Dask, etc.)
  • Experience with an array of data storage technologies (e.g. S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, etc.)
  • Experience with an array of data formats and serialization systems (e.g. Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, etc.)
  • Experience managing complex data ETL Pipelines (e.g. Kubernetes, Argo Workflows, Airflow, Prefect, Dagster, etc.)
  • Prior experience dealing with schema governance and schema evolution
  • Prior experience developing data quality control processes to detect data gaps or inaccuracies
  • A desire to mentor less experienced team-members and champion both engineering best-practices and high code-quality standards.
  • Strong technical problem-solving skills
  • Proven ability to work in an agile, fast-paced environment, prioritize multiple tasks and projects, and efficiently handle the demands of a trading environment

$145,000 - $200,000 per year, depending on location and experience.

**Benefits:**

  • Competitive salary range: $145,000 - $200,000 per year
  • Opportunities for career growth and professional development
  • A dynamic and supportive work environment
  • A comprehensive benefits package
  • Access to cutting-edge technology and tools


  • Chicago, Illinois, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    **About Quanteam - North America (RAINBOW PARTNERS Group)**We are a leading technology partner in the banking industry, committed to delivering innovative solutions that drive business growth.In this role, you will have the opportunity to work on high-profile projects, collaborating with cross-functional teams to design and implement scalable data pipelines...


  • Chicago, Illinois, United States Epsilon Data Management, LLC Full time

    About Epsilon Data Management, LLCEpsilon Data Management, LLC is a global leader in data, technology, and services that power the marketing and advertising ecosystem. With a rich history of empowering data-driven solutions, we continue to shape the market with innovative big ideas that drive big outcomes.Job Title: Senior Software Development LeadWe are...


  • Chicago, Illinois, United States Publicis Groupe Full time

    About the Role:We are seeking a talented Senior Big Data Specialist to join our team in Los Angeles. This role will involve designing and implementing scalable AI/ML applications using Spark, Scala, and other big data technologies.About the Company:We are Publicis Groupe, a global leader in marketing, media, and digital transformation. Our comprehensive...


  • Chicago, Illinois, United States NielsenIQ Full time

    Job OverviewNielsenIQ is seeking a Senior Data Engineer with hands-on experience in Python and Pyspark to support software development activities in an Agile environment. The ideal candidate will possess strong technical, analytical, and interpersonal skills.About NielsenIQNielsenIQ is the world's leading consumer intelligence company, delivering...


  • Chicago, Illinois, United States Capital One Full time

    About the JobJob Description:We are seeking an experienced Data Engineer Lead to join our team. As a key member of our engineering team, you will design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.Key responsibilities include:Collaborating with Agile teams to deliver robust cloud-based...


  • Chicago, Illinois, United States Aloden, Inc. Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to join our team at Aloden, Inc. as a Senior Hadoop Developer with Python skills. This is a full-time opportunity to work on designing, developing, and maintaining data pipelines using Hadoop, Spark, and Python/Scala.The ideal candidate will have strong understanding of Big Data concepts and...


  • Chicago, Illinois, United States Tekfortune Inc Full time

    Tekfortune is a fast-growing consulting firm that specializes in permanent, contract & project-based staffing services for world's leading organizations across various industries. In today's rapidly changing economic landscape, virtual recruiting and remote work are crucial for the future of employment. To address the active project demands and skills gaps,...


  • Chicago, Illinois, United States Capital One Full time

    Capital One is seeking a skilled Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will have the opportunity to design, develop, and implement technical solutions in cloud-based data warehousing services such as Redshift and Snowflake.About the RoleThis is a challenging role that requires expertise in big data technologies, including...


  • Chicago, Illinois, United States Axiom Global Full time

    We are looking for a talented Big Data Quality Specialist to lead our efforts in ensuring data accuracy and reliability at Axiom Global. Based in Chicago, IL, this role offers a competitive salary of around $130,000 per year.In this position, you will be responsible for designing and implementing data quality frameworks that meet the needs of our business....


  • Chicago, Illinois, United States Saxon Global, Inc. Full time

    Saxon Global, Inc. is one of the fastest growing companies in the US, providing enhanced IT consulting and engineering solution services for 16 years.About UsWe specialize in Business Intelligence, Mobility, Big Data & Cloud and provide IT tools and services to help organizations across industry verticals such as Financial Services, Retail, Telecom,...


  • Chicago, Illinois, United States WEX, Inc. Full time

    About WEX, Inc.WEX, Inc. is a leading provider of business solutions for the automotive repair industry and other markets. Our sophisticated business solutions empower a diverse range of customers, generating rich and complex data that holds immense potential to drive value for our customers and the business.The Data TeamThe Data team at WEX, Inc. builds big...


  • Chicago, Illinois, United States Prairie Consulting Services Full time

    Prairie Consulting Services is looking for a Senior Data Modeler and Developer to help create a foundational data model for interactive PowerBI reports and dashboards.**Job Description:**The Senior Data Modeler will work closely with the Product Manager to develop and expand the core data model and its capabilities.The successful candidate will have...

  • Senior Data Architect

    2 weeks ago


    Chicago, Illinois, United States Digital Republic Talent Full time

    We are looking for a highly skilled Senior Data Architect to join our Analytics team in Chicago. The successful candidate will have experience designing and implementing large-scale data architectures.This role requires strong technical skills and experience working with big data tools and technologies like Databricks, Druid or the likes. Additionally, the...


  • Chicago, Illinois, United States Feeding America Full time

    Job Title: Senior Data Solutions DeveloperWe are seeking an experienced Senior Data Solutions Developer to join our team. In this role, you will be responsible for designing and developing data solutions that meet the needs of our organization.Key Responsibilities:Design and optimize data models, schemas, and metadata to support complex data pipelines and...


  • Chicago, Illinois, United States Crowe Full time

    Job OverviewCrowe is seeking a highly skilled Data Engineer Senior Developer to provide critical infrastructure for analytical support and solution development for the broader Enterprise using market-leading tools and methodologies.Responsibilities:Design, develop, and implement advanced, scalable, and highly performant data pipelines using Azure Data...


  • Chicago, Illinois, United States Amazon Full time

    About the RoleWe are seeking a talented Senior Data Engineer to join our Science Innovation team at Amazon. As a Senior Data Engineer, you will play a critical role in building scalable and robust data systems that will drive innovation and growth for Amazon Prime.Key Responsibilities- Design and implement large-scale data pipelines for machine learning...


  • Chicago, Illinois, United States Abode Techzone LLC Full time

    About the RoleWe are seeking a Senior Lead Data Engineer with extensive experience in the Healthcare domain to join our team at Abode Techzone LLC. This is a 12-month contract position that requires the incumbent to work onsite in Chicago, IL from day one.Key Responsibilities:Provide recommendations and insights on data management and governance...

  • Senior Data Engineer

    2 weeks ago


    Chicago, Illinois, United States CapB InfoteK Full time

    **Job Title:** Senior Data Engineer - Databricks DeveloperAt CapB InfoteK, we are seeking an experienced Data Engineer to join our team as a Senior Data Engineer - Databricks Developer. This is a full-time or contract position.**Key Responsibilities:

  • Senior Java Engineer

    2 weeks ago


    Chicago, Illinois, United States QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    **Job Summary**We are seeking an experienced Senior Big Data Java Engineer to join our team at Quanteam - North America. As a key member of our engineering team, you will be responsible for designing and developing scalable data pipelines using Java, Kafka Streams, and Spark.The ideal candidate will have a strong background in Java programming, expertise in...


  • Chicago, Illinois, United States Vertex Elite LLC Full time

    Dear Hiring Manager, We are seeking a skilled Senior Data Stage Developer with expertise in Snowflake to join our team at Vertex Elite LLC.Job Title: Senior Data Stage Developer SnowflakeLocation: Chicago, IL (Hybrid 3 days office)Work Authorization: USC/GC/GC-EAD/H4-EAD/L2EAD/H1BSalary Estimate: $150,000 - $200,000 per yearJob Description:We are looking for...