Staff Software Engineer- Data Analytics

1 week ago


Austin, United States Aledade Full time

As a Staff Software Engineer, you will take us beyond traditional monolithic SQL engines and batch pipelines. You will build the next generation of distributed data storage and processing systems. You will build systems that can scale indefinitely, and surpass traditional query performance, while making the interfaces for that data simple, expressive, and cleanly abstracted. Your interfaces will support a broad array of data consumers, from our web application, to business analytics, and artificial intelligence.

Primary Duties:
  • Identify and develop scalable and performant solutions.
  • Work across discipline to shape product strategy and execution.
  • Develop the foundations of code architecture and quality.
  • Mentor and coach engineers.
  • Set and uphold the standard for engineering processes to support high-quality engineering.
Minimum Qualifications:
  • BS/BTech (or higher) in Computer Science, Engineering or a related field required.
  • 8+ years of production-level experience as an engineer building highly scalable systems.
  • 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value.
  • 4+ years of experience working with SQL or other database querying languages on large multi-table data sets.
  • Experience architecting, developing, and deploying large-scale distributed systems at scale.
  • Experience with cloud technologies, e.g., AWS, Azure, GCP.
  • Experience building continuous integration and continuous development (CI/CD) pipelines.
  • Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).
Preferred KSAs:
  • Deep understanding of one or more tools like Apache Spark, SQL, and Python for data analysis, manipulation, and processing.
  • Familiarity with data technologies and architectures (e.g., event based architecture, distributed computing, in-memory data processing).
  • Experience working with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, Cassandra, MongoDB), focusing on high-performance querying and optimization for analytical workloads.
  • Experience in designing, deploying, and managing data warehouses (eg. Snowflake, Amazon Redshift, etc.) for analytics and business intelligence applications.
  • Knowledge of data partitioning, sharding, and indexing strategies to ensure optimal performance in high-load environments.
  • Proficiency in designing data models that support analytical requirements, ensuring efficient data retrieval and storage.
  • Knowledge of data pipeline architecture, including ETL/ELT processes, batch, and real-time data processing.
  • Skilled in optimizing data pipelines for scalability and performance, ensuring efficient data ingestion, storage, and retrieval.
  • Ability to use caching strategies and indexing techniques to reduce query and processing times.
  • Knowledge of tools for data pipeline creation and orchestration such as Apache Airflow, AWS Glue, and Apache Kafka.
  • Knowledge of data security principles and ensuring compliance with regulations (e.g., GDPR, HIPAA) through proper data governance practices.
Physical Requirements:
  • Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required.
PDN-9d082ae0-ee05-4843-8c94-38da370f9921

  • Austin, Texas, United States Lorven Technologies Full time

    We are seeking a highly skilled Senior Software Engineer to join our team at Lorven Technologies. As a key member of our team, you will be responsible for designing and implementing data analytics solutions using Python and Spark.Job DescriptionLocation: Austin, TXDuration: Long-term contractSalary:$120,000 - $180,000 per year (dependent on experience)About...


  • Austin, United States Aledade Full time

    As a Staff Software Engineer, you will take us beyond traditional monolithic SQL engines and batch pipelines. You will build the next generation of distributed data storage and processing systems. You will build systems that can scale indefinitely, and surpass traditional query performance, while making the interfaces for that data simple, expressive, and...

  • Cloud Data Engineer

    5 days ago


    Austin, Texas, United States United Software Group Full time

    Job Title: Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at United Software Group. As a Cloud Data Engineer, you will be responsible for designing and implementing data solutions within the Azure ecosystem.The ideal candidate will have 5+ years of experience in Azure native services with good exposure to ADF,...


  • Austin, Texas, United States Amazon Full time

    OverviewAmazon is well-positioned to grow its share of the fast-growing online advertising industry due to its unique assets – e-commerce data, service-oriented architecture, and startup culture. We're looking for strong software engineers to build upon technologies such as Elasticsearch, Spark, Hive, and Presto, as well as AWS services like Elastic Map...

  • Data Engineering Lead

    16 hours ago


    Austin, Texas, United States ShiftCode Analytics Full time

    About UsShiftCode Analytics is a leading technology company that leverages data to drive business growth.We are seeking an experienced Data Engineer Lead to join our team and contribute to the development of cutting-edge data systems.Job DescriptionThe ideal candidate will have 5+ years of experience in data engineering, with a strong background in Hadoop,...


  • Austin, Texas, United States ShiftCode Analytics Full time

    Job Description: Senior Data Engineer PositionLocation: Remote or Office-basedSalary: $150,000 - $220,000 per yearWe are seeking an experienced Senior Data Engineer to lead our data engineering team at ShiftCode Analytics. The successful candidate will have a strong background in cloud-based data engineering and architecture.About the Role:Leverage your...


  • Austin, Texas, United States United Software Group Full time

    Job Title: Azure Synapse Analytics SpecialistWe are seeking a seasoned Azure Synapse Analytics Specialist to join our team at United Software Group. As an Azure Synapse Analytics Specialist, you will be responsible for designing and implementing data solutions within the Azure ecosystem, with a focus on optimizing data storage and ensuring high performance...

  • Cloud Data Engineer

    5 days ago


    Austin, Texas, United States United Software Group Full time

    United Software Group is seeking a skilled Cloud Data Engineer to design and build cloud-ready applications using Python, Kafka, Big Data, Spark, and dev/build tools like git, maven, and gradle. The ideal candidate will have expertise in integration patterns, integration technologies, and integration platforms.Key Responsibilities:• Designing and...


  • Austin, Texas, United States United Software Group Full time

    United Software Group Job DescriptionWe are seeking a highly skilled Data Scientist for Large-Scale Data Processing to join our team in Austin, TX. This is a long-term opportunity that will challenge you to push the boundaries of data processing and analytics.About the Role:This position requires expertise in working with large datasets, designing and...


  • Austin, Texas, United States United Software Group Full time

    Job Title: Data Engineer Specialist">About the Role:We are seeking a highly skilled Data Engineer Specialist to join our team at United Software Group. The successful candidate will have expertise in designing and developing large-scale data systems, ensuring high performance, scalability, and reliability.">Key Responsibilities:Design, develop, and deploy...


  • Austin, Texas, United States Assyst Full time

    Job SummaryWe are seeking an experienced ETL Developer to join our team in Austin, Texas. As a key member of our data analytics team, you will design, develop, and maintain ETL processes for enterprise-level data solutions.Key ResponsibilitiesDevelop mappings and workflows to automate ETL processes using Informatica IICS, IDMC, or Power Center.Automate data...

  • Data Engineer

    3 weeks ago


    Austin, United States EPAM Full time

    We are searching for a skilled Data Engineer to join our Data Analytics and Visualization team. The ideal candidate will play a fundamental role in supporting data pipeline executions and designing high-quality technical solutions that meet product requirements and drive strategic decisions. #LI-DNI#LI-OC2 Responsibilities Support data pipeline executions...


  • Austin, Texas, United States Amazon Full time

    Are you an experienced Data Engineer looking for a challenging role that will push the boundaries of innovation? Do you want to work on a project that will redefine the customer experience for one of the fastest-growing organizations within Global Engineering Services (GES)?As a key member of our Global Engineering Insights team, you will play a pivotal role...


  • Austin, United States Centric Software Full time

    We are looking for a highly skilled Senior Software Engineer to join our team as an individual contributor, playing a crucial role in delivering product features and driving the development of cutting-edge enterprise systems. Key Responsibilities: Pragmatic Problem-Solving: Provide practical solutions by understanding and effectively leveraging the...


  • Austin, United States Centric Software Full time

    We are looking for a highly skilled Senior Software Engineer to join our team as an individual contributor, playing a crucial role in delivering product features and driving the development of cutting-edge enterprise systems. Key Responsibilities: Pragmatic Problem-Solving: Provide practical solutions by understanding and effectively leveraging the...

  • Software Engineer

    2 months ago


    Austin, United States Avride Inc. Full time

    JOB DUTIES: Design, develop and support the backend infrastructure for a service dedicated to labeling self-driving car perception data Design, develop, and support a comprehensive storage solution specifically tailored for managing perception data, as well as systems for both data collection and analytics functionalities Design, develop and support data...


  • Austin, United States United Software Group Full time

    Job Title: Azure Synapse Data Engineer Duration: Fulltime Position Work location : Remote ( Anywhere in USA) Should be willing to work in CST time zone. Description: Primary Skills : Apache Spark, Azure Synapse, Azure Data bricks, SQL, SSIS Secondary Skills : Scala, Python • Overall IT experience: 10+ years • Need a Sr Data Engineer who has 5+ years of...


  • Austin, Texas, United States Apple Full time

    Job Summary">We're seeking a talented Data Analytics Program Manager to lead our efforts in developing data-driven solutions for our Software and Services division. This is a full-time position based in Austin, Texas, United States, with an estimated annual salary of $145,000.As a Data Analytics Program Manager, you'll be responsible for overseeing the...

  • Data Engineer

    4 days ago


    Austin, United States TalentBurst Full time

    Title: Data Engineer II Duration: 12 months Location: Austin, TX 78758 (5 days onsite) Number of Interviews: 3 interviewsJob Description: Client is looking for a Senior Data Engineer to join a team of highly skilled individuals working on our initiatives in resource and application discovery within Client security. Our product, Veritas, is a foundational...

  • Data Science Engineer

    3 weeks ago


    Austin, Texas, United States United Software Group Full time

    We are seeking an experienced Data Science Engineer to join our team at United Software Group in Austin, TX or Sunnyvale, CA. As a Data Science Engineer, you will be responsible for leading big data testing requirements and developing test automation scripts for Ad platforms applications.Key Responsibilities:Communicate project status and relevant details on...