Big Data Developer With Pyspark Experience

4 weeks ago

Baltimore, United States WRA, Inc. Full time

Big Data Developer With Pyspark Experience Big Data Developer With Pyspark Experience 1 week ago Be among the first 25 applicants Leading IT consulting firm in Baltimore MD seeking an experienced developer with hands-on experience in Big Data, Pyspark, Python, AWS, and SQL/NoSQL. This is a six-month consulting position with possibility of extension. Payrate $65/hour. Note: Visa sponsorship or C2C employment not available for this position. Position Responsibilities:: Lead the design, development, and deployment of PySpark-based big data solutions. Architect and optimize ETL pipelines for structured and unstructured data. Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions. Optimize Spark performance through partitioning, caching, and tuning. Work with cloud platforms like AWS. Ensure data security, governance, and compliance. Mentor junior developers and review code for best practices and efficiency. MUST HAVE: 7+ years of experience in Amazon Web Service(AWS) Cloud Computing. 10+ years of experience in big data and distributed computing. Experience with PySpark, Apache Spark, and Python. Experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.). Hands on experience with AWS cloud-based data platforms. Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus. Seniority level Seniority level Not Applicable Employment type Employment type Full-time Job function Job function Engineering and Information Technology Industries Information Services Referrals increase your chances of interviewing at WRA by 2x Get notified about new Big Data Developer jobs in Baltimore, MD. Baltimore, MD $112,597.33-$152,810.66 1 month ago Linthicum Heights, MD $57.87-$92.40 1 week ago Columbia, MD $100,000.00-$160,000.00 2 days ago Baltimore, MD $112,597.33-$152,810.66 1 month ago Software Engineer - 2 (Python Developer) Data Engineer - Multiple Levels (TS/SCI with Poly Required) Dayton, MD $95,000.00-$155,000.00 1 year ago Data Engineer (Mid-Senior Level) Healthcare SaaS Platform Annapolis, MD $110,000.00-$130,000.00 2 days ago Baltimore, MD $144,768.00-$209,109.33 1 month ago Baltimore, MD $144,768.00-$209,109.33 1 month ago Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics Big Data Engineer (Remote, Top Secret Clearance Required) (Baltimore) Agile Developer - 5 (Java/Spring Boot/Python) Annapolis Junction, MD $228,000.00-$293,000.00 1 week ago Software Engineer I (Merchant Data Platform) Maryland, United States $90,000.00-$150,000.00 4 months ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr

  • Big data Architect

    1 week ago

    Baltimore, United States krg technology inc Full time

    Job Description· 10+ years’ experience with 3+ years of experience in designing big data solutions using Hadoop technology ecosystem· Lead the tool selection, technical design, development, testing, implementation, and support of key projects implementing Big Data technologies with client's data centers or on cloud providers like Amazon Web Services.·...

  • Big Data ETL

    11 hours ago

    Baltimore, Maryland, United States nTech Workforce Full time

    Title: Big Data ETLLocation: Hybrid (Candidates from MD, VA & DC are required)Terms of Employment• W2 Contract, 6 Months• This position is a hybrid schedule (Candidates from MD, VA & DC are required)OverviewOur client, a leading firm undertaking a significant technology transformation, is seeking a Senior SDET (Software Development Engineer in Test) with...

  • Senior Data Engineer

    2 days ago

    Baltimore, United States Capital One Full time

    Job Description Senior Data Engineer (PySpark/Spark, AWS, Databricks, EMR, ETL/SQL) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...

  • Data Engineer Consultant: Scalable Pipelines

    1 week ago

    Baltimore, United States Fearless Solutions Full time

    A leading digital integration consultancy in Maryland seeks an experienced Data Engineer to design and optimize data infrastructure. You will develop automated data pipelines and collaborate with cross-functional teams to support data-driven decisions. Ideal candidates have a strong background in ETL processes, experience with PySpark, and a Bachelor's in a...

  • Senior Software Engineer

    2 days ago

    Baltimore, United States ClickHouse Full time

    Senior Software Engineer - Data Integration & JVM Ecosystem Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With over 2,000 customers and ARR that has more than quadrupled over the past year, ClickHouse leads the market in real-time analytics, data warehousing, observability,...

  • Senior Software Engineer

    2 days ago

    Baltimore, MD, United States ClickHouse Full time

    Senior Software Engineer - Data Integration & JVM Ecosystem Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With over 2,000 customers and ARR that has more than quadrupled over the past year, ClickHouse leads the market in real-time analytics, data warehousing, observability,...

  • Senior Software Engineer

    18 hours ago

    Baltimore, MD, United States ClickHouse Full time

    Senior Software Engineer - Data Integration & JVM Ecosystem Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With over 2,000 customers and ARR that has more than quadrupled over the past year, ClickHouse leads the market in real-time analytics, data warehousing, observability,...

  • Senior Software Engineer

    17 hours ago

    Baltimore, MD, United States ClickHouse Full time

    Senior Software Engineer - Data Integration & JVM Ecosystem Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With over 2,000 customers and ARR that has more than quadrupled over the past year, ClickHouse leads the market in real-time analytics, data warehousing, observability,...

  • Senior Software Engineer

    15 hours ago

    Baltimore, MD, United States ClickHouse Full time

    Senior Software Engineer - Data Integration & JVM Ecosystem Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With over 2,000 customers and ARR that has more than quadrupled over the past year, ClickHouse leads the market in real-time analytics, data warehousing, observability,...

  • Senior Software Engineer

    1 day ago

    Baltimore, MD, United States ClickHouse Full time

    Senior Software Engineer - Data Integration & JVM Ecosystem Recognized on the 2025 Forbes Cloud 100 list, ClickHouse is one of the most innovative and fast-growing private cloud companies. With over 2,000 customers and ARR that has more than quadrupled over the past year, ClickHouse leads the market in real-time analytics, data warehousing, observability,...