Big Data Documentation Specialist

2 days ago

Jersey City, New Jersey, United States ApTask Full time

About the Role:

We are seeking a highly skilled Technical Writer to join our team at ApTask. The ideal candidate will have a solid background in Big Data technologies, particularly with Databricks, and experience in creating clear, concise, and comprehensive documentation for data platforms, engineers, and end-users.

Key Responsibilities:

  • Document Big Data Architectures: Create comprehensive technical documentation for Big Data platforms, including Databricks, Apache Spark, and data lake architectures.
  • Develop User Guides: Produce detailed user manuals, API documentation, tutorials, and how-to guides for internal teams and external clients.
  • Technical Writing: Translate complex technical concepts into clear, concise, and user-friendly documentation for technical and non-technical audiences.
  • Collaborate with Teams: Work closely with data engineers, data analysts, and platform architects to understand workflows, pipelines, and data transformation processes.
  • Create Data Flow Diagrams: Develop high-quality data flow diagrams, architecture diagrams, and process flow visuals to assist users in understanding data pipelines.
  • Review & Edit Documentation: Continuously review and improve documentation for accuracy, clarity, and usability, ensuring it adheres to industry standards.
  • Support Knowledge Sharing: Assist in maintaining an internal knowledge base for Big Data practices, troubleshooting guides, and FAQs.
  • Version Control: Ensure all documentation is up-to-date, version-controlled, and reflects current systems and processes.

Requirements:

  • Experience in Big Data: 3+ years of experience working in the Big Data ecosystem, particularly with tools like Databricks, Apache Spark, Hadoop, etc.
  • Proficiency with Databricks: Hands-on experience using Databricks for big data processing and analytics workflows.
  • Strong Technical Writing Skills: Proven experience creating clear, structured, and concise technical documentation.
  • Familiarity with Cloud Platforms: Experience with cloud-based data solutions such as AWS, Azure, or Google Cloud, particularly with services related to big data (e.g., AWS EMR, Azure Data Lake).
  • Knowledge of Data Engineering Concepts: Familiarity with ETL processes, data pipelines, and modern data architectures (e.g., data lakes, data warehouses).
  • Collaboration and Communication Skills: Ability to work collaboratively across teams, gathering input from multiple stakeholders to develop accurate documentation.
  • Technical Tool Proficiency: Experience with tools like Markdown, Confluence, Git, or other version control systems used in documentation management.
  • Bachelor's Degree: In Computer Science, Data Engineering, Technical Communication, or a related field.

Preferred Qualifications:

  • Certification: Databricks Certified Associate or higher is a plus.
  • Experience in Data Analytics: Knowledge of using Databricks for data analytics and BI reporting.
  • Familiarity with Data Security and Compliance: Experience writing documentation related to data governance, security, and compliance (GDPR, HIPAA, etc.).
  • Knowledge of AI/ML: Familiarity with machine learning and AI concepts is a plus.

  • Big Data Engineer

    3 days ago

    Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are Photon, a leading Digital Platform Engineering company providing a unique combination of Strategy Consulting, Creative Design, and Technology Services to a wide range of customers.Job DescriptionWe are seeking a highly skilled Big Data Developer to join our core team. As a Big Data Developer, you will be responsible for building ingestion...

  • Big Data Engineer

    1 week ago

    Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are a leading digital experience provider for the Fortune 500, with a 20-year history of innovation and growth. Our team of over 4000 experts across the globe is dedicated to delivering cutting-edge digital modernization solutions.Key RequirementsWe are seeking a highly skilled Data Engineer with expertise in the Kafka-Yarn-Spark-HDFS...

  • Data Engineer

    2 weeks ago

    Jersey City, New Jersey, United States Pyramid Consulting, Inc Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Pyramid Consulting, Inc. in Jersey City, NJ. This is a 12+ months contract opportunity with long-term potential.Job Summary:The successful candidate will have expertise in Hadoop, PySpark, and Python, with a strong background in big data and ecosystem technologies. They...

  • Senior Java Developer

    2 weeks ago

    Jersey City, New Jersey, United States Rose International Full time

    Job Summary:Rose International is seeking a highly skilled Senior Java Developer to join our team as a Big Data Engineer. This is a lead position that requires a strong understanding of Java, Big Data technologies, and experience in leading development teams.Key Responsibilities:Design and Implement Big Data Solutions: Develop and implement scalable and...

  • Senior Java Developer with Big Data Expertise

    1 week ago

    Jersey City, New Jersey, United States Pinnacle Group, Inc. Full time

    Job Title: Senior Java Engineer w/ Big DataLocation: Jersey City, NJ (Hybrid)Duration: 12 monthsPay: $70-$75**NO C2C**ONLY W2; WILL Accept Profiles Only local to Jersey City, NJJob Summary:We are seeking a highly skilled Senior Java Engineer with expertise in Big Data to lead our team in Jersey City office. The ideal candidate will have strong experience in...

  • Senior Java Developer with Big Data Expertise

    2 weeks ago

    Jersey City, New Jersey, United States Pinnacle Group, Inc. Full time

    Job Title: Senior Java Developer with Big Data ExpertiseLocation: Remote (Hybrid)Duration: 12 monthsPay: $70-$75Job Type: W2, Local HireJob Description:We are seeking a highly skilled Senior Java Developer with expertise in Big Data to join our team at Pinnacle Group, Inc. as a Lead Java Engineer in our Jersey City office.Key Responsibilities:Lead a team of...

  • Senior Java Developer

    2 weeks ago

    Jersey City, New Jersey, United States Pinnacle Group, Inc. Full time

    About the RoleWe are seeking a highly skilled Senior Java Developer with expertise in Big Data to join our team at Pinnacle Group, Inc.Key ResponsibilitiesDesign and implement application features and functions using Java and Spring frameworks.Tune and optimize Java processes using various techniques such as JVM tuning, thread dumps, and JDK dynamic...

  • Senior SQL Server Developer with Big Data Expertise

    2 weeks ago

    Jersey City, New Jersey, United States Synechron Full time

    About the RoleWe are seeking a highly skilled Senior SQL Server Developer to join our dynamic team at Synechron. As a Senior Developer, you will be responsible for hands-on application development to support the current and target process across the SDLC – design, build, test, deploy support.Key Responsibilities:Collaborate with cross-functional teams to...

  • Big Data Engineer

    6 days ago

    Jersey City, New Jersey, United States Photon Full time

    We are looking for a skilled Data Engineer to join our digital platform team at Photon. Our company has a rich history of powering digital experiences for Fortune 500 companies, and we are now seeking a talented individual to help us drive new initiatives.About PhotonFor over 20 years, we have been a leader in digital modernization, growing from a small team...

  • Big Data Engineer

    1 week ago

    Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are a leading digital experience provider for the Fortune 500, with a 20-year history of innovation and growth. Our team of over 4000 experts across the globe is dedicated to delivering cutting-edge digital solutions.Key RequirementsWe are seeking a highly skilled Data Engineer with expertise in the Kafka-Yarn-Spark-HDFS ecosystem. The ideal...

  • Senior SQL Server Developer with Big Data Expertise

    7 days ago

    Jersey City, New Jersey, United States Synechron Full time

    Senior SQL Server Developer with Hadoop ExperienceWe are seeking a highly skilled Senior SQL Server Developer to join our dynamic team. As a Senior Developer, you will be responsible for hands-on application development to support the current and target process across the SDLC – design, build, test, deploy support.Key Responsibilities:Collaborate with...

  • PySpark Data Reconciliation Specialist

    3 days ago

    Jersey City, New Jersey, United States Photon Full time

    PySpark Data Reconciliation EngineerWe are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. As a key member of our team, you will be responsible for designing, developing, and testing PySpark-based applications to automate data reconciliation processes across various financial data sources.Key...

  • Data Governance Specialist

    2 weeks ago

    Jersey City, New Jersey, United States Bank of America Full time

    About the RoleThis is a unique opportunity to join the Bank of America team as a Data Governance Specialist, where you will play a critical role in shaping the bank's data strategy and ensuring the accuracy and integrity of its data assets.Key ResponsibilitiesCollaborate with data stewards, process owners, and technology teams to understand and assess data,...

  • PySpark Data Reconciliation Specialist

    5 days ago

    Jersey City, New Jersey, United States Photon Full time

    Job Title: PySpark Data Reconciliation EngineerWe are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. As a key member of our team, you will be responsible for designing, developing, and testing PySpark-based applications to automate data reconciliation processes across various financial data...

  • PySpark Data Reconciliation Specialist

    1 week ago

    Jersey City, New Jersey, United States Photon Full time

    PySpark Data Reconciliation EngineerWe are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. As a key member of our team, you will be responsible for designing, developing, and testing PySpark-based applications to automate data reconciliation processes across various financial data sources.Key...

  • PySpark Data Reconciliation Specialist

    6 days ago

    Jersey City, New Jersey, United States Photon Full time

    PySpark Data Reconciliation EngineerWe are seeking a highly skilled PySpark Data Reconciliation Engineer to join our Digital Engineering team at Photon. As a key member of our team, you will be responsible for designing, developing, and testing PySpark-based applications to automate data reconciliation processes across various financial data sources.Key...

  • PySpark Data Reconciliation Specialist

    7 days ago

    Jersey City, New Jersey, United States Photon Full time

    Job Title: PySpark Data Reconciliation EngineerWe're seeking a skilled PySpark Data Reconciliation Engineer to drive the development of robust data reconciliation solutions within our financial systems.Key Responsibilities:Design, develop, and test PySpark-based applications to automate data reconciliation processes across various financial data...

  • Data Reconciliation Specialist

    1 week ago

    Jersey City, New Jersey, United States Photon Full time

    About PhotonWe are Photon, a leading Digital Platform Engineering company that provides a unique combination of Strategy Consulting, Creative Design, and Technology Services to a wide range of customers.As a high growth organization serving over 40% of Fortune 100 companies, we truly believe that our people make the world of difference for our clients and...

  • Documentation Control Specialist III

    6 days ago

    Jersey City, New Jersey, United States Mercury Systems Full time

    Job SummaryMercury Systems is seeking a highly skilled Documentation Control Specialist III to join our team.The successful candidate will be responsible for managing and developing command media and systems for our Business Systems Management platform.Key ResponsibilitiesDevelop and maintain processes and work instructions supporting our Business Management...

  • Documentation Control Specialist III

    2 weeks ago

    Jersey City, New Jersey, United States Mercury Systems Full time

    Business Systems Management Specialist **Key Responsibilities:** * Develop and manage processes and work instructions supporting Mercury Systems Business Management System. **Key Skills:** * Strong understanding of business systems and technical documentation. * Excellent communication and project management skills. * Ability to work independently and...